method: GraphDoc+Classify+Merge2023-05-24

Authors: Yan Wang, Jiefeng Ma, Zhenrong Zhang, Pengfei Hu, Jianshu Zhang, Jun Du

Affiliation: University of Science and Technology of China (USTC), iFLYTEK AI Research

Description: We pre-trained several GraphDoc models on provided unlabelled documents under different configurations. We then fine-tuned the models on the training set for 200-500 epochs. After classifying OCR boxes into various categories, we proposed a Merger module to handle the aggregation process.
We also used some pre/post-processing according to the text content and distances between OCR boxes. Finally, we adopted model ensembling to further enhance the system performance.

method: YOLOv8X+Grid2023-05-08

Authors: Jakub Straka

Affiliation: University of West Bohemia, Department of Cybernetics

Description: KILE task may be solved in many different ways. We chose to approach this task as object detection. This means that we treated each field in the document as an object. As the detection model was used YOLOv8X. The model is based on the convolutional neural network. One of the advantages of this model is its speed and small size. We also incorporated methods used in [1].

1. Anoop Raveendra Katti, Christian Reisswig, Cordula Guder, Sebastian Brarda,
Steffen Bickel, Johannes Höhne, and Jean Baptiste Faddoul. Chargrid: Towards
understanding 2d documents. arXiv preprint arXiv:1809.08799, 2018

Authors: UIT@AICLUB_TAB

Affiliation: UIT - University of Information Technology - VNUHCM

Email: 22520121@gm.uit.edu.vn

Description: Our approach is based on the checkpoint baseline with some improvements. We trained/used models:
1. Model RoBERTa base from scratch using FGM and Lion Optimizer with synthetic data for 30 epochs, after that, I trained on annotated data.
2. Model RoBERTa ours (checkpoint) with Lion Optimizer
3. Model RoBERTa base (checkpoint)

After that, we ensemble them by unioning words that are marked at 1 of 55 field type, post-processing.
After that, we used the ensembled model to predict unlabeled data, we have pseudo data, use them to pre-train 3 models, and train on annotated data after that.

Pipeline: https://ibb.co/4MWcXgb

Ranking Table

Description Paper Source Code
DateMethodAPF1PrecisionRecall
2023-05-24GraphDoc+Classify+Merge81.98%81.98%77.54%86.96%
2023-05-08YOLOv8X+Grid81.42%83.47%79.72%87.60%
2023-05-16Baseline+Ensemble+Pseudo+Post-Processing69.63%75.39%74.04%76.80%
2023-05-02baseline - RoBERTa-base with synthetic pre-training61.47%74.00%74.07%73.94%
2023-05-02baseline - RoBERTa-base60.95%74.17%74.19%74.16%
2023-05-02baseline - LayoutLMv3 with unsupervised pre-training60.07%73.31%73.14%73.48%
2023-05-02baseline - LayoutLMv3 with unsupervised and synthetic pre-training60.01%73.93%74.23%73.62%
2023-05-25SRCB Submission on Key Information Localization and Extraction56.48%73.34%74.22%72.48%

Ranking Graphic

Ranking Graphic