News - ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Images

02/28/2023

DUDE - Updated submission schedule

Dear participants, 

Following inquiries regarding the submission schedule, we have opted to better align the submissions for evaluation phase 1 (test set for Task 1) and for evaluation phase 2 (domain shift and selective question-answering).

We hope that this renewed schedule gives participants more clarity and time to work on their submissions (3 weeks, 1 week for method description) for either evaluation phase. We would urge participants to submit method descriptions (just a couple of paragraphs to understand the overall idea) together with their submissions as the competition report deadline is strict. We would not want to disqualify any team for not providing their method description in time. wink 

When giving participants access to questions from the test set, we will provide a mixture of the questions from evaluation phase 1 and phase 2.
Submissions for phase 1 would need to only provide the answers key and preferably answers_confidence for calibration evaluation.
Submissions for phase 2 would need to as well provide both the keys answers_confidence and answers_abstain for all question-answer pairs. 

Cheers, 

The DUDEs

Important Dates

Note: The time zone of all deadlines is UTC-12. The cut-off time for all dates is 11:59 PM.

December 30, 2022

Website ready

January 10-12, 2023

1) Task 1&2 training dataset available

2) Task 3&4 training dataset available

March 10, 2023

1) Test set of task 1 available, submission open

March 15, 2023

1) Task 1 submission deadline

2) Test set of task 2 available and submission open

March 20, 2023

1) Task 2 submission deadline

------------------------------------------------------

March 6, 2023

1) Test set of task 3 available

March 10, 2023

1) Task 3 submission open

March 17, 2023

1) Task 3 submission deadline

2) Test set of task 4 available and submission open

3) Few-shot training examples of task 4 available

March 24, 2023

1) Task 4 submission deadline

March 25, 2023

Submit reproducible script and short description of the method for Task 1-4. (The detailed instructions will be uploaded.)

March 27, 2023

The notification for reproducible script submission has been sent to top-5 participants via email.

Note: Task 1&2  submission data has been extended.

Note: Task 3&4  submission data has been extended.