News - Hierarchical Text: Challenge on Unified OCR and Layout Analysis
02/28/2023DUDE - Updated submission schedule
Dear participants,
Following inquiries regarding the submission schedule, we have opted to better align the submissions for evaluation phase 1 (test set for Task 1) and for evaluation phase 2 (domain shift and selective question-answering).
We hope that this renewed schedule gives participants more clarity and time to work on their submissions (3 weeks, 1 week for method description) for either evaluation phase. We would urge participants to submit method descriptions (just a couple of paragraphs to understand the overall idea) together with their submissions as the competition report deadline is strict. We would not want to disqualify any team for not providing their method description in time.
When giving participants access to questions from the test set, we will provide a mixture of the questions from evaluation phase 1 and phase 2.
Submissions for phase 1 would need to only provide the answers key and preferably answers_confidence for calibration evaluation.
Submissions for phase 2 would need to as well provide both the keys answers_confidence and answers_abstain for all question-answer pairs.
Cheers,
The DUDEs
Challenge News
- 04/14/2023
Competition 2023 Results are out! Read here for more! - 03/01/2023
Please submit as JSONL! - 12/13/2022
Results temporarily hidden and how you can request them. - 12/12/2022
ICDAR 2023 Competition
Important Dates
All dates are final.
- 2023 Jan 2nd: Start of the competition, and submissions of results will be made available.
- 2023 Apr 1st 23:59 PST: Deadline for submissions to the ICDAR 2023 Competition
- 2023 Apr 15th: Release of competition results.