News - Document Visual Question Answering
02/28/2023DUDE - Updated submission schedule
Dear participants,
Following inquiries regarding the submission schedule, we have opted to better align the submissions for evaluation phase 1 (test set for Task 1) and for evaluation phase 2 (domain shift and selective question-answering).
We hope that this renewed schedule gives participants more clarity and time to work on their submissions (3 weeks, 1 week for method description) for either evaluation phase. We would urge participants to submit method descriptions (just a couple of paragraphs to understand the overall idea) together with their submissions as the competition report deadline is strict. We would not want to disqualify any team for not providing their method description in time.
When giving participants access to questions from the test set, we will provide a mixture of the questions from evaluation phase 1 and phase 2.
Submissions for phase 1 would need to only provide the answers key and preferably answers_confidence for calibration evaluation.
Submissions for phase 2 would need to as well provide both the keys answers_confidence and answers_abstain for all question-answer pairs.
Cheers,
The DUDEs
Challenge News
- 09/01/2023
QA Types made public - 02/19/2023
Multipage DocVQA Dataset is public! - 03/31/2021
ICDAR competition deadline extended - 02/11/2021
Infographics Test Set Available - 08/01/2020
The challenge continues in ICDAR 2021
Important Dates
19 February 2023: MP-DocVQA Dataset released.
ICDAR 2021 edition
6 September 2021: Presentation at the Document VQA workshop at ICDAR 2021
30 April 2021: Results available online
10 April 2021: Deadline for Competition submissions
11 February 2021: Test set available
23 December 2020: Release of full training data for Infographics VQA.
10 November 2020: Release of training data subset for new task "Infographics VQA"
CVPR 2020 edition
16-18 June 2020: CVPR workshop
15 May 2020 (23:59 PST): Submission of results
20 April 2020: Test set available
19 March 2020 : Text Transcriptions for Train_v0.1 Documents available
16 March 2020: Training set v0.1 available