News - Document Visual Question Answering
05/02/2019MLT-2019 Test Set Available
Test set:
The test set download links are now available on our website (http://rrc.cvc.uab.es/?ch=15&com=downloads).
Evaluation: Please note the evaluation protocols and metrics for the first 3 tasks are the same as the ones used in MLT-2017, you could check the website and the competition paper of MLT2017 for more details.
Information about the evaluation protocol for the 4th task will be available on our website very soon.
Deadlines for results submission:
We updated the dates for the results submission because the ICADR competition chairs have announced earlier deadlines for submitting the competition reports, but we will keep the date for submitting the final results, so, do not worry.
The test set download links are now available on our website (http://rrc.cvc.uab.es/?ch=15&com=downloads).
Evaluation: Please note the evaluation protocols and metrics for the first 3 tasks are the same as the ones used in MLT-2017, you could check the website and the competition paper of MLT2017 for more details.
Information about the evaluation protocol for the 4th task will be available on our website very soon.
Deadlines for results submission:
We updated the dates for the results submission because the ICADR competition chairs have announced earlier deadlines for submitting the competition reports, but we will keep the date for submitting the final results, so, do not worry.
The process of results submission:
27th May 2019: deadline for the submitting the 1) participants information (names/teams and affiliations), 2) methods descriptions for the task(s) in which you are participating and 3) initial results* (see below)
3rd June 2019: submission of the final results (you are able to update the results which you submit to us till 3rd June, for example if you tune more etc.). It is preferable if you submit earlier, and in this case, please notify us which one is your final submission.
* initial results: same format and completeness of the final results, but only the final results will appear in the MLT-2019 challenge results, and the initial results may be removed after 3rd June.
You will receive a confirmation from us that your results are received and are in valid formats (only for your initial and last submissions).
Please make sure to check our website for information and updates regarding the challenge during the test period.
The MLT-2019 challenge team wishes you good luck and a happy participation !
Challenge News
- 09/01/2023
QA Types made public - 02/19/2023
Multipage DocVQA Dataset is public! - 03/31/2021
ICDAR competition deadline extended - 02/11/2021
Infographics Test Set Available - 08/01/2020
The challenge continues in ICDAR 2021
Important Dates
19 February 2023: MP-DocVQA Dataset released.
ICDAR 2021 edition
6 September 2021: Presentation at the Document VQA workshop at ICDAR 2021
30 April 2021: Results available online
10 April 2021: Deadline for Competition submissions
11 February 2021: Test set available
23 December 2020: Release of full training data for Infographics VQA.
10 November 2020: Release of training data subset for new task "Infographics VQA"
CVPR 2020 edition
16-18 June 2020: CVPR workshop
15 May 2020 (23:59 PST): Submission of results
20 April 2020: Test set available
19 March 2020 : Text Transcriptions for Train_v0.1 Documents available
16 March 2020: Training set v0.1 available