News - ICDAR 2019 Robust Reading Challenge on Scanned Receipts OCR and Information Extraction

05/02/2019

MLT-2019 Test Set Available

Test set: 
The test set download links are now available on our website (http://rrc.cvc.uab.es/?ch=15&com=downloads).

Evaluation: Please note the evaluation protocols and metrics for the first 3 tasks are the same as the ones used in MLT-2017, you could check the website and the competition paper of MLT2017 for more details.
Information about the evaluation protocol for the 4th task will be available on our website very soon.

Deadlines for results submission:

We updated the dates for the results submission because the ICADR competition chairs have announced earlier deadlines for submitting the competition reports, but we will keep the date for submitting the final results, so, do not worry.

The process of results submission:
27th May 2019: deadline for the submitting the 1) participants information (names/teams and affiliations), 2) methods descriptions for the task(s) in which you are participating and 3) initial results* (see below)

3rd June 2019: submission of the final results (you are able to update the results which you submit to us till 3rd June, for example if you tune more etc.). It is preferable if you submit earlier, and in this case, please notify us which one is your final submission.

* initial results: same format and completeness of the final results, but only the final results will appear in the MLT-2019 challenge results, and the initial results may be removed after 3rd June.

You will receive a confirmation from us that your results are received and are in valid formats (only for your initial and last submissions).

Please make sure to check our website for information and updates regarding the challenge during the test period.
 
The MLT-2019 challenge team wishes you good luck and a happy participation !

Challenge News

Important Dates

Registration open: February 10 – March 31, 2019

Training/validation dataset available: March 1, 2019

Task 1&2 submission open: April 15, 2019

Task 1&2 submission deadline: April 22, 2019

Task 3 submission open: April 23, 2019

Task 3 submission Deadline: May 5, 2019

 

Note on the registration for the SROIE challenge:

There is no need to register explicitly for the SROIE challenge. As long as you are registered to the RRC portal you will be able to submit your results when the submission is open.

Note on the granulairty level of recognition outcomes for Task2:

Dear All, we received a few quiries on the above issue. We would like to clarify that for Task2, you should submit all the recognized words, which are split from the detected sentences. For example, for a sentence "Payment Date: 2018/09/19", you should submit three words "Payment", "Date:" and "2018/09/19". The chinese characters if any need to be ignored in the submission.

Note on the extension of Task 3 submission deadline:

Dear All, following many requests from Task 3 participants, the Task 3 submission deadline is extended to 5th May, 2019.