News - ICDAR 2019 Robust Reading Challenge on Multi-lingual scene text detection and recognition

02/28/2023

DUDE - Updated submission schedule

Dear participants, 

Following inquiries regarding the submission schedule, we have opted to better align the submissions for evaluation phase 1 (test set for Task 1) and for evaluation phase 2 (domain shift and selective question-answering).

We hope that this renewed schedule gives participants more clarity and time to work on their submissions (3 weeks, 1 week for method description) for either evaluation phase. We would urge participants to submit method descriptions (just a couple of paragraphs to understand the overall idea) together with their submissions as the competition report deadline is strict. We would not want to disqualify any team for not providing their method description in time. wink 

When giving participants access to questions from the test set, we will provide a mixture of the questions from evaluation phase 1 and phase 2.
Submissions for phase 1 would need to only provide the answers key and preferably answers_confidence for calibration evaluation.
Submissions for phase 2 would need to as well provide both the keys answers_confidence and answers_abstain for all question-answer pairs. 

Cheers, 

The DUDEs

Important Dates

15 Feb to 2 May

Manifestation of interest by participants opens

Asking/Answering questions about the details of the competition

1 Mar

Competition formal announcement

15 Mar

Website fully ready

Registration of participants continues

Evaluation protocol, file formats etc. available

15 Mar to 2 May

Train set available - training period - MLT challenge in progress -Participants evaluate their methods on the training/validation sets - Prepare for submission

Registration is still open

2 May

Registration closes for this MLT challenge for ICDAR-2019

2 May to 3 June

Test set available

27 May

Deadline for submitting: 1) participant information (names and affiliation), 2) methods description, 3) initial (or final) results

3 June

Deadline for submission of the final results by participants

20 - 25 Sept

Announcement of results at ICDAR2019

1 Oct

The public release of the full dataset