News - Document Information Localization and Extraction

05/02/2019

MLT-2019 Test Set Available

Test set: 
The test set download links are now available on our website (http://rrc.cvc.uab.es/?ch=15&com=downloads).

Evaluation: Please note the evaluation protocols and metrics for the first 3 tasks are the same as the ones used in MLT-2017, you could check the website and the competition paper of MLT2017 for more details.
Information about the evaluation protocol for the 4th task will be available on our website very soon.

Deadlines for results submission:

We updated the dates for the results submission because the ICADR competition chairs have announced earlier deadlines for submitting the competition reports, but we will keep the date for submitting the final results, so, do not worry.

The process of results submission:
27th May 2019: deadline for the submitting the 1) participants information (names/teams and affiliations), 2) methods descriptions for the task(s) in which you are participating and 3) initial results* (see below)

3rd June 2019: submission of the final results (you are able to update the results which you submit to us till 3rd June, for example if you tune more etc.). It is preferable if you submit earlier, and in this case, please notify us which one is your final submission.

* initial results: same format and completeness of the final results, but only the final results will appear in the MLT-2019 challenge results, and the initial results may be removed after 3rd June.

You will receive a confirmation from us that your results are received and are in valid formats (only for your initial and last submissions).

Please make sure to check our website for information and updates regarding the challenge during the test period.
 
The MLT-2019 challenge team wishes you good luck and a happy participation !

Challenge News

Important Dates

Test set published and submissions open: 24 Apr 2023

Register by: 28 Apr 2023 (at http://clef2023-labs-registration.dei.unipd.it/)

Benchmark submission deadline: 24 May 2023

Working note submission deadline: 5 June 2023

Notification of working note acceptance: 23 June 2023

 

Note: DocILE 2023 runs simultaneously as a CLEF 2023 Lab and follows CLEF 2023 schedule: https://clef2023.clef-initiative.eu/index.php?page=Pages/schedule.html

Working note papers: On top of providing method description for the submission on RRC website, working note must be submitted to organizers as explained in the competition rules: https://docile.rossum.ai/static/docile_rules_and_prize_eligibility.pd