News - Document Information Localization and Extraction

04/14/2023

Competition 2023 Results are out! Read here for more!

Results are out! Check here!

The `Results` / `My Methods` tabs will also be released soon and allow non-competition submissions and evaluation on HierText test set.

Note that, the competition submission from the DeepSE x Upstage team failed in the evaluation server, probably due to some memory issue in the server, and thus has 0 scores in the Task 1. However, evaluating it locally on our linux machine was successful, so we still gave this submission its fair scores and ranking in the competition. For fair comparison, we also evaluated all other submissions in all tasks to make sure that the local evaluation gives the same results as the server.

Challenge News

Important Dates

Test set published and submissions open: 24 Apr 2023

Register by: 28 Apr 2023 (at http://clef2023-labs-registration.dei.unipd.it/)

Benchmark submission deadline: 24 May 2023

Working note submission deadline: 5 June 2023

Notification of working note acceptance: 23 June 2023

 

Note: DocILE 2023 runs simultaneously as a CLEF 2023 Lab and follows CLEF 2023 schedule: https://clef2023.clef-initiative.eu/index.php?page=Pages/schedule.html

Working note papers: On top of providing method description for the submission on RRC website, working note must be submitted to organizers as explained in the competition rules: https://docile.rossum.ai/static/docile_rules_and_prize_eligibility.pd