Challenge Rules

LifeCLEF lab is part of the Conference and Labs of the Evaluation Forum: CLEF 2021. CLEF 2021 consists of independent peer-reviewed workshops on a broad range of challenges in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various labs designed to test different aspects of mono and cross-language Information retrieval systems. More details about the conference can be found here.

Submitting a working note with the full description of the methods used in each run is mandatory. Any run that could not be reproduced thanks to its description in the working notes might be removed from the official publication of the results. Working notes are published within CEUR-WS proceedings, resulting in an assignment of an individual DOI (URN) and an indexing by many bibliography systems including DBLP. According to the CEUR-WS policies, a light review of the working notes will be conducted by LifeCLEF organizing committee to ensure quality. As an illustration, LifeCLEF 2020 working notes (task overviews and participant working notes) can be found within CLEF 2020 CEUR-WS proceedings.

Important

Participants of this challenge will automatically be registered at CLEF 2020. In order to be compliant with the CLEF registration requirements, please edit your profile by providing the following additional information:

• First name

• Last name

• Affiliation

• Address

• City

• Country

• Regarding the username, please choose a name that represents your team.

This information will not be publicly visible and will be exclusively used to contact you and to send the registration data to CLEF, which is the main organizer of all CLEF labs

 

The following rules have to be observed by all participants:

• Participants are allowed at most 1 submissions per day

• The results achieved by the solver must be reproducible. If there are randomized portions of your approach, be sure to include seeds to make the runs repeatable.

• Sample solutions by Admins and Organizers can serve as baselines/benchmarks. However, your solutions must not be based on those. Your solutions must be produced from the problem instances by your code.

• In case of conflicts, the decision of the Organizers will be final and binding.

• Organizers reserve the right to make changes to the rules and timeline.

• Violation of the rules or other unfair activity may result in disqualification.