Loading
AIcrowd
Challenges
Organize a challenge FAQ Contact Jobs
Log In Sign Up

Data Purchasing Challenge 2022

Challenge Rules

Challenge Rules

PLEASE READ THESE OFFICIAL RULES CAREFULLY. ENTRY INTO THIS COMPETITION CONSTITUTES YOUR ACCEPTANCE OF THESE OFFICIAL RULES. IF YOU DO NOT AGREE TO ANY PART OF THESE OFFICIAL RULES, PLEASE DO NOT ENTER THIS CHALLENGE.

NO PURCHASE IS NECESSARY TO ENTER OR WIN. A PURCHASE OF ANY KIND WILL NOT INCREASE YOUR CHANCES OF WINNING VOID WHERE PROHIBITED.

1. Competition Description

The ZEW Data Purchasing Challenge 2022 is a competition on data valuation. In this competition, participants face data purchasing challenges in the context of an multi-label image classification task in a quality control setting. The images consist of synthetically generated images of painted metal sheets. A classifier is meant to predict whether the metal sheets have production damages and if so which ones. Participants have access to a set of images, a subset of which are labeled with respect to production damages. They have to decide which of the unlabeled images labels should be labeled.

2. Sponsors

The Competition is organized by AIcrowd SA, referred to as "Organizers'' collectively from here on. Third parties may provide sponsorship to cover running costs, prizes, and compute grants. These third parties will be known as "Sponsors". The principal Sponsor of this competition is ZEW – Leibniz-Zentrum für Europäische Wirtschaftsforschung GmbH Mannheim (ZEW – Leibniz Centre for European Economic Research).

3. Organizers Admins

"Organizers Admins" are any companies or organizations authorized by Organizers to aid them with the administration, sponsorship or execution of this Challenge including but not limited to AICrowd SA and ZEW – Leibniz-Zentrum für Europäische Wirtschaftsforschung GmbH Mannheim.

4. Entry

The Entry in this competition refers to a git repository on gitlab.aicrowd.com which includes:

  • Source code for running the submitted model
  • Specifications of the software runtime
  • Information provided during competition registration

In order to submit an entry to the competition, a representative of a participating team must create an account on AIcrowd, and register for the competition on the [ZEW Data Purchasing Challenge 2022 page](TODO: link to be updated).

5. Competition Start and End Dates

  • Round 1: Feb 4th, 2022, 12:00:00 pm UTC – February 28th, 2022, 12:00:00 pm UTC
  • Round 2: March 3rd, 2022, 12:00:00 pm UTC – April 7th, 2022 12:00:00 pm UTC

6. Am I Eligible to Enter the Challenge?

You are eligible to enter this Challenge if you (and each member of your Team) meet all of the following requirements as of the time and date of entry:

  • You are an individual;
  • You are 18 years of age or older but in no event less than the age of majority in your place of residence;
  • You have Internet Access, an Email Account, and access to a personal computer;

The organizers admins will not be able to transfer prize to accounts of any of the following countries or regions. (Please note that residents of these countries or regions are still allowed to participate in the challenge and be ranked in the official rankings.)

  • The Crimea region of Ukraine
  • Cuba
  • Iran
  • North Korea
  • Sudan
  • Syria
  • Quebec, Canada
  • Brazil
  • Italy

Furthermore, teams involving one or more participants from AIcrowd SA may submit entries for the purpose of benchmarking and comparison, but such entries are not considered part of the competition for the purpose of the official rankings, and are not eligible for Prizes.

Teams from institutions sponsoring the competition, excluding AIcrowd SA, are eligible to participate (subject to the individual conditions listed above) and appear in official rankings, but are not eligible for Prizes.

Please Note: it is entirely your responsibility to review and understand your employer's and countries policies about your eligibility to participate in this Challenge. If you participate in violation of your employer's or countries policies, you and your Entry may be disqualified from the Challenge. Organizers disclaim any and all liability or responsibility with respect to disputes arising between an employer and such employer's employee or between a country and its resident in relation to this matter.

7. Is the Entry an Eligible Entry?

To be eligible to be considered for a prize, as solely determined by the Organizers:

The Entry MUST:

  • be compatible with the official submission format;
  • Be self-contained and function without a dependency on any external services and network access
  • be in English;
  • be the Team's own original work;
  • not have been submitted previously in any promotion of any kind;
  • not contain material or content that: is inappropriate, indecent, obscene, offensive, sexually explicit, pornographic, hateful, tortious, defamatory, or slanderous or libelous; or promotes bigotry, racism, hatred or harm against any group or individual or promotes discrimination based on race, gender, ethnicity, religion, nationality, disability, sexual orientation, or age; or promotes alcohol, illegal drugs, or tobacco; or violates or infringes another's rights, including but not limited to rights of privacy, publicity, or their intellectual property rights; or is inconsistent with the message, brand, or image of Organizers, is unlawful, or is in violation of or contrary to the laws or regulations of any jurisdiction in which the Entry is created; and

The Team members MUST:

  • designate one person as the team leader who will be solely responsible for receiving communications from and communicating with Sponsor;
  • ensure the Team has obtained any and all consents, approvals, or licenses required for submission of the Entry;
  • obtain any consents necessary from all members of the Team with respect to the sharing of such member's personal information as outlined herein;
  • obtain the agreement of all members of the Team to these Rules;
  • not generate the Entry by any means which violate these Rules, the Organizers Terms of Service or the Organizers Privacy Policy;
  • not engage in false, fraudulent, or deceptive acts at any phase during participation in the Challenge; and
  • not tamper or abuse any aspect of this Challenge.

The Team members MUST:

  • ensure the Team has obtained any and all consents, approvals, or licenses required for submission of the Entry;
  • obtain any consents necessary from all members of the Team with respect to the sharing of such member's personal information as outlined herein;
  • obtain the agreement of all members of the Team to these Rules;
  • not generate the Entry by any means which violate these Rules, the Sponsor's Terms of Service or the Sponsor's Privacy Policy;
  • not engage in false, fraudulent, or deceptive acts at any phase during participation in the Challenge; and
  • not tamper or abuse any aspect of this Challenge.

8. Disqualification

  • If you, any Team member, or the Entry is found to be ineligible for any reason, including but not limited to conflicts within Teams and noncompliance with these Rules, Organizers and Organizers Affiliates reserve the right to disqualify the Entry and/or you and/or your Team members from this Challenge and any other contest or promotional activity sponsored or administered in any way by the Organizers.
  • A participant is not allowed to create more than one account to participate in the challenge. Violating this will result in disqualification from the challenge.
  • Participants should not attempt to get around the limited number of submissions by entering several teams into the competition. Participants should only be associated with one Entry. If two teams have overlap in number of participants, or if the organizers deem two entries to be effectively similar modulo small changes, they reserve the right to disqualify both teams.
  • If a participating team does not receive the Prizes for any of the above-mentioned reasons, the prizes will be offered to the next eligible team on the final leaderboard.

9. How may the Entry potentially be used?

The Entry may be used in a few different ways. Organizers do not claim to own your Team's Entry, however, by submitting the Entry you and each member of your Team:

  • hereby grants to Organizers and Organizer Admins a perpetual, worldwide, non-exclusive, royalty-free, transferable, irrevocable license to review and analyze the Entry in relation to this Challenge;
  • hereby grants to Organizers and Organizer Admins a perpetual, worldwide, non-exclusive, royalty-free, transferable, irrevocable license to use their Submission Materials (and any intellectual property relating thereto) for purposes of academic research, including the right to reproduce, modify, prepare derivative works, publicly display and distribute them.
  • agrees that each member will execute any necessary paperwork for Organizers and Organizers Admins to use the rights and licenses granted hereunder;
  • acknowledges and agrees that the Team will not be compensated and may not be credited (at Organizer's sole discretion) for the use of the Entry as described in these Rules;
  • acknowledges that the Organizers may have developed or commissioned materials similar to the Entry and waive any claims resulting from any similarities to the Entry;
  • understand and acknowledge that, subject to provision of Prizes, Organizers are not obligated to use the Entry in any way, even if the Entry is selected as a winning Entry.

Personal data you submit in relation to this Challenge will be used by Organizers in accordance with Section 15 of these Rules.

10. Your Odds of Winning

ODDS OF WINNING A PRIZE ARE SUBJECT TO THE TOTAL NUMBER OF ELIGIBLE ENTRIES RECEIVED AND HOW YOUR ENTRY SCORES IN ACCORDANCE WITH THE JUDGING CRITERIA.

11. Prizes

  • The challenge contains 3 leaderboard prizes

    • 1st Prize: : USD 6,000
    • 2nd Prize: : USD 4,500
    • 3rd Prize: : USD 3,000

  • The challenge contains the following Community Contribution prizes, which can be awarded by the Organizer Admins at their discretion based on the contributions made by individual participants towards the community of participants active in the challenge. The eligible contributions can be including, but not limited to, open source solutions, exploratory notebooks, blog posts, explanatory videos, etc.

  • To be eligible for the prizes, participants will have to release the code to their solutions under an Open Source Foundation (OSF) approved license of their choice, along with a short technical description (between 300-500 words) of their solution. The submitted code is expected to be reproducible and should produce a similar score as on the leaderboard.

  • The winning participants will have to provide a valid and unexpired ID card or passport which the organizer will use only for the purpose of verifying the individual's identity in case of transferring the cash prize and for internal record keeping.

  • Any and all prize(s) is(are) non transferable. All taxes, fees and expenses associated with participation in the Challenge or receipt and use of a prize are the sole responsibility of the Prize Winner(s). No substitution of prize or transfer/assignment of prize to others or request for the cash equivalent by winners is permitted. Acceptance of prize constitutes permission for Organizer Admins to use the winner's name and entry for purposes of advertising and trade without further compensation unless prohibited by law.

  • The participation of the Organizers and Organizer Admins , its employee and its affiliates, parents, agents, representatives, advertising and promotional agencies and members of the immediate family (parents, children or siblings) of these employees or any person with whom they are domiciled, are permitted to participate in the challenge but will not be eligible to win the cash prize.

  • The prizes will be awarded based on the final leaderboard for Round 2.

12. When will prizes be awarded?

The prizes will be awarded within a commercially reasonable time frame to the designated Team Leader unless otherwise agreed to by Team Leader, remaining Team members and Organizer. All members of a Team may be required to complete and sign additional documentation, such as non-disclosures, representations and warranties, liability and publicity releases (unless prohibited by applicable law), and tax documents, or other similar documentation in the manner and within the timeframe specified by Organizer in order for the potentially winning team to claim the prize. Organizers will in no way be involved in any dispute with respect to receipt of a prize by any other members of a Team, including, without limitation, division of the prize value among Team members. Winners are responsible for any tax liability that may result from receipt of any prize.

Only prizes claimed in accordance with these Rules will be awarded.

13. Winner List

A list of all winners of this Challenge will be posted on AIcrowd Site and may be announced at Organizers' discretion via Organizers' Twitter, Facebook, Blog, or Website, or at an Organizer or Organizer, Admins sponsored or hosted event.

14. Your Personal Data and Privacy

Organizers may use cookies and/or collect IP addresses for the purpose of implementing or exercising its rights or obligations under the Rules, for information purposes, identifying your location, including without limitation for the purpose of redirecting you to the appropriate geographic website, if applicable, or for any other lawful purpose in accordance with the AIcrowd Privacy Policy.

Organizers may use the personal data you provide via your participation in this Challenge:

  • to contact you in relation to the Challenge;
  • to confirm the details of your Entry;
  • to administer and execute this Challenge, including sharing it with Organizer Admins;
  • at Organizers' discretion, to credit you and/or your Team for the Entry, identify you and/or your Team as a Winner, or other similar notice; and
  • as otherwise noted in these Rules or as necessary for Organizers to meet their obligations under these Rules or applicable law.

Organizers only require your name and email address to be submitted for you to participate in this Challenge.

Please read the AIcrowd Terms and Conditions, Participation Terms carefully to understand how your data may be used by AIcrowd SA.

15. Additional Terms and Conditions

If Organizers determine, in their sole discretion, that any portion of this Challenge is compromised by virus, bugs, unauthorized human intervention, or any other causes beyond its control, that in the sole opinion of Organizers corrupts, or impairs the administration, security, fairness or proper participation in/of the Challenge, Organizers reserve the right to (a) cancel the Challenge; (b) pause the Challenge until such time the aforementioned issues may be resolved; or (c) consider only those Entries submitted prior to the when the Challenge was so compromised for the prizes.

To the fullest extent permitted by applicable law, you agree that Organizers, Organizer Affiliates, and Organizer Admins, and each of their directors, officers, employees, agents and assigns, will not be liable for personal injuries, death, damages, expenses or costs or losses of any kind resulting from participation or inability to participate in this Challenge or acceptance of or use or inability to use a prize or parts thereof including, without limitation, claims, suits, injuries, losses and damages related to personal injuries, death, damage to or destruction of property, rights of publicity or privacy, defamation or portrayal in a false light (whether intentional or unintentional), whether under a theory of contract, tort (including negligence), warranty or other theory.

Your use of any other products and services required by these Rules, whether required by these Rules or not, are subject to the terms and conditions associated with such products or services, including the AIcrowd site and services.

In the event any clause or provision of these Rules prove unenforceable, void or incomplete, the validity of the other conditions will remain unaffected.