AIcrowd | Meta Comprehensive RAG Benchmark: KDD Cup 2024 | Discussions

Loading

Topics

New topic

0

💬 Welcome to KDD Cup 2024: CRAG Comprehensive RAG Benchmark Challenge By aicrowd-bot 3 months ago

3

0

Evaluation succeeded but the results are not on the lead board By lizhuoqun 12 days ago

4

4

About Test Set Leakage in Round 1 By jinwei_luo 5 days ago

5

1

Inference failed without any useful message in debug-logs About 21 hours ago

3

0

Submission stuck in Private test dataset By rxlqna126com 3 days ago

7

0

Evaluate Scores failed By jjplane Yesterday

1

0

The evaluation was successful but is still in the submitted state By mc_liu Yesterday

1

1

Failed inference By itao_zheng 5 days ago

3

0

Inference failed without reporting logs, why is this? By mc_liu 3 days ago

1

0

Added tag with "submission-v" prefix but no evaluation issue created By yc5 5 days ago

8

1

Submissions not launched By firdawse_guerbouzi 3 days ago

1

0

Expect to return a message that stating whether it was a timeout problem By jiazunchen 3 days ago

1

0

Is it allowed to have some modifications in local_evaluation.py? By soumidas 5 days ago

4

0

Data Quality Collection V3 - Task1 By Appaloosa 4 days ago

1

0

Submission budget By firdawse_guerbouzi 4 days ago

1

0

Couldn't instantiate the backend tokenizer By rlefdali 4 days ago

1

0

Couldn't instantiate the backend tokenizer By rlefdali 4 days ago

1

0

Why am I not qualified for this round. By itao_zheng 6 days ago

5

0

The node was low on resource: ephemeral-storage By CPP 15 days ago

4

0

The error of have not qualified for this round By Barianc 6 days ago

3

0

Why am I not eligible to participate? By laoyee_xuan 6 days ago

11

2

📢 Announcements: Phase 1 Extension, New Private Test Set, Batch Prediction Interface, and Updated Baselines By aicrowd_team 6 days ago

6

0

Is it allowed to build Ollama docker to run different model? 6 days ago

2

1

Still the same test data for task 1? By jeongeum_seok 6 days ago

1

0

CUDA out of memory issue By seven_chi 8 days ago

3

1

Do I need to set up my own openai key when uploading evaluations By yaxun_dai 29 days ago

6

0

How to use mock api in task #2 submission? By liu_chenyang 8 days ago

2

2

Data Quality Collection V2, Task-1 By jjplane 12 days ago

12

1

What does `split` field mean? By shizueyy 27 days ago

9

1

What are the criteria to select the teams for phase 2? By hoang_dang_tuan 8 days ago

2