Location
VN
Badges
Activity
Ratings Progression
Challenge Categories
Challenges Entered
Completed
Meta
Improve RAG with Real-World Benchmarks
Latest submissions
See All| graded | 266335 | ||
| graded | 266193 | ||
| graded | 266168 |
Seerave Foundation
A benchmark for image-based food recognition
Latest submissions
LifeCLEF
Institute of Global Health
Classify images of snake species from around the world
Latest submissions
See All| graded | 10024 | ||
| graded | 6995 | ||
| failed | 6992 |
AIcrowd
5 Problems 15 Days. Can you solve it all?
Latest submissions
See All| graded | 74031 | ||
| graded | 73938 | ||
| graded | 73831 |
Max Planck Institute for Intelligent Systems
Disentanglement: from simulation to real-world
Latest submissions
Unity Technologies
A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning
Latest submissions
Latest submissions
See All| graded | 73807 | ||
| graded | 73198 | ||
| graded | 72790 |
Testing RAG Systems with Limited Web Pages
Latest submissions
See All| graded | 266167 | ||
| failed | 266122 | ||
| failed | 265909 |
Evaluating RAG Systems With Mock KGs and APIs
Latest submissions
See All| graded | 266168 | ||
| failed | 266069 | ||
| graded | 266068 |
Enhance RAG systems With Multiple Web Sources & Mock API
Latest submissions
See All| graded | 266335 | ||
| graded | 266193 | ||
| failed | 266166 |
Sony Group Corporation
Create Videos with Spatially Aligned Stereo Audio
Latest submissions
| Participant | Rating |
|---|---|
alchemi01
|
235 |
| Participant | Rating |
|---|
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
Did somebody try deploy three llama3-8b on four T4?
6 months agoHow large is each llama3-8b model? If it is 16GB each, itβs possible.
Whether the task test phase can link to the Internet
6 months agoThere is the Internet when building the Docker image. But no internet when they run submissions.
The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?
7 months agoThe docker file can be customized. It is the environment to run the code in gitlab.
The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?
7 months agoLook at crag_mock_api/apiwrapper/pycragapi.py to see how to use its functions.
The openai interface cannot be used during evaluation? Why?
7 months agoYou need to pass API key. There is also no internet in the submission.
Added tag with "submission-v" prefix but no evaluation issue created
7 months agoGot this issue again.
When will the submission limit be reset?
8 months agoIn the Submission tab of the main challenge page, we can see how many submissions are left this week.
Is anyone using Colab for this competition?
8 months agoYou can use Colab, but having a local GPU is more convenient for debugging and checking submission
Meta KDD Cup 24 - CRAG - Retrieval Summarization
Failed to communicate with the grader
7 months agoI had the same issue. Is it fixed now? @aicrowd_team
Couldn't instantiate the backend tokenizer
7 months agoHave you tried installing the transformer package?
About Test Set Leakage in Round 1
7 months ago@aicrowd_team I suggest that the Round 2 test set should be truly private and not share any similarity or distribution with the data in Round 1.
Why am I not eligible to participate?
7 months agoI have tried again and still failed with the same reason
MASKD
MMdetection unable to form final test file
Over 4 years agoLooking at the starter/baseline code. Thereβs the example for preparing the submission.
CHESS
About the dataset
Over 4 years agoThanks for the reply.
I make another submission without external data. However, the leaderboard doesnβt seem to be updated:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73348
Is it ok to make submission now? @ashivani
Did somebody try deploy three llama3-8b on four T4?
6 months agoThere are 4 T4 cards. But I see that the total GPU memory is < 60GB.