Build Packages And Env Failed

(post deleted by author)

View post 0

Concern about the Competition of NeurIPS 2022 CityLearn Challenge

Dear Organizing Committee of NeurIPS 2022 CityLearn Challenge:

On behalf of our team, I’d like to propose the following concern about the fairness of the current competition.
According to your announcement issued from “Removal of logs from Phase 2 runs” on Sep 14, we are quite worried that some teams may have the private data logged from Phase 2 and take them for training or other usage. If someone uses these leaked data and over fits the logged data, the score will be significantly improved.

Therefore, we’d like to present the following suggestions to the organizers, which may help to improve the fairness of the competition.
(1) It would be helpful to announce again that all the teams can not use the private data logged in phase2 for training or inference in the final selected submissions.
(2) The winner teams need to release the final code (training, inference codes, etc.) to ensure the reproducibility of the final best result, which should not rely on the private data logged from Phase 2.

Thanks for your attention and wish the competition a great success.

@dipam @kingsley_nweye

View post 10

Submission waiting in queue

(post deleted by author)

View post 0

Submission waiting in queue

@dipam @kingsley_nweye

Could you please help us check that ? Thank you!

View post 1

Submission waiting in queue

Hello,
Submission 203295 has been waiting in queue for hours. Do you have any information about the reason?

Thank you!

View post 2

Build Packages And Env Failed

The problem is solved now.

View post 0

Build Packages And Env Failed

(post deleted by author)

View post 0

Build Packages And Env Failed

Screen Shot 2022-10-24 at 11.52.181006×388 72.3 KB

Hi,

“Build Packages And Env” failed this morning (submission id #201545). However, the submission content is same as the one of last week, which had run successfully.

Could you please help us check the reason?

@kingsley_nweye @dipam Thank you very much !

View post 1

Questions about Leaderboard

Dear Organizers,

Thanks for the recent clarification of the rules and leaderboard. Still I have some concerns:

1. Since the current leaderboard is totally different from that in Phase 3, would it be possible to update the leaderboard at this moment just as the way in Phase 3 ? Otherwise it makes no sense to keep submitting on it. I suppose the difference is just adding the weight of 40% and 60% ?

2. Will the winner be decided by the last submission in Phase 3 or the highest score in private leaderboard among all submissions in Phase 3 ?

View post 4

[Announcement] Average Score Weighting

Hi,

Thanks for the update ! Still I have some concerns:

1. Since the leaderboard in Phase 2 is totally different from the Phase 3, would it be possible to update the current leaderboard just as the way in Phase 3 ? Otherwise it is meaningless to keep submitting on it. I think the difference is just the weighting of 40% and 60%.

2. Will the winner be decided by the last submission in Phase 3 or the highest score in private leaderboard among all submissions in Phase 3 ?

View post 1

[Announcement] Update to Evaluation and Leaderboard

(post deleted by author)

View post 0

Topic deleted by author

(topic deleted by author)

View post 0

Team freeze deadline

Hello,

Yesterday we tried to create a team. However, the button didn’t work with a message “this challenge has team-freeze in effect”.

I haven’t found any official information concerning the deadline of team creation and freeze. Is it still possible to create a team at this moment, or in the next phase?

Thank you very much !

View post 1