Yesterday, it was brought to our attention that there was a small, but important error in the evaluation script and random forest starter kit. (Thanks @cyga for the tip!) The calculation for NDCG was using a discount factor of rather than the correct . See correct formulation for NDCG in Technical Details section of the challenge overview.
This error would have affected those that have already submitted solutions through the crowdAI API.
Apologies for this inconvenience. Best of luck on the challenge!
Data Science & Operations Research
Principal Global Investors
I have an issue to report. As we all are well aware that this competition allows maximum 5 submissions per day and uptill now (for the date 2018-04-24) I have submitted 3 solution's as per "submissions dashboard" but while making my 4th attempt for the day I have been experiencing "CrowdAIExecuteFunctionError: The participant has no submission slots remaining for today" Exception, so could anyone please clarify about any change in rule or is this due to some bug on leaderboard evaluator end ?
here are the winners of the IEEE Investment Ranking Challenge:
The six of you are invited to present your solution at the IEEE Data Science Workshop. You’ll find all the final result scores on the winner page.
Thanks to all the participants who submitted solutions and participated to this challenge as well as for being involved in the crowdAI community! Congratulations to the winners!