## Where communities thrive

• Join over 1.5M+ people
• Join over 100K+ communities
• Free without limits
##### Activity
SP Mohanty
@spMohanty
Hello World !
bharlander
@bharlander

Hi everyone,

Yesterday, it was brought to our attention that there was a small, but important error in the evaluation script and random forest starter kit. (Thanks @cyga for the tip!) The calculation for NDCG was using a discount factor of $\frac{n}{n-i}$ rather than the correct $\frac{n}{n+i}$. See correct formulation for NDCG in Technical Details section of the challenge overview.

This error would have affected those that have already submitted solutions through the crowdAI API.

Apologies for this inconvenience. Best of luck on the challenge!

Ben Harlander
Data Science & Operations Research
Principal Global Investors

hackerwei
@hackerwei
hi
how to involve in this contest
SP Mohanty
@spMohanty
@hackerwei : please have a look at the starter kit released as a part of this challenge : https://github.com/crowdAI/ieee_investment_ranking_challenge-starter-kit
Aalekh Nigam
@AALEKH

Hey guys,
I have an issue to report. As we all are well aware that this competition allows maximum 5 submissions per day and uptill now (for the date 2018-04-24) I have submitted 3 solution's as per "submissions dashboard" but while making my 4th attempt for the day I have been experiencing "CrowdAIExecuteFunctionError: The participant has no submission slots remaining for today" Exception, so could anyone please clarify about any change in rule or is this due to some bug on leaderboard evaluator end ?

Thanks

Aalekh Nigam
@AALEKH
SP Mohanty
@spMohanty
@Alekh Nigam: we got reports of this issue and have been tracking it here : crowdAI/crowdai#716
Please do add a comment on the issue to stay in the loop.
There havent been any changes in the challenge policy. This is because of a bug from a major refactor of the leaderboard and should be fixed soon.
Aalekh Nigam
@AALEKH
Thanks for the follow up @spMohanty !!
Aalekh Nigam
@AALEKH
Hey @spMohanty could you please post an update about issue 716, it seems to persist for random number of participants even if no submission has been made for the day.
SP Mohanty
@spMohanty
@/all ,
BearStrikesBack
@BearStrikesBack
@spMohanty
Can you be so kind to specify 2 things:
1) What size of 2002-2016 test data is taken for calculation submission scores?
2) Is it correct that submissions deadline is 20 may 23:59?
SP Mohanty
@spMohanty
Hi @BearStrikesBack
for 1) I would check with @bharlander
and for 2, yes thats correct, the deadline is 20th May, 23:59
BearStrikesBack
@BearStrikesBack
@bharlander
Same question. What part of test dataset for 2002-2016 is used to calculate submission scores presented on submission tab?
Sylvain Bernard
@XCaellaX

Dear all,

here are the winners of the IEEE Investment Ranking Challenge:

1) mkoseoglu
2) lance
3) shanka
4) kvr
5) Alphard.Liu
6) pranoot_hatwar

The six of you are invited to present your solution at the IEEE Data Science Workshop. You’ll find all the final result scores on the winner page.

Thanks to all the participants who submitted solutions and participated to this challenge as well as for being involved in the crowdAI community! Congratulations to the winners!

Shanka Subhra Mondal
@Shanka123
@XCaellaX Did anyone start writing their approaches in the paper.And when will the timeslots be given for the whole narrative of the paper?
SP Mohanty
@spMohanty
@Shanka123 : @XCaellaX volunteered to coordinate that effort, but he is on vacations right now. He should reach out when he is back next week !
Shanka Subhra Mondal
@Shanka123
@spMohanty for our individual approaches what section name should we create and what details should be given(approach,results etc).What kind of plots should be given as well?
SP Mohanty
@spMohanty
@Shanka123 : For now, you can choose an appropriate title which summarizes your approach, but yes, your approach and rresults can go in there. We will move things around for a coherent narrative when all the sections are in place.
Shanka Subhra Mondal
@Shanka123
When are we planning for first review?
SP Mohanty
@spMohanty
it will mostly be a month or so from now.
Shanka Subhra Mondal
@Shanka123
Which conference or journal are you aiming to publish ?
SP Mohanty
@spMohanty
@XCaellaX can probably tell more after confirming with the IEEE team, but its planned to go in the proceedings with the IEEE conference where the challenge was organised as a part of the challenge track (https://2018.ieeedatascience.org/).
But I guess we are also open to submitting to other venues depending on how it turns out.
Shanka Subhra Mondal
@Shanka123
@spMohanty @XCaellaX I have added my contents like method, experiments and results and discussion also. Please go through it and suggest changes that can be made from my side. I am yet to add some plots related to it.Also when will the other candidates fill in their contents?
Sylvain Bernard
@XCaellaX
@bharlander will write intro, problematic, explication of the dataset and how the submissions were graded within the next two weeks.
I'll send all 6 winners an email tomorrow to ask them to start adding their content to the paper.
Goal to have the paper ready/publishable is end of August
Shanka Subhra Mondal
@Shanka123
@XCaellaX Can we get some sort of certification?
Shanka Subhra Mondal
@Shanka123
@XCaellaX can you please notify others once again to write their parts
Shanka Subhra Mondal
@Shanka123
@spMohanty @XCaellaX all the 6 winners have put in their details , only the first part is left, please provide the feedback on it
SP Mohanty
@spMohanty
@Shanka123 : I am on it this weekend. Thanks for the rreminder. I will add the rrest of the sections, and do the final formatting and get back to you guys.
Shanka Subhra Mondal
@Shanka123
@spMohanty @XCaellaX when are you planning to submit the paper for the first review?
SP Mohanty
@spMohanty
We are waiting to hear from Principal.
But we have confirmed with IEEE that we will have to given the final reviewed version in 4-6 weeks;
Note that the revision can take something like 3 weeks; so we are trying to push it now.
Shanka Subhra Mondal
@Shanka123
I have added some references under scholar.bib but not able to merge with zotero.bib . Is it necessary to have references linked to my zotero account?
Can anybody help me with this, thanks.
Sylvain Bernard
@XCaellaX
I'll add them to my zotero account and generate the references from there!