Leaderboard after release of test data

#1

Hey after the release of test data on the 15th, when we submit our predictions, will there be a leaderboard score or will we atleast get to know how our model is performing?

Thanks

#2

You will not be permitted to see your score until after the deadline has passed. This is to prevent teams from tuning their model on test-set performance, which would bias performance estimates upward.

To help avoid situations where errors occur during evaluation and aren’t caught due to the blind process, we will be closely monitoring the submissions that come in, and if any scores look implausibly poor, we will let that team know.

1 Like