Submissions / leaderboard show zero fraction of done agents / mean reward for random agent

[lewtun]

I made a submission with the random agent provided in the starter kit and noticed that the Fraction of done-agents and Mean Reward on the submission page and leaderboard are both shown as 0.0:

On the other hand, the evaluation logs show non-zero values for both quantities, as I would expect:

Is this behaviour by design?

[MLerik]

Hi @lewtun

Yes because you submitted with debugging turned on. Debugging submissions will not be ranked and thus get 0 as values for score. If you want to make a full submission you have to change the value "debug": true in the aicrowd.json to false

[lewtun]

Hi @MLerik, thanks for the clarification. If I want to add a small tweak to the README via a PR is it possible to contribute to this repo?

[MLerik]

Hi @lewtun

If you send me the changes to the README I'm happy to update it. This repo is owned by AIcrowd so I cannot manage who has access. Reach out to @spMohanty if you prefer to submit directly instead of through me

[spMohanty]

@lewtun : We would be every happy if you send across a PR with your changes.
@MLerik : You are listed as an Admin of this repository, so you can definitely add others to the repo. But I think its best to stick to the PR based approach from all the external contributors.