Announcing Release 3.0.4
A new reasoning dataset is added to the current DISTILLED_REASONING_3B competition, and the evaluation method is improved to rely less on Hugging Face's unstable API.
Changes
- Added the (Codeforces COTS dataset)[https://huggingface.co/datasets/open-r1/codeforces-cots]
- Better validation handling in case one or multiple datasets are unavailable via HF's API.
- Reset validator state
Notes to validators
Please make sure to increase the number of open files limit before running the validator, then update the dependencies:
$ ulimit -n 64000
$ python -m pip install -e .