Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Thoughts on having a Public Leaderboard? #226

Open
cfahlgren1 opened this issue Jan 21, 2025 · 2 comments
Open

Thoughts on having a Public Leaderboard? #226

cfahlgren1 opened this issue Jan 21, 2025 · 2 comments

Comments

@cfahlgren1
Copy link
Contributor

Was wondering if ya'll have thought about having a public leaderboard?

Feel like it could bring some more visibility to sql-eval and would be pretty easy to maintain (just add scores to a csv file)

I have a small leaderboard on top of a dataset for DuckDB NSQL here for reference.

Image

Let me know your thoughts 🤗
@rishsriv Slack
Copy link
Member

Great point! Thank you for bringing this up. We're about to a major overhaul of sql-eval's code (by simplifying the current complicated setup), and will definitely do this over the next couple of weeks as a part of that

@cfahlgren1
Copy link
Contributor Author

Awesome! Look forward to it! If you need any help setting anything up on HF let me know! :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rishsriv @cfahlgren1