Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOC: Conbench PoC benchmark is down #60915

Open
1 task done
luxedo opened this issue Feb 11, 2025 · 3 comments
Open
1 task done

DOC: Conbench PoC benchmark is down #60915

luxedo opened this issue Feb 11, 2025 · 3 comments
Labels
Benchmark Performance (ASV) benchmarks Docs Needs Discussion Requires discussion from core team before further action

Comments

@luxedo
Copy link

luxedo commented Feb 11, 2025

Pandas version checks

  • I have checked that the issue still exists on the latest versions of the docs on main here

Location of the documentation

In the current benchmark documentation we have the following links for viewing the benchmarks:

  • Original server: asv
  • OVH server: asv (benchmarks results can also be visualized in this Conbench PoC

This Cornbench PoC points to http://57.128.112.95:5000/ and it is currently down.

I've found an old link for a project of the same name but the repo have been deleted: https://github.com/DeaMariaLeon/Conbench-PoC

Documentation problem

A broken link in the documentation

Suggested fix for documentation

Either find the maintainer (I think it is Dea Maria) and check how to set it up again or if the address has changed or just remove this link

@luxedo luxedo added Docs Needs Triage Issue that has not been reviewed by a pandas team member labels Feb 11, 2025
@mroeschke
Copy link
Member

cc @DeaMariaLeon

@rhshadrach
Copy link
Member

rhshadrach commented Feb 12, 2025

I plan to bring this up in the community meeting tomorrow. I've made a new version of the asv-runner that runs in GitHub instead of on my local machine.

https://github.com/rhshadrach/asv-runner/

You can see the benchmarks posted here; they are updated once a day.

https://rhshadrach.github.io/asv-runner/

Regressions are automatically detected and raised as issues in that repo, e.g.

pandas-dev/asv-runner#42

I don't believe there is anyone who intends to maintain the Conbench-PoC, but I'd be happy to be wrong here.

@rhshadrach rhshadrach added Benchmark Performance (ASV) benchmarks Closing Candidate May be closeable, needs more eyeballs Needs Discussion Requires discussion from core team before further action and removed Needs Triage Issue that has not been reviewed by a pandas team member Closing Candidate May be closeable, needs more eyeballs labels Feb 12, 2025
@DeaMariaLeon
Copy link
Member

Thanks for the ping. Richard is correct, I'm not maintaining the Conbench-PoC anymore. It was just a PoC. One of the issues was that I don't have access to the source of the asv files setup. Moreover, I think that the Conbench project itself is not maintained anymore.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Benchmark Performance (ASV) benchmarks Docs Needs Discussion Requires discussion from core team before further action
Projects
None yet
Development

No branches or pull requests

4 participants