Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
1,898 workflow runs
1,898 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Push details without converting fields to str Quality #2225: Pull request #572 synchronize by NathanHB
February 21, 2025 16:06 2m 8s nathan-fix-details-to-str
nathan-fix-details-to-str
February 21, 2025 16:06 2m 8s
Add swiss legal evals as new community tasks Quality #2224: Pull request #389 synchronize by JoelNiklaus
February 21, 2025 13:27 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
February 21, 2025 13:27 Action required
Fix attribute and parameter names in loggers Quality #2223: Pull request #476 synchronize by NathanHB
February 21, 2025 13:22 2m 12s albertvillanova:fix-loggers
albertvillanova:fix-loggers
February 21, 2025 13:22 2m 12s
Config fixes for VLLMModel Quality #2222: Pull request #472 synchronize by NathanHB
February 21, 2025 13:21 2m 15s anton-l:vllm_quick_fixes
anton-l:vllm_quick_fixes
February 21, 2025 13:21 2m 15s
feat: add JGLUE tasks Quality #2221: Pull request #469 synchronize by NathanHB
February 21, 2025 13:20 Action required ryan-minato:jglue
ryan-minato:jglue
February 21, 2025 13:20 Action required
Added custom model inference. Quality #2220: Pull request #437 synchronize by NathanHB
February 21, 2025 13:15 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
February 21, 2025 13:15 Action required
new metrics and pr-fouras dataset add Quality #2219: Pull request #558 synchronize by NathanHB
February 21, 2025 13:12 Action required BertrandCabotIDRIS:main
BertrandCabotIDRIS:main
February 21, 2025 13:12 Action required
Add draft functionality for a generic sandboxed code running Quality #2218: Pull request #580 opened by plaguss
February 21, 2025 12:44 2m 8s plaguss:code-run
plaguss:code-run
February 21, 2025 12:44 2m 8s
Fix vLLM generation with sampling params (#578) Quality #2217: Commit ebb7377 pushed by lewtun
February 21, 2025 10:30 2m 13s main
main
February 21, 2025 10:30 2m 13s
Fix vLLM generation with sampling params Quality #2216: Pull request #578 synchronize by lewtun
February 21, 2025 09:51 2m 0s lewtun/fix-lcb
lewtun/fix-lcb
February 21, 2025 09:51 2m 0s
Fix vLLM generation with sampling params Quality #2215: Pull request #578 synchronize by lewtun
February 21, 2025 09:47 2m 8s lewtun/fix-lcb
lewtun/fix-lcb
February 21, 2025 09:47 2m 8s
Fix vLLM generation with sampling params Quality #2214: Pull request #578 synchronize by lewtun
February 21, 2025 08:33 2m 14s lewtun/fix-lcb
lewtun/fix-lcb
February 21, 2025 08:33 2m 14s
Fix vLLM generation with sampling params Quality #2213: Pull request #578 synchronize by lewtun
February 21, 2025 08:15 2m 27s lewtun/fix-lcb
lewtun/fix-lcb
February 21, 2025 08:15 2m 27s
Fix vLLM generation with sampling params Quality #2212: Pull request #578 synchronize by lewtun
February 20, 2025 21:57 2m 19s lewtun/fix-lcb
lewtun/fix-lcb
February 20, 2025 21:57 2m 19s
Fix vLLM generation with sampling params Quality #2211: Pull request #578 opened by lewtun
February 20, 2025 21:33 2m 20s lewtun/fix-lcb
lewtun/fix-lcb
February 20, 2025 21:33 2m 20s
Multi node vLLM Quality #2210: Pull request #530 synchronize by ncassereau
February 20, 2025 09:04 2m 13s ncassereau:multi_node_vllm
ncassereau:multi_node_vllm
February 20, 2025 09:04 2m 13s
Add CodeElo Quality #2209: Pull request #575 opened by plaguss
February 19, 2025 07:50 2m 4s plaguss:codeelo
plaguss:codeelo
February 19, 2025 07:50 2m 4s
Humanity's last exam (#520) Quality #2208: Commit 782afe8 pushed by NathanHB
February 18, 2025 16:01 2m 6s main
main
February 18, 2025 16:01 2m 6s
Humanity's last exam Quality #2207: Pull request #520 synchronize by NathanHB
February 18, 2025 14:52 2m 9s clem_last_exam
clem_last_exam
February 18, 2025 14:52 2m 9s
Humanity's last exam Quality #2206: Pull request #520 synchronize by NathanHB
February 18, 2025 14:52 2m 8s clem_last_exam
clem_last_exam
February 18, 2025 14:52 2m 8s
Humanity's last exam Quality #2205: Pull request #520 synchronize by NathanHB
February 18, 2025 14:50 2m 10s clem_last_exam
clem_last_exam
February 18, 2025 14:50 2m 10s
Humanity's last exam Quality #2204: Pull request #520 synchronize by NathanHB
February 18, 2025 14:22 2m 5s clem_last_exam
clem_last_exam
February 18, 2025 14:22 2m 5s
Let lighteval support sglang (#552) Quality #2203: Commit 086cf90 pushed by NathanHB
February 18, 2025 14:13 2m 3s main
main
February 18, 2025 14:13 2m 3s
Push details without converting fields to str Quality #2202: Pull request #572 synchronize by NathanHB
February 18, 2025 14:04 2m 9s nathan-fix-details-to-str
nathan-fix-details-to-str
February 18, 2025 14:04 2m 9s
raise exception when generation size is more than model length (#571) Quality #2201: Commit bee02f7 pushed by NathanHB
February 18, 2025 14:04 2m 15s main
main
February 18, 2025 14:04 2m 15s