Skip to content

Commit f325c20

Browse files
authored
updated bencmark table (#1674)
1 parent d2281bb commit f325c20

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/en/benchmark_llm.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,8 +16,7 @@ sidebar:
1616

1717
### Benchmarking
1818

19-
{:.table-model-big.db}
20-
19+
{:.table-model-big}
2120
| Model | Avarega | MedMCQA | MedQA | MMLU <br>anotomy | MMLU<br>clinical<br>knowledge | MMLU<br>college<br>biology | MMLU<br>college<br>medicine | MMLU<br>medical<br>genetics | MMLU<br>professional<br>medicine | PubMedQA |
2221
|-----------------|---------|---------|--------|------------------|-------------------------------|----------------------------|------------------------------|------------------------------|-----------------------------------|----------|
2322
| jsl_medm_q4_v3 | 0.6884 | 0.6421 | 0.6889 | 0.7333 | 0.834 | 0.8681 | 0.7514 | 0.9 | 0.8493 | 0.782 |
@@ -26,6 +25,7 @@ sidebar:
2625
| jsl_meds_q4_v3 | 0.5522 | 0.5104 | 0.48 | 0.6444 | 0.7472 | 0.8333 | 0.6532 | 0.68 | 0.6691 | 0.752 |
2726
| jsl_meds_q8_v3 | 0.5727 | 0.53 | 0.4933 | 0.6593 | 0.7623 | 0.8681 | 0.6301 | 0.76 | 0.7647 | 0.762 |
2827
| jsl_meds_q16_v3 | 0.5793 | 0.5482 | 0.4839 | 0.637 | 0.7585 | 0.8403 | 0.6532 | 0.77 | 0.7022 | 0.766 |
28+
2929
</div><div class="h3-box" markdown="1">
3030

3131
### Benchmark Summary

0 commit comments

Comments
 (0)