How to Load and Evaluate a Local HF-Formatted Model. #605

Answered by Leymore

liu904-61 asked this question in Q&A

liu904-61
Nov 20, 2023

A model based on LLAMA2

Answered by Leymore

Set the path and tokenizer_path variables to your local path

https://github.com/open-compass/opencompass/blob/main/configs/models/hf_llama/hf_llama2_7b.py#L8-L9

View full answer

Replies: 1 comment 2 replies

Leymore
Nov 20, 2023

Set the path and tokenizer_path variables to your local path

https://github.com/open-compass/opencompass/blob/main/configs/models/hf_llama/hf_llama2_7b.py#L8-L9

2 replies

liu904-61 Nov 20, 2023
Author

ok，thinks。

liu904-61 Nov 20, 2023
Author

Sorry, additional question: How should the 5shot evaluation be conducted?

Answer selected by liu904-61

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment