Skip to content

Linux Bash script that sets CPU governor to Performance, takes User input on Ollama Model and number of times to run benchmark. Does not identify if CPU or GPU, but does provide a Tokens per Second (tokens/s) for eval rate. Set CPU governor back to system default.

License

Notifications You must be signed in to change notification settings

tabletuser-blogspot/ollama-benchmark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

ollama-benchmark

Linux Bash script that sets CPU governor to Performance, takes User input on Ollama Model and number of times to run benchmark. Does not identify if CPU or GPU, but does provide a Tokens per Second (tokens/s) for eval rate. Usually sets CPU governor back to system default. Clears Model from Vram once complete.

About

Linux Bash script that sets CPU governor to Performance, takes User input on Ollama Model and number of times to run benchmark. Does not identify if CPU or GPU, but does provide a Tokens per Second (tokens/s) for eval rate. Set CPU governor back to system default.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages