Skip to content

aws-samples/foundation-model-benchmarking-tool

Error
Looks like something went wrong!

About

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.

aws-samples.github.io/foundation-model-benchmarking-tool/

Topics

benchmarking benchmark p5 bedrock evaluation-metrics sagemaker g6 p4d g5 foundation-models inferentia generative-ai llama2 deepseek trainium llama3 g6e deepseek-r1

Resources

Readme

License

MIT-0 license

Code of conduct

Code of conduct

Security policy

Security policy
Activity
Custom properties

Stars

241 stars

Watchers

8 watching

Forks

43 forks
Report repository

Releases 50

Llama3.1-8b for p5en Latest
Apr 2, 2025
+ 49 releases

Packages

No packages published

Contributors 7

Languages