v0.4.10
What's Changed
- Support Tensor Parallel in Python API by @rasbt in #1661
- Swap old Llama model with Phi-3 by @rasbt in #1666
- Update azure-gpu-test.yml by @rasbt in #1669
- Support the refactored API in litgpt serve by @rasbt in #1668
- Multi-gpu serving by @rasbt in #1670
- Add Mistral Large 123B by @rasbt in #1673
- Bumb version to 0.4.10 for next release by @rasbt in #1674
Full Changelog: v0.4.9...v0.4.10