Skip to content

Commit 83a8d90

Browse files
authored
chore(model gallery): add l3.3-70b-magnum-v4-se (mudler#4642)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent adebd55 commit 83a8d90

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

gallery/index.yaml

+16
Original file line numberDiff line numberDiff line change
@@ -419,6 +419,22 @@
419419
- filename: L3.3-MS-Nevoria-70b-Q4_K_M.gguf
420420
sha256: e8b0763f263089a19d4b112b7ed5085cc5f1ed9ca49c5085baa8d51f4ded1f94
421421
uri: huggingface://bartowski/L3.3-MS-Nevoria-70b-GGUF/L3.3-MS-Nevoria-70b-Q4_K_M.gguf
422+
- !!merge <<: *llama33
423+
name: "l3.3-70b-magnum-v4-se"
424+
urls:
425+
- https://huggingface.co/Doctor-Shotgun/L3.3-70B-Magnum-v4-SE
426+
- https://huggingface.co/bartowski/L3.3-70B-Magnum-v4-SE-GGUF
427+
description: |
428+
The Magnum v4 series is complete, but here's something a little extra I wanted to tack on as I wasn't entirely satisfied with the results of v4 72B. "SE" for Special Edition - this model is finetuned from meta-llama/Llama-3.3-70B-Instruct as an rsLoRA adapter. The dataset is a slightly revised variant of the v4 data with some elements of the v2 data re-introduced.
429+
430+
The objective, as with the other Magnum models, is to emulate the prose style and quality of the Claude 3 Sonnet/Opus series of models on a local scale, so don't be surprised to see "Claude-isms" in its output.
431+
overrides:
432+
parameters:
433+
model: L3.3-70B-Magnum-v4-SE-Q4_K_M.gguf
434+
files:
435+
- filename: L3.3-70B-Magnum-v4-SE-Q4_K_M.gguf
436+
sha256: 9724a6364a42caa3d5a1687258eb329c9af6cbb2ce01c8dd556c1a222a2e0352
437+
uri: huggingface://bartowski/L3.3-70B-Magnum-v4-SE-GGUF/L3.3-70B-Magnum-v4-SE-Q4_K_M.gguf
422438
- &rwkv
423439
url: "github:mudler/LocalAI/gallery/rwkv.yaml@master"
424440
name: "rwkv-6-world-7b"

0 commit comments

Comments
 (0)