Skip to content

Commit 8d16a0a

Browse files
authoredMar 13, 2025
chore(model gallery): add gemma-3-4b-it (mudler#5008)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 87ca801 commit 8d16a0a

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed
 

‎gallery/index.yaml

+14
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,20 @@
3838
- filename: gemma-3-12b-it-Q4_K_M.gguf
3939
sha256: 7bb69bff3f48a7b642355d64a90e481182a7794707b3133890646b1efa778ff5
4040
uri: huggingface://ggml-org/gemma-3-12b-it-GGUF/gemma-3-12b-it-Q4_K_M.gguf
41+
- !!merge <<: *gemma3
42+
name: "gemma-3-4b-it"
43+
urls:
44+
- https://ai.google.dev/gemma/docs/core
45+
- https://huggingface.co/ggml-org/gemma-3-4b-it-GGUF
46+
description: |
47+
Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3 models are multimodal, handling text and image input and generating text output, with open weights for both pre-trained variants and instruction-tuned variants. Gemma 3 has a large, 128K context window, multilingual support in over 140 languages, and is available in more sizes than previous versions. Gemma 3 models are well-suited for a variety of text generation and image understanding tasks, including question answering, summarization, and reasoning. Their relatively small size makes it possible to deploy them in environments with limited resources such as laptops, desktops or your own cloud infrastructure, democratizing access to state of the art AI models and helping foster innovation for everyone. Gemma-3-4b-it is a 4 billion parameter model.
48+
overrides:
49+
parameters:
50+
model: gemma-3-4b-it-Q4_K_M.gguf
51+
files:
52+
- filename: gemma-3-4b-it-Q4_K_M.gguf
53+
sha256: 882e8d2db44dc554fb0ea5077cb7e4bc49e7342a1f0da57901c0802ea21a0863
54+
uri: huggingface://ggml-org/gemma-3-4b-it-GGUF/gemma-3-4b-it-Q4_K_M.gguf
4155
- &phi4
4256
url: "github:mudler/LocalAI/gallery/phi-4-chat.yaml@master"
4357
name: "phi-4"

0 commit comments

Comments
 (0)