Skip to content

Commit 28de07a

Browse files
authored
Merge pull request #41 from remichu-ai/transformer_multimodal
update README.md
2 parents 1e5785e + 219eeac commit 28de07a

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

README.md

+2-3
Original file line numberDiff line numberDiff line change
@@ -44,10 +44,9 @@ gallama run -id "model_id=pixtral max_seq_len=32768"
4444
```
4545

4646
2. Qwen 2 VL:
47-
As of this release, the transformers build in pip is not yet updated with bugfix for Qwen 2 VL, hence you will need to install the latest code from github.
48-
This is already be handled in the requirements.txt, however, getting transformers dependency working can be tricky.
47+
For Exllama V2, please install `dev` branch of Exllama V2 as the code is not yet merged to `v0.2.4`.
4948

50-
After installation you can download by following commands (choose a version that fit your VRAM):
49+
After installation you can download by following commands (choose a version that fit your VRAM), there are other quantization available from 3 to 8bpw.
5150
```shell
5251
# 2B model
5352
gallama download qwen-2-VL-2B:4.0

0 commit comments

Comments
 (0)