You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**NOTE**: It is possible to use scale-factors greater than `1.0`, but if too large it will eventually damage the model's output.
248
249
249
-
## Important Notes
250
+
###Important Notes
250
251
251
252
1.**Always** include the relevant "de-bias" control vector as well as the positive-axis/negative-axis control vector - they cannot be used on their own!
252
253
2.**Do not** mix both sides of a positive/negative axis at the same time (eg: `--control-vector language__simple.gguf` and `--control-vector language__ornate.gguf` will just cancel out and have no effect...).
253
254
3. Ensure your `llama.cpp` version is up to date (multi-vector support added 27/06/24 in [#8137](https://github.com/ggerganov/llama.cpp/pull/8137)).
254
255
255
-
## Llama.cpp Command Line Generator for Control Vectors
256
+
## Command Line Generator
256
257
257
-
Courtesy of [gghfez](https://huggingface.co/gghfez), this utility helps create command line options:
258
+
Courtesy of [gghfez](https://huggingface.co/gghfez), a utility to easily generate command line options for [llama.cpp](https://github.com/ggerganov/llama.cpp):
258
259
259
260
<palign="center">
260
261
<imgsrc="https://github.com/jukofyork/control-vectors/blob/main/command_line_generator.png"alt="Command Line Generator Tool" />
261
262
</p>
262
263
263
-
Use this tool on [GitHub Pages](https://jukofyork.github.io/control-vectors/command_line_generator.html) to easily generate command line options for use with [llama.cpp](https://github.com/ggerganov/llama.cpp).
264
+
You can run this tool directly on [GitHub Pages](https://jukofyork.github.io/control-vectors/command_line_generator.html).
0 commit comments