Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

modifiable max response length? #83

Open
BBC-Esq opened this issue Aug 6, 2024 · 3 comments
Open

modifiable max response length? #83

BBC-Esq opened this issue Aug 6, 2024 · 3 comments

Comments

@BBC-Esq
Copy link

BBC-Esq commented Aug 6, 2024

I noticed when playing with Kobold that the max response length slider bar is maxed at 512 and there isn't a setting within the quicklaunch GUI that allows me to change this. Apparently, once I start kobold it can be changed within "settings" by manually typing in a different number - e.g. 1024 - but it wasn't immediately apparent to me because I assumed the slider bar represented anything/everything that the program would accept. It'd be nice to be able to change it within the launcher GUI from the beginning and/or have a higher amount than 512 in the "settings" even after Kobold starts up.

@LostRuins
Copy link
Owner

As you said, you can overwrite the number in the input box if you need values greater than 512.

If you need to adjust the slider, you can use this usermod

document.getElementById('max_length_slide').max = 9999;

image

@BBC-Esq
Copy link
Author

BBC-Esq commented Aug 6, 2024

Thanks I'll check that out in the meantime. Is this not something that would be a beneficial change?

@LostRuins
Copy link
Owner

Not really. It's misleading to new users, because an increased gen amount actually reduces the available context since space needs to be reserved for the output. That's why the slider max by default is 512 - people can always increase it further if they need to.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants