You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed when playing with Kobold that the max response length slider bar is maxed at 512 and there isn't a setting within the quicklaunch GUI that allows me to change this. Apparently, once I start kobold it can be changed within "settings" by manually typing in a different number - e.g. 1024 - but it wasn't immediately apparent to me because I assumed the slider bar represented anything/everything that the program would accept. It'd be nice to be able to change it within the launcher GUI from the beginning and/or have a higher amount than 512 in the "settings" even after Kobold starts up.
The text was updated successfully, but these errors were encountered:
Not really. It's misleading to new users, because an increased gen amount actually reduces the available context since space needs to be reserved for the output. That's why the slider max by default is 512 - people can always increase it further if they need to.
I noticed when playing with Kobold that the max response length slider bar is maxed at 512 and there isn't a setting within the quicklaunch GUI that allows me to change this. Apparently, once I start kobold it can be changed within "settings" by manually typing in a different number - e.g. 1024 - but it wasn't immediately apparent to me because I assumed the slider bar represented anything/everything that the program would accept. It'd be nice to be able to change it within the launcher GUI from the beginning and/or have a higher amount than 512 in the "settings" even after Kobold starts up.
The text was updated successfully, but these errors were encountered: