This has been the best so far, some wierd behaviour sometimes, maybe that’s my parameters though.
For some characters, this has been the best at keeping them in character and progressing the story!
You must log in or register to comment.
so glad to find this sub on lemmy. i was trying to find out more about this and didn’t want to re-open my reddit! thank you for posting
Edit: unusably slow when i first got it set up but much faster once I got the GPTQ-for-llama set up. Some really good responses.
I ended up downloading all of the 13B SuperHOT models, each one seems great, but I am still trying to work out how to set the parameters correctly
