Sounds like you are using too strong of an AI file for your hardware or settings aren't set quite right. I had the same issue but It took me some fiddling on settings before I got it to work. When Kobold_cpp first starts, it is looking at your CPU. Mine is not great so I had to switch it to use my GPU more through I think it was Vulkan Old CPU.
RainbowDarth
4
Posts
A member registered Jun 16, 2020
Recent community posts
That's because the default prompt gives her the intelligence of a 4 year old. So I fiddled with the prompt quite a bit to make them more useful. I upped the age of intelligence first and then just gave them an overwhelming yandere obsession with the player in the prompt and removed the word short from the original prompt. Much more talkative and helpful to be honest. I'm using a local LLM though so not sure if you are as well.