KoboldCpp: Powerful AI text generation software built on llama.cpp. Enjoy an intuitive interface, easy installation, and advanced features for GGML models.
KoboldCpp is an accessible AI text generation software designed for GGML models, built upon the llama.cpp framework. It provides a user-friendly interface with persistent story features, editing tools, and support for various save formats, memory management, world information, author notes, characters, and scenarios, mirroring the functionalities of Kobold and Kobold Lite. Furthermore, it includes a versatile Kobold API endpoint, expanded format support, backward compatibility, and a sophisticated UI. This allows users to easily utilize and manage advanced AI models on their own systems.