I have used Ollama so far and it’s indeed quite slow, can you recommend a good guide for setting up llama.cpp (on linux). I have Ollama running in a docker container with openwebui, that kind of setup would be ideal.

Sorry, but I already have a more secure solution. Just don’t use that crappy software. It’s completely free too, although prices might go up soon.