Install llama.cpp, X64 Cuda 12 in my case (4070 Super 12GB)(https://github.com/ggml-org/llama.cpp/releases) NOTE: there are two download links, don’t forget the DLLs or you’ll run in CPU mode! Download a GGUF model file off hugging face that will fit in your… Continue reading