num_threads

Num_threads corresponds to the —threads option in llama.cpp. It set’s the number of threads to use during generation. It is recommended to set this to the number of physical CPU cores your system has which is what Ollama will default to.