services.ollama.acceleration
Home-Manager option
What interface to use for hardware acceleration. null: default behavior if nixpkgs.config.rocmSupport is enabled, uses "rocm" if nixpkgs.config.cudaSupport is enabled, uses "cuda" otherwise defaults to false false: disable GPU, only use CPU "rocm": supported by most modern AMD GPUs may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn’t detect your AMD gpu "cuda": supported by most modern NVIDIA GPUs
type: null or one of false, “rocm”, “cuda”Default
null
Example
declared in: <home-manager/modules/services/ollama.nix>source unavailable"rocm"