services.tabbyapi.settings.sampling.override_preset

NixOS option

Select a sampler override preset, found in the sampler_overrides folder of the package. This overrides default fallbacks for sampler values that are passed to the API. NOTE: “safe_defaults” provides llama.cpp-style fallbacks (temperature 0.8, top_k 40, top_p 0.95, min_p 0.05) for frontends that don’t send sampling parameters. Leaving this null means no fallbacks at all. A preset that cannot be found makes TabbyAPI exit at startup.

type: null or string
Default
null
Example
"safe_defaults"
declared in: nixos/modules/services/web-apps/tabbyapi.nixView source on NixOS/nixpkgs →