services.tabbyapi.settings.sampling.override_preset
NixOS option
Select a sampler override preset, found in the sampler_overrides folder of the package. This overrides default fallbacks for sampler values that are passed to the API. NOTE: “safe_defaults” provides llama.cpp-style fallbacks (temperature 0.8, top_k 40, top_p 0.95, min_p 0.05) for frontends that don’t send sampling parameters. Leaving this null means no fallbacks at all. A preset that cannot be found makes TabbyAPI exit at startup.
type: null or stringDefault
null
Example
declared in: nixos/modules/services/web-apps/tabbyapi.nixView source on NixOS/nixpkgs →"safe_defaults"