TernixTernix
Config (0)

services.tabbyapi.settings.draft_model.draft_gpu_split

NixOS option

List of VRAM sizes to split between GPUs, in GB. If this is empty, the draft model is autosplit.

type: list of (signed integer or floating point number)
Default
[ ]
Example
[
  2
  2
]
declared in: nixos/modules/services/web-apps/tabbyapi.nixView source on NixOS/nixpkgs →