TernixTernix
Config (0)

services.tabbyapi.settings.draft_model.draft_rope_scale

NixOS option

Rope scale for draft models, same as compress_pos_emb. Use if the draft model was trained on long context with rope.

type: null or signed integer or floating point number
Default
1.0
Example
4.0
declared in: nixos/modules/services/web-apps/tabbyapi.nixView source on NixOS/nixpkgs →