Text Generation Models

KTransformers text generation support is model-family specific. Use the model page together with the Support Matrix to check the exact model, method, backend, and hardware combination.

Current Registry Families

Registry alias examples	Model family	Default method direction
`deepseek-v3`, `deepseek-r1`	DeepSeek	`AMXINT4` registry defaults
`deepseek-v3.2`	DeepSeek	`FP8` registry default
`deepseek-v4-flash`	DeepSeek	`MXFP4` narrow path
`kimi-k2-thinking`	Kimi	`RAWINT4`
`m2`, `m2.1`	MiniMax	`FP8`

List the current registry in your environment:

kt model list
kt model search deepseek

Manual Tutorial Families

Some model families have manual SGLang-KT tutorials but are not yet registry-first paths. Treat them as model-page driven:

MiniMax M2.5
Qwen3 / Qwen3.5 / Qwen3-Coder-Next
GLM-5 / GLM-5.1

Validation Scope

Validated status applies to an exact combination:

model family + checkpoint + method + backend + hardware + launch entry

If any dimension changes, run minimum validation and throughput checks before treating the command as directly reusable.