KTransformers

Text Generation Models

KTransformers text generation support is model-family specific. Always pair a model page with Support Matrix before publishing a deployment claim.

Current Registry Families

Registry alias examplesModel familyDefault method direction
deepseek-v3, deepseek-r1DeepSeekAMXINT4 registry defaults
deepseek-v3.2DeepSeekFP8 registry default
deepseek-v4-flashDeepSeekMXFP4 narrow path
kimi-k2-thinkingKimiRAWINT4
m2, m2.1MiniMaxFP8

List the current registry in your environment:

kt model list
kt model search deepseek

Manual Tutorial Families

Some model families have manual SGLang-KT tutorials but are not yet registry-first paths. Treat them as model-page driven:

Status Rule

Do not mark a model as "Current" unless the exact tuple has been checked:

model family + checkpoint + method + backend + hardware + launch entry