Installation Reference

The canonical installation page is Getting Started / Installation.

Use this short reference when an older link points to /docs/installation.

Inference

pip install kt-kernel sglang-kt

Use this path for:

• kt run
• SGLang-KT serving
• OpenAI-compatible inference APIs

Fine-Tuning

cd /path/to/LLaMA-Factory
pip install -e .
pip install -r requirements/ktransformers.txt

requirements/ktransformers.txt should contain:

ktransformers[sft]

Use this path for LLaMA-Factory based MoE LoRA SFT.

Next Steps

• First inference server
• First LoRA SFT run
• Support Matrix