AMX and AVX CPU Paths
CPU backend selection is part of the support claim. The same model can behave differently across AMX, AVX512, AVX2, and compatibility backends.
CPU Feature Check
lscpu | grep -i -E "amx|avx512|avx2|numa"
For AMX, expected flags include:
amx-bf16 amx-int8 amx-tile
Method Direction
| CPU path | Typical methods |
|---|---|
| Intel AMX | AMXINT4, AMXINT8, AMX SFT backends |
| AVX512 native precision | BF16, FP8, RAWINT4, selected GPTQ_INT4 paths |
| AVX2 compatibility | limited fallback paths; use only when the model page says it is supported |
| LLAMAFILE | GGUF compatibility backend |
Documentation Rule
If a page gives AMX tuning advice, do not apply it to AVX2/AVX512 paths without saying so. If a page gives native precision advice, do not imply AMX conversion is required unless the selected method is AMXINT4 or AMXINT8.