AMX and AVX CPU Paths
CPU backend selection affects how a model runs. The same model can behave differently across AMX, AVX512, AVX2, and compatibility backends.
CPU Feature Check
lscpu | grep -i -E "amx|avx512|avx2|numa"
For AMX, expected flags include:
amx-bf16 amx-int8 amx-tile
Method Direction
| CPU path | Typical methods |
|---|---|
| Intel AMX | AMXINT4, AMXINT8, AMX SFT backends |
| AVX512 native precision | BF16, FP8, RAWINT4, selected GPTQ_INT4 paths |
| AVX2 compatibility | limited fallback paths; use only when the model page says it is supported |
| LLAMAFILE | GGUF compatibility backend |
Parameter Scope
AMX tuning advice does not automatically apply to AVX2/AVX512 paths. Native precision paths do not automatically require AMX conversion; AMX weight preparation is needed when the selected method is AMXINT4 or AMXINT8.