AMD matrix cores break the rules

AMD's GPU matrix multipliers don't follow IEEE 754 floating point standards. Each architecture handles rounding, overflow, and special numbers differently, making results unpredictable across devices.

“Matrix multipliers available on recent GPUs do not conform with the IEEE 754 floating point standard.”

The mystery of undocumented hardware

AMD doesn't publish how its matrix multipliers actually work. Without documentation, engineers can't explain why results differ between devices or predict behavior in new applications.

“Implementation details of matrix multipliers are not documented, making it difficult to interpret discrepancies in the computed results.”

Three AMD architectures tested

Researchers tested matrix cores across CDNA 1, CDNA 2, and CDNA 3 architectures using MI100, MI210/250, and MI300A/300X GPUs to map their numerical behavior.

Custom test vectors reveal secrets

Researchers designed specific test inputs to expose how each GPU handles accumulator width, rounding, underflow, overflow, and special numbers like subnormals.

Building software models of hardware

The team created MATLAB-based software models that replicate each AMD architecture's matrix multiplier behavior, validated against 10 million random test cases for bit-level accuracy.

AMD versus NVIDIA in practice

Using the models, researchers compared real application accuracy between AMD matrix cores and NVIDIA tensor cores, showing measurable differences in numerical results.

Reproducibility now possible

With accurate models, developers can now predict and reproduce matrix core results across AMD GPUs, solving a major problem for scientific computing and AI applications.