#weight quantization

1 story

#ai efficiency #alexander heinecke #bitcos #breaking #evangelos georganas #gpu optimization #inference speed #model compression #pradeep dubey #storage optimization #ternary llms

New method shrinks AI models below the theoretical limit
Researchers break through a fundamental barrier in ternary AI compression by exploiting how weights actually distribute.
arXiv · 1m · 5 views