Rethinking BitNet STE: The torch.compile-Friendly Design Torchao Uses (And Its Trade-Off)
We replaced a monolithic autograd.Function wrapping all of BitNet's ternary quantization with a minimal _STERound (STE only on round()), mirroring torchao's design — enabling full torch.compile fusion at the cost of being slower in eager mode without the compiler.