Is The AMD GPU Better Than We Thought For AI?

MosaicML, just acquired by DataBricks for $1.3B, published some interesting benchmarks for training LLMs on the AMD MI250 GPU, and said it is ~80% as fast as an NVIDIA A100. Did the world just change? To be brutally honest, everyone wants to see a fight, between AMD...