by Karl Freund | Jul 10, 2023 | In the News
It can be done, but it requires the edge device vendor to work to optimize the model. A hybrid approach can also extend the applicability of LLMs by combining Cloud and Edge processing. When most people think of Artificial Intelligence (AI), they imagine a berserk...
by Karl Freund | Jun 30, 2023 | In the News
MosaicML, just acquired by DataBricks for $1.3B, published some interesting benchmarks for training LLMs on the AMD MI250 GPU, and said it is ~80% as fast as an NVIDIA A100. Did the world just change? To be brutally honest, everyone wants to see a fight, between AMD...
by Karl Freund | Jun 27, 2023 | In the News
Let’s look into the results and explore why so many competitors chose not to play ball. Those who follow me know the drill: MLCommons publishes benchmarking results every 3 months, alternating between inferencing and training. Then I explain the results and whine...
by Karl Freund | Jun 16, 2023 | In the News
Intel stock is up 35% in the last three weeks on a string of good news. Is there more to come? Semiconductors have been one of the fastest growing segments on Wall Street this year. Intel has quietly recovered its losses over the last year, with the bulk of the...
by Karl Freund | Jun 14, 2023 | In the News
For the first time, IBM has used a quantum computer to solve a problem that that stumps the leading classical methods. This accomplishment marks a significant milestone in the path towards useful quantum computing systems and software. IBM has published a paper in...
by Karl Freund | Jun 13, 2023 | In the News
AMD disclosed a few more details on the MI300 GPU, due later this year, with support for 192GB of memory on the MI300X. Here’s what we know. In today’s world of ChatGPT, everyone keeps asking if the NVIDIA A100 and H100 GPUs are the only platforms that can deliver the...
