by Karl Freund | Jul 26, 2023 | In the News
According to the company, the new Gen-2 of HBM increases memory capacity by 50%, with another bump in the works for 2024. As you may have heard, in addition to NVIDIA GPUs, generative AI eats memory for lunch. And dinner. In fact, running ChatGPT takes 8 or 16 GPUs...
by Karl Freund | Jul 24, 2023 | In the News
Synopsys is seeing strong demand for its newer AI technologies in test, verification, manufacturing and analog migration, in addition to the ongoing need for design optimization (DSO.ai). Synopsys was the first Electronic Design Automation (EDA) company to provide AI...
by Karl Freund | Jul 20, 2023 | In the News
The Wafer-Scale Engine company has been working for 8 years to break into the top tier of AI computing. This deal might just assure its success. We have been watching Cerebras for a long time, from its launch of the first wafer-scale engine for AI to its recent...
by Karl Freund | Jul 11, 2023 | In the News
Cadence’s acquisition of Future Facilities in 2022 opened the door to large data centers, and provides the company with the ability to manage power and cooling just when data centers need help the most as AI surges. Suppose you are running a data center, racks full of...
by Karl Freund | Jul 10, 2023 | In the News
It can be done, but it requires the edge device vendor to work to optimize the model. A hybrid approach can also extend the applicability of LLMs by combining Cloud and Edge processing. When most people think of Artificial Intelligence (AI), they imagine a berserk...
by Karl Freund | Jun 30, 2023 | In the News
MosaicML, just acquired by DataBricks for $1.3B, published some interesting benchmarks for training LLMs on the AMD MI250 GPU, and said it is ~80% as fast as an NVIDIA A100. Did the world just change? To be brutally honest, everyone wants to see a fight, between AMD...
