by Karl Freund | Jan 13, 2025 | In the News
How do we create AI in Healthcare? If you are like me, when you see your doctor, the constant probing for data can be somewhat annoying. First, you fill out forms with endless questions about your medical and familial history. Then, your doctor asks about your...
by Karl Freund | Nov 19, 2024 | In the News
Startup launches “Corsair” AI platform with Digital In-Memory Computing, using on-chip SRAM memory that can produce 30,000 tokens/second at 2 ms/token latency for Llama3 70B in a single rack. Using Generative AI, called inference processing, is a memory-intensive...
by Karl Freund | Oct 14, 2024 | In the News
As GPU’s become a bigger part of data center spend, the companies that provide the HBM memory needed to make them sing are benefitting tremendously. AI system performance is highly dependent on memory capacity, bandwidth and latency. Consequently, memory technology is...
by Karl Freund | Oct 14, 2024 | In the News
Flex is expanding its role in the AI data center market with power, cooling and infrastructure solutions for the most demanding AI servers. Artificial Intelligence (AI) is reshaping the data center, creating opportunities to help manage the flow of power and cooling...
by Karl Freund | Oct 11, 2024 | In the News
Chasing Nvidia is hard; Team Green simultaneously countered with new software that can triple AI performance. Consequently, AMD’s performance claims are already out of date. And AMD compared it against the older Hopper, not Blackwell which will ship long before the...