This tiny box from Samsung can hold 2TB of a special kind of RAM worth tens of thousands of dollars — CXL Memory Module Box hailed as the future of expansive server memory in the age of AI

At MemCon 2024, Samsung showcased its latest HBM3E technology, talked about its future HBM4 plans, and unveiled the CXL Memory Module Box, also known as CMM-B, the latest addition to its Compute Express Link (CXL) memory module portfolio. CMM-B is essentially a memory pooling appliance for rack computing leveraging CXL. It supports disaggregated memory allocation, … Read more

Samsung CXL upgrade – SamMobile

Samsung is the world’s biggest semiconductor memory chip maker and is often the first to launch new technologies in the segment. Today, the company unveiled its new CXL (Compute Express Link) memory modules and the HBM3E memory. These products are meant to be used in cloud servers and supercomputers for AI and other high-performance computing … Read more

Startup claims to boost LLM performance using standard memory instead of GPU HBM — but experts remain unconvinced by the numbers despite promising CXL technology

MemVerge, a provider of software designed to accelerate and optimize data-intensive applications, has partnered with Micron to boost the performance of LLMs using Compute Express Link (CXL) technology.  The company’s Memory Machine software uses CXL to reduce idle time in GPUs caused by memory loading. The technology was demonstrated at Micron’s booth at Nvidia GTC … Read more