At MemCon 2024, Samsung showcased its latest HBM3E technology, talked about its future HBM4 plans, and unveiled the CXL Memory Module Box, also known as CMM-B, the latest addition to its Compute Express Link (CXL) memory module portfolio.
CMM-B is essentially a memory pooling appliance for rack computing leveraging CXL. It supports disaggregated memory allocation, allowing memory capacity available in remote locations to be shared across multiple servers. Through this, CMM-B enables independent resource allocation in the rack cluster and allows for larger pools of memory to be assigned as needed. With up to 60GB/s bandwidth, Samsung says CMM-B is ideal for applications like AI, in-memory databases, and data analytics.
CMM-B can accommodate eight E3.S form factor CMM-D (PCIe Gen5) memory modules for a total of 2TB. CMM-D memory integrates Samsung’s DRAM technology with the CXL open standard interface to deliver efficient, low-latency connectivity between the CPU and memory expansion devices.
Easy setup
Samsung says the CMM-B integrates seamlessly into Supermicro Plug and Play Rack Scale Solutions, ensuring not only faster productivity but also reduced total cost of ownership (TCO).
The CMM-B module comes pre-installed with Samsung’s Cognos Management Console (SCMC) software, which provides an intuitive interface for quick setup of the Rack-Scale server appliance. This software facilitates dynamic memory allocation, enabling memory to be allocated independently of the server to which it is attached.
During his keynote at MemCon, Jin-Hyeok Choi, Corporate Executive Vice President, Device Solutions Research America – Memory at Samsung Electronics said, “AI innovation cannot continue without memory technology innovation. As the market leader in memory, Samsung is proud to continue advancing innovation – from the industry’s most advanced CMM-B technology, to powerful memory solutions like HBM3E for high-performance computing and demanding AI applications. We are committed to collaborating with our partners and serving our customers to unlock the full potential of the AI era together.”