Want to have access to 96TB (yes Terabytes) of RAM? Check out this CXL expansion box that shows what the future of memory looks like

Looking to beef up server capacity? The Inventec 96 CXL box could be what you’re looking for. Unveiled at OCP Summit 2024 alongside Astera Labs, the expansion box allows users to connect up to 96 DDR5 DIMMS to a single server, providing enormous memory capacities ranging up to the tens of terabytes per memory server. As reported by , the expansion box can connect to the upcoming eight-way Xeon 6 Granite Rapids-SP server, offering an even bigger punch.

Combined with the , which boasts a total of 128 DDR DIMM slots, this means users could harness a massive 244 DIMM slots for a single server, providing significant memory capacity. What you can expect from the 96 DIMM CXL expansion box So what does this announcement mean exactly? Well, we’re talking about significant memory capacity boosts for servers. The DIMMS in question here are DDR5-4800, and the expansion box uses the Astera Labs Leo.



Elsewhere, users are able to draw up 24 CDFP ports, each of which boasts a PCIe Gen5 x16 connection linking the CXL boat and the servers themselves. As noted, the launch shows users can draw upon a sizable 20TB of memory in a single server, which has massive long-term implications for server capacities and marks a huge development. Underpinning all of this is the growing potential of technology.

In 2023, Meta announced a partnership with to and capable of recycling petabytes worth of RAM. As part of the collaboration, the two firms showed CXL can be used to markedly improve memory efficiency, in turn reducing costs and enhancing performance. The demo board showcased by AMD and Meta included an AMD EPYC 9004 Genoa, boasted four dual in-line memory module (DIMM) slots, and a heat sink and fan.

Astera Labs’ involvement here marks the second major announcement from the semiconductor company so far this year. In April 2024, Astera Labs showcased its Aries 6 PCIe retimer board, which could unlock significant benefits for hyperscalers ramping up AI development. This retimer board can help maintain data signal integrity over the interface.

These high-speed data transfers typically suffer from degradation over long distances or due to interference. The Aries 6 retimers marked the first in Astera Labs’ PCIe 6.x portfolio, and are aimed specifically at enhancing networking capabilities for next-generation GPUs, accelerators, CPUs, and CXL memory controllers.

.