SOCAM Market Demand Rises with Qualcomm and AMD Entry Impacting Global DRAM Supply Chain
The market for Small Area Memory (SOCAM), increasingly referred to as the "second High Bandwidth Memory (HBM)," is widening. The SOCAM modules which NVIDIA introduced as their first product are now being evaluated by Qualcomm and AMD, who will use them in their new AI server chips. The growing demand for SOCAM technology has created challenges for manufacturers who need to handle reduced availability of LPDDR DRAM, which serves as the primary material for SOCAM production.
New Players Entering the SOCAM Space
Qualcomm is currently examining its supply chain to implement SOCAM as part of its AI server semiconductor development according to industry sources. Qualcomm, which specializes in smartphone application processors, plans to enter the AI server market with its upcoming AI200 and AI250 chips to compete against NVIDIA within the next two years.
AMD operates in the AI GPU market as a leading company which has shared prototype memory products with Samsung Electronics and other memory manufacturers to test their new SOCAM technology.
Understanding SOCAM Technology
NVIDIA developed SOCAM as a dedicated DRAM module format which serves its GPU server systems. SOCAM stores DRAM components through its module design, which assembles four DRAM chips into a separate unit instead of using the conventional onboard DRAM installation method that requires direct soldering to the server motherboard.
The DRAM module base construction, which introduces additional data routing paths, results in enhanced data transmission speeds for the system. The module design allows for easy part replacement which enables sustained server functionality throughout its extended operational timeframe. NVIDIA is now implementing its second-generation SOCAM (SOCAM 2) system for use with its Vera server CPU products.
Design Variations and Standardization Challenges
The original SOCAM design from NVIDIA uses a rectangular module which contains one row of four DRAM chips. The company requests a square module design which includes two rows of two DRAM chips according to existing reports from Qualcomm and AMD. The industry insiders believe that the square design will enable board designers to integrate power management IC (PMIC) components, which NVIDIA's current design does not support.
The technology standards for SOCAM remain undefined because NVIDIA developed SOCAM as a separate project before the Joint Electron Device Engineering Council (JEDEC) established its standard. The industry will face standardization problems if new players like Qualcomm and AMD choose to bring different module designs into the market.
Impact on the DRAM Supply Chain
The SOCAM market growth is contributing to a shortage of LPDDR DRAM which affects major producers such as Samsung Electronics, SK Hynix, and Micron Technology. Non-NVIDIA companies that order SOCAM products cause both LPDDR demand and prices to rise because SOCAM production depends on LPDDR.
Samsung Electronics has reportedly secured orders for 10 billion Gb of the 20 billion Gb SOCAM2 volume NVIDIA intends to deploy this year. Samsung is increasing its 1b DRAM SOCAM2 production processes while simultaneously producing 1c DRAM for HBM4 to satisfy current market needs.
Mobile devices, which traditionally use LPDDR technology, are now experiencing market shifts due to this transformation. IT device manufacturers are forced to decrease product specifications because they cannot access stock or cope with skyrocketing prices.
