DRAM


2022-01-10

Impact of Components Shortage on Whole Device Shipments Continues, PCs and Notebooks Least Affected, Says TrendForce

Driven by forces such as the pandemic, geopolitics, and the digital transformation of everyday life, there has been a shortage of global foundry production capacity for nearly two years and shortages have been especially severe for mature 1Xnm~180nm nodes, according to TrendForce’s investigations. Although all foundries are furiously increasing capital expenditures to expand capacity, unrealized future expansion does not ease existing supply issues. In addition, the uneven distribution of supply chain resources that has exacerbated the shortage of parts and components has yet to be definitively alleviated. Circumstances as a whole will continue affecting shipments of related whole devices. Only the PC category is expected to emerge largely unscathed in 1Q22.

Moving into 1Q22, TrendForce states, due to the limited increase in production capacity, the market’s supply situation is expected to be approximately the same as in 4Q21. However, some end products have entered their traditional off-season cycle and the slowdown in demand momentum is expected to alleviate the immediate pressure on OEMs and ODMs regarding supply chain stocking.

In terms of the whole servers, the FPGA delivery cycle is currently at over 50 weeks at most, while the delivery cycle of Lan chips has improved significantly, from the original 50+ weeks to approximately 40 weeks. However, escalating purchase order activity caused by the uncertainty of the pandemic combined with an accumulated backlog of demand (Back order/backlog) have pushed the SMT capacity of ODMs to full load in general. The aforementioned phenomenon have not only accelerated the consumption of ICs such as FPGA and PMIC, but the demand for additional purchase orders of FPGA, PMIC and MOSFET is still compelling. The overall market remains tight and the production of server motherboards in the future may face hidden issues. TrendForce has ascertained a more crucial matter. Taking the L6 server as an example, its production scale in 1Q22 will be roughly the same as the previous quarter. However, whole server shipments will show a seasonal decline with a decrease of approximately 8% QoQ.

In terms of mobile phones, material shortages have gradually eased from the second half of 2021 partly due to the discretionary adjustment of mobile phone specifications. Mobile phone brands can adjust their specifications and configurations based on available materials. Currently, the supply of four components remains relatively tight. Among them, 4G SoC (30-40 weeks) and OLED DDIC/Touch IC (20-22 weeks) have a significant impact on the market. The former will affect brands that focus on selling 4G mobile phones. The latter is affected by oligopolistic market structure and the adjustment of foundry capacity. Thus, there are rumblings of insufficient supply. Though the supply of the remaining two items, PMIC and A+G Sensor, remains tight, material shortage risk can be largely mitigated through alternative material replacements or the adjustment of specifications and configurations. In terms of production, the 1Q22 supply chain will essentially carry on its performance from the previous quarter. However, due to disappointing holiday demand at the end of 2021, mobile phone brands must adjust the distributed inventory level of finished products in a timely manner. Combined with uncertainty caused by disruptions stemming from a winter-time pandemic, 1Q22 production performance is estimated to fall by approximately 13% QoQ.

In terms of PCs and laptops, starting from November 2021, material shortages have been partially alleviated. Therefore, the shipment volume of PC ODMs in 4Q21 has been revised upwards. Compared with mobile phones and whole servers, the impact of under/oversupply of materials on end PCs and notebooks is relatively minor. Except for the SSD PCIe 3.0 controller, current tightness exhibited in component supply is due to delays in the transition of Intel’s new platform. This temporary shortfall has led to a delivery cycle of approximately 8-12 weeks while any tightness in the supply of Type C IC, WiFi, and PMIC is gradually abating. TrendForce expects that, as overall supply chain stability recuperates, notebook shipments from ODM brands in 1Q22 will only decrease by 5.1% QoQ. However, if the component shortage factor is discounted, subsequent sales originating from various distribution channels will be another major variable TrendForce must consider.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

2022-01-04

Latest Assessment of Jan. 3 Earthquake in Taiwan Finds No Significant Impact on Local DRAM and Foundry Fabs, Says TrendForce

An earthquake that was around magnitude 6.0 on the Richter scale occurred off the east coast of Taiwan at 5:46PM local time on January 3, 2022. As most local DRAM and foundry fabs are located in the northern and central parts of the island, TrendForce’s latest investigations reveal no notable damages to the equipment from the fabs. Therefore, the production side is expected to continue normal operation, and the actual impact of the earthquake on the output of Taiwan’s DRAM and foundry industries will likely be limited. Taiwan’s memory fabs, including those operated by MTTW, Nanya, and other smaller semiconductor companies, collectively account for about 21% of the global DRAM production capacity. In the foundry industry, Taiwan’s fabs, including those operated by TSMC, UMC, Vanguard, PSMC, etc., together make up as much as 51% of the global production capacity.

Regarding the current state of the DRAM market, it is in midst of the conventional off-season. However, the recent easing of component gaps in the supply chain is generating some stock-up activities in different application segments and thus bolstering the overall demand. The headwinds of the off-season are not as strong as usual. Also, there are now concerns brewing in the wider memory market about the supply side being affected by the COVID-19 lockdown in the Chinese city of Xi’an. Consequently, memory spot prices have been registering daily hikes lately. It is worth noting that increases in DRAM spot prices have been more significant than the increases in NAND Flash spot prices. Regarding DRAM contract prices, TrendForce for now maintains its original forecast of QoQ drops in the 8-13% range for 1Q22. However, the latest earthquake that struck Taiwan could affect DRAM buyers’ behavior at any time. How contract prices will actually end up is something that requires further observation. As for DRAM spot trading, the memory spot market of Mainland China was still in midst of the year-end holiday on January 3. Hence, spot traders were passive for the most part. TrendForce will continue monitoring the spot market to see if the earthquake is going to be a positive driver going forward.

Turning to the current state of the foundry market, the chip demand related to some categories of end products has slowed down a bit recently because of seasonality. However, demand remains quite strong for chips that were previously in short supply, such as PMIC, Wi-Fi SoC, etc. Foundry fabs on the whole are still operating with a fully loaded capacity because demand continues to outstrip supply. The fabs of Taiwan-based foundries, including TSMC, UMC, PSMC, and Vanguard, are concentrated in Hsinchu, Taichung, and Tainan. In those places, an earthquake intensity scale of 3 or under was recorded. As such, no foundry fab in Taiwan has halted operation because of the earthquake, and all fabs are operating normally at the moment.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

2021-12-13

DRAM ASP Expected to Decline by 8-13% QoQ in 1Q22 Owing to Seasonal Demand Downturn, Says TrendForce

Regarding the shipment of various end products in 4Q21, the quarterly shipment of notebook computers is expected to remain about the same as 3Q21 figures, as prior component gaps were partially resolved during the quarter, according to TrendForce’s latest investigations. As such, since PC OEMs’ DRAM inventory has lowered by several weeks, TrendForce has also further reduced its forecast of DRAM price drops for 1Q22. Even so, the overall demand for DRAM will still enter a cyclical downturn in 1Q22, during which DRAM ASP will also maintain a downward trajectory with an 8-13% QoQ decline. Whether this price drop will subside going forward will depend on how well suppliers manage their inventory pressure and how DRAM purchasers anticipate further price changes.

Decline in PC DRAM prices will narrow somewhat as PC OEMs reduce inventory

Whereas demand for Chromebooks has noticeably slowed down, demand for consumer and commercial notebooks remains strong. Furthermore, certain components which were previously in shortage are starting to experience improved lead times. Hence, quarterly shipment of notebook computers for 4Q21 will likely surpass earlier projections. Looking ahead to 1Q22, not only will the demand side undergo a cyclical downturn, but the sufficiency ratio of PC DRAM will also surpass 3.0% following 4Q21’s high base period for comparison. These factors will result in DRAM prices undergoing a noticeable decline, although PC OEMs will carry a lower inventory of DRAM in 1Q22 compared with 11-13 weeks of inventory in the previous quarter, thereby helping to curb the price drop of PC DRAM products. On the other hand, as mobile DRAM prices begin to drop, certain DRAM suppliers have begun reallocating some of their production capacities from mobile DRAM to PC DRAM. As a result, PC DRAM bit supply will likely undergo a corresponding increase in the short run. In sum, although the above factors are able to provide some upside momentum that narrows the price drop of PC DRAM products, they are not enough to result in an upturn. In particular, DDR4 and DDR5 PC DRAM will experience QoQ declines of 5-10% and 3-8%, respectively, for 1Q22, although the latter product will not noticeably impact the overall PC DRAM ASP, as its penetration rate is still relatively low.

Server DRAM prices will decrease by about 8-13% QoQ due to slowdown in procurement activities

At the moment, CSPs and enterprise clients are carrying about 6-9 weeks and 8-10 weeks of server DRAM inventory, respectively. Although these levels represent a slight decline compared to the end of 3Q21, this decline will not substantially contribute to an increase in demand. Hence, server DRAM buyers will remain relatively conservative with regards to procurement activities before server DRAM prices reach a level that these buyers consider to be rock bottom. DRAM suppliers’ inventory of server DRAM, on the other hand, has been gradually rising in 1H21 owing to decreased demand. Furthermore, certain suppliers have ramped up their wafer input for server DRAM products, leading to an increased production. In addition, while both buyers and sellers have reached a consensus on the falling prices of server DRAM, supply chain-related component gap issues have become gradually resolved, meaning Tier 1 clients will lessen their server DRAM procurement in the upcoming off-season. As a result, suppliers will then be able to fulfill orders that were placed by Tier 2 clients but previously deferred because suppliers prioritized orders from Tier 1 clients. These Tier 2 client orders will provide some upside demand for server DRAM, which is a component that is in relative surplus compared to other components. TrendForce therefore expects server DRAM prices to decrease by 8-13% QoQ in 1Q22, during which server DRAM prices will experience the most severe declines compared to the other quarters in 2022.

Mobile DRAM prices will decline by about 8-13% QoQ in light of intensifying oversupply

Thanks to mobile DRAM suppliers’ aggressive sell-offs in 4Q21, smartphone brands still carry a high level of mobile DRAM inventory as of the end of 2021. Looking ahead to 1Q22, not only will the market welcome the arrival of the traditional off-season, but other issues with the supply of processor chip bundles and the impact of the COVID-19 pandemic will also result in a 10% QoQ drop in smartphone production for the quarter. Smartphone brands will become even more careful with respect to their procurement activities so as to avoid continually accumulating inventory. As smartphone brands revise down their production targets, market demand for mobile DRAM has therefore become weaker now than it was in 1H21, in turn exacerbating the oversupply situation, which is reflected in the persistently rising mobile DRAM inventory of DRAM suppliers. On the whole, the aforementioned issues of high inventory levels and oversupply situation will lead smartphone brands to further conservatize their production and procurement plans in 1Q22. Given that suppliers have suggested a sales strategy of negotiating for 4Q21 and 1Q22 prices collectively, and both buying and selling sides are confronted with inventory pressure, TrendForce thus forecasts an 8-13% QoQ decline in mobile DRAM prices for 1Q22.

Graphics DRAM prices will hold flat while demand improves and spot prices rises ahead of time

The application demand for graphics DRAM has been recovering noticeably in the recent period. Even so, it is worth pointing out that the graphics DRAM market is subject to a very high degree of fluctuations, and this situation is exacerbated by the introduction of the application demand from cryptocurrency mining in recent years. Because the values of cryptocurrencies can swing dramatically, GPU manufacturers such as NVIDIA and AMD have to constantly adjust their sales strategies and switch between bundling and de-bundling. In so doing, they are contributing to the rapid rise and fall of graphics DRAM demand. The graphics DRAM products that the three dominant suppliers are now producing belong to the GDDR6 series. The latest distribution of graphics DRAM output by chip type shows that suppliers are also gradually shifting their focus from 8Gb to 16Gb. Micron, in particular, is the most proactive in this transition. On the other hand, the mainstream graphics cards are still using 8Gb chips at this moment, so the demand for 8Gb graphics DRAM chips has actually increased. In addition, spot prices of both GDDR5 8Gb and GDDR6 8Gb chips have experienced huge price hikes. Due to this uptrend in spot prices, the difference between spot and contract prices is now negligible for graphics DRAM. Some spot transactions even reveal prices that are higher than contract prices. This latest development reflects the situation where buyers are more proactive in price negotiations. Prices of graphics DRAM products on the whole will be fairly constrained from declining further due to the rise in spot prices, the aforementioned demand turnaround, and Micron’s decision to scale back production for 8Gb chips. Taking these factors into account, TrendForce expects that the overall price trend will stay mostly flat.

DDR3 Consumer DRAM prices will drop by about 3-8% QoQ despite reduced supply

The demand for consumer (specialty) DRAM is expected to be relatively weak in 1Q22 due to the effect of the traditional off-season for consumer electronics. Also, demand will stay fairly depressed for TVs, which represent the leading source of in-home entertainment spending. This is because countries around the world will continue in their attempts to lift their pandemic-related restrictions. In addition to these factors, component gaps in the supply chain will still be a serious challenge for device manufacturers. As DRAM components are in excess supply relative to non-memory components, device manufacturers will be less willing to stock up on the former. Suppliers have been slow to scale back production for DDR3 products this year because prices of DDR3 products surged during the first half of the year. However, the downward pressure on prices has now become much more significant, so the two leading South Korean suppliers have taken the initiative to revise their product mix strategies. Hence, they will again transfer more of their mature wafer processing capacity from DDR3 products to CMOS image sensors or logic ICs. Turning to price trend, TrendForce points to the strong correlation between DDR4 consumer DRAM products and PC DRAM products. The latter were the first to experience a weakening of demand, and their prices have already made a downward turn in 4Q21. Looking ahead to 1Q22, contract prices of PC DRAM products will keep falling because of their significant difference with spot prices. This means that DDR4 consumer DRAM products will also suffer sliding prices for 1Q22 with QoQ declines reaching 5-10%. Looking at DDR3 consumer DRAM products, their prices will also drop even as their supply is shrinking. Contract prices of DDR3 2Gb chips are projected fall by 3-8% QoQ on average for 1Q22, whereas DDR3 4Gb chips are projected to register larger declines.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

2021-11-16

DRAM Industry’s Revenue Rises by 10% QoQ for 3Q21 Thanks to Slight Shipment Growth and Ongoing Quote Hikes, Says TrendForce

DRAM buyers were aggressively stocking up during 1H21 because quotes began to rise at the start of the year, and there were concerns about shortages in the supply chain, according to TrendForce’s latest investigations. To avoid the risk of a supply crunch, most DRAM buyers kept raising their demand until the middle of the year. Moving into this second half of the year, the COVID-19 pandemic has exacerbated component gaps, the adverse effect of which on OEMs’ ability to assemble their end products has widened as well. Due to having a glut of memory and a shortage of other key components, some OEMs have opted to scale back DRAM procurement. PC OEMs have especially become noticeably restrained in this regard. Fortunately, the server-related segment of the market has been propping up the overall demand; and because of this, most DRAM suppliers were able to post a marginal growth in shipments for 3Q21. Additionally, quotes for DRAM product also kept rising in 3Q21. On account of these factors, the quarterly total DRAM revenue rose again by 10.2% QoQ to US$26.6 billion for 3Q21.

Regarding 4Q21, DRAM buyers that are already carrying a high level of inventory will probably adopt an even more conservative stance, as OEMs are still affected by component gaps in the supply chain while also preparing for stock-taking at the end of the year. Without adequate demand for support, DRAM prices on the whole are going to make a downward turn in 4Q21 and thereby end this short three-quarter period of cyclical price upturn. Also, since 4Q21 is going to be the first quarter in the general downtrend in quotes, buyers anticipate further price reductions in the future and are more reluctant to stock up in the near term. Declines in quotes will continue to widen as a result. With demand shrinking and prices falling, the DRAM industry will inevitably experience a drop in revenue as well.

DRAM suppliers saw higher profits in 3Q21 because of rising prices and growth in output shares of more advanced process technologies

Looking at the performances of individual DRAM suppliers for 3Q21, the three dominant suppliers all had positive revenue growth but diverged slightly in bit shipments. Samsung and Micron posted a small QoQ increase in their respective bit shipments, whereas SK hynix posted a small QoQ drop. The rise in quotes was able to offset the weakening momentum in bit shipments, so the top three suppliers managed to again raise their revenues from the previous quarter. Samsung’s, Sk hynix’s, and Micron’s QoQ revenue growth rates came to 11%, 8%, and 12% respectively. While their growth rates were still around the 10% level, they were more modest compared with the previous quarter. In the ranking by revenue market share, Samsung remained at the top with its market share expanding further to 44%. SK hynix and Micron were still at second and third place respectively. The former’s market share shrank a bit to 27.2% due to the decline in bit shipments, whereas the latter’s market share grew slightly to 22.9%.

In terms of profitability, 3Q21 saw continuing improvements thanks to rising quotes and growth in the output shares of the more advanced process technologies. Samsung raised its operating margin to 53% in 3Q21 as the share of 1Z nm products in its output kept growing. As such, Samsung’s operating margin reached almost to the high of nearly three years ago. Likewise, SK hynix’s operating margin grew to 47% in 3Q21 because of the increase in the output share of 1Z nm products. As for third-largest supplier Micron, the increase in its ASP for its latest fiscal quarter (June to August) is similar to the increases in the two South Korean suppliers’ respective ASPs for 3Q21. Its operating margin also rose to 42% for this period. Moving into 4Q21, TrendForce expects the slide in DRAM prices to be an inescapable trend. Whether individual suppliers will be able to maintain a high level of profitability depends on their own progress in process migration and yield rate improvement.

While the specialty DRAM market weakened in 3Q21, Taiwanese suppliers trailed closely behind the three dominant suppliers

Compared with mainstream DRAM products, specialty DRAM underwent a higher magnitude of price hikes in 1H21. Hence, as demand for TVs and other consumer electronics fell in 3Q21, and supply chain disruptions persisted, clients in turn reduced their DRAM procurement. This reduced demand indirectly impacted the revenue performances of Taiwanese suppliers, which primarily target the consumer electronics market. Nanya Tech continued to raise its quarterly ASP in order to offset weak shipment. The company’s revenue increased by about 6% QoQ in 3Q21, while its operating profit margin also increased from 31.2% in 2Q21 to 38.1% in 3Q21 due to the price hike. Winbond benefitted from high demand for its low-density (1/2Gb) products and recorded a nearly 13% QoQ increase in DRAM revenue in 3Q21. Among all Taiwanese suppliers, Winbond registered the strongest revenue growth during the quarter.

Nevertheless, TrendForce’s investigations also find that the physical spaces within the two aforementioned Taiwanese suppliers’ fabs are now fully occupied, meaning the suppliers are unable to install additional equipment in these fabs before building new fabs. Hence, these suppliers’ financial performances will be heavily impacted by their ASPs in the short run. For instance, Nanya Tech’s new facilities will not contribute to DRAM production until construction finalizes in 2024. In the short run, Nanya Tech is able to slightly increase its DRAM bit shipment only through migrating to the advanced 1A/1B nm process technologies. Similarly, Winbond will be able to continue expanding its production capacity only after its new fab located in Luzhu, Kaohsiung kicks off mass production in 2H22. As for PSMC, its revenue from sales of PC DRAM products manufactured in-house increased by about 6% QoQ in 3Q21. However, PSMC’s total revenue from both sales of in-house DRAM and its DRAM foundry business increased by 12% QoQ in 3Q21.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

2021-11-15

HBM/CXL Emerge in Response to Demand for Optimized Hardware Used in AI-driven HPC Applications, Says TrendForce

According to TrendForce’s latest report on the server industry, not only have emerging applications in recent years accelerated the pace of AI and HPC development, but the complexity of models built from machine learning applications and inferences that involve increasingly sophisticated calculations has also undergone a corresponding growth as well, resulting in more data to be processed. While users are confronted with an ever-growing volume of data along with constraints placed by existing hardware, they must make tradeoffs among performance, memory capacity, latency, and cost. HBM (High Bandwidth Memory) and CXL (Compute Express Link) have thus emerged in response to the aforementioned conundrum. In terms of functionality, HBM is a new type of DRAM that addresses more diverse and complex computational needs via its high I/O speeds, whereas CXL is an interconnect standard that allows different processors, or xPUs, to more easily share the same memory resources.

HBM breaks through bandwidth limitations of traditional DRAM solutions through vertical stacking of DRAM dies

Memory suppliers developed HBM in order to be free from the previous bandwidth constraints posed by traditional memory solutions. Regarding memory architecture, HBM consists of a base logic die with DRAM dies vertically stacked on top of the logic die. The 3D-stacked DRAM dies are interconnected with TSV and microbumps, thereby enabling HBM’s high-bandwidth design. The mainstream HBM memory stacks involve four or eight DRAM die layers, which are referred to as “4-hi” or “8-hi”, respectively. Notably, the latest HBM product currently in mass production is HBM2e. This generation of HBM contains four or eight layers of 16Gb DRAM dies, resulting in a memory capacity of 8GB or 16GB per single HBM stack, respectively, with a bandwidth of 410-460GB/s. Samples of the next generation of HBM products, named HBM3, have already been submitted to relevant organizations for validation, and these products will likely enter mass production in 2022.

TrendForce’s investigations indicate that HBM comprises less than 1% of total DRAM bit demand for 2021 primarily because of two reasons. First, the vast majority of consumer applications have yet to adopt HBM due to cost considerations. Second, the server industry allocates less than 1% of its hardware to AI applications; more specifically, servers that are equipped with AI accelerators account for less than 1% of all servers currently in use, not to mention the fact that most AI accelerators still use GDDR5(x) and GDDR6 memories, as opposed to HBM, to support their data processing needs.

Although HBM currently remains in the developmental phase, as applications become increasingly reliant on AI usage (more precise AI needs to be supported by more complex models), computing hardware will then require the integration of HBM to operate these applications effectively. In particular, FPGA and ASIC represent the two hardware categories that are most closely related to AI development, with Intel’s Stratix and Agilex-M as well as Xilinx’s Versal HBM being examples of FPGA with onboard HBM. Regarding ASIC, on the other hand, most CSPs are gradually adopting their own self-designed ASICs, such Google’s TPU, Tencent’s Enflame DTU, and Baidu’s Kunlun – all of which are equipped with HBM – for AI deployments. In addition, Intel will also release a high-end version of its Sapphire Rapids server CPU equipped with HBM by the end of 2022. Taking these developments into account, TrendForce believes that an increasing number of HBM applications will emerge going forward due to HBM’s critical role in overcoming hardware-related bottlenecks in AI development.

A new memory standard born out of demand from high-speed computing, CXL will be more effective in integrating resources of whole system

Evolved from PCIe Gen5, CXL is a memory standard that provides high-speed and low-latency interconnections between the CPU and other accelerators such as the GPU and FPGA. It enables memory virtualization so that different devices can share the same memory pool, thereby raising the performance of a whole computer system while reducing its cost. Hence, CXL can effectively deal with the heavy workloads related to AI and HPC applications.

CXL is just one of several interconnection technologies that feature memory sharing. Other examples that are also in the market include NVLink from NVIDIA and Gen-Z from AMD and Xilinx. Their existence is an indication that the major ICT vendors are increasingly attentive to the integration of various resources within a computer system. TrendForce currently believes that CXL will come out on top in the competition mainly because it is introduced and promoted by Intel, which has an enormous advantage with respect to the market share for CPUs. With Intel’s support in the area of processors, CXL advocates and hardware providers that back the standard will be effective in organizing themselves into a supply chain for the related solutions. The major ICT companies that have in turn joined the CXL Consortium include AMD, ARM, NVIDIA, Google, Microsoft, Facebook (Meta), Alibaba, and Dell. All in all, CXL appears to be the most favored among memory protocols.

The consolidation of memory resources among the CPU and other devices can reduce communication latency and boost the computing performance needed for AI and HPC applications. For this reason, Intel will provide CXL support for its next-generation server CPU Sapphire Rapids. Likewise, memory suppliers have also incorporated CXL support into their respective product roadmaps. Samsung has announced that it will be launching CXL-supported DDR5 DRAM modules that will further expand server memory capacity so as to meet the enormous resource demand of AI computing. There is also a chance that CXL support will be extended to NAND Flash solutions in the future, thus benefiting the development of both types of memory products.

Synergy between HBM and CXL will contribute significantly to AI development; their visibility will increase across different applications starting in 2023

TrendForce believes that the market penetration rate of CXL will rise going forward as this interface standard is built into more and more CPUs. Also, the combination of HBM and CXL will be increasingly visible in the future hardware designs of AI servers. In the case of HBM, it will contribute to a further ramp-up of data processing speed by increasing the memory bandwidth of the CPU or the accelerator. As for CXL, it will enable high-speed interconnections among CPU and other devices. By working together, HBM and CXL will raise computing power and thereby expedite the development of AI applications.

The latest advances in memory pooling and sharing will help overcome the current hardware bottlenecks in the designs of different AI models and continue the trend of more sophisticated architectures. TrendForce anticipates that the adoption rate of CXL-supported Sapphire Rapids processors will reach a certain level, and memory suppliers will also have put their HBM3 products and their CXL-supported DRAM and SSD products into mass production. Hence, examples of HBM-CXL synergy in different applications will become increasingly visible from 2023 onward.

For more information on reports and market data from TrendForce’s Department of Semiconductor Research, please click here, or email Ms. Latte Chung from the Sales Department at lattechung@trendforce.com

  • Page 1
  • 6 page(s)
  • 26 result(s)