NVIDIA's next-generation GPU is equipped with the world's first HBM3e memory, increasing local GPU m
According to industry reports, currently most large models use NVIDIA's GPU chips. TrendForce predicts that global AI chip shipments will increase by 46% by 2023. NVIDIA GPUs are the mainstream choice in the AI server market, with a market share of about 60% to 70%.
Compared to the previous generation products, NVIDIA's new GH200 has basically the same "genes". It still features a 72-core Arm Neoverse V2 Grace CPU, Hopper GPU, and NVLink-C2C interconnect with a bandwidth of 900GB/s. However, the difference lies in the inclusion of the world's first HBM3e memory. The new chip no longer comes with the 96GB HBM3 vRAM and 480GB LPDDR5x DRAM found in the spring models of this year, but instead includes 500GB of LPDDR5X and 141GB of HBM3e memory, achieving a data throughput of 5TB/s.
In summary, this is the world's first chip equipped with HBM3e memory, which can increase local GPU memory by 50%. This is a special upgrade designed for the artificial intelligence market, as top generative AIs often have large sizes but limited memory capacity.
NVIDIA has stated that its latest GPU chip is equipped with the world's first HBM3e memory, which increases its local GPU memory by 50%. This is a specific upgrade for the artificial intelligence market, as top generative AIs often have large sizes but limited memory capacity.
According to the latest report from TrendForce, it is predicted that by 2024, market demand will significantly shift towards HBM3, while the demand for HBM2e is expected to decrease. Currently, SK Hynix is the main supplier of HBM3, while Samsung focuses on meeting orders from other cloud service providers. Micron plans to focus on developing HBM3e products, but its market share may slightly decline due to different customer compositions and the squeeze effect.
According to industry reports, Samsung plans to start production of HBM3 from the end of this year and plans to invest billions of Korean won to increase the HBM capacity at its Cheonan plant. Starting from the fourth quarter, Samsung's HBM3 will also be supplied to NVIDIA. Currently, SK Hynix exclusively supplies high-end GPU HBM chips to NVIDIA.
NVIDIA officials have stated that their latest GH200 product will not be in production until the second quarter of next year, and the price has not been announced yet. One important reason is that HBM3e will only be available for supply next year. Market reports indicate that Samsung and SK Hynix are expected to release HBM3E samples in the first quarter of next year and start mass production in the second half of 2024. Micron, on the other hand, chooses to skip HBM3 and directly develop HBM3e. By then, with the new NVIDIA chips, AI large models are expected to usher in a new round of breakthroughs.
Based on the observation of HBM supply and demand changes by TrendForce, it is estimated that by 2024, with various manufacturers actively expanding production strategies, the HBM supply-demand ratio is expected to improve, with an estimated change from -2.4% in 2023 to 0.6%.
lu/Tg2D68eZGv1a7uJ/EyhfXsQfmqTrWaX0YR7QOBsGsKJ8z+qQwPwxcpWLR9NBvLPwzsfUF9JXOtboN/XrBh/6nzDxMTExMzkeXDEKK/ZVRm4bPEFx9fPHX6wIbV08e9+4pRKxqloLDrido+R47pjxOLvH/2yMap37T1lXiEnEDamSa1qn0MhSzoRRKN3POnluPQLQmLX8nGP4ZBwduqU6b1T4fuWPNl5JzViGgTqmNh2t1t0cGSJjSzibNfGMr8J7Hf1fdk1+CKVpTfgGLmNibpzw/zVwQxa34dCWPLMIHlDAo/V5nKg7alOVHEjGAVQkTZfv6zQC0IyVQ5RHQ8nvGanlX9yxrh+0eeIHlNSPoJgI7NoYxq7EPSO6+xWcpAnqFTE2OvPTYUNCNInRAxe80rGhCsAYjyjcG+mmYYnYWCFvQmiUgTAJ2xLZiUW+0kskWz+VWmwxN+KhI0JRmFVTGUL7aV3ALE3PkhGqaLSkNR7f1Iqh8TAfFqF4nO8yc7kn/H5otcBhlR6tEkRkZXAPFSuJuA8s462tXxFgrrnCQRwNA8IfDBh0Ya/RfpSLnSl0lbKwM8WEMtWp6U0UXAPRXdBHSuLq9VTc6jwNsMJBX2iIEpQ3wp+iQi7blgJhVvs3CuDVaH8HMotMo5fje4CVj4s1GbKm5HkW9UJoF2N8XAjD8CiFrfQOrMpkw8/mGBjl2dTCpQYx+6EJjYyV3A5AhNKjPPIVTau0RSt4tiYN7iqgT1jyC9cyAT6QsnC5Sta96vXzWwnKeZVCea31yHS4Gr/ATI/cIlwt2VNcg4LhvFnmUiAQg7LQbKMY2kouruRpZzDCygwWMmiOh4fGL39rmzSSeOHDly5IiB773Xp33LehUkbtKATHQtUroIUPBneEuuzWa7CLYBGtTtCQp+qzGZ1HCHLAQ64iI8AcDYdJfM5KSFid9qVszzMzOfP7p35cT2OV+3reApcah5FbnKLFOrc5JpWcjFMsN5Jn5ySvw9rvGpPIJS5WJZyOQYQ5aOMnsOuLWM5oQcQ9HlCQYigOB1BUIgWpdHduw9JcGJTJ80ZAL9s8QilPOe31rat6aelXGqk1XG/XMHYlZMZfj3SB8uOZumTCWfsiiVKmne1CJnbjpw8amTyaNa/BRI4jPq76lFL8+kSl3511TSKb2Javw8lf2szTG7j5+7/czBIrOF1ui/tQuH8aEUEDA/XwxEp82OrDP7sil/QCFF2uMmN9WzaX4XWcrJu3+MbBViAQE3UsUHAq3pNNVaCYo11+o6fF0yA1t/VSP1PUW1zgxK1ZcPea3byD35dI7vJY0JvY7iywu8KcB/wnNBuP7OBiKzFIRojx9TkYXhJ2SZML1VeSMIOlWmuW2h0p+kmk8AAJJf+5gCKpyhET4HqRaAsqUKI1Oo8JCHtujGygrAtI90FOAxJFFxO/zZeK9QFGLhnvYSXchVBgW72+hB3F+cCgOAKpvodvlqxCGVATANzqC621Bb/M+gIm+2owFT1D2l3WjCBhqcVRbinb4Gqqh8OsfqIBBZDaBVEtX5ui4a+G6myuirLW2tysArbSQK0HW8KCsr9y1G0OuBwjDpIz2FfgXSb6oEWuOxgepGE1cNPsijwe+15Zs8heDFrjoKgEa7HIrCIaykqEcKwye9KCpcobsbDmq3hE43Vqa51cxlq/GEaq5RU/5ExT4YZKaBoOW5ivrRwAgMfRMUhifrkXV5RuWcpFe9fToqGOSkedbFZQs4TLXJX1OWKAdTfyxLA2UnPlfSJD0r0EeccihLnudNNKyA6m44qN5RBm9SpfZw2SwLqY5Uc5Ewd0kVGjB/mqhGAHWnpCgKU7sRzUDqrWYtauWg6u6ywSiqUyGaMsGhIHRsbyxRgL7bSadiBgNPz/ZrnzgVhP9YCPw2URUMg5cfBrNX+cCKNWozDZ1Oda+hpnySrSTEM2/QAIRuLFRI3ltcADxbTtz7VFaMtSNB0FGq9Eaa1DzHZdLX6jpw2I+zF+/cvf/yndssHxdSPWysKe2tysI7HxhpoPISuzIu1ecEoKvU6sNf18feslqtqRm02Xl5dpkL/kkQeonqejlNqv/INdIHRK26lJSPYj/Qlsr3FIZPx/rSQOBipyKWenB70ejlFxAYWL5O+3bkHT747NPxU5bvOXU9ndnRasW1SKT6x0eTQuOFc1zbGcN1d4Iq+fY7nYPia4znEaVhzl8VaSD4iBLS3wTl6ys3fPuX2zKbJ+2La/Uv1VSTNt0TLu9L4DxZjYJnZ6ISNcbwl6w0zNsaSgNdkxSwxVsFXjSFLrQxwUHFdbdTjdW5BGk9FTdGhWpscqDrA5EOVgWPLifYxUA81c5A4TlbvKSuoJo+P+Qw+dNUTG+kHuMaOPpp1Cojh8qbZXSFwjLY2M981ap+i0H788WQb/b3IIO2iaLlTTarB5Rbz2Sjr4uDn2hUTAA7j78c6BLVuMAk44/qEgBIFUYlCoGY9kMAmWmJYPLKcqCm4U9ZnK/AbrRbt5NDZAq6Rn5rWNjGWKBoXZ/LshCYu7Q2EfQuEOt4bVBVv3UsnlUvpksu1STDS4nAXegiwQ8MCv70guL1zQ7IQqDjYD2ikFtC3ekIKvulzCCzdjGtk6gWe76UeD/HZYp8TuVcGQjEVVblCoG4syqJz3KR0gfo1aablUFOl2Ka3ac6UuZlhNdedJka36Y6XBsoA/+wiVHwtUQAYwSy/2AGtQ2/wyKimDpxVI+qvYxok+Q6WQ7SXGwG1N6Dk4XA44Ek0fnCFC4qA6r72i0e5WOobD1fRkxwMHA8vXmeZWzsM62D2RTx3YChKTpBiOwWJBHPhNkZAurb5gEPw3wqecZLCP9tSC1fm/h6VZORocE4TvMG5BKlDdSzAH23KyIUfEbS/K4oF5uCCkflsOhaDIy00+D5mu6T5zqqGFZ1z9Eda6EH1tGa1ySdxDbKBIxbnXbys48gee2mIAkRoMLmmcgwq3FxHZOo8odJbpPHHKrjwYzaP6W6Hw7sta/cBQL7TD9g3nCPYLfESB+kU6PGD1kkVSvO/wIVXqjrCmUNUKc7zRj1LqD62+TCmOcVJ6+tBBzr7nXyyoskiXgmRO5kT1BhvyUyi7jA4vQzZCrnbIsLZO2uCoYfqaydGL2H1G+BCwOfFHeoJnB9ZY/MyfoqSVSeCIXzfEGFy/yRiywXWYqDdllUmDXcy/V51lUVpCFUBe+L0t2l6Zxe1JUWwDnsAae1PiTfoYi7qoP6GustsSHTIUAYuJ8OU4db3CPoQ4XLvQQZKrkytU4X8aCrxEs/UebyLAIIy2wS4VR9UFfJUrVBlyl3ZWT6oBUJfJpLh5nT60huUTsbVdb7eiaRdCcquzKmFS+kfiwB95ZpPPIne5I0eCTAjY4goiVqoKiDvvtt6aEEO7Le4U9U7QgDdJ7+opo7VP8mFT7sZ2YRkUlln1HRhYExhYi2b83Av0ECB3lVABBKYxz8nvaVhKicmJMtaI6MPPO+AfKBNgaI2XEz3wmtFBgYGOjnTW+RtM/aQx0q7qbD5GU9QyoElvX29vb20hcTFk+FuUe/blK5nI83Q9PHLkDPFLRP8wUB22axcx4IAdJaV5B75tcGELJKGqri1eoU3huYIDpzM+Pj4uLitq9aTT03UPtyP1cHw2wGKOckX4zbv2b16tWrBxZT9TAdYoHt/vENqxmuPOkCVLssb64AAuonyuwuhQGpz7RCbvbfLKAhzh90FNDuPhue2W20L+9LdYCv8hkQ7y9Gt4CFuFqkf+vLYBCx4X1kfreDRGIYmoG8HYvKgZbEBgOtYahNsJw33Iam98SA/lkuFYAEIpZbJTN7HK0HQl3kM+S+LQi0JL0v0JdZKIuV9arbYN4gSIUzLpaQ5h9zkHXWMCOQtruJ3C80Bi1xzPFhALUOyUJlBLkN0CtbDGlIobth/CQdWef/4gmkjc4g99udQFP2VAOmTY7K7lmZTWJAtWPuRuRTZC0vKwukVbch99RInaacaAaMmx53z6DLIzGg97/uRZe7yHxnMJAGLCjk9nyoATREjm0KzBvusGtYoyTtMg6ziWEakelOhJ1H5mcbAqnHBBvyzp1kAQ2xLQsCjlX/StWuVoXaBT5TbEKAecJz9yEoBpkndAVS6aM05O1cGgDa4bz/TQBwtbx30q5ZDtUZJxD4Dk8UAnxGWd2F8isczDK+MBB1voe85d3VQTPst2eE6oCzrsrws9nugccskcDUYe1TWQDw6BGb6xZ4/FqArJ3TLEDaNA65xzUGjXA+3jG2gQQiVhu04p5DsF9VoUU+r/bCec4TCsDSdeYtOz+A6oP3ZsnCPXQ5TEMykfmB6kBaZTtyj+8Eole8nWxlnfiQdfyxvTELxr/TqLwORPVp0OfXbTcfPbXyvFaFaPi/VvKUg2a6mDQreep6ia7O6WQrcXLi2zRNz6RYyVNuduUEg5OtlMlLDFwAPEJ7T9504WGSlThlERVIldoNXnUqIfGZVdyUk3UpqmxNtVKO0WuM1CcRmd/vDKQBCx3cnkZJwpmahDGv7sfa18tiMelAcIOnb7mG4WEc6xiIyjQNowyWqKR64WGUIUCvrxkeRhweaqbR1wyjDH/VwMuvcRhlMz/gbzD7+NUNDyNtVokOAHQe3r4VG4eJG17bQCFVC6P1B41tfR2Z5483kJjG5yDv7LEeUNK29iFkv70sEOr7pSLvwrneUNK2wjpkf6ExkL6egLwLlpSDkraWvwvYxXcH0oankXfh4gpQ0tZjpA2Z3+qhI6myG3nnLCwPJW11UUnIunB/Wx0QBswq5JX4bVkocdvwLjK2x0+oDKSek7KRq/x8TwczlLx991lhxrPirTlF2W7uGB+qB1Lpk2zkmX9jVR9/KIlbtnOfiI6EvaIGT5gwbkCPpmUlIDesRpQL83JsGRnpt+PIz2xcNPHdRhYoGSzp9TpgKPXeuXfu+P4RLUOCgioFUvpaDFDiWdJJUOr/Uv+X+r/U/6X+L/V/qf9L/V/q/1L/u9kAVlA4IBoHAABQWACdASq8AvcAPm0ylkkkIqGhIbFqSIANiWdu4XEej/4B+AHw4wAoUIgH4AfoB/ADezfwH5O69/2f8fPzA6FHgTwF+R/CA0v52/iP5h/kvuH9/HqH8wP9Lf9R1D/MB+y/7ge9D/oP1m92X+A9QX+d/5H//9gf+2/sAfuF6YP7EfBP+3P7bfAl+xH/s6wDqv+gH8A/AD9mf4/+/vf4NHd3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3dzFgPvzDdBgzBatVnMOh5wj13d3d25f7WzLXjzFk+UxXkXFVRgdsHdeam1lKAJnndldfwPPHgXoksk0sZmZmY7Dd+AjxCwZlFRMkKHnzq3fxWJXA/Z5VLpvgfCIkJOozDvTpPf1+tIuDMkQymmIe/uq67qk2s0sYnwlBgF/xTX2LcLZjnpvlOumLWGahu7cmW9SbN7YtoV0dG2MSOrumUZbXq8ej1uHWlG9urpVE+sH4V867gBSzIv+Tvt+ak0T5VKGJVkSQfQ8ftqmRkq+kzMw+DrxrTBrGYhbVPRJynSYW0Up6dW9k6TThvSoJ86YXj63hwDOxnFS7FgAPjbZmZZF03ZQCmCIV4l0kb19QohQ3PvogF7W6iI50PcnH6HXy/NQarfQ4E98j4tfvUv+4bWCvn1I64qJpJCjNR9r5DyvSEVa2W5wr/y+uKiaQ1iffUEXoSShd4A2XlRKPDAeEf3t08GlhXFRNRT4zKiUeGA8I/vbp4NLCuKiainSp3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3d3dzAAP6vdAAAAAAAAAAAABKlpqnWvGKt1VAHOGvMbhagJn5Ejhn72+LBi8VajN0vpFWkSXTP30z5LSJDoQO29V+S666uHjOVqz3sDZ81gL+lsQqOmLHltxSZmx2ZOoIf8n3/iKNQLcM23oFyQqf86B5q/nQPM79DNZ4GlxKpgNEqQbvmb5ywCnr9M/oCYcMgeaDM8EjyDagWf8adWF/RpXceSPAzlCu9Uu5Ks0AYcPdZ/w3dDnfRBOWL4vkmt23uNCOEb63xEhiV3WqX/gtUok7QG+xj6hqPMs30uPMtpOugdiVtvGAf9YeHtHSCLOOns17iNjy6ppUwtQODzswPgHkBFUgMODUzSedzfb6iudxY7W0+5mh//1Zf/+q4v//VOQ78gR5fX2ArPw5Y6L/MuuzlFmUNwmQn//td7xPUzTgF/Bm1oI3zcLebKT2ggw6zfjkfUzZaD1sv8sDaTkrbDVAIzPNRHZM8CO+yrS3SrmM+obk3PiwidycCt1cTLMGaCZMszo5cpzJ1aYzhQrYR5Ej24ipprtGTASDmGXAlYK0tv6vZWhMHVpRtCQLAaX9ad3FYr1U4CO3UNBsqh6bxu4ivE/W9KCLvxQ9gNMn50H5iFHP//nAQCOy5hnI4AC4p5vAUR7sg74dhreP5wYdcRYkXpVccOckQx7Ayd5Y2s9EZhkdVvDtVe7VVQdHdnOev5kDLSXvEo98rvElgqfGzqk5ab36eEY7mM61SB/FveIH+KKu9vVtlofAqu/5TJkvzo5nYXf52a/nVZfnZ3+d7g0QR0fE4bCT6tAGqg0MaYl6lccNLv97l7Xad5j64VzDtYpa+9fx7lArvOfhbkw3uiWzfXU9I5JoUKiLsRnqFpjzMFC+V3CqluBZiY3cRxLXoYOAbDwvapg3AccYgtg6IZQ9q0TKdWYHC8WUu4kSj/zgL9MD+GSF8fK6sBDACYYuEtyb9A9Giycm7f7uy1K5aWLPo1MUbjLWlhaS6DcJwSIKW39/P/D1P//OAjQeHHuQFx9kIFMRfD1cLoNXak9aHvgrpgG0NLkXigun0jFi6gTNAQGR0Cz0vk3mQSgDt1ftg1RbuwCN7WCpmoQPcfJhuEa+w5A4s/mwMn//gqO/ID5LCk+j5uFOGn6hJWs8BiVi3aOy38/RXS11YOrLp/UhjxJ+kWLk1vTqjV7hxhckuIzLzAE9tFrDaaaDO7yW8NPUP508E6LxGtdg2jMdgwpQ1X0jXMc0tvX+l82z6HxEgXcnP/Iu/5pPTZJoU8VUH+9Hm3PvNa663qkfLglQ+AaidU22I/4XUyjHB+fGXCSe2kPaN+wID1etR7NF5DQyM5ADd5r5DHO4kmutsaByqfp2qnNPU0Abb3N8KcxXVYrwl6mC54SxX5OorGH6vDfuy0/sjOw9tInsYMq7sYtMHp61LqEW5ejIE5wi4hXfncBjAaf51BARb5QAAAAAAAAAAAAAAAAA=" src-original="//31753717.s21i.faiusr.com/4/ABUIABAEGAAgu-3ZqQYopKWSqgEwywc41gI.png" natural-width="971" natural-height="342" data-loaded="true">