{"id":33862,"date":"2023-11-13T06:00:00","date_gmt":"2023-11-13T14:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=33862"},"modified":"2023-11-09T10:25:44","modified_gmt":"2023-11-09T18:25:44","slug":"nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/","title":{"rendered":"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

NVIDIA<\/a> today announced it has supercharged the world\u2019s leading AI computing platform with the introduction of the NVIDIA HGX\u2122 H200. Based on NVIDIA Hopper\u2122 architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced memory to handle massive amounts of data for generative AI and high performance computing workloads.<\/p>\n\n\n\n

The NVIDIA H200 is the first GPU to offer HBM3e \u2014 faster, larger memory to fuel the acceleration of generative AI and large language models, while advancing scientific computing for HPC workloads. With HBM3e, the NVIDIA H200 delivers 141GB of memory at 4.8 terabytes per second, nearly double the capacity and 2.4x more bandwidth compared with its predecessor, the NVIDIA A100.<\/p>\n\n\n\n

H200-powered systems from the world\u2019s leading server manufacturers and cloud service providers are expected to begin shipping in the second quarter of 2024.<\/p>\n\n\n\n

\u201cTo create intelligence with generative AI and HPC applications, vast amounts of data must be efficiently processed at high speed using large, fast GPU memory,\u201d said Ian Buck, vice president of hyperscale and HPC at NVIDIA. \u201cWith NVIDIA H200, the industry\u2019s leading end-to-end AI supercomputing platform just got faster to solve some of the world\u2019s most important challenges.\u201d<\/em><\/p>\n\n\n\n

Perpetual Innovation, Perpetual Performance Leaps<\/strong><\/p>\n\n\n

\n
\"\"
NVIDIA Grace Hopper<\/figcaption><\/figure><\/div>\n\n\n

The NVIDIA Hopper architecture delivers an unprecedented performance leap over its predecessor and continues to raise the bar through ongoing software enhancements with H100, including the recent release of powerful open-source libraries like NVIDIA TensorRT\u2122-LLM<\/a>.<\/p>\n\n\n\n

The introduction of H200 will lead to further performance leaps, including nearly doubling inference speed on Llama 2, a 70 billion-parameter LLM, compared to the H100. Additional performance leadership and improvements with H200 are expected with future software updates.<\/p>\n\n\n\n

NVIDIA H200 Form Factors<\/strong><\/p>\n\n\n\n

NVIDIA H200 will be available in NVIDIA HGX H200 server boards with four- and eight-way configurations, which are compatible with both the hardware and software of HGX H100 systems. It is also available in the NVIDIA GH200 Grace Hopper\u2122 Superchip with HBM3e<\/a>, announced in August.<\/p>\n\n\n

\n
\"\"
NVIDIA H200<\/figcaption><\/figure><\/div>\n\n\n

With these options, H200 can be deployed in every type of data center, including on premises, cloud, hybrid-cloud and edge. NVIDIA\u2019s global ecosystem of partner server makers \u2014 including ASRock Rack, ASUS, Dell Technologies, Eviden, GIGABYTE, Hewlett Packard Enterprise, Lenovo, QCT, Supermicro, Wistron and Wiwynn \u2014 can update their existing systems with an H200.\u00a0<\/p>\n\n\n\n

Amazon Web Services, Google Cloud and Oracle Cloud Infrastructure will be among the first cloud service providers to deploy H200-based instances starting next year, in addition to CoreWeave, Lambda and Vultr. <\/p>\n\n\n\n

Powered by NVIDIA NVLink\u2122 and NVSwitch\u2122 high-speed interconnects, HGX H200 provides the highest performance on various application workloads, including LLM training and inference for the largest models beyond 175 billion parameters.<\/p>\n\n\n\n

An eight-way HGX H200 provides over 32 petaflops of FP8 deep learning compute and 1.1TB of aggregate high-bandwidth memory for the highest performance in generative AI and HPC applications.<\/p>\n\n\n\n

When paired with NVIDIA Grace\u2122 CPUs with an ultra-fast NVLink-C2C interconnect, the H200 creates the GH200 Grace Hopper Superchip with HBM3e \u2014 an integrated module designed to serve giant-scale HPC and AI applications.<\/p>\n\n\n\n

Accelerate AI With NVIDIA Full-Stack Software<\/strong><\/p>\n\n\n\n

NVIDIA\u2019s accelerated computing platform is supported by powerful software tools that enable developers and enterprises to build and accelerate production-ready applications from AI to HPC. This includes the NVIDIA AI Enterprise<\/a> suite of software for workloads such as speech, recommender systems and hyperscale inference.<\/p>\n\n\n\n

Availability<\/strong><\/p>\n\n\n\n

The NVIDIA H200 will be available from global system manufacturers and cloud service providers starting in the second quarter of 2024.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

NVIDIA today announced it has supercharged the world\u2019s leading AI computing platform with the introduction of the NVIDIA HGX\u2122 H200. Based on NVIDIA Hopper\u2122 architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced memory to handle massive amounts of data for generative AI and high performance computing workloads.<\/p>\n","protected":false},"author":10513,"featured_media":32645,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,182,180,258,67,268,56,1],"tags":[865,263,1416,1415,96],"acf":[],"yoast_head":"\nNVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"NVIDIA today announced it has supercharged the world\u2019s leading AI computing platform with the introduction of the NVIDIA HGX\u2122 H200. Based on NVIDIA Hopper\u2122 architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced memory to handle massive amounts of data for generative AI and high performance computing workloads.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-13T14:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-09T18:25:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/AI_shutterstock_2287025875_special-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1100\" \/>\n\t<meta property=\"og:image:height\" content=\"550\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/\",\"name\":\"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-11-13T14:00:00+00:00\",\"dateModified\":\"2023-11-09T18:25:44+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/","og_locale":"en_US","og_type":"article","og_title":"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform - insideBIGDATA","og_description":"NVIDIA today announced it has supercharged the world\u2019s leading AI computing platform with the introduction of the NVIDIA HGX\u2122 H200. Based on NVIDIA Hopper\u2122 architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced memory to handle massive amounts of data for generative AI and high performance computing workloads.","og_url":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-11-13T14:00:00+00:00","article_modified_time":"2023-11-09T18:25:44+00:00","og_image":[{"width":1100,"height":550,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/AI_shutterstock_2287025875_special-1.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/","url":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/","name":"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-11-13T14:00:00+00:00","dateModified":"2023-11-09T18:25:44+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/AI_shutterstock_2287025875_special-1.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8Oa","jetpack-related-posts":[{"id":28784,"url":"https:\/\/insidebigdata.com\/2022\/03\/22\/nvidia-announces-hopper-architecture-the-next-generation-of-accelerated-computing\/","url_meta":{"origin":33862,"position":0},"title":"NVIDIA Announces Hopper Architecture, the Next Generation of Accelerated Computing","date":"March 22, 2022","format":false,"excerpt":"To power the next wave of AI data centers, NVIDIA today announced its next-generation accelerated computing platform with NVIDIA Hopper\u2122 architecture, delivering an order of magnitude performance leap over its predecessor. Named for Grace Hopper, a pioneering U.S. computer scientist, the new architecture succeeds the NVIDIA Ampere architecture, launched two\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":21259,"url":"https:\/\/insidebigdata.com\/2018\/10\/10\/oracle-nvidia-bring-power-cloud-next-generation-analytics-machine-learning-ai\/","url_meta":{"origin":33862,"position":1},"title":"Oracle and NVIDIA Bring the Power of the Cloud to the Next Generation of Analytics, Machine Learning and AI","date":"October 10, 2018","format":false,"excerpt":"Oracle (NYSE:ORCL) and NVIDIA (NASDAQ: NVDA) today announced that Oracle is the first public cloud provider to support the NVIDIA HGX-2TM platform on Oracle Cloud Infrastructure, to meet the needs of the next generation of analytics, machine learning and AI.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":31899,"url":"https:\/\/insidebigdata.com\/2023\/03\/22\/nvidia-launches-inference-platforms-for-large-language-models-and-generative-ai-workloads\/","url_meta":{"origin":33862,"position":2},"title":"NVIDIA Launches Inference Platforms for Large Language Models and Generative AI Workloads","date":"March 22, 2023","format":false,"excerpt":"NVIDIA launched four inference platforms optimized for a diverse set of rapidly emerging generative AI applications \u2014 helping developers quickly build specialized, AI-powered applications that can deliver new services and insights. The platforms combine NVIDIA\u2019s full stack of inference software with the latest NVIDIA Ada, NVIDIA Hopper\u2122 and NVIDIA Grace\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":30844,"url":"https:\/\/insidebigdata.com\/2022\/11\/08\/coreweave-among-first-cloud-providers-to-offer-nvidia-hgx-h100-supercomputers-set-to-transform-ai-landscape\/","url_meta":{"origin":33862,"position":3},"title":"CoreWeave Among First Cloud Providers to Offer NVIDIA HGX H100 Supercomputers Set to Transform AI Landscape","date":"November 8, 2022","format":false,"excerpt":"CoreWeave, a specialized cloud provider built for large-scale GPU-accelerated workloads, announced it is among the first to offer cloud instances with NVIDIA HGX H100 supercomputing. CoreWeave, Amazon, Google, Microsoft and Oracle are the first cloud providers included in the launch of this groundbreaking AI platform.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":31892,"url":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","url_meta":{"origin":33862,"position":4},"title":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows","date":"March 21, 2023","format":false,"excerpt":"NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU \u2014 the powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.\u00a0","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":29436,"url":"https:\/\/insidebigdata.com\/2022\/05\/24\/introducing-vultr-talon-with-nvidia-gpus-cloud-platform-breakthrough-makes-accelerated-computing-efficient-and-affordable\/","url_meta":{"origin":33862,"position":5},"title":"Introducing Vultr Talon with NVIDIA GPUs \u2014 Cloud Platform Breakthrough Makes Accelerated Computing Efficient and Affordable","date":"May 24, 2022","format":false,"excerpt":"Vultr\u00ae, a leading independent provider of cloud infrastructure, announced that Vultr Talon, powered by NVIDIA GPUs and NVIDIA AI Enterprise software, is now available in beta. A breakthrough cloud-based platform, Vultr Talon offers affordable accelerated computing by enabling GPU sharing, so multiple workloads can efficiently run on a single NVIDIA\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/05\/Vultr_fig1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33862"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=33862"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33862\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/32645"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=33862"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=33862"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=33862"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}