{"id":30408,"date":"2022-09-20T09:45:00","date_gmt":"2022-09-20T16:45:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=30408"},"modified":"2022-09-19T11:02:57","modified_gmt":"2022-09-19T18:02:57","slug":"nvidia-hopper-in-full-production","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/","title":{"rendered":"NVIDIA Hopper in Full Production"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

NVIDIA today announced that the NVIDIA H100 Tensor Core GPU<\/a> is in full production, with global tech partners planning in October to roll out the first wave of products and services based on the groundbreaking NVIDIA Hopper\u2122 architecture.<\/p>\n\n\n\n

Unveiled in April, H100 is built with 80 billion transistors and benefits from a range of technology breakthroughs. Among them are the powerful new Transformer Engine<\/a> and an NVIDIA NVLink\u00ae<\/a> interconnect to accelerate the largest AI models, like advanced recommender systems and large language models, and to drive innovations in such fields as conversational AI and drug discovery.<\/p>\n\n\n\n

\u201cHopper is the new engine of AI factories, processing and refining mountains of data to train models with trillions of parameters that are used to drive advances in language-based AI, robotics, healthcare and life sciences,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cHopper\u2019s Transformer Engine boosts performance up to an order of magnitude, putting large-scale AI and HPC within reach of companies and researchers.”<\/p><\/blockquote>\n\n\n\n

In addition to Hopper\u2019s architecture and Transformer Engine, several other key innovations<\/a> power the H100 GPU to deliver the next massive leap in NVIDIA\u2019s accelerated compute data center platform, including second-generation Multi-Instance GPU, confidential computing, fourth-generation NVIDIA NVLink and DPX Instructions.<\/p>\n\n\n\n

A five-year license for the NVIDIA AI Enterprise<\/a> software suite is now included with H100 for mainstream servers. This optimizes the development and deployment of AI workflows and ensures organizations have access to the AI frameworks and tools needed to build AI chatbots, recommendation engines, vision AI and more. <\/p>\n\n\n\n

Global Rollout of Hopper<\/strong><\/p>\n\n\n\n

H100 enables companies to slash costs for deploying AI, delivering the same AI performance with 3.5x more energy efficiency and 3x lower total cost of ownership, while using 5x fewer server nodes over the previous generation.<\/p>\n\n\n\n

For customers who want to immediately try the new technology, NVIDIA announced that H100 on Dell PowerEdge servers is now available on NVIDIA LaunchPad<\/a>, which provides free hands-on labs, giving companies access to the latest hardware and NVIDIA AI software.<\/p>\n\n\n\n

Customers can also begin ordering NVIDIA DGX\u2122 H100 systems<\/a>, which include eight H100 GPUs and deliver 32 petaflops of performance at FP8 precision. NVIDIA Base Command<\/a>\u2122 and NVIDIA AI Enterprise software power every DGX system, enabling deployments from a single node to an NVIDIA DGX SuperPOD<\/a>\u2122 supporting advanced AI development of large language models and other massive workloads.<\/p>\n\n\n\n

H100-powered systems from the world\u2019s leading computer makers are expected to ship in the coming weeks, with over 50 server models in the market by the end of the year and dozens more in the first half of 2023. Partners building systems include Atos, Cisco, Dell Technologies, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Lenovo and Supermicro.<\/p>\n\n\n\n

Additionally, some of the world\u2019s leading higher education and research institutions will be using H100 to power their next-generation supercomputers. Among them are the Barcelona Supercomputing Center, Los Alamos National Lab, Swiss National Supercomputing Centre (CSCS), Texas Advanced Computing Center and the University of Tsukuba.<\/p>\n\n\n\n

H100 Coming to the Cloud<\/strong><\/p>\n\n\n\n

Amazon Web Services, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure will be among the first to deploy H100-based instances in the cloud starting next year.<\/p>\n\n\n\n

\u201cWe look forward to enabling the next-generation of AI models on the latest H100 GPUs in Microsoft Azure,\u201d said Nidhi Chappell, general manager of Azure AI Infrastructure. \u201cWith the advancements in Hopper architecture coupled with our investments in Azure AI supercomputing, we\u2019ll be able to help accelerate the development of AI worldwide\u201d<\/p><\/blockquote>\n\n\n\n

\u201cBy offering our customers the latest H100 GPUs from NVIDIA, we\u2019re helping them accelerate their most complex machine learning and HPC workloads,\u201d said Karan Batta, vice president of product management at Oracle Cloud Infrastructure. \u201cAdditionally, using NVIDIA\u2019s next generation of H100 GPUs allows us to support our demanding internal workloads and helps our mutual customers with breakthroughs across healthcare, autonomous vehicles, robotics and
IoT.\u201d<\/p><\/blockquote>\n\n\n\n

NVIDIA Software Support<\/strong><\/p>\n\n\n\n

The advanced Transformer Engine technology of H100 enables enterprises to quickly develop large language models with a higher level of accuracy. As these models continue to grow in scale, so does the complexity, sometimes requiring months to train.<\/p>\n\n\n\n

To tackle this, some of the world\u2019s leading large language model and deep learning frameworks are being optimized on H100, including NVIDIA NeMo Megatron<\/a>, Microsoft DeepSpeed, Google JAX, PyTorch, TensorFlow and XLA. These frameworks combined with Hopper architecture will significantly speed up AI performance to help train large language models within days or hours.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

NVIDIA today announced that the NVIDIA H100 Tensor Core GPU is in full production, with global tech partners planning in October to roll out the first wave of products and services based on the groundbreaking NVIDIA Hopper\u2122 architecture.<\/p>\n","protected":false},"author":10513,"featured_media":17071,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,64,180,268,56],"tags":[865,263,1210,96],"acf":[],"yoast_head":"\nNVIDIA Hopper in Full Production - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NVIDIA Hopper in Full Production - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"NVIDIA today announced that the NVIDIA H100 Tensor Core GPU is in full production, with global tech partners planning in October to roll out the first wave of products and services based on the groundbreaking NVIDIA Hopper\u2122 architecture.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2022-09-20T16:45:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-19T18:02:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2017\/02\/Nvidia_Logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"138\" \/>\n\t<meta property=\"og:image:height\" content=\"110\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/\",\"url\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/\",\"name\":\"NVIDIA Hopper in Full Production - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2022-09-20T16:45:00+00:00\",\"dateModified\":\"2022-09-19T18:02:57+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NVIDIA Hopper in Full Production\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NVIDIA Hopper in Full Production - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/","og_locale":"en_US","og_type":"article","og_title":"NVIDIA Hopper in Full Production - insideBIGDATA","og_description":"NVIDIA today announced that the NVIDIA H100 Tensor Core GPU is in full production, with global tech partners planning in October to roll out the first wave of products and services based on the groundbreaking NVIDIA Hopper\u2122 architecture.","og_url":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2022-09-20T16:45:00+00:00","article_modified_time":"2022-09-19T18:02:57+00:00","og_image":[{"width":138,"height":110,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2017\/02\/Nvidia_Logo.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/","url":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/","name":"NVIDIA Hopper in Full Production - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2022-09-20T16:45:00+00:00","dateModified":"2022-09-19T18:02:57+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"NVIDIA Hopper in Full Production"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2017\/02\/Nvidia_Logo.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-7Us","jetpack-related-posts":[{"id":31892,"url":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","url_meta":{"origin":30408,"position":0},"title":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows","date":"March 21, 2023","format":false,"excerpt":"NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU \u2014 the powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.\u00a0","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28784,"url":"https:\/\/insidebigdata.com\/2022\/03\/22\/nvidia-announces-hopper-architecture-the-next-generation-of-accelerated-computing\/","url_meta":{"origin":30408,"position":1},"title":"NVIDIA Announces Hopper Architecture, the Next Generation of Accelerated Computing","date":"March 22, 2022","format":false,"excerpt":"To power the next wave of AI data centers, NVIDIA today announced its next-generation accelerated computing platform with NVIDIA Hopper\u2122 architecture, delivering an order of magnitude performance leap over its predecessor. Named for Grace Hopper, a pioneering U.S. computer scientist, the new architecture succeeds the NVIDIA Ampere architecture, launched two\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":33862,"url":"https:\/\/insidebigdata.com\/2023\/11\/13\/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform\/","url_meta":{"origin":30408,"position":2},"title":"NVIDIA Supercharges Hopper, the World\u2019s Leading AI Computing Platform","date":"November 13, 2023","format":false,"excerpt":"NVIDIA today announced it has supercharged the world\u2019s leading AI computing platform with the introduction of the NVIDIA HGX\u2122 H200. Based on NVIDIA Hopper\u2122 architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced memory to handle massive amounts of data for generative AI and high performance computing\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/AI_shutterstock_2287025875_special-1.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":31899,"url":"https:\/\/insidebigdata.com\/2023\/03\/22\/nvidia-launches-inference-platforms-for-large-language-models-and-generative-ai-workloads\/","url_meta":{"origin":30408,"position":3},"title":"NVIDIA Launches Inference Platforms for Large Language Models and Generative AI Workloads","date":"March 22, 2023","format":false,"excerpt":"NVIDIA launched four inference platforms optimized for a diverse set of rapidly emerging generative AI applications \u2014 helping developers quickly build specialized, AI-powered applications that can deliver new services and insights. The platforms combine NVIDIA\u2019s full stack of inference software with the latest NVIDIA Ada, NVIDIA Hopper\u2122 and NVIDIA Grace\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":30844,"url":"https:\/\/insidebigdata.com\/2022\/11\/08\/coreweave-among-first-cloud-providers-to-offer-nvidia-hgx-h100-supercomputers-set-to-transform-ai-landscape\/","url_meta":{"origin":30408,"position":4},"title":"CoreWeave Among First Cloud Providers to Offer NVIDIA HGX H100 Supercomputers Set to Transform AI Landscape","date":"November 8, 2022","format":false,"excerpt":"CoreWeave, a specialized cloud provider built for large-scale GPU-accelerated workloads, announced it is among the first to offer cloud instances with NVIDIA HGX H100 supercomputing. CoreWeave, Amazon, Google, Microsoft and Oracle are the first cloud providers included in the launch of this groundbreaking AI platform.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":29436,"url":"https:\/\/insidebigdata.com\/2022\/05\/24\/introducing-vultr-talon-with-nvidia-gpus-cloud-platform-breakthrough-makes-accelerated-computing-efficient-and-affordable\/","url_meta":{"origin":30408,"position":5},"title":"Introducing Vultr Talon with NVIDIA GPUs \u2014 Cloud Platform Breakthrough Makes Accelerated Computing Efficient and Affordable","date":"May 24, 2022","format":false,"excerpt":"Vultr\u00ae, a leading independent provider of cloud infrastructure, announced that Vultr Talon, powered by NVIDIA GPUs and NVIDIA AI Enterprise software, is now available in beta. A breakthrough cloud-based platform, Vultr Talon offers affordable accelerated computing by enabling GPU sharing, so multiple workloads can efficiently run on a single NVIDIA\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/05\/Vultr_fig1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/30408"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=30408"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/30408\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/17071"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=30408"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=30408"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=30408"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}