{"id":31892,"date":"2023-03-21T09:15:00","date_gmt":"2023-03-21T16:15:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=31892"},"modified":"2023-03-21T14:15:45","modified_gmt":"2023-03-21T21:15:45","slug":"nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","title":{"rendered":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows"},"content":{"rendered":"\n<p>NVIDIA and key partners today announced the availability of new products and services featuring the <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/h100\/\" target=\"_blank\" rel=\"noreferrer noopener\">NVIDIA H100 Tensor Core GPU<\/a> \u2014 the powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.&nbsp;<\/p>\n\n\n\n<p><a href=\"https:\/\/blogs.oracle.com\/cloud-infrastructure\/post\/limited-availability-oci-compute-nvidia-h100\">Oracle Cloud Infrastructure<\/a> (OCI) announced the limited availability of new OCI Compute bare-metal GPU instances featuring H100 GPUs. Additionally, Amazon Web Services announced its forthcoming EC2 UltraClusters of Amazon EC2 P5 instances, which can scale in size up to 20,000 interconnected H100 GPUs. This follows <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/azure-previews-powerful-and-scalable-virtual-machine-to-help-customers-accelerate-ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Azure<\/a>\u2019s private preview announcement last week for its H100 virtual machine, ND H100 v5.&nbsp;<\/p>\n\n\n\n<p>Additionally, Meta has now deployed its H100-powered Grand Teton AI supercomputer internally for its AI production and research teams.<\/p>\n\n\n\n<p>NVIDIA founder and CEO Jensen Huang announced during his GTC keynote today that <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/dgx-h100\/\" target=\"_blank\" rel=\"noreferrer noopener\">NVIDIA DGX\u2122 H100<\/a> AI supercomputers are in full production and will be coming soon to enterprises worldwide.&nbsp;<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cGenerative AI\u2019s incredible potential is inspiring virtually every industry to reimagine its business strategies and the technology required to achieve them,\u201d said Huang. \u201cNVIDIA and our partners are moving fast to provide the world\u2019s most powerful AI computing platform to those building applications that will fundamentally transform how we live, work and play.\u201d<\/p>\n<\/blockquote>\n\n\n\n<p><strong>Hopper Architecture Accelerates AI<\/strong><\/p>\n\n\n\n<p>The H100, based on the NVIDIA Hopper\u2122 GPU computing architecture with its built-in Transformer Engine, is optimized for developing, training and deploying generative AI, large language models (LLMs) and recommender systems. This technology makes use of the H100\u2019s FP8 precision and offers 9x faster AI training and up to 30x faster AI inference on LLMs versus the prior-generation A100. The H100 began shipping in the fall in individual and select board units from global manufacturers.&nbsp;<\/p>\n\n\n\n<p>The NVIDIA DGX H100 features eight H100 GPUs connected with NVIDIA NVLink\u00ae high-speed interconnects and integrated NVIDIA Quantum InfiniBand and Spectrum\u2122 Ethernet networking. This platform provides 32 petaflops of compute performance at FP8 precision, with 2x faster networking than the prior generation, helping maximize energy efficiency in processing large AI workloads.&nbsp;<\/p>\n\n\n\n<p>DGX H100 also features the complete NVIDIA AI software stack, enabling enterprises to seamlessly run and manage their AI workloads at scale. This offering includes the latest version of <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/products\/ai-enterprise\/\">NVIDIA AI Enterprise<\/a>, <a href=\"https:\/\/developer.nvidia.com\/blog\/catapulting-enterprises-to-the-leading-edge-of-ai-with-ai-enterprise-3-1\/\" target=\"_blank\" rel=\"noreferrer noopener\">announced<\/a> separately today, as well as <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/base-command\/\" target=\"_blank\" rel=\"noreferrer noopener\">NVIDIA Base Command<\/a>\u2122, the operating system of the DGX data center, which coordinates AI training and operations across the NVIDIA DGX platform to simplify and streamline AI development.&nbsp;<\/p>\n\n\n\n<p><strong>AI Pioneers Adopt H100<\/strong><\/p>\n\n\n\n<p>Several pioneers in generative AI are adopting H100 to accelerate their work:<\/p>\n\n\n\n<ul>\n<li><strong>OpenAI<\/strong> used H100\u2019s predecessor \u2014 NVIDIA A100 GPUs \u2014 to train and run ChatGPT, an AI system optimized for dialogue, which has been used by hundreds of millions of people worldwide in record time. OpenAI will be using H100 on its Azure supercomputer to power its continuing AI research.<\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.nvidia.com\/blog\/2022\/10\/18\/meta-grand-teton\/\"><strong>Meta<\/strong><\/a><strong>,<\/strong> a key technology partner of NVIDIA, developed its Hopper-based AI supercomputer Grand Teton system with multiple performance enhancements over its predecessor, Zion, including 4x the host-to-GPU bandwidth, 2x the compute and data network bandwidth, and 2x the power envelope. With this greater compute capacity, Grand Teton can support both the training and production inference of deep learning recommender models and content understanding.<\/li>\n\n\n\n<li><strong>Stability.ai<\/strong>, a pioneer in text-to-image generative AI, is an H100 early access customer on AWS. Stability.ai plans to use H100 to accelerate its upcoming video, 3D and multimodal models.<\/li>\n\n\n\n<li><strong>Twelve Labs<\/strong>, a platform that gives businesses and developers access to multimodal video understanding, plans to use H100 instances on an OCI Supercluster to make video instantly, intelligently and easily searchable.&nbsp;<\/li>\n\n\n\n<li><strong>Anlatan<\/strong>, the creator of the NovelAI app for AI-assisted story writing and text-to-image synthesis, is using H100 instances on CoreWeave\u2019s cloud platform for model creation and inference.<\/li>\n<\/ul>\n\n\n\n<p><strong>DGX H100 Around the World<\/strong><\/p>\n\n\n\n<p>Innovators worldwide are receiving the first wave of DGX H100 systems, including:<\/p>\n\n\n\n<ul>\n<li><strong>CyberAgent<\/strong>, a leading digital advertising and internet services company based in Japan, is creating AI-produced digital ads and celebrity digital twin avatars, fully using generative AI and LLM technologies.&nbsp;<\/li>\n\n\n\n<li><a href=\"https:\/\/www.jhuapl.edu\/about\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Johns Hopkins University Applied Physics Laboratory<\/strong><\/a>, the U.S.\u2019s largest university-affiliated research center, will use DGX H100 for training LLMs.&nbsp;<\/li>\n\n\n\n<li><strong>KTH Royal Institute of Technology<\/strong>, a leading European technical and engineering university based in Stockholm, will use DGX H100 to provide state-of-the-art computer science programs for higher education.<\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.nvidia.com\/blog\/2023\/03\/21\/generative-ai-supercomputer-pharmaceutical-industry\/\"><strong>Mitsui<\/strong><\/a>, one of Japan\u2019s leading business groups, which has a wide variety of businesses in fields such as energy, wellness, IT and communication, is building Japan\u2019s first generative AI supercomputer for drug discovery, powered by DGX H100.&nbsp;<\/li>\n\n\n\n<li><strong>Telconet<\/strong>, a leading telecommunications provider in Ecuador, is building intelligent video analytics for safe cities and language services to support customers across Spanish dialects.<\/li>\n<\/ul>\n\n\n\n<p><strong>Ecosystem Support<\/strong><\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cWe are fully focused on AI innovation and AI-first products. NVIDIA H100 GPUs are state-of-the-art machine learning accelerators, giving us a significant competitive advantage within the machine learning industry for a wide variety of applications from model training to model inference.\u201d \u2014 <em>Eren Do\u011fan, CEO of Anlatan<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cAWS and NVIDIA have collaborated for more than 12 years to deliver large-scale, cost-effective GPU-based solutions on demand. AWS has unmatched experience delivering GPU-based instances that push the scalability envelope with each successive generation. Today, many customers scale machine learning training workloads to more than 10,000 GPUs. With second-generation EFA, customers can scale their P5 instances to more than 20,000 H100 GPUs, bringing on-demand supercomputer capabilities to any organization.\u201d \u2014 <em>David Brown, vice president of Amazon EC2 at AWS<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cAs we build new AI-powered experiences \u2014 like those based on generative AI \u2014 the underlying AI models become increasingly more sophisticated. Meta\u2019s latest H100-powered Grand Teton AI supercomputer brings greater compute, memory capacity and bandwidth, further accelerating training and inference of Meta\u2019s AI models, such as the open-sourced DLRM. As we move into the next computing platform, H100 also provides greater compute capabilities for researching Meta\u2019s future content recommendation, generative AI and metaverse needs.\u201d \u2014 <em>Alexis Bjorlin, vice president of Infrastructure, AI Systems and Accelerated Platforms at Meta<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cAs the adoption of AI continues to accelerate, the way businesses operate and succeed is fundamentally changing. By bringing NVIDIA\u2019s Hopper architecture to Microsoft Azure, we are able to offer unparalleled computing performance and functionality to enterprises looking to scale their AI capabilities.\u201d \u2014 <em>Scott Guthrie, executive vice president of the Cloud + AI group at Microsoft<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cThe computational power of the NVIDIA H100 Tensor Core GPU will be vital for enabling our efforts to push the frontier of AI training and inference. NVIDIA\u2019s advancements unlock our research and alignment work on systems like GPT-4.\u201d \u2014 <em>Greg Brockman, president and co-founder of OpenAI<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cOCI is bringing AI supercomputing capabilities at scale to thousands of organizations of all sizes. Our strong collaboration with NVIDIA is providing great value to customers, and we\u2019re excited by the power of H100.\u201d \u2014 <em>Greg Pavlik, CTO and senior vice president at Oracle Cloud Infrastructure<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cAs the world\u2019s leading open-source generative AI model company, Stability AI is committed to providing consumers and enterprises with the world\u2019s best tools for multimodal creation. Harnessing the power of the NVIDIA H100 provides unprecedented computing power to fuel the creativity and research capabilities of the surging numbers of those looking to benefit from the transformative powers of generative AI. It will unlock our video, 3D and other models that uniquely benefit from the higher interconnect and advanced architecture for exabytes of data.\u201d \u2014 <em>Emad Mostaque, founder and CEO of Stability.ai<\/em><\/p>\n<\/blockquote>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u201cTwelve Labs is excited to leverage Oracle Cloud Infrastructure Compute bare-metal instances powered by NVIDIA H100 GPUs to continue leading the effort in bringing video foundation models to market.\u201d \u2014 <em>Jae Lee, CEO of Twelve Labs&nbsp;<\/em><\/p>\n<\/blockquote>\n\n\n\n<p><strong>Availability<\/strong><\/p>\n\n\n\n<p>NVIDIA DGX H100 supercomputers are in full production and orderable from NVIDIA partners worldwide. Customers can trial DGX H100 today with <a href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/dgx-cloud\/\" target=\"_blank\" rel=\"noreferrer noopener\">NVIDIA DGX Cloud<\/a>. Pricing is available from NVIDIA DGX partners worldwide.<\/p>\n\n\n\n<p>NVIDIA H100 in the cloud is available now from <a href=\"https:\/\/forms.office.com\/pages\/responsepage.aspx?id=v4j5cvGGr0GRqy180BHbR2ylsmaTbFxHk-vH3S0XIfNUQ0xVSktQSktBVVNWSFVNTDVDQkRZVzg4US4u\" target=\"_blank\" rel=\"noreferrer noopener\">Azure<\/a> in private preview, <a href=\"https:\/\/go.oracle.com\/LP=132858?src1=:ad:pas:go:dg:a_nas:l5:RC_GOOG220512P00032C00538:MainAd&amp;gclsrc=aw.ds&amp;gclid=EAIaIQobChMIkqOE2Z7j_QIVgQbnCh06mw-KEAAYASAAEgKRvvD_BwE\" target=\"_blank\" rel=\"noreferrer noopener\">Oracle Cloud Infrastructure<\/a> in limited availability, and generally available from <a href=\"https:\/\/cirrascale.com\/press-nvidia-h100.php\" target=\"_blank\" rel=\"noreferrer noopener\">Cirrascale <\/a>and <a href=\"https:\/\/www.coreweave.com\/blog\" target=\"_blank\" rel=\"noreferrer noopener\">CoreWeave<\/a>. AWS announced H100 will be available in the coming weeks in limited preview. Google Cloud along with NVIDIA\u2019s cloud partners <a href=\"https:\/\/lambdalabs.com\/blog\/lambda-cloud-adding-nvidia-h100-tensor-core-gpus-in-early-april\" target=\"_blank\" rel=\"noreferrer noopener\">Lambda<\/a>, <a href=\"https:\/\/blog.paperspace.com\/paperspace-launches-support-for-the-new-nvidia-h100-gpu\/\" target=\"_blank\" rel=\"noreferrer noopener\">Paperspace<\/a> and <a href=\"https:\/\/www.vultr.com\/news\/announcement-availability-of-NVIDIA-H100\/\" target=\"_blank\" rel=\"noreferrer noopener\">Vultr <\/a>plan to offer H100.<\/p>\n\n\n\n<p>Servers and systems featuring NVIDIA H100 GPUs are available from leading server makers including Atos, Cisco, Dell Technologies, GIGABYTE, Hewlett Packard Enterprise, Lenovo and Supermicro.<\/p>\n\n\n\n<p>Pricing and other details are available directly from NVIDIA partners.&nbsp;<\/p>\n\n\n\n<p><em>Sign up for the free insideBIGDATA&nbsp;<a href=\"http:\/\/inside-bigdata.com\/newsletter\/\" target=\"_blank\" rel=\"noreferrer noopener\">newsletter<\/a>.<\/em><\/p>\n\n\n\n<p><em>Join us on Twitter:&nbsp;<a href=\"https:\/\/twitter.com\/InsideBigData1\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n<p><em>Join us on LinkedIn:&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/insidebigdata\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n<p><em>Join us on Facebook:&nbsp;<a href=\"https:\/\/www.facebook.com\/insideBIGDATANOW\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU \u2014 the powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.\u00a0<\/p>\n","protected":false},"author":10513,"featured_media":31890,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,182,87,180,67,56,1],"tags":[437,294,616,865,263,1210,96],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU \u2014 the powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.\u00a0\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-21T16:15:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-21T21:15:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/03\/NVIDIA_GTC_2023.png\" \/>\n\t<meta property=\"og:image:width\" content=\"114\" \/>\n\t<meta property=\"og:image:height\" content=\"118\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/\",\"name\":\"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-03-21T16:15:00+00:00\",\"dateModified\":\"2023-03-21T21:15:45+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","og_locale":"en_US","og_type":"article","og_title":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows - insideBIGDATA","og_description":"NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU \u2014 the powerful GPU for AI \u2014 to address rapidly growing demand for generative AI training and inference.\u00a0","og_url":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-03-21T16:15:00+00:00","article_modified_time":"2023-03-21T21:15:45+00:00","og_image":[{"width":114,"height":118,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/03\/NVIDIA_GTC_2023.png","type":"image\/png"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","url":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/","name":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-03-21T16:15:00+00:00","dateModified":"2023-03-21T21:15:45+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/03\/21\/nvidia-hopper-gpus-expand-reach-as-demand-for-ai-grows\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/03\/NVIDIA_GTC_2023.png","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8io","jetpack-related-posts":[{"id":30408,"url":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-hopper-in-full-production\/","url_meta":{"origin":31892,"position":0},"title":"NVIDIA Hopper in Full Production","date":"September 20, 2022","format":false,"excerpt":"NVIDIA today announced that the NVIDIA H100 Tensor Core GPU is in full production, with global tech partners planning in October to roll out the first wave of products and services based on the groundbreaking NVIDIA Hopper\u2122 architecture.","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28784,"url":"https:\/\/insidebigdata.com\/2022\/03\/22\/nvidia-announces-hopper-architecture-the-next-generation-of-accelerated-computing\/","url_meta":{"origin":31892,"position":1},"title":"NVIDIA Announces Hopper Architecture, the Next Generation of Accelerated Computing","date":"March 22, 2022","format":false,"excerpt":"To power the next wave of AI data centers, NVIDIA today announced its next-generation accelerated computing platform with NVIDIA Hopper\u2122 architecture, delivering an order of magnitude performance leap over its predecessor. Named for Grace Hopper, a pioneering U.S. computer scientist, the new architecture succeeds the NVIDIA Ampere architecture, launched two\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":30844,"url":"https:\/\/insidebigdata.com\/2022\/11\/08\/coreweave-among-first-cloud-providers-to-offer-nvidia-hgx-h100-supercomputers-set-to-transform-ai-landscape\/","url_meta":{"origin":31892,"position":2},"title":"CoreWeave Among First Cloud Providers to Offer NVIDIA HGX H100 Supercomputers Set to Transform AI Landscape","date":"November 8, 2022","format":false,"excerpt":"CoreWeave, a specialized cloud provider built for large-scale GPU-accelerated workloads, announced it is among the first to offer cloud instances with NVIDIA HGX H100 supercomputing. CoreWeave, Amazon, Google, Microsoft and Oracle are the first cloud providers included in the launch of this groundbreaking AI platform.","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":30653,"url":"https:\/\/insidebigdata.com\/2022\/10\/18\/oracle-and-nvidia-partner-to-speed-ai-adoption-for-enterprises\/","url_meta":{"origin":31892,"position":3},"title":"Oracle and NVIDIA Partner to Speed AI Adoption for Enterprises","date":"October 18, 2022","format":false,"excerpt":"Expanding their longstanding alliance, Oracle and NVIDIA today announced a multi-year partnership to help customers solve business challenges with accelerated computing and AI. The collaboration aims to bring the full NVIDIA accelerated computing stack \u2014 from GPUs to systems to software \u2014 to Oracle Cloud Infrastructure (OCI).","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":31899,"url":"https:\/\/insidebigdata.com\/2023\/03\/22\/nvidia-launches-inference-platforms-for-large-language-models-and-generative-ai-workloads\/","url_meta":{"origin":31892,"position":4},"title":"NVIDIA Launches Inference Platforms for Large Language Models and Generative AI Workloads","date":"March 22, 2023","format":false,"excerpt":"NVIDIA launched four inference platforms optimized for a diverse set of rapidly emerging generative AI applications \u2014 helping developers quickly build specialized, AI-powered applications that can deliver new services and insights. The platforms combine NVIDIA\u2019s full stack of inference software with the latest NVIDIA Ada, NVIDIA Hopper\u2122 and NVIDIA Grace\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":19524,"url":"https:\/\/insidebigdata.com\/2017\/12\/05\/nvidia-gpu-cloud-now-available-hundreds-thousands-ai-researchers-using-nvidia-desktop-gpus\/","url_meta":{"origin":31892,"position":5},"title":"NVIDIA GPU Cloud Now Available to Hundreds of Thousands of AI Researchers Using NVIDIA Desktop GPUs","date":"December 5, 2017","format":false,"excerpt":"NVIDIA announced that hundreds of thousands of AI researchers using desktop GPUs can now tap into the power of NVIDIA GPU Cloud (NGC) as the company has extended NGC support to NVIDIA TITAN.","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/31892"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=31892"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/31892\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/31890"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=31892"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=31892"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=31892"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}