{"id":30414,"date":"2022-09-20T14:00:00","date_gmt":"2022-09-20T21:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=30414"},"modified":"2022-09-19T11:30:40","modified_gmt":"2022-09-19T18:30:40","slug":"nvidia-launches-large-language-model-cloud-services","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/","title":{"rendered":"NVIDIA Launches Large Language Model Cloud Services"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

NVIDIA today announced two new large language model cloud AI services \u2014 the NVIDIA NeMo Large Language Model Service<\/a> and the NVIDIA BioNeMo LLM Service<\/a> \u2014 that enable developers to easily adapt LLMs and deploy customized AI applications for content generation, text summarization, chatbots, code development, as well as protein structure and biomolecular property predictions, and more.<\/p>\n\n\n\n

The NeMo LLM Service allows developers to rapidly tailor a number of pretrained foundation models using a training method called prompt learning on NVIDIA-managed infrastructure. The NVIDIA BioNeMo Service is a cloud application programming interface (API) that expands LLM use cases beyond language and into scientific applications to accelerate drug discovery for pharma and biotech companies.<\/p>\n\n\n\n

\u201cLarge language models hold the potential to transform every industry,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cThe ability to tune foundation models puts the power of LLMs within reach of millions of developers who can now create language services and power scientific discoveries without needing to build a massive model from scratch.\u201d<\/p><\/blockquote>\n\n\n\n

NeMo LLM Service Boosts Accuracy With Prompt Learning, Accelerates Deployments<\/strong><\/p>\n\n\n\n

With the NeMo LLM Service, developers can use their own training data to customize foundation models ranging from 3 billion parameters up to Megatron 530B, one of the world\u2019s largest LLMs. The process takes just minutes to hours compared with the weeks or months required to train a model from scratch.<\/p>\n\n\n\n

Models are customized with prompt learning, which uses a technique called p-tuning. This allows developers to use just a few hundred examples to rapidly tailor foundation models that were originally trained with billions of data points. The customization process generates task-specific prompt tokens, which are then combined with the foundation models to deliver higher accuracy and more relevant responses for specific use cases.<\/p>\n\n\n\n

Developers can customize for multiple use cases using the same model and generate many different prompt tokens. A playground feature provides a no-code option to easily experiment and interact with models, further boosting the effectiveness and accessibility of LLMs for industry-specific use cases.<\/p>\n\n\n\n

Once ready to deploy, the tuned models can run on cloud instances, on-premises systems or through an API.<\/p>\n\n\n\n

BioNeMo LLM Service Enables Researchers to Tap Power of Massive Models<\/strong><\/p>\n\n\n\n

The BioNeMo LLM Service<\/a> includes two new BioNeMo language models for chemistry and biology applications. It provides support for protein, DNA and biochemical data to help researchers discover patterns and insights in biological sequences.<\/p>\n\n\n\n

BioNeMo enables researchers to expand the scope of their work by leveraging models that contain billions of parameters. These larger models can store more information about the structure of proteins, evolutionary relationships between genes, and even generate novel biomolecules for therapeutic applications.<\/p>\n\n\n\n

Cloud API Provides Access to Megatron 530B, Other Ready-Made Models<\/strong><\/p>\n\n\n\n

In addition to tuning foundation models, the LLM services include the option to use ready-made and custom models through a cloud API.<\/p>\n\n\n\n

This gives developers access to a broad range of pretrained LLMs, including Megatron 530B. It also provides access to T5 and GPT-3 models created with the NVIDIA NeMo Megatron<\/a> framework \u2014 now available in open beta \u2014 to support a broad range of applications and multilingual service requirements.<\/p>\n\n\n\n

Leaders in automotive, computing, education, healthcare, telecommunications and other industries are using NeMo Megatron to pioneer services for customers in Chinese, English, Korean, Swedish and other languages.<\/p>\n\n\n\n

Availability<\/strong><\/p>\n\n\n\n

The NeMo LLM and BioNeMo services and cloud APIs are expected to be available in early access starting next month. Developers can apply now for more details.<\/p>\n\n\n\n

The beta release of the NeMo Megatron framework is available from NVIDIA NGC<\/a>\u2122 and is optimized to run on NVIDIA DGX\u2122 Foundry<\/a> and NVIDIA DGX SuperPOD<\/a>\u2122, as well as accelerated cloud instances from Amazon Web Services, Microsoft Azure and Oracle Cloud Infrastructure. <\/p>\n\n\n\n

To experience the NeMo Megatron framework, developers can try NVIDIA LaunchPad<\/a> labs at no charge.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

NVIDIA today announced two new large language model cloud AI services \u2014 the NVIDIA NeMo Large Language Model Service and the NVIDIA BioNeMo LLM Service \u2014 that enable developers to easily adapt LLMs and deploy customized AI applications for content generation, text summarization, chatbots, code development, as well as protein structure and biomolecular property predictions, and more.<\/p>\n","protected":false},"author":10513,"featured_media":17071,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,66,180,122,268,56,1],"tags":[117,948,263,96],"acf":[],"yoast_head":"\nNVIDIA Launches Large Language Model Cloud Services - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NVIDIA Launches Large Language Model Cloud Services - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"NVIDIA today announced two new large language model cloud AI services \u2014 the NVIDIA NeMo Large Language Model Service and the NVIDIA BioNeMo LLM Service \u2014 that enable developers to easily adapt LLMs and deploy customized AI applications for content generation, text summarization, chatbots, code development, as well as protein structure and biomolecular property predictions, and more.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2022-09-20T21:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-19T18:30:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2017\/02\/Nvidia_Logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"138\" \/>\n\t<meta property=\"og:image:height\" content=\"110\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/\",\"url\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/\",\"name\":\"NVIDIA Launches Large Language Model Cloud Services - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2022-09-20T21:00:00+00:00\",\"dateModified\":\"2022-09-19T18:30:40+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NVIDIA Launches Large Language Model Cloud Services\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NVIDIA Launches Large Language Model Cloud Services - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/","og_locale":"en_US","og_type":"article","og_title":"NVIDIA Launches Large Language Model Cloud Services - insideBIGDATA","og_description":"NVIDIA today announced two new large language model cloud AI services \u2014 the NVIDIA NeMo Large Language Model Service and the NVIDIA BioNeMo LLM Service \u2014 that enable developers to easily adapt LLMs and deploy customized AI applications for content generation, text summarization, chatbots, code development, as well as protein structure and biomolecular property predictions, and more.","og_url":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2022-09-20T21:00:00+00:00","article_modified_time":"2022-09-19T18:30:40+00:00","og_image":[{"width":138,"height":110,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2017\/02\/Nvidia_Logo.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/","url":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/","name":"NVIDIA Launches Large Language Model Cloud Services - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2022-09-20T21:00:00+00:00","dateModified":"2022-09-19T18:30:40+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2022\/09\/20\/nvidia-launches-large-language-model-cloud-services\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"NVIDIA Launches Large Language Model Cloud Services"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2017\/02\/Nvidia_Logo.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-7Uy","jetpack-related-posts":[{"id":31902,"url":"https:\/\/insidebigdata.com\/2023\/03\/23\/nvidia-brings-generative-ai-to-worlds-enterprises-with-cloud-services-for-creating-large-language-and-visual-models\/","url_meta":{"origin":30414,"position":0},"title":"NVIDIA Brings Generative AI to World\u2019s Enterprises With Cloud Services for Creating Large Language and Visual Models","date":"March 23, 2023","format":false,"excerpt":"To accelerate enterprise adoption of generative AI, NVIDIA announced a set of cloud services that enable businesses to build, refine and operate custom large language models and generative AI models that are trained with their own proprietary data and created for their unique domain-specific tasks.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":33412,"url":"https:\/\/insidebigdata.com\/2023\/09\/18\/anyscale-teams-with-nvidia-to-supercharge-llm-performance-and-efficiency\/","url_meta":{"origin":30414,"position":1},"title":"Anyscale Teams With NVIDIA to Supercharge LLM Performance and Efficiency","date":"September 18, 2023","format":false,"excerpt":"Anyscale, the AI infrastructure company built by the creators of Ray, the world\u2019s fastest-growing open-source unified framework for scalable computing, today announced a collaboration with NVIDIA to further boost the performance and efficiency of large language model (LLM) development on\u00a0Ray\u00a0and the\u00a0Anyscale Platform\u00a0for production AI.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Generative_AI_shutterstock_2273007347_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":32729,"url":"https:\/\/insidebigdata.com\/2023\/06\/26\/snowflake-and-nvidia-team-to-help-businesses-harness-their-data-for-generative-ai-in-the-data-cloud\/","url_meta":{"origin":30414,"position":2},"title":"Snowflake and NVIDIA Team to Help Businesses Harness Their Data for Generative AI in the Data Cloud","date":"June 26, 2023","format":false,"excerpt":"Snowflake (NYSE: SNOW), the Data Cloud company, and NVIDIA today announced at Snowflake Summit 2023 that they are partnering to provide businesses of all sizes with an accelerated path to create customized generative AI applications using their own proprietary data, all securely within the Snowflake Data Cloud.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/NVIDIA_Snowflake_logo.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33182,"url":"https:\/\/insidebigdata.com\/2023\/08\/22\/vmware-and-nvidia-unlock-generative-ai-for-enterprises\/","url_meta":{"origin":30414,"position":3},"title":"VMware and NVIDIA Unlock Generative AI for Enterprises","date":"August 22, 2023","format":false,"excerpt":"VMware Inc. (NYSE: VMW) and NVIDIA (NASDAQ: NVDA) today announced the expansion of their strategic partnership to ready the hundreds of thousands of enterprises that run on VMware\u2019s cloud infrastructure for the era of generative AI","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/12\/Data_Pipeline_shutterstock_9623992_small.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":32464,"url":"https:\/\/insidebigdata.com\/2023\/05\/23\/nvidia-collaborates-with-microsoft-to-accelerate-enterprise-ready-generative-ai\/","url_meta":{"origin":30414,"position":4},"title":"NVIDIA Collaborates With Microsoft to Accelerate Enterprise-Ready Generative AI","date":"May 23, 2023","format":false,"excerpt":"NVIDIA today announced that it is integrating its NVIDIA AI Enterprise software into Microsoft\u2019s Azure Machine Learning to help enterprises accelerate their AI initiatives. The integration will create a secure, enterprise-ready platform that enables Azure customers worldwide to quickly build, deploy and manage customized applications using the more than 100\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":31899,"url":"https:\/\/insidebigdata.com\/2023\/03\/22\/nvidia-launches-inference-platforms-for-large-language-models-and-generative-ai-workloads\/","url_meta":{"origin":30414,"position":5},"title":"NVIDIA Launches Inference Platforms for Large Language Models and Generative AI Workloads","date":"March 22, 2023","format":false,"excerpt":"NVIDIA launched four inference platforms optimized for a diverse set of rapidly emerging generative AI applications \u2014 helping developers quickly build specialized, AI-powered applications that can deliver new services and insights. The platforms combine NVIDIA\u2019s full stack of inference software with the latest NVIDIA Ada, NVIDIA Hopper\u2122 and NVIDIA Grace\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/30414"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=30414"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/30414\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/17071"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=30414"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=30414"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=30414"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}