{"id":31841,"date":"2023-03-15T06:00:00","date_gmt":"2023-03-15T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=31841"},"modified":"2023-03-16T10:04:13","modified_gmt":"2023-03-16T17:04:13","slug":"lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/","title":{"rendered":"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

Lightning AI<\/a>, the company accelerating the development of an AI-powered world, today announced the general availability of PyTorch Lightning 2.0<\/strong>, the company\u2019s flagship open source AI framework used by more than 10,000 organizations to quickly and cost-efficiently train and scale machine learning models. The new release introduces a stable API, offers a host of powerful features with a smaller footprint, and is easier to read and debug. Lightning AI has also unveiled Lightning Fabric<\/strong> to give users full control over their training loop. This new library allows users to leverage tools like callbacks and checkpoints only when needed, and also supports reinforcement learning, active learning and transformers without losing control over training code.<\/p>\n\n\n\n

The new releases are available for download at https:\/\/lightning.ai\/pages\/open-source\/<\/a>. Users seeking a simple, scalable training method that works out of the box can use PyTorch Lightning 2.0, while those looking for additional granularity and control throughout the training process can use Lightning Fabric. By extending its portfolio of open source offerings, Lightning AI is supporting a wider range of individual and enterprise developers as advances in machine learning are growing exponentially.<\/p>\n\n\n\n

Until now, machine learning practitioners have had to choose between two extremes: either using proscriptive tools for training and deploying machine learning tools or figuring it out completely on their own. With the update to PyTorch Lightning, and the introduction of Lightning Fabric, Lightning AI is now offering users an extensive array of training options for their machine learning models. If users want features like checkpointing, logging, and early stopping to be included out of the box, the original PyTorch Lightning framework is the right choice for them. If users want to scale their model to multiple GPUs but also want to write their own training loop for tasks like reinforcement learning, a method used by OpenAI\u2019s ChatGPT, then Fabric is the right choice for them. <\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n
\n

\u201cThe dual launch of PyTorch Lightning 2.0 and Lightning Fabric marks a significant milestone for Lightning AI and our community,\u201c said William Falcon, creator of PyTorch Lightning and the CEO and co-founder of Lightning AI. \u201cEach release provides a robust set of options for companies with in-house machine learning developers interested in additional granularity, and those who want a simple scaling solution that works out of the box. As the size of models deployed in enterprise settings continues to expand, the ability to scale the training process in a way that is simple, lightweight, and cost-effective becomes increasingly important. Lightning AI is proud to be expanding the choices that users have to scale their models for downstream tasks whether those are internal, like analytics and content creation tools, or customer-facing, like ChatGPT and other customer service chatbots.\u201d<\/p>\n<\/blockquote>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Lightning AI, the company accelerating the development of an AI-powered world, today announced the general availability of PyTorch Lightning 2.0, the company\u2019s flagship open source AI framework used by more than 10,000 organizations to quickly and cost-efficiently train and scale machine learning models. The new release introduces a stable API, offers a host of powerful features with a smaller footprint, and is easier to read and debug.<\/p>\n","protected":false},"author":10513,"featured_media":31843,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,182,87,180,56,1],"tags":[437,264,337,915,96],"acf":[],"yoast_head":"\nLightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0 - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0 - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"Lightning AI, the company accelerating the development of an AI-powered world, today announced the general availability of PyTorch Lightning 2.0, the company\u2019s flagship open source AI framework used by more than 10,000 organizations to quickly and cost-efficiently train and scale machine learning models. The new release introduces a stable API, offers a host of powerful features with a smaller footprint, and is easier to read and debug.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-15T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-16T17:04:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/03\/Lightning_AI_logo.png\" \/>\n\t<meta property=\"og:image:width\" content=\"282\" \/>\n\t<meta property=\"og:image:height\" content=\"81\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/\",\"name\":\"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0 - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-03-15T13:00:00+00:00\",\"dateModified\":\"2023-03-16T17:04:13+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0 - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/","og_locale":"en_US","og_type":"article","og_title":"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0 - insideBIGDATA","og_description":"Lightning AI, the company accelerating the development of an AI-powered world, today announced the general availability of PyTorch Lightning 2.0, the company\u2019s flagship open source AI framework used by more than 10,000 organizations to quickly and cost-efficiently train and scale machine learning models. The new release introduces a stable API, offers a host of powerful features with a smaller footprint, and is easier to read and debug.","og_url":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-03-15T13:00:00+00:00","article_modified_time":"2023-03-16T17:04:13+00:00","og_image":[{"width":282,"height":81,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/03\/Lightning_AI_logo.png","type":"image\/png"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/","url":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/","name":"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0 - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-03-15T13:00:00+00:00","dateModified":"2023-03-16T17:04:13+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/03\/15\/lightning-ai-releases-pytorch-lightning-2-0-and-a-new-open-source-library-for-lightweight-scaling-of-machine-learning-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Lightning AI Releases PyTorch Lightning 2.0 and a New Open Source Library for Lightweight Scaling of Machine Learning Models\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/03\/Lightning_AI_logo.png","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8hz","jetpack-related-posts":[{"id":34211,"url":"https:\/\/insidebigdata.com\/2023\/12\/16\/lightning-ai-introduces-lightning-ai-studios-its-enterprise-grade-platform-for-rapid-prototyping-and-deploying-ai-products\/","url_meta":{"origin":31841,"position":0},"title":"Lightning AI Introduces Lightning AI Studios; its Enterprise-Grade Platform for Rapid-prototyping, and Deploying AI Products","date":"December 16, 2023","format":false,"excerpt":"Lightning AI, the company behind PyTorch Lightning, with over 91 million downloads, announced the introduction of Lightning AI Studios, the culmination of 3 years of research into the next generation development paradigm for the age of AI.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Data_scientist_shutterstock_768047488_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33826,"url":"https:\/\/insidebigdata.com\/2023\/11\/05\/video-highlights-pytorch-2-0-on-the-rocm-platform\/","url_meta":{"origin":31841,"position":1},"title":"Video Highlights: PyTorch 2.0 on the ROCm Platform","date":"November 5, 2023","format":false,"excerpt":"From the recent PyTorch Conference we present a Lightning Talk: PyTorch 2.0 on the ROCm Platform by Douglas Lehr, Principal Engineer at AMD. Douglas talks about the current state of PyTorch on the ROCm platform including efforts to achieve day 0 support for Triton on Pytorch 2.0 as well as\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Data_scientist_shutterstock_768047488_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":32878,"url":"https:\/\/insidebigdata.com\/2023\/07\/25\/video-highlights-generative-ai-with-large-language-models\/","url_meta":{"origin":31841,"position":2},"title":"Video Highlights: Generative AI with Large Language Models","date":"July 25, 2023","format":false,"excerpt":"At an unprecedented pace, Large Language Models like GPT-4 are transforming the world in general and the field of data science in particular. This two-hour training video presentation by Jon Krohn, Co-Founder and Chief Data Scientist at the machine learning company Nebula, introduces deep learning transformer architectures including LLMs.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":26235,"url":"https:\/\/insidebigdata.com\/2021\/05\/17\/best-of-arxiv-org-for-ai-machine-learning-and-deep-learning-april-2021\/","url_meta":{"origin":31841,"position":3},"title":"Best of arXiv.org for AI, Machine Learning, and Deep Learning \u2013 April 2021","date":"May 17, 2021","format":false,"excerpt":"In this recurring monthly feature, we will filter all the recent research papers appearing in the arXiv.org preprint server for subjects relating to AI, machine learning and deep learning \u2013 from disciplines including statistics, mathematics and computer science \u2013 and provide you with a useful \u201cbest of\u201d list for the\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2013\/12\/arxiv.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":17842,"url":"https:\/\/insidebigdata.com\/2017\/05\/10\/h2o-ai-brings-lightning-fast-machine-learning-enterprises-nvidia-gpu-acceleration\/","url_meta":{"origin":31841,"position":4},"title":"H2O.AI Brings Lightning-Fast Machine Learning to Enterprises with NVIDIA GPU Acceleration","date":"May 10, 2017","format":false,"excerpt":"[GPU Technology Conference Coverage] H2O.ai, today announced that it has collaborated with NVIDIA to offer its best-of-breed machine learning algorithms in a newly minted GPU edition. In addition, H2O\u2019s platform will be optimized for NVIDIA\u00ae DGX-1\u2122 systems.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2015\/11\/h2o-logo.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":31588,"url":"https:\/\/insidebigdata.com\/2023\/02\/12\/insidebigdatapodcast-the-open-source-stack-unleashing-a-game-changing-ai-hardware-shift\/","url_meta":{"origin":31841,"position":5},"title":"@insideBIGDATApodcast: The Open Source Stack Unleashing a Game-Changing AI Hardware Shift","date":"February 12, 2023","format":false,"excerpt":"Welcome to the insideBIGDATA series of podcast presentations, a highly curated collection of topics relevant to our global audience. Topics include big data, data science, machine learning, AI, and deep learning. Enjoy! This episode discusses the emerging open source software stack for PyTorch that makes it easier and more accessible\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/01\/Podcast_shutterstock_612194837.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/31841"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=31841"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/31841\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/31843"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=31841"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=31841"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=31841"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}