{"id":32053,"date":"2023-04-06T07:00:00","date_gmt":"2023-04-06T14:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=32053"},"modified":"2023-04-05T15:50:09","modified_gmt":"2023-04-05T22:50:09","slug":"the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/","title":{"rendered":"The Truth Behind Why Most ML Projects Still Fail and What to Do About It"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"alignright size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"200\" height=\"166\" src=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/04\/Gideon.jpg\" alt=\"\" class=\"wp-image-32055\" srcset=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/04\/Gideon.jpg 200w, https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/04\/Gideon-150x125.jpg 150w\" sizes=\"(max-width: 200px) 100vw, 200px\" \/><\/figure><\/div>\n\n\n<p><em>In this special guest feature, Gideon Mendels, CEO and co-founder of <a href=\"http:\/\/www.comet.ml\/\" target=\"_blank\" rel=\"noreferrer noopener\">Comet ML<\/a>, dives into why so many ML projects are failing and what ML practitioners and leaders can do to course correct, protect their investments and ensure success. Gideon is a computer scientist, ML researcher and entrepreneur at his core. Before Comet, he co-founded GroupWize where they trained and deployed NLP models processing billions of chats.  His journey with NLP and Speech Recognition models began at Columbia University and Google where he worked on hate speech and deception detection.<\/em><\/p>\n\n\n\n<p>While it is true that ML adoption has significantly increased, there is still the hard reality that most ML projects fail to see the light of day. Maybe not to the level&nbsp;<a href=\"https:\/\/www.gartner.com\/en\/newsroom\/press-releases\/2018-02-13-gartner-says-nearly-half-of-cios-are-planning-to-deploy-artificial-intelligence\" target=\"_blank\" rel=\"noreferrer noopener\">Gartner predicted back in 2018<\/a>, but the numbers are not in ML\u2019s favor. Depending on who you ask,&nbsp;<a href=\"https:\/\/venturebeat.com\/ai\/idc-for-1-in-4-companies-half-of-all-ai-projects-fail\/\" target=\"_blank\" rel=\"noreferrer noopener\">failure rates range from 50%<\/a>&nbsp;to above Gartner\u2019s 85%.<\/p>\n\n\n\n<p>If we take an honest look at what\u2019s actually happening, it is not an ML maturity issue, as many would suggest. The technology should not be considered a scapegoat. Rather, several different factors are at play. Factors, which once identified, can be easily addressed so that organizations can reap the exceptional benefits of ML once and for all.&nbsp;<\/p>\n\n\n\n<p><strong>Why ML Projects are Failing&nbsp;<\/strong><\/p>\n\n\n\n<p>There are 3 high level reasons why ML Projects are failing<\/p>\n\n\n\n<ol type=\"1\" start=\"1\">\n<li>Lack of Clear Business Goals and Objectives<\/li>\n\n\n\n<li>Lack of Collaboration with Business Leaders and SMEs&nbsp;<\/li>\n\n\n\n<li>Not investing in the right tools and processes<\/li>\n<\/ol>\n\n\n\n<p><strong><em>Lack of clear business goals and objectives<\/em><\/strong><\/p>\n\n\n\n<p>Often, there is a lack of understanding of the business problem that teams are attempting to solve and how success will be measured. Without clear objectives it is difficult for ML teams to determine the right approach, algorithms and metrics to use. For example, if the objective is to create a model that can accurately predict customer churn, the ML team needs to understand how customer churn is defined for that problem and what factors contribute to it. This would require insights from domain or subject matter experts. The ML team will then have to determine what metrics will be used to measure the model\u2019s performance. These metrics should be defined early in the project and used to guide the team\u2019s effort throughout the project. And even when understanding exists, it is not uncommon to continue to see a misalignment of business needs with the capabilities of the ML model being developed. Is the model designed to reveal the answers teams seek or are teams trying to force a square peg into a round hole?&nbsp;<\/p>\n\n\n\n<p><strong><em>Lack of collaboration with business leaders and SMEs&nbsp;<\/em><\/strong><\/p>\n\n\n\n<p>Another very common issue is that ML teams may not have sufficient collaboration with key business leaders, domain experts, and stakeholders who could add necessary insights. Without open communication, there is a lack of understanding on both sides that results in models failing to meet expectations. This is true not only in the early development process but also once the model makes it into production and the business is actively using it<\/p>\n\n\n\n<p><strong><em>Not investing in the right tools and processes<\/em><\/strong><\/p>\n\n\n\n<p>As more companies invest in ML, there is a growing need to move from proof-of-concept (POC) to production. This requires investing in the right tools and processes to ensure success. ML projects can be hindered if the wrong tools are selected or if processes are not efficient. For example, teams may have initially relied on manual experiment tracking or ad-hoc model deployment, which may work for a small number of models in a research-focused setting. However, when it comes to building production-ready models, these ad-hoc methods may not meet business expectations in terms of collaboration, reproducibility, explainability, and governance. The same can be said for companies that have built their own in-house MLOps tools. As they scale their efforts, they may find that these tools are not able to meet their scaling requirements especially if they are built on top of open source solutions.<\/p>\n\n\n\n<p><strong>The Importance of Understanding<\/strong><\/p>\n\n\n\n<p>Using ML to make better decisions that positively impact your bottom line, whether it be through more efficient ad targeting or improved customer retention, is a goal for many companies. However, assembling a team of top data scientists and tasking them to find this information alone may not be enough.<\/p>\n\n\n\n<p>For ML projects to be successful, it&#8217;s crucial for the team to not only understand what information is needed, but also the reasoning behind why it&#8217;s needed. Without a deep understanding of how different business lines function and what information is important to different teams, ML models may not provide the insights and results that are needed.<\/p>\n\n\n\n<p>To overcome this, team leads and decision-makers must work closely with ML teams throughout the entire process, from identifying the correct questions to ask to ensuring that the data team understands the reasoning behind what the business wants to know. This ongoing collaboration is essential for success and cannot be circumvented by talent alone.<\/p>\n\n\n\n<p><strong>Standardize on the Best Tools and Practices for Your Needs<\/strong><\/p>\n\n\n\n<p>Machine learning projects are complex and multi-faceted, as they are not just reliant on code but also on data and models. There are several steps that ML teams can take to standardize on best tools and practices to make their ML projects successful:<\/p>\n\n\n\n<ol type=\"1\" start=\"1\">\n<li><strong>Research and evaluate different ML tools and frameworks:<\/strong>&nbsp;There are many ML tools and frameworks available, and it&#8217;s important to research and evaluate them to determine which ones are best suited for the specific project and use case. This includes evaluating the ease of use, scalability, and performance of the tools.<\/li>\n\n\n\n<li><strong>Establish best practices:<\/strong>&nbsp;Once the team has selected the appropriate tools, they should establish best practices for using them. This includes guidelines for data preprocessing, model training, and evaluation. This helps to ensure consistency and reproducibility across projects.<\/li>\n\n\n\n<li><strong>Implement a version control system:<\/strong>&nbsp;To ensure that changes to the code, data, and models can be tracked and easily undone if necessary, it&#8217;s important to implement a version control system such as Git. This also helps to facilitate collaboration among team members.<\/li>\n\n\n\n<li><strong>Automate the ML pipeline:<\/strong>&nbsp;To increase efficiency and reduce the risk of errors, it&#8217;s important to automate as much of the ML pipeline as possible. This includes automating tasks such as data preprocessing, model training, and deployment.<\/li>\n\n\n\n<li><strong>Invest in MLOps tools<\/strong>: MLOps tools can help to streamline the process of experimentation, deploying, monitoring, and maintaining ML models both during training and production. These tools can automate the process of tracking experiments, managing models, and deploying updates.<\/li>\n\n\n\n<li><strong>Encourage open communication and collaboration:<\/strong>&nbsp;To ensure that the team is aligned and working towards the same goals, it&#8217;s important to encourage open communication and collaboration. This includes regular meetings and check-ins to share progress, discuss challenges, and get feedback.<\/li>\n\n\n\n<li><strong>Continuously evaluate and improve:<\/strong>&nbsp;Finally, it&#8217;s important to continuously evaluate the tools and processes used by the team and make improvements as necessary. This includes gathering feedback from team members and using it to identify areas for improvement.<\/li>\n<\/ol>\n\n\n\n<p><strong>Carry On<\/strong><\/p>\n\n\n\n<p>In today\u2019s world, it is very easy to brush off ML as simply \u201cnot being there yet\u201d but to get \u201cthere\u201d, we have to acknowledge that it\u2019s not just about the technology and its capabilities. Teams don\u2019t always do everything right\u2013 and that\u2019s ok. It\u2019s part of learning. The bottom line is, the technology works, it&#8217;s valid, and some businesses are growing significantly as a direct result of project outcomes.&nbsp;<\/p>\n\n\n\n<p>To get there, organizations must follow five clear steps:<\/p>\n\n\n\n<ol type=\"1\" start=\"1\">\n<li>Ensure that ML teams have a deep understanding of the business problem they are attempting to solve, including the specific factors that should be considered and how they will play a role in the outcome. Alternatively assign someone from the business side to the ML project as a domain expert.<\/li>\n\n\n\n<li>Align business needs with ML capabilities by clearly defining the goals and objectives of the project and selecting the appropriate tools and processes to support those goals. What does success looks like to the business and how can we find the right \u201coffline\u201d metric to optimize for that<\/li>\n\n\n\n<li>Foster communication and collaboration between ML teams and business leaders or other stakeholders to ensure that all parties have a clear understanding of the problem being solved and the needs of the organization.<\/li>\n\n\n\n<li>Implement efficient tools and processes, such as automated experiment tracking and standardized model deployment, to streamline the ML development process and increase the chances of success.<\/li>\n\n\n\n<li>Engage in perpetual learning. ML tools are developing quite rapidly. Build in time to experiment so that your team stays fresh and forward-thinking. And look for integrations between tools that will make life easier and more productive.<\/li>\n<\/ol>\n\n\n\n<p>By following these steps, you can dramatically increase the likelihood of ML success. By following these steps, teams can make magic happen.<\/p>\n\n\n\n<p><em>Sign up for the free insideBIGDATA&nbsp;<a href=\"http:\/\/inside-bigdata.com\/newsletter\/\" target=\"_blank\" rel=\"noreferrer noopener\">newsletter<\/a>.<\/em><\/p>\n\n\n\n<p><em>Join us on Twitter:&nbsp;<a href=\"https:\/\/twitter.com\/InsideBigData1\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n<p><em>Join us on LinkedIn:&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/insidebigdata\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n<p><em>Join us on Facebook:&nbsp;<a href=\"https:\/\/www.facebook.com\/insideBIGDATANOW\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this special guest feature, Gideon Mendels, CEO and co-founder of Comet ML, dives into why so many ML projects are failing and what ML practitioners and leaders can do to course correct, protect their investments and ensure success.<\/p>\n","protected":false},"author":37,"featured_media":32055,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[115,87,180,61,67,56,97,1],"tags":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The Truth Behind Why Most ML Projects Still Fail and What to Do About It - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Truth Behind Why Most ML Projects Still Fail and What to Do About It - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"In this special guest feature, Gideon Mendels, CEO and co-founder of Comet ML, dives into why so many ML projects are failing and what ML practitioners and leaders can do to course correct, protect their investments and ensure success.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-04-06T14:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-05T22:50:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/04\/Gideon.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"200\" \/>\n\t<meta property=\"og:image:height\" content=\"166\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Daniel Gutierrez\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AMULETAnalytics\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daniel Gutierrez\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/\",\"name\":\"The Truth Behind Why Most ML Projects Still Fail and What to Do About It - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-04-06T14:00:00+00:00\",\"dateModified\":\"2023-04-05T22:50:09+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Truth Behind Why Most ML Projects Still Fail and What to Do About It\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed\",\"name\":\"Daniel Gutierrez\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g\",\"caption\":\"Daniel Gutierrez\"},\"description\":\"Daniel D. Gutierrez is a Data Scientist with Los Angeles-based AMULET Analytics, a service division of AMULET Development Corp. He's been involved with data science and Big Data long before it came in vogue, so imagine his delight when the Harvard Business Review recently deemed \\\"data scientist\\\" as the sexiest profession for the 21st century. Previously, he taught computer science and database classes at UCLA Extension for over 15 years, and authored three computer industry books on database technology. He also served as technical editor, columnist and writer at a major computer industry monthly publication for 7 years. Follow his data science musings at @AMULETAnalytics.\",\"sameAs\":[\"http:\/\/www.insidebigdata.com\",\"https:\/\/twitter.com\/@AMULETAnalytics\"],\"url\":\"https:\/\/insidebigdata.com\/author\/dangutierrez\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Truth Behind Why Most ML Projects Still Fail and What to Do About It - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/","og_locale":"en_US","og_type":"article","og_title":"The Truth Behind Why Most ML Projects Still Fail and What to Do About It - insideBIGDATA","og_description":"In this special guest feature, Gideon Mendels, CEO and co-founder of Comet ML, dives into why so many ML projects are failing and what ML practitioners and leaders can do to course correct, protect their investments and ensure success.","og_url":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-04-06T14:00:00+00:00","article_modified_time":"2023-04-05T22:50:09+00:00","og_image":[{"width":200,"height":166,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/04\/Gideon.jpg","type":"image\/jpeg"}],"author":"Daniel Gutierrez","twitter_card":"summary_large_image","twitter_creator":"@AMULETAnalytics","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Daniel Gutierrez","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/","url":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/","name":"The Truth Behind Why Most ML Projects Still Fail and What to Do About It - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-04-06T14:00:00+00:00","dateModified":"2023-04-05T22:50:09+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/04\/06\/the-truth-behind-why-most-ml-projects-still-fail-and-what-to-do-about-it\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"The Truth Behind Why Most ML Projects Still Fail and What to Do About It"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed","name":"Daniel Gutierrez","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g","caption":"Daniel Gutierrez"},"description":"Daniel D. Gutierrez is a Data Scientist with Los Angeles-based AMULET Analytics, a service division of AMULET Development Corp. He's been involved with data science and Big Data long before it came in vogue, so imagine his delight when the Harvard Business Review recently deemed \"data scientist\" as the sexiest profession for the 21st century. Previously, he taught computer science and database classes at UCLA Extension for over 15 years, and authored three computer industry books on database technology. He also served as technical editor, columnist and writer at a major computer industry monthly publication for 7 years. Follow his data science musings at @AMULETAnalytics.","sameAs":["http:\/\/www.insidebigdata.com","https:\/\/twitter.com\/@AMULETAnalytics"],"url":"https:\/\/insidebigdata.com\/author\/dangutierrez\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/04\/Gideon.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8kZ","jetpack-related-posts":[{"id":31547,"url":"https:\/\/insidebigdata.com\/2023\/02\/04\/comet-announces-convergence-2023-the-leading-conference-to-explore-the-new-frontiers-of-machine-learning\/","url_meta":{"origin":32053,"position":0},"title":"Comet Announces Convergence 2023, the Leading Conference to Explore the New Frontiers of Machine Learning","date":"February 4, 2023","format":false,"excerpt":"Comet, provider of a leading MLOps platform for machine learning (ML) teams from startup to enterprise, announced its second annual Convergence conference. The event, which is free to the ML community, will take place virtually March 7-8, 2023.","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/02\/Comet_Convergence_2023.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":28056,"url":"https:\/\/insidebigdata.com\/2021\/12\/25\/video-highlights-ml-system-design-for-continuous-experimentation\/","url_meta":{"origin":32053,"position":1},"title":"Video Highlights: ML System Design for Continuous Experimentation","date":"December 25, 2021","format":false,"excerpt":"While ML model development is a challenging process, the management of these models becomes even more complex once they're in production. Shifting data distributions, upstream pipeline failures, and model predictions impacting the very data set they're trained on can create thorny feedback loops between development and production.","rel":"","context":"In &quot;Big Data&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2019\/12\/Machine_Learning_shutterstock_344688470.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":30912,"url":"https:\/\/insidebigdata.com\/2022\/11\/16\/comet-introduces-kangas-an-open-source-smart-data-exploration-analysis-and-model-debugging-tool-for-machine-learning\/","url_meta":{"origin":32053,"position":2},"title":"Comet Introduces Kangas, An Open Source\u00a0Smart Data Exploration, Analysis and Model Debugging Tool for Machine Learning\u00a0","date":"November 16, 2022","format":false,"excerpt":"Comet, provider of a leading MLOps platform for machine learning (ML) teams from startup to enterprise, announced a bold new product:\u00a0Kangas. Open sourced to democratize large scale visual dataset exploration and analysis for the computer vision and machine learning community, Kangas helps users understand and debug their data in a\u2026","rel":"","context":"In &quot;Analytics&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":32138,"url":"https:\/\/insidebigdata.com\/2023\/04\/19\/comet-unveils-suite-of-tools-and-integrations-to-accelerate-large-language-model-workflow-for-data-scientists\/","url_meta":{"origin":32053,"position":3},"title":"Comet Unveils Suite of Tools and Integrations to Accelerate Large Language Model Workflow for Data Scientists","date":"April 19, 2023","format":false,"excerpt":"Comet, a leading platform for managing, visualizing and optimizing models - from training runs to production monitoring, announced a new suite of tools designed to revolutionize the workflow surrounding Large Language Models (LLMs).","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":34031,"url":"https:\/\/insidebigdata.com\/2023\/11\/29\/comet-launches-course-on-building-with-llms\/","url_meta":{"origin":32053,"position":4},"title":"Comet Launches Course on Building with LLMs","date":"November 29, 2023","format":false,"excerpt":"Comet, a leading MLOps platform, launched of a new initiative to help data scientists and software engineers keep pace with the changing world of Large Language Models (LLMs) and all of the possibilities they can enable. In a new course, taught by\u00a0co-founder of\u00a0DAIR.AI,\u00a0Elvis Saravia, Comet breaks down the process of\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/09\/AI_data_storage_shutterstock_1107715973_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":26642,"url":"https:\/\/insidebigdata.com\/2021\/07\/11\/video-highlights-running-effective-machine-learning-teams\/","url_meta":{"origin":32053,"position":5},"title":"Video Highlights: Running Effective Machine Learning Teams","date":"July 11, 2021","format":false,"excerpt":"In the video presentation below, Niko Laskaris, Data Scientist and Head of Strategic Projects at MLOps solutions provider Comet, hosts a compelling webinar showing you how to address many issues regarding AI\/ML. He also shares case studies, and examines the shortfalls of traditional and agile practices applied to ML teams.","rel":"","context":"In &quot;Featured&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2018\/12\/shutterstock_1012126252-e1545242729684.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/32053"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/37"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=32053"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/32053\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/32055"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=32053"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=32053"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=32053"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}