{"id":25846,"date":"2021-03-29T06:00:00","date_gmt":"2021-03-29T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=25846"},"modified":"2021-03-30T09:31:00","modified_gmt":"2021-03-30T16:31:00","slug":"book-excerpt-real-world-ai","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/","title":{"rendered":"Book Excerpt: Real World AI"},"content":{"rendered":"\n
\"\"<\/figure><\/div>\n\n\n\n

This article was adapted from the recently released best-selling book, Real World AI<\/a>, written by Alyssa Rochwerger and Wilson Pang. Alyssa is the director of product at Blue Shield of California and has previously served as VP of product for Figure Eight (acquired by Appen), VP of AI and data at Appen, and director of product at IBM Watson. Wilson is the CTO of Appen<\/a> and has over nineteen years\u2019 experience in software engineering and data science, having served as the chief data officer of Ctrip and the senior director of engineering at eBay.<\/em><\/p>\n\n\n\n

8 Factors to Prepare for When Deploying an AI Model<\/strong><\/p>\n\n\n\n

AI is the future for business. Just as it\u2019s nearly impossible today to find a business without a social media strategy, in a few years, it will be just as hard to find a company without an AI strategy. <\/p>\n\n\n\n

AI tools allow for the automation of many different tasks, and when deployed properly, they can save companies significant money and time.<\/p>\n\n\n\n

However, proper deployment is no easy task. There are a lot of potential pitfalls that could derail your model before it gets off the ground. Here are 8 important factors to consider when preparing to deploy your AI model.<\/p>\n\n\n\n

#1: Availability of Core Business Services<\/strong><\/p>\n\n\n\n

You must ensure that your AI model does not disrupt core business services, even during upgrades or deploys. <\/p>\n\n\n\n

If your AI model is used in a business-critical application or an end-user facing product, a system outage can cost a lot of money. For instance, when Amazon was down for 30 minutes, it theoretically cost $66,240<\/a> per minute, or nearly $2 million.<\/p>\n\n\n\n

At the most foundational level, your AI model is intended to benefit the business, by improving the customer experience, increasing efficiency, generating more revenue, etc. If you disrupt core business services, you\u2019ll be working directly against your goals.<\/p>\n\n\n\n

#2: Performance and Speed<\/strong><\/p>\n\n\n\n

Also consider the performance of your AI model. It must not only work well; it must also work quickly. <\/p>\n\n\n\n

For the majority of production systems, the faster the site speed, the higher the user-conversion rate. Walmart<\/a> found that for every one-second improvement in page-load times, conversions increased by 1 percent. Another company, COOK, increased conversions by 7 percent<\/em> by reducing page-load time by 0.85 seconds.  <\/p>\n\n\n\n

No one wants to use a slow product. So before deploying your AI model, make sure it is performing well, at a speed that doesn\u2019t significantly slow down your product.<\/p>\n\n\n\n

#3: Scalability<\/strong><\/p>\n\n\n\n

When you first launch an AI model, it\u2019s smart to start small, but you must prepare for future scalability.<\/p>\n\n\n\n

How much traffic can your AI model handle now? How does it handle an increase in demand\u2014scale out, scale up? <\/p>\n\n\n\n

You need to consider how many users will use your product, which is supported by your AI model. More importantly, if the user base increases in the future, consider how your AI model will continue to support that increase, both in terms of performance and also the cost of computational power.<\/p>\n\n\n\n

#4: Holes in Your Data<\/strong><\/p>\n\n\n\n

You\u2019ll often discover holes in your data once you put an AI model into production. If this happens, you\u2019ll have to either find data to fill the holes or narrow the model\u2019s scope.<\/p>\n\n\n\n

For example, AI was used during the 2018 California wildfires. The AI model was trained on historical data, but past fires don\u2019t have a direct bearing on future fires, so the model couldn\u2019t predict fires. This data hole was impossible to fill, so they narrowed the model\u2019s scope to lower-level predictions of how fires might spread, which assisted in damage control and helped save lives and property.<\/p>\n\n\n\n

#5: Unexpected Inputs<\/strong><\/p>\n\n\n\n

Once you release an AI solution into the wild, people may give it input you didn\u2019t anticipate.<\/p>\n\n\n\n

If your AI application responds to feedback, this could result in outputs you don\u2019t want, like when 4chan turned Tay, Microsoft\u2019s chatbot, into a racist in less than a day.<\/p>\n\n\n\n

Unexpected inputs can also create security issues. For example, Siri and Alexa were not designed to handle secure, sensitive information, but if someone asks them to remember a credit card or social security number, they will, which creates security risk.<\/p>\n\n\n\n

Be on the lookout for unexpected inputs, and adapt as necessary.<\/p>\n\n\n\n

#6: Compliance Issues<\/strong><\/p>\n\n\n\n

Compliance issues often arise once an AI model is deployed. <\/p>\n\n\n\n

Even if compliance risks appear to be low, it\u2019s worth going through the plan with lawyers well before you go into production. They could easily uncover something that might have scrapped your whole project, giving you a chance to deal with it. <\/p>\n\n\n\n

Be sure to revisit potential compliance issues periodically. In some cases, laws can change out from under your model. For instance, the usage rights you have to your data might change. <\/p>\n\n\n\n

The sooner you prepare for compliance issues, the sooner you can get out in front of them.<\/p>\n\n\n\n

#7: Security<\/strong><\/p>\n\n\n\n

If your system is available in any kind of public way, you\u2019ll have to guard against bad actors. <\/p>\n\n\n\n

Spammers have come up with clever ways to trick machine learning models designed to filter them out into letting their emails through. Try to limit the amount of probing that bad actors can do\u2014for example, by rate-limiting requests from the same IP or account or requiring the user to solve a CAPTCHA if they make frequent requests. <\/p>\n\n\n\n

People with malicious intent will try all sorts of things in order to defeat your model, so security is a constant battle. <\/p>\n\n\n\n

#8: Adaptability<\/strong><\/p>\n\n\n\n

AI is not a one-and-done thing. AI models must be monitored and trained continually, and adaptability is important.<\/p>\n\n\n\n

Ensuring your system can adapt to novel information and a changing reality ensures that it\u2019s sustainable and has a shelf life longer than the time it took to train it. The world moves fast; what was true two weeks ago may no longer be so. <\/p>\n\n\n\n

Adaptability is key for a sustainable, long-term business. Your business needs to incorporate new ideas or different customer behaviors as they evolve, which naturally should be reflected and translated into your AI models as well.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: @InsideBigData1 \u2013 https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

This article was adapted from the recently released best-selling book, Real World AI, written by Alyssa Rochwerger and Wilson Pang. Alyssa is the director of product at Blue Shield of California and has previously served as VP of product for Figure Eight (acquired by Appen), VP of AI and data at Appen, and director of product at IBM Watson. Wilson is the CTO of Appen and has over nineteen years\u2019 experience in software engineering and data science, having served as the chief data officer of Ctrip and the senior director of engineering at eBay.<\/p>\n","protected":false},"author":10513,"featured_media":25847,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,92,87,180,56,1],"tags":[437,324,988,95],"acf":[],"yoast_head":"\nBook Excerpt: Real World AI - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Book Excerpt: Real World AI - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"This article was adapted from the recently released best-selling book, Real World AI, written by Alyssa Rochwerger and Wilson Pang. Alyssa is the director of product at Blue Shield of California and has previously served as VP of product for Figure Eight (acquired by Appen), VP of AI and data at Appen, and director of product at IBM Watson. Wilson is the CTO of Appen and has over nineteen years\u2019 experience in software engineering and data science, having served as the chief data officer of Ctrip and the senior director of engineering at eBay.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2021-03-29T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-03-30T16:31:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/03\/Appen_Real_World_AI.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"150\" \/>\n\t<meta property=\"og:image:height\" content=\"231\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/\",\"url\":\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/\",\"name\":\"Book Excerpt: Real World AI - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2021-03-29T13:00:00+00:00\",\"dateModified\":\"2021-03-30T16:31:00+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Book Excerpt: Real World AI\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Book Excerpt: Real World AI - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/","og_locale":"en_US","og_type":"article","og_title":"Book Excerpt: Real World AI - insideBIGDATA","og_description":"This article was adapted from the recently released best-selling book, Real World AI, written by Alyssa Rochwerger and Wilson Pang. Alyssa is the director of product at Blue Shield of California and has previously served as VP of product for Figure Eight (acquired by Appen), VP of AI and data at Appen, and director of product at IBM Watson. Wilson is the CTO of Appen and has over nineteen years\u2019 experience in software engineering and data science, having served as the chief data officer of Ctrip and the senior director of engineering at eBay.","og_url":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2021-03-29T13:00:00+00:00","article_modified_time":"2021-03-30T16:31:00+00:00","og_image":[{"width":150,"height":231,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/03\/Appen_Real_World_AI.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/","url":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/","name":"Book Excerpt: Real World AI - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2021-03-29T13:00:00+00:00","dateModified":"2021-03-30T16:31:00+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2021\/03\/29\/book-excerpt-real-world-ai\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Book Excerpt: Real World AI"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/03\/Appen_Real_World_AI.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-6IS","jetpack-related-posts":[{"id":28673,"url":"https:\/\/insidebigdata.com\/2022\/03\/08\/appen-invests-in-synthetic-data-business-mindtech\/","url_meta":{"origin":25846,"position":0},"title":"Appen Invests in Synthetic Data Business Mindtech","date":"March 8, 2022","format":false,"excerpt":"Appen Limited, a leader in data for the AI Lifecycle, announced the investment in Mindtech, a synthetic data company specializing in the creation of high-quality training data for AI computer vision models. As part of the investment, Appen has formed a commercial partnership agreement with Mindtech.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24705,"url":"https:\/\/insidebigdata.com\/2020\/07\/08\/special-report-the-state-of-ai-and-machine-learning\/","url_meta":{"origin":25846,"position":1},"title":"Special Report: The State of AI and Machine Learning","date":"July 8, 2020","format":false,"excerpt":"Appen Limited, a leading provider of high-quality training data for organizations that build effective AI systems at scale, released its annual State of AI Report for 2020. The report highlights increasing C-suite involvement and investment in enterprise AI projects as well as data being a key challenge as AI models\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2020\/07\/Appen_State_of_AI_report.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":23576,"url":"https:\/\/insidebigdata.com\/2019\/11\/17\/how-to-ensure-data-quality-for-ai\/","url_meta":{"origin":25846,"position":2},"title":"How to Ensure Data Quality for AI","date":"November 17, 2019","format":false,"excerpt":"In this special guest feature, Wilson Pang, CTO of Appen, offers a few quality controls that organizations can implement to allow for the most accurate and consistent data annotation process possible. When we talk about quality training data, we\u2019re talking about both the accuracy and consistency of those labels. Accuracy\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2019\/11\/WilsonPang.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":20183,"url":"https:\/\/insidebigdata.com\/2018\/04\/03\/crowdflower-unveils-new-machine-learning-solutions-changes-name-figure-eight\/","url_meta":{"origin":25846,"position":3},"title":"CrowdFlower Unveils New Machine Learning Solutions; Changes Name to Figure Eight","date":"April 3, 2018","format":false,"excerpt":"CrowdFlower, the essential Human-in-the-Loop artificial intelligence platform for data science and machine learning teams, today unveiled new machine learning solutions that will help companies reduce the time to apply AI to their business and generate business impact from real world AI applications.","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2014\/11\/crowdflower_logo.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33127,"url":"https:\/\/insidebigdata.com\/2023\/08\/12\/why-reinforcement-learning-will-save-generative-ai\/","url_meta":{"origin":25846,"position":4},"title":"Why Reinforcement Learning Will Save Generative AI","date":"August 12, 2023","format":false,"excerpt":"In this contributed article, Kim Stagg, VP of Product for Appen, knows the only way to achieve functional AI models is to use high-quality data in every stage of deployment. As businesses look for pathways to adoption, there must be a significant focus on removing bottlenecks for data quality in\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":26589,"url":"https:\/\/insidebigdata.com\/2021\/07\/01\/the-state-of-ai-and-machine-learning\/","url_meta":{"origin":25846,"position":5},"title":"The State of AI and Machine Learning","date":"July 1, 2021","format":false,"excerpt":"In the 7th edition of its annual State of AI and Machine Learning report, Appen continues to explore the strategies\u00a0 employed by companies large and small in successfully deploying AI. The reports surveys business\u00a0 leaders and technical practitioners ( referred to as technologists) alike to understand\u00a0 their priorities, their successes,\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2021\/06\/Appen_State_AI_fig.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/25846"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=25846"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/25846\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/25847"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=25846"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=25846"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=25846"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}