{"id":24908,"date":"2020-08-24T06:00:00","date_gmt":"2020-08-24T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=24908"},"modified":"2020-08-25T09:38:57","modified_gmt":"2020-08-25T16:38:57","slug":"interview-andy-horng-co-founder-and-head-of-ai-cultivate","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/","title":{"rendered":"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate"},"content":{"rendered":"\n
\"\"<\/figure><\/div>\n\n\n\n

I recently caught up with Andy Horng, Co-Founder and Head of AI at Cultivate<\/a>, to get a sense for the technology underlying the company’s AI-powered leadership development platform. NLP plays an important role, and as a result they’re using the RoBERTa language model for very good results. Andy has a background in data science and has worked as a software engineer building machine learning tools for legal document analysis and medical research. He holds a BS in Electrical Engineering\/Computer Science and a BA in Cognitive Science, both from the University of California Berkeley.<\/em><\/p>\n\n\n\n

insideBIGDATA:<\/strong> Apparently the area of AI that Cultivate uses is NLP. That’s a broad area of course, but is the company using any of the latest language models like GPT, GPT-2, or the latest GPT-3 (with zero-shot or few-shot learning)?<\/p>\n\n\n\n

Andy Horng:<\/strong> First, some background: Cultivate is a highly scalable platform that provides employees of highly digital\/distributed workplaces with their own personalized AI assistants. These assistants are able to tune in to the specific collaboration dynamics of each user’s team, and to each user’s specific roles and relationships within the team. With this knowledge, the assistants either coach managers to lead optimally or help individual contributors achieve maximal effectiveness. To do this, we’ve built a system which acts as a second set of eyes for the user in the digital space, scanning over their own emails, chat messages, and calendar events to pick up on conversational nuances and quantifying each of their digital relationships. Note that Cultivate is opt-in and private for individual employees, as an empowerment tool to strengthen workplace relationships.<\/p>\n\n\n\n

Technically, this involves deploying a number of different text sequence classification models to not only identify table stakes such as topic, sentiment, mood and politeness, but also various collaborative intents (committing to work, sharing completed work, scheduling a meeting, etc.) and personality tendencies.<\/p>\n\n\n\n

We rely largely on fine-tuning pre-trained language models to specific classification tasks. We’ve found the BERT family of models (specifically RoBERTa) to be a great trade-off between model size, inference speed, and fine-tuned performance.<\/p>\n\n\n\n

insideBIGDATA:<\/strong> What motivated the Cultivate technology early on … Word2vec, GloVe, or RNNs with seq2seq? Or is your tech based more on a transformer model like BERT, or CTRL?<\/p>\n\n\n\n

Andy Horng:<\/strong> Prior to the advent of BERT, training text classifiers without large amounts of data was a much more arduous task. Our early models relied mainly on GloVe embeddings and bidirectional LSTMs. We also invested significant time into data set development, i.e. building active learning processes and integrating various weak and programmatic supervision signals.<\/p>\n\n\n\n

insideBIGDATA:<\/strong> What’s your training time, and what compute resources are you using? How many parameters are in your model?<\/p>\n\n\n\n

Andy Horng:<\/strong> Compared to the resources poured into training the latest language models (e.g. GPT-3), our operations are relatively small scale. The RoBERTa language model we often use contains ~125M parameters. We do our model training on Google Cloud GPUs (such as NVIDIA Tesla T4s or P100s). Fine-tuning takes anywhere from 20 minutes to 2 hours, depending on the task.<\/p>\n\n\n\n

insideBIGDATA:<\/strong> Anything else you can convey that is of a deep dive level would be welcome.<\/p>\n\n\n\n

Andy Horng:<\/strong> While our NLP technology is certainly interesting, it’s important to note that it is just one component of our machine learning and data science efforts. After pulling out a large set of behavioral signals from digital conversations, we then turn to interpretation of these signals. We want to understand if certain behaviors are expected or anomalous. We also want to understand how various behaviors are causally linked to upstream variables (user preferences and team norms) and downstream variables (team engagement and manager performance). We’ve developed time series models and structural causal models to understand this. These models pinpoint specific behaviors to nudge users on, to maximally improve work for themselves and those around them.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

I recently caught up with Andy Horng, Co-Founder and Head of AI at Cultivate, to get a sense for the technology underlying the company’s AI-powered leadership development platform. NLP plays an important role, and as a result they’re using the RoBERTa language model for very good results.<\/p>\n","protected":false},"author":37,"featured_media":24909,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,87,180,191,56,97,1],"tags":[437,264,635,95],"acf":[],"yoast_head":"\nInterview: Andy Horng, Co-Founder and Head of AI, Cultivate - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"I recently caught up with Andy Horng, Co-Founder and Head of AI at Cultivate, to get a sense for the technology underlying the company's AI-powered leadership development platform. NLP plays an important role, and as a result they're using the RoBERTa language model for very good results.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2020-08-24T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-08-25T16:38:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2020\/08\/Andy-Horng.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"200\" \/>\n\t<meta property=\"og:image:height\" content=\"200\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Daniel Gutierrez\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AMULETAnalytics\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daniel Gutierrez\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/\",\"url\":\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/\",\"name\":\"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2020-08-24T13:00:00+00:00\",\"dateModified\":\"2020-08-25T16:38:57+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed\",\"name\":\"Daniel Gutierrez\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g\",\"caption\":\"Daniel Gutierrez\"},\"description\":\"Daniel D. Gutierrez is a Data Scientist with Los Angeles-based AMULET Analytics, a service division of AMULET Development Corp. He's been involved with data science and Big Data long before it came in vogue, so imagine his delight when the Harvard Business Review recently deemed \\\"data scientist\\\" as the sexiest profession for the 21st century. Previously, he taught computer science and database classes at UCLA Extension for over 15 years, and authored three computer industry books on database technology. He also served as technical editor, columnist and writer at a major computer industry monthly publication for 7 years. Follow his data science musings at @AMULETAnalytics.\",\"sameAs\":[\"http:\/\/www.insidebigdata.com\",\"https:\/\/twitter.com\/@AMULETAnalytics\"],\"url\":\"https:\/\/insidebigdata.com\/author\/dangutierrez\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/","og_locale":"en_US","og_type":"article","og_title":"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate - insideBIGDATA","og_description":"I recently caught up with Andy Horng, Co-Founder and Head of AI at Cultivate, to get a sense for the technology underlying the company's AI-powered leadership development platform. NLP plays an important role, and as a result they're using the RoBERTa language model for very good results.","og_url":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2020-08-24T13:00:00+00:00","article_modified_time":"2020-08-25T16:38:57+00:00","og_image":[{"width":200,"height":200,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2020\/08\/Andy-Horng.jpg","type":"image\/jpeg"}],"author":"Daniel Gutierrez","twitter_card":"summary_large_image","twitter_creator":"@AMULETAnalytics","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Daniel Gutierrez","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/","url":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/","name":"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2020-08-24T13:00:00+00:00","dateModified":"2020-08-25T16:38:57+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2020\/08\/24\/interview-andy-horng-co-founder-and-head-of-ai-cultivate\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Interview: Andy Horng, Co-Founder and Head of AI, Cultivate"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2540da209c83a68f4f5922848f7376ed","name":"Daniel Gutierrez","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5780282e7e567e2a502233e948464542?s=96&d=mm&r=g","caption":"Daniel Gutierrez"},"description":"Daniel D. Gutierrez is a Data Scientist with Los Angeles-based AMULET Analytics, a service division of AMULET Development Corp. He's been involved with data science and Big Data long before it came in vogue, so imagine his delight when the Harvard Business Review recently deemed \"data scientist\" as the sexiest profession for the 21st century. Previously, he taught computer science and database classes at UCLA Extension for over 15 years, and authored three computer industry books on database technology. He also served as technical editor, columnist and writer at a major computer industry monthly publication for 7 years. Follow his data science musings at @AMULETAnalytics.","sameAs":["http:\/\/www.insidebigdata.com","https:\/\/twitter.com\/@AMULETAnalytics"],"url":"https:\/\/insidebigdata.com\/author\/dangutierrez\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2020\/08\/Andy-Horng.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-6tK","jetpack-related-posts":[{"id":25737,"url":"https:\/\/insidebigdata.com\/2021\/03\/10\/interview-unlocking-audience-understanding-with-nlp-ai\/","url_meta":{"origin":24908,"position":0},"title":"Interview: Unlocking Audience Understanding with NLP AI","date":"March 10, 2021","format":false,"excerpt":"I recently caught up with Andrea Vattani, Co-Founder & Chief Scientist, Spiketrap, to explore the path forward for brands looking to unlock true understanding of their audiences and their communications in the context of the world. Only two months into 2021 and nearing our second year of the pandemic, consumer\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":18723,"url":"https:\/\/insidebigdata.com\/2017\/08\/25\/machine-learning-interpretability-driverless-ai\/","url_meta":{"origin":24908,"position":1},"title":"Machine Learning Interpretability with Driverless AI","date":"August 25, 2017","format":false,"excerpt":"In this presentation, our friends Andy Steinbach, Head of AI in Financial Services at NVIDIA, and Patrick Hall, Senior Director of Product at H2O.ai discuss Machine Learning Interpretability with Driverless AI. Interpretability is a hugely popular topic in machine learning. Wherever possible, interpretability approaches are deconstructed into more basic components\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/3_gm00kBwEw\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":21377,"url":"https:\/\/insidebigdata.com\/2018\/11\/05\/natural-language-processing-ai-innovation\/","url_meta":{"origin":24908,"position":2},"title":"Use of Natural Language Processing and AI Driving Big Data Innovation to New Levels","date":"November 5, 2018","format":false,"excerpt":"To really drive innovation to a whole new level we\u2019re seeing a rise in the use of Natural Language Processing (NLP) and Artificial Intelligence (AI) to make finding and using quality data that much easier. Leading industry analyst firms have noted that Machine Learning, AI and NLP are quickly becoming\u2026","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2018\/11\/Headshot_Sean-VP-Product-1-e1541006568163.jpeg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":28495,"url":"https:\/\/insidebigdata.com\/2022\/02\/17\/h2o-ai-democratizes-deep-learning-with-h2o-hydrogen-torch\/","url_meta":{"origin":24908,"position":3},"title":"H2O.ai Democratizes Deep Learning with H2O Hydrogen Torch","date":"February 17, 2022","format":false,"excerpt":"H2O.ai, an AI Cloud leader, announced H2O Hydrogen Torch, a deep learning training engine that makes it easy for companies of any size in any industry to make state-of-the-art image, video and natural language processing (NLP) models without coding.\u00a0","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2015\/11\/h2o-logo.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":28941,"url":"https:\/\/insidebigdata.com\/2022\/04\/06\/deci-boosts-computer-vision-nlp-models-performance-at-mlperf\/","url_meta":{"origin":24908,"position":4},"title":"Deci Boosts Computer Vision & NLP Models\u2019 Performance at MLPerf\u00a0","date":"April 6, 2022","format":false,"excerpt":"Deci, the deep learning company harnessing Artificial Intelligence (AI) to build AI, announced its results for both Computer Vision (CV) and Natural Language Processing (NLP) inference models that were submitted to the MLPerf v2.0\u00a0Datacenter Open division. These submissions demonstrated the power of Deci\u2019s Automated Neural Architecture Construction (AutoNAC) technology, which\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":32878,"url":"https:\/\/insidebigdata.com\/2023\/07\/25\/video-highlights-generative-ai-with-large-language-models\/","url_meta":{"origin":24908,"position":5},"title":"Video Highlights: Generative AI with Large Language Models","date":"July 25, 2023","format":false,"excerpt":"At an unprecedented pace, Large Language Models like GPT-4 are transforming the world in general and the field of data science in particular. This two-hour training video presentation by Jon Krohn, Co-Founder and Chief Data Scientist at the machine learning company Nebula, introduces deep learning transformer architectures including LLMs.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/24908"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/37"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=24908"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/24908\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/24909"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=24908"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=24908"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=24908"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}