{"id":25781,"date":"2021-03-16T06:00:00","date_gmt":"2021-03-16T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=25781"},"modified":"2021-03-17T15:01:41","modified_gmt":"2021-03-17T22:01:41","slug":"deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/","title":{"rendered":"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs"},"content":{"rendered":"\n
\"\"<\/figure><\/div>\n\n\n\n

Deci<\/a>, the deep learning company building the next generation of AI, announced a broad strategic business and technology collaboration with Intel Corporation to optimize deep learning inference on Intel Architecture (IA) CPUs. As one of the first companies to participate in Intel Ignite startup accelerator, Deci will now work with Intel to deploy innovative AI technologies to mutual customers.     <\/p>\n\n\n\n

The collaboration between Deci and Intel takes a significant step towards enabling deep learning inference at scale on Intel CPUs, reducing costs and latency, and enabling new applications of deep learning inference. New deep learning tasks can be performed in a real-time environment on edge devices and companies that use large scale inference scenarios can dramatically cut cloud or datacenter cost, simply by changing the inference hardware from GPU to Intel CPU.<\/p>\n\n\n\n

\u201cBy optimizing the AI models that run on Intel\u2019s hardware, Deci enables customers to get even more speed and will allow for cost-effective and more general deep learning use cases on Intel CPUs,\u201d said Deci CEO and co-founder Yonatan Geifman. \u201cWe are delighted to collaborate with Intel to deliver even greater value to our mutual customers and look forward to a successful partnership.\u201d<\/p><\/blockquote>\n\n\n\n

Deci and Intel\u2019s collaboration began with MLPerf where on several popular Intel CPUs, Deci\u2019s AutoNAC (Automated Neural Architecture Construction) technology accelerated the inference speed<\/a> of the well-known ResNet-50 neural network, reducing the submitted models\u2019 latency by a factor of up to 11.8x and increasing throughput by up to 11x. Deci\u2019s AutoNAC technology uses machine learning to redesign any model and maximize its inference performance on any hardware \u2013 all while preserving its accuracy.<\/p>\n\n\n\n

\u201cDeci delivers optimized deep learning inference on Intel processors as highlighted in MLPerf. Optimizing advanced AI models on general purpose infrastructure based on Intel Xeon Scalable CPUs allows our customers to meet performance SLAs, reduce cost, decrease time to deployment, and gives them the ability to effectively scale,\u201d said Monica Livingston, AI Solutions and Sales Director at Intel.     <\/p><\/blockquote>\n\n\n\n

This collaboration started with Deci being one of the first companies to join Intel Ignite, an accelerator program designed to support innovative startups in advancing new technologies in disruptive markets. Pilots of Deci\u2019s platform to select customers in the enterprise, cloud, communications, and media segments are being developed to enable them to scale up and further accelerate their deep learning usage on Intel CPUs. As the results of these engagements are shared, an opportunity to scale the Deci platform to a broader base of customers is being planned.<\/p>\n\n\n\n

For more in-depth information about Deci and Intel\u2019s MLPerf results, see here<\/a>.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: @InsideBigData1 \u2013 https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Deci, the deep learning company building the next generation of AI, announced a broad strategic business and technology collaboration with Intel Corporation to optimize deep learning inference on Intel Architecture (IA) CPUs. As one of the first companies to participate in Intel Ignite startup accelerator, Deci will now work with Intel to deploy innovative AI technologies to mutual customers. <\/p>\n","protected":false},"author":10513,"featured_media":25782,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,87,180,210,67,56,1],"tags":[437,324,580,896,284,941,96],"acf":[],"yoast_head":"\nDeci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"Deci, the deep learning company building the next generation of AI, announced a broad strategic business and technology collaboration with Intel Corporation to optimize deep learning inference on Intel Architecture (IA) CPUs. As one of the first companies to participate in Intel Ignite startup accelerator, Deci will now work with Intel to deploy innovative AI technologies to mutual customers.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2021-03-16T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-03-17T22:01:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/03\/Deci_Intel.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"206\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/\",\"url\":\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/\",\"name\":\"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2021-03-16T13:00:00+00:00\",\"dateModified\":\"2021-03-17T22:01:41+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/","og_locale":"en_US","og_type":"article","og_title":"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs - insideBIGDATA","og_description":"Deci, the deep learning company building the next generation of AI, announced a broad strategic business and technology collaboration with Intel Corporation to optimize deep learning inference on Intel Architecture (IA) CPUs. As one of the first companies to participate in Intel Ignite startup accelerator, Deci will now work with Intel to deploy innovative AI technologies to mutual customers.","og_url":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2021-03-16T13:00:00+00:00","article_modified_time":"2021-03-17T22:01:41+00:00","og_image":[{"width":300,"height":206,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/03\/Deci_Intel.jpeg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/","url":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/","name":"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2021-03-16T13:00:00+00:00","dateModified":"2021-03-17T22:01:41+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2021\/03\/16\/deci-and-intel-collaborate-to-optimize-deep-learning-inference-on-intels-cpus\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Deci and Intel Collaborate to Optimize Deep Learning Inference on Intel\u2019s CPUs"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/03\/Deci_Intel.jpeg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-6HP","jetpack-related-posts":[{"id":31488,"url":"https:\/\/insidebigdata.com\/2023\/01\/28\/deci-delivers-breakthrough-inference-performance-on-intels-4th-gen-sapphire-rapids-cpu\/","url_meta":{"origin":25781,"position":0},"title":"Deci delivers breakthrough inference performance on Intel’s 4th Gen Sapphire Rapids CPU","date":"January 28, 2023","format":false,"excerpt":"Deci,\u00a0the deep learning company building the next generation of AI,\u00a0announced\u00a0a\u00a0breakthrough performance on Intel\u2019s newly released 4th\u00a0Gen Intel\u00ae Xeon\u00ae Scalable processors, code-named\u00a0Sapphire Rapids. By optimizing the AI models which run on Intel\u2019s new hardware, Deci enables AI developers to achieve GPU-like inference performance on CPUs in production for both Computer Vision\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/01\/Deci_fig1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":28941,"url":"https:\/\/insidebigdata.com\/2022\/04\/06\/deci-boosts-computer-vision-nlp-models-performance-at-mlperf\/","url_meta":{"origin":25781,"position":1},"title":"Deci Boosts Computer Vision & NLP Models\u2019 Performance at MLPerf\u00a0","date":"April 6, 2022","format":false,"excerpt":"Deci, the deep learning company harnessing Artificial Intelligence (AI) to build AI, announced its results for both Computer Vision (CV) and Natural Language Processing (NLP) inference models that were submitted to the MLPerf v2.0\u00a0Datacenter Open division. These submissions demonstrated the power of Deci\u2019s Automated Neural Architecture Construction (AutoNAC) technology, which\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":23061,"url":"https:\/\/insidebigdata.com\/2019\/08\/14\/the-ai-opportunity\/","url_meta":{"origin":25781,"position":2},"title":"The AI Opportunity","date":"August 14, 2019","format":false,"excerpt":"The tremendous growth in compute power and explosion of data is leading every industry to seek AI-based solutions. In this Tech.Decoded video, \u201cThe AI Opportunity - Episode 1: The Compute Power Difference,\u201d Vice President of Intel Architecture and AI expert Wei Li shares his views on the opportunities and challenges\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2019\/08\/Intel_AI_opportunities_pic.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":22979,"url":"https:\/\/insidebigdata.com\/2019\/07\/24\/darwinai-generative-synthesis-platform-and-intel-optimizations-for-tensorflow-accelerate-neural-networks\/","url_meta":{"origin":25781,"position":3},"title":"DarwinAI Generative Synthesis Platform and Intel Optimizations for TensorFlow Accelerate Neural Networks","date":"July 24, 2019","format":false,"excerpt":"DarwinAI, a Waterloo, Canada startup creating next-generation technologies for Artificial Intelligence development, announced that the company\u2019s Generative Synthesis platform \u2013 when used with Intel technology and optimizations \u2013 generated neural networks with a 16.3X improvement in image classification inference performance. Intel shared the optimization results in a recently published solution\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2019\/07\/DarwinAI_solution_pic.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":29303,"url":"https:\/\/insidebigdata.com\/2022\/05\/11\/deci-launches-version-2-0-of-its-deep-learning-development-platform-to-democratize-the-power-of-nas-and-eliminate-the-ai-efficiency-gap\/","url_meta":{"origin":25781,"position":4},"title":"Deci Launches Version 2.0 of its Deep Learning Development Platform, to Democratize the Power of NAS and Eliminate the AI Efficiency Gap\u00a0","date":"May 11, 2022","format":false,"excerpt":"Deci, the deep learning company harnessing AI to build AI, today launched Version 2.0 of its deep learning development platform, making it easier than ever before for AI developers to build, optimize, and deploy computer vision models on any hardware and environment including cloud, edge and mobile with outstanding accuracy\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":30345,"url":"https:\/\/insidebigdata.com\/2022\/09\/12\/decis-natural-language-processing-nlp-model-achieves-breakthrough-performance-at-mlperf\/","url_meta":{"origin":25781,"position":5},"title":"Deci\u2019s Natural Language Processing (NLP) Model Achieves Breakthrough Performance at MLPerf","date":"September 12, 2022","format":false,"excerpt":"Deci, the deep learning company harnessing Artificial Intelligence (AI) to build better AI, announced results for its Natural Language Processing (NLP) inference model submitted to the MLPerf Inference v2.1 benchmark suite under the open submission track.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/09\/Deci_table1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/25781"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=25781"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/25781\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/25782"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=25781"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=25781"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=25781"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}