{"id":33161,"date":"2023-08-17T02:59:00","date_gmt":"2023-08-17T09:59:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=33161"},"modified":"2023-08-17T11:17:55","modified_gmt":"2023-08-17T18:17:55","slug":"generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/","title":{"rendered":"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

Deci<\/a>,\u00a0the deep learning company harnessing AI to build AI, released DeciCoder, its inaugural foundation model in generative AI helping users generate programming language code. This groundbreaking Large Language Model (LLM), dedicated to code generation with 1 billion parameters and an expansive 2048-context window, surpasses results released in equivalent models and effectively redefines the standards of efficient code generation.<\/p>\n\n\n\n

DeciCoder’s unmatched throughput and low memory footprint enables teams to achieve extensive code generation with low latency, and migrate workloads to more affordable and widely available GPUs such as the NVIDIA A10G, resulting in substantial cost savings. When DeciCoder was benchmarked on Hugging Face Inference Endpoints against well-established code LLMs such as SantaCoder, DeciCoder showcased a 22% increase in throughput, a significant reduction in memory usage, and a 1.5-2.4 percentage point improvement in accuracy on the HumanEval benchmark. Notably, when combining DeciCoder with Deci\u2019s LLM inference acceleration library, Infery, its throughput outperforms that of SantaCoder by 350%.   <\/p>\n\n\n\n

\n

“From enabling the fastest and most cost-efficient deployment for enterprises, to now branching into generative AI, we are relentlessly pushing boundaries and empowering developers with the advanced models and tools needed to effectively implement AI-powered applications across industries,\u201d  said  Yonatan Geifman PhD, CEO & co-founder of Deci. \u201cUtilizing DeciCoder means less operations during inference, which translates to lower computational costs.\u201d<\/p>\n<\/blockquote>\n\n\n\n

DeciCoder was generated using Deci\u2019s proprietary Automated Neural Architecture Construction (AutoNAC) engine, the most advanced Neural Architecture Search (NAS)-based technology on the market. AutoNAC identifies the ideal architecture that strikes a perfect balance between accuracy and processing speed, tailored for distinct data features, tasks, performance goals, and inference environment. Deci\u2019s AutoNAC has generated some of the world\u2019s most efficient computer vision and NLP models such as YOLO-NAS<\/a>, DeciBERT<\/a> and DeciSeg<\/a>, among others.<\/p>\n\n\n\n

The rollout of DeciCoder is the first in a series of the highly anticipated releases outlining Deci\u2019s Generative AI offering, which are due to be released in the coming weeks.\u00a0 DeciCoder and its pre-trained weights are available under the permissive Apache 2.0 License, granting developers broad usage rights and positioning the model for real-world, commercial applications.<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Deci, the deep learning company harnessing AI to build AI, released DeciCoder, its inaugural foundation model in generative AI helping users generate programming language code. This groundbreaking Large Language Model (LLM), dedicated to code generation with 1 billion parameters and an expansive 2048-context window, surpasses results released in equivalent models and effectively redefines the standards of efficient code generation.<\/p>\n","protected":false},"author":10513,"featured_media":32680,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,182,1323,180,67,268,56,1],"tags":[437,1245,1248,96],"acf":[],"yoast_head":"\nGenerative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0 - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0 - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"Deci, the deep learning company harnessing AI to build AI, released DeciCoder, its inaugural foundation model in generative AI helping users generate programming language code. This groundbreaking Large Language Model (LLM), dedicated to code generation with 1 billion parameters and an expansive 2048-context window, surpasses results released in equivalent models and effectively redefines the standards of efficient code generation.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-08-17T09:59:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-17T18:17:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1100\" \/>\n\t<meta property=\"og:image:height\" content=\"550\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/\",\"name\":\"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0 - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-08-17T09:59:00+00:00\",\"dateModified\":\"2023-08-17T18:17:55+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0 - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/","og_locale":"en_US","og_type":"article","og_title":"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0 - insideBIGDATA","og_description":"Deci, the deep learning company harnessing AI to build AI, released DeciCoder, its inaugural foundation model in generative AI helping users generate programming language code. This groundbreaking Large Language Model (LLM), dedicated to code generation with 1 billion parameters and an expansive 2048-context window, surpasses results released in equivalent models and effectively redefines the standards of efficient code generation.","og_url":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-08-17T09:59:00+00:00","article_modified_time":"2023-08-17T18:17:55+00:00","og_image":[{"width":1100,"height":550,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/","url":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/","name":"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0 - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-08-17T09:59:00+00:00","dateModified":"2023-08-17T18:17:55+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/08\/17\/generative-ai-report-deci-releases-powerful-open-source-generative-ai-model-decicoder-to-redefine-code-generation-for-developers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Generative AI Report: Deci Releases Powerful Open-Source Generative AI Model, DeciCoder, to Redefine Code Generation for Developers\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8CR","jetpack-related-posts":[{"id":34204,"url":"https:\/\/insidebigdata.com\/2023\/12\/14\/deci-unveils-decilm-7b-a-leap-forward-in-language-model-performance-and-inference-cost-efficiency\/","url_meta":{"origin":33161,"position":0},"title":"Deci Unveils DeciLM-7B: A Leap Forward in Language Model Performance and Inference Cost Efficiency","date":"December 14, 2023","format":false,"excerpt":"Deci, the deep learning company harnessing AI to build AI, unveiled the latest addition to its suite of innovative generative AI models, DeciLM-7B, a 7 billion parameter large language model. Building upon the success of its predecessor DeciLM 6B, DeciLM 7B is setting new benchmarks in the large language model\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":32900,"url":"https:\/\/insidebigdata.com\/2023\/07\/19\/poll-which-company-will-lead-the-llm-pack\/","url_meta":{"origin":33161,"position":1},"title":"POLL: Which Company Will Lead the LLM Pack?","date":"July 19, 2023","format":false,"excerpt":"Since the release of ChatGPT late last year, the world has gone crazy for large language models (LLMs) and generative AI powered by transformers. The biggest players in our industry are now jockeying for prime position in this lucrative space. The news cycle is extremely fast-paced and technology is advancing\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/AI_shutterstock_2287025875_special-1.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33558,"url":"https:\/\/insidebigdata.com\/2023\/10\/03\/generative-ai-report-10-3-2023\/","url_meta":{"origin":33161,"position":2},"title":"Generative AI Report \u2013 10\/3\/2023","date":"October 3, 2023","format":false,"excerpt":"Welcome to the Generative AI Report round-up feature here on insideBIGDATA with a special focus on all the new applications and integrations tied to generative AI technologies. We\u2019ve been receiving so many cool news items relating to applications and deployments centered on large language models (LLMs), we thought it would\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33412,"url":"https:\/\/insidebigdata.com\/2023\/09\/18\/anyscale-teams-with-nvidia-to-supercharge-llm-performance-and-efficiency\/","url_meta":{"origin":33161,"position":3},"title":"Anyscale Teams With NVIDIA to Supercharge LLM Performance and Efficiency","date":"September 18, 2023","format":false,"excerpt":"Anyscale, the AI infrastructure company built by the creators of Ray, the world\u2019s fastest-growing open-source unified framework for scalable computing, today announced a collaboration with NVIDIA to further boost the performance and efficiency of large language model (LLM) development on\u00a0Ray\u00a0and the\u00a0Anyscale Platform\u00a0for production AI.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Generative_AI_shutterstock_2273007347_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":32203,"url":"https:\/\/insidebigdata.com\/2023\/04\/25\/one-ai-introduces-cutgpt-a-slim-and-task-oriented-generative-ai-solution\/","url_meta":{"origin":33161,"position":4},"title":"One AI Introduces CutGPT, a Slim and Task-Oriented Generative AI Solution","date":"April 25, 2023","format":false,"excerpt":"One AI, the language AI platform that enable businesses to tune and deploy generative AI capabilities in days, has announced the release of CutGPT, a slim and task-oriented generative AI solution.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":33948,"url":"https:\/\/insidebigdata.com\/2023\/11\/21\/generative-ai-report-11-21-2023\/","url_meta":{"origin":33161,"position":5},"title":"Generative AI Report \u2013 11\/21\/2023","date":"November 21, 2023","format":false,"excerpt":"Welcome to the Generative AI Report round-up feature here on insideBIGDATA with a special focus on all the new applications and integrations tied to generative AI technologies. We\u2019ve been receiving so many cool news items relating to applications and deployments centered on large language models (LLMs), we thought it would\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33161"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=33161"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33161\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/32680"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=33161"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=33161"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=33161"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}