{"id":27382,"date":"2021-10-13T06:00:00","date_gmt":"2021-10-13T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=27382"},"modified":"2021-10-14T08:09:51","modified_gmt":"2021-10-14T15:09:51","slug":"building-the-gpu-accelerated-datacenter","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/","title":{"rendered":"Building the GPU-accelerated Datacenter"},"content":{"rendered":"\n<p class=\"has-text-align-center\"><em>Sponsored Post<\/em><\/p>\n\n\n\n<div class=\"wp-block-image is-style-default\"><figure class=\"aligncenter size-large\"><a href=\"https:\/\/www.pny.com\/forms\/professional\/webinars\/building-the-gpu-accelerated-data-center\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" width=\"600\" height=\"101\" src=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/source-code-webinar-email-signature-banner_iBD.jpg\" alt=\"\" class=\"wp-image-27383\" srcset=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/source-code-webinar-email-signature-banner_iBD.jpg 600w, https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/source-code-webinar-email-signature-banner_iBD-150x25.jpg 150w, https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/source-code-webinar-email-signature-banner_iBD-300x51.jpg 300w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/a><\/figure><\/div>\n\n\n\n<p>Data volumes have been increasing for years \u2013 and researchers expect they will continue to increase in the coming years.<\/p>\n\n\n\n<p>Meanwhile, edge computing, 5G-fueled hyperconnectivity, artificial intelligence (AI), and other new technologies we\u2019ve been hearing about for years are becoming real solution realities, not research projects.<\/p>\n\n\n\n<p>For these and many other reasons, organizations and the technologists that support them are being forced to reimagine the datacenter that is still the heart of most data-reliant organizations. Modern datacenters need to be ready for what\u2019s next, ideally without downtime or unplanned costs\u200b.<\/p>\n\n\n\n<p>From academia to aerospace\/defense to finance to life sciences, and high-performance computing, standing still means quickly falling behind. You become less competitive in terms of innovation, mission execution, even attracting and retaining talent.<\/p>\n\n\n\n<p>Fortunately, there is a solution many organizations can implement today that addresses many of these issues \u2013 building a datacenter that incorporates graphics processing unit (GPU) workload acceleration.<\/p>\n\n\n\n<p>Why?<\/p>\n\n\n\n<p>Its well-known that GPUs can accelerate deep learning, machine learning and high-performance computing (HPC) workloads. However, they can also improve performance of data-heavy applications. Virtualization allows users to take advantage of the fact that GPUs rarely operate anywhere near capacity. By abstracting GPU hardware from the software virtualization essentially right-sizes GPU acceleration for every task.<\/p>\n\n\n\n<p>Also, many exciting new technologies are being built on GPUs\u200b or explicitly need the acceleration GPUs provide. While AI is certainly an example of this, the same highly-parallel mathematical operations that make GPUs so valuable for any algorithm that can exploit embarrassingly parallel approaches can also accelerate the most demanding hyperscale and enterprise data center workloads.<\/p>\n\n\n\n<p>GPU-based infrastructure requires fewer servers, dramatically improves performance per Watt, and offers unrivaled performance\u200b. Consider, for example the 20x improvement of NVIDIA\u2019s Ampere architecture over previous generations of GPUs due to numerous architectural innovations and transistor count increases. The cost of GPUs has been dropping in recent years while the hardware infrastructure and software stacks that can take advantage of them \u2013 both storage and compute \u2013 have been rapidly expanding. As a result, you can more accurately predict future performance capacity and, thus, the costs of potential workload expansion.<\/p>\n\n\n\n<p>How?<\/p>\n\n\n\n<p>GPUs are ideal parallel processing engines with high-speed memory with lots of bandwidth. They\u2019re often more efficient and require less floor space than central processing units (CPUs), which traditionally have served as the performance driver of datacenters. To make the case for GPU adoption even stronger, GPU providers such as NVIDIA are pre-testing and bundling software necessary for workload execution.<\/p>\n\n\n\n<p>Hardware infrastructure providers such as Thinkmate (<a href=\"https:\/\/www.thinkmate.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Thinkmate.com<\/a>) have spent the last several years ensuring clients of all kinds have access to the computing and storage technology they need to not just keep up but leapfrog competitors in the GPU-enabled datacenter era. Today, the options are greater than ever before.<\/p>\n\n\n\n<p>You can get systems that generate massively parallel processing power and offer unrivaled networking flexibility. Choices include two double-width GPUs or up to 5 expansion slots in a 1U, for performance and quality that is optimized for the most computationally intensive applications. At the same time, thanks to GPU-experienced engineers, these unique designs come with Gold Level power supplies, energy-saving motherboards and enterprise class server management to optimize cooling for even the most demanding applications.<\/p>\n\n\n\n<p>By working with experienced infrastructure providers with access to the latest technology and training to inform their system designs, organizations and their datacenter administrators can transform or augment existing datacenters to be more agile and performant without breaking the bank or shutting down operations.<\/p>\n\n\n\n<p>To learn more about GPU-accelerated datacenters, join the upcoming live webinar from Thinkmate and PNY via this <a href=\"https:\/\/www.pny.com\/forms\/professional\/webinars\/building-the-gpu-accelerated-data-center\" target=\"_blank\" rel=\"noreferrer noopener\">registration page<\/a>. We\u2019ll dive into the future of the datacenter, why the GPU is crucial, the technology behind GPU acceleration, and what sort of options exist for different industries or types of organizations.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.pny.com\/forms\/professional\/webinars\/building-the-gpu-accelerated-data-center\" target=\"_blank\" rel=\"noreferrer noopener\">REGISTER NOW<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[Sponsored Post] To learn about GPU-accelerated datacenters, join the upcoming live webinar from Thinkmate and PNY. You\u2019ll hear about the future of the datacenter, why the GPU is crucial, the technology behind GPU acceleration, and what sort of options exist for different industries or types of organizations.<\/p>\n","protected":false},"author":10513,"featured_media":27384,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,115,62,81,87,180,258,56,83,311,1],"tags":[617,865,263,895,1061,95],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Building the GPU-accelerated Datacenter - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Building the GPU-accelerated Datacenter - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"[Sponsored Post] To learn about GPU-accelerated datacenters, join the upcoming live webinar from Thinkmate and PNY. You\u2019ll hear about the future of the datacenter, why the GPU is crucial, the technology behind GPU acceleration, and what sort of options exist for different industries or types of organizations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-13T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-14T15:09:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/Source-Code-Webinar-Facebook-1200x628-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"157\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/\",\"url\":\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/\",\"name\":\"Building the GPU-accelerated Datacenter - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2021-10-13T13:00:00+00:00\",\"dateModified\":\"2021-10-14T15:09:51+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Building the GPU-accelerated Datacenter\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Building the GPU-accelerated Datacenter - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/","og_locale":"en_US","og_type":"article","og_title":"Building the GPU-accelerated Datacenter - insideBIGDATA","og_description":"[Sponsored Post] To learn about GPU-accelerated datacenters, join the upcoming live webinar from Thinkmate and PNY. You\u2019ll hear about the future of the datacenter, why the GPU is crucial, the technology behind GPU acceleration, and what sort of options exist for different industries or types of organizations.","og_url":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2021-10-13T13:00:00+00:00","article_modified_time":"2021-10-14T15:09:51+00:00","og_image":[{"width":300,"height":157,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/Source-Code-Webinar-Facebook-1200x628-1.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/","url":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/","name":"Building the GPU-accelerated Datacenter - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2021-10-13T13:00:00+00:00","dateModified":"2021-10-14T15:09:51+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2021\/10\/13\/building-the-gpu-accelerated-datacenter\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Building the GPU-accelerated Datacenter"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/Source-Code-Webinar-Facebook-1200x628-1.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-77E","jetpack-related-posts":[{"id":24551,"url":"https:\/\/insidebigdata.com\/2020\/06\/08\/interview-global-technology-leader-pny\/","url_meta":{"origin":27382,"position":0},"title":"Interview: Global Technology Leader PNY","date":"June 8, 2020","format":false,"excerpt":"We recently caught up with our friends over at PNY to discuss a variety of topics affecting data scientists conducting work on big data problem domains including how \u201cBig Data\u201d is becoming increasingly accessible with big clusters with disk-based databases, small clusters with in-memory data, single systems with in-CPU-memory data,\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2020\/03\/PNYLogo2020-03-16_9-23-48.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":29115,"url":"https:\/\/insidebigdata.com\/2022\/04\/25\/nvidia-networking-solutions-unlock-the-full-potential-of-your-data-center\/","url_meta":{"origin":27382,"position":1},"title":"NVIDIA Networking Solutions &#8211; Unlock the full potential of your Data Center","date":"April 25, 2022","format":false,"excerpt":"[SPONSORED POST] NVIDIA\u00ae\u00a0is the leader in accelerated networking solutions and a pioneer in new advancements such as the Data Processing Unit (DPU) which is why PNY is proud to become an\u00a0NVIDIA networking\u00a0product partner carrying and supporting\u00a0NVIDIA\u2019s\u00a0entire Ethernet and InfiniBand end-to-end product suites. In this article, we highlight four PNY videos\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/04\/PNY_IBD_pic1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":25701,"url":"https:\/\/insidebigdata.com\/2021\/03\/08\/nvidia-a100-a40-and-nvidia-rtx-a6000-ampere-architecture-based-professional-gpus-transform-data-science-and-big-data-analytics\/","url_meta":{"origin":27382,"position":2},"title":"NVIDIA A100, A40 and NVIDIA RTX A6000 Ampere Architecture-Based Professional GPUs Transform Data Science and Big Data Analytics","date":"March 8, 2021","format":false,"excerpt":"Scientists, researchers, and engineers are solving the world\u2019s most important scientific, industrial, and big data challenges with AI and high-performance computing (HPC). Businesses, even entire industries, harness the power of AI to extract new insights from massive data sets, both on-premises and in the cloud. NVIDIA Ampere architecture-based products, like\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Pic3.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":18863,"url":"https:\/\/insidebigdata.com\/2017\/09\/14\/spend-less-time-processing-queries-time-gaining-insights\/","url_meta":{"origin":27382,"position":3},"title":"How To Spend Less Time Processing Queries And More Time Gaining Insights","date":"September 14, 2017","format":false,"excerpt":"In this contributed article, Richard Heyns, CEO of Brytlyt discusses the trend of companies adopting GPU database software and the things they should keep in mind when adopting a GPU database.","rel":"","context":"In &quot;Analytics&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":29436,"url":"https:\/\/insidebigdata.com\/2022\/05\/24\/introducing-vultr-talon-with-nvidia-gpus-cloud-platform-breakthrough-makes-accelerated-computing-efficient-and-affordable\/","url_meta":{"origin":27382,"position":4},"title":"Introducing Vultr Talon with NVIDIA GPUs \u2014 Cloud Platform Breakthrough Makes Accelerated Computing Efficient and Affordable","date":"May 24, 2022","format":false,"excerpt":"Vultr\u00ae, a leading independent provider of cloud infrastructure, announced that Vultr Talon, powered by NVIDIA GPUs and NVIDIA AI Enterprise software, is now available in beta. A breakthrough cloud-based platform, Vultr Talon offers affordable accelerated computing by enabling GPU sharing, so multiple workloads can efficiently run on a single NVIDIA\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/05\/Vultr_fig1.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":13379,"url":"https:\/\/insidebigdata.com\/2015\/07\/15\/nvidia-doubles-performance-for-deep-learning-training\/","url_meta":{"origin":27382,"position":5},"title":"NVIDIA Doubles Performance for Deep Learning Training","date":"July 15, 2015","format":false,"excerpt":"NVIDIA announced updates to its GPU-accelerated deep learning software that will double deep learning training performance. The new software will empower data scientists and researchers to supercharge their deep learning projects and product development work.","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/27382"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=27382"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/27382\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/27384"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=27382"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=27382"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=27382"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}