{"id":29612,"date":"2022-06-18T06:00:00","date_gmt":"2022-06-18T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=29612"},"modified":"2022-06-29T09:37:37","modified_gmt":"2022-06-29T16:37:37","slug":"great-expectations-study-reveals-77-of-organizations-have-data-quality-issues","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/","title":{"rendered":"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

Great Exp<\/a>ectations<\/a>, a leading open-source platform for data quality, announced the results of a survey highlighting top pain points and consequences of poor data quality within organizations. Insights from 500 data practitioners (engineers, analysts, and scientists) showed that 77% have data quality issues and 91% said it\u2019s impacting their company\u2019s performance.<\/p>\n\n\n\n

\u201cPoor data quality and pipeline debt create organizational friction between stakeholders, with consequences like degraded confidence,\u201d said Abe Gong, CEO and Cofounder of Superconductive, the company that makes Great Expectations. \u201cThis survey made it clear that data quality issues are prevalent and they\u2019re harming business outcomes.\u201d <\/p><\/blockquote>\n\n\n\n

Data quality issues can make it difficult or impossible to see a “single view” of an end-user or service, lower productivity, obscure reliable performance metrics, and overwhelm development teams and budgets with data migration tasks. Data practitioners blamed poor data quality on lack of documentation (31%), lack of tooling (27%), and teams not understanding each other (22%). They said data scientists spent too much time preparing data for analysts, end-users complained about gaps in their data (such as lost transactions), and production teams were mired with delays. <\/p>\n\n\n\n

Data confidence is critical for organizations to make informed business decisions. Fewer than half of respondents expressed high trust in their organization\u2019s data, and 13% had low trust in data quality, which stemmed from broken apps or dashboards, decisions based on unreliable or bad data, teams having no shared understanding of metrics, and siloed or conflicting departments. Additional issues impacting data trust included alert fatigue, misalignment on certain metrics, and friction between teams.<\/p>\n\n\n\n

\u201cData quality is critical to facilitate the making of decisions with confidence across the organization, enabling a singular understanding of what that data means and what it’s being used for. That\u2019s why support for data quality efforts should be found at every level of an organization, from data scientists and engineers to the C-suite and board who have confidence in outcomes for decision-making,\u201d Gong said.<\/p><\/blockquote>\n\n\n\n

89% of respondents said their leadership was supportive of data quality efforts, and 52% believed leadership regards data quality with high trust. When asked about their company\u2019s current approach to data quality, 75% said they validated data. Only 11% do not think they have a data quality issue. Data quality efforts included having a data quality plan scoped and budgeted (22%), using a specific data quality tool (19%), checking data manually (14%), and building their own systems (15%). <\/p>\n\n\n\n

This survey was conducted in May 2022 by Pollfish, an independent research platform, leveraging responses from 500 information services and data professionals based in the United States (57% men and 43% women aged 18-54). 60% of respondents were employed at companies with 250 or more employees. <\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: @InsideBigData1 \u2013 https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Great Expectations, a leading open-source platform for data quality, announced the results of a survey highlighting top pain points and consequences of poor data quality within organizations. Insights from 500 data practitioners (engineers, analysts, and scientists) showed that 77% have data quality issues and 91% said it\u2019s impacting their company\u2019s performance.<\/p>\n","protected":false},"author":10513,"featured_media":27298,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[115,180,268,56,1],"tags":[237,96],"acf":[],"yoast_head":"\nGreat Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0 - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0 - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"Great Expectations, a leading open-source platform for data quality, announced the results of a survey highlighting top pain points and consequences of poor data quality within organizations. Insights from 500 data practitioners (engineers, analysts, and scientists) showed that 77% have data quality issues and 91% said it\u2019s impacting their company\u2019s performance.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2022-06-18T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-06-29T16:37:37+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/data_quality_shutterstock_243064750.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"283\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/\",\"url\":\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/\",\"name\":\"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0 - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2022-06-18T13:00:00+00:00\",\"dateModified\":\"2022-06-29T16:37:37+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0 - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/","og_locale":"en_US","og_type":"article","og_title":"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0 - insideBIGDATA","og_description":"Great Expectations, a leading open-source platform for data quality, announced the results of a survey highlighting top pain points and consequences of poor data quality within organizations. Insights from 500 data practitioners (engineers, analysts, and scientists) showed that 77% have data quality issues and 91% said it\u2019s impacting their company\u2019s performance.","og_url":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2022-06-18T13:00:00+00:00","article_modified_time":"2022-06-29T16:37:37+00:00","og_image":[{"width":300,"height":283,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/data_quality_shutterstock_243064750.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/","url":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/","name":"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0 - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2022-06-18T13:00:00+00:00","dateModified":"2022-06-29T16:37:37+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2022\/06\/18\/great-expectations-study-reveals-77-of-organizations-have-data-quality-issues\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Great Expectations Study Reveals 77% of Organizations have Data Quality Issues\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/data_quality_shutterstock_243064750.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-7HC","jetpack-related-posts":[{"id":32641,"url":"https:\/\/insidebigdata.com\/2023\/06\/14\/largest-data-engineering-survey-reports-on-adoption-of-modern-data-stack-tools\/","url_meta":{"origin":29612,"position":0},"title":"Largest Data Engineering Survey Reports on Adoption of Modern Data Stack Tools","date":"June 14, 2023","format":false,"excerpt":"Airbyte, creators of a fast-growing open-source data integration platform, made available results of the biggest data engineering survey in the market which provides\u00a0insights\u00a0into the latest trends, tools, and practices in data engineering \u2013 especially adoption of tools in the modern data stack.\u00a0Its first worldwide\u00a0State of Data survey displays results in\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":27297,"url":"https:\/\/insidebigdata.com\/2021\/10\/11\/almost-half-of-organizations-still-struggle-with-the-quality-of-their-data\/","url_meta":{"origin":29612,"position":1},"title":"Almost Half of Organizations Still Struggle with the Quality of their Data","date":"October 11, 2021","format":false,"excerpt":"Nearly half (48%) of organizations are still struggling to use and access quality data as underlying technology is failing to deliver on a number of critical functions. According to new research conducted by ESG in partnership with InterSystems, while organizations are looking to rapidly progress how they deliver data across\u2026","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/data_quality_shutterstock_243064750.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":32613,"url":"https:\/\/insidebigdata.com\/2023\/06\/13\/state-of-data-quality-report\/","url_meta":{"origin":29612,"position":2},"title":"State of Data Quality Report","date":"June 13, 2023","format":false,"excerpt":"Bigeye, the data observability company, announced the results of its 2023 State of Data Quality survey. The report sheds light on the most pervasive problems in data quality today. The report, which was researched and authored by Bigeye, consisted of answers from 100 survey respondents.","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2021\/10\/data_quality_shutterstock_243064750.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":22873,"url":"https:\/\/insidebigdata.com\/2019\/06\/30\/new-syncsort-trillium-software-delivers-data-quality-at-scale\/","url_meta":{"origin":29612,"position":3},"title":"New Syncsort Trillium Software Delivers Data Quality at Scale","date":"June 30, 2019","format":false,"excerpt":"Syncsort, a leader in Big Iron to Big Data software, unveiled Trillium DQ for Big Data, providing best-in-class data profiling and data quality capabilities in a single solution, designed to work natively with distributed architectures. Using Trillium DQ for Big Data, organizations can apply data quality to large volumes of\u2026","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":15233,"url":"https:\/\/insidebigdata.com\/2016\/06\/22\/big-data-or-bad-data-survey-shows-enterprises-struggle-to-manage-big-data-flows\/","url_meta":{"origin":29612,"position":4},"title":"Big Data or Bad Data? Survey Shows Enterprises Struggle to Manage Big Data Flows","date":"June 22, 2016","format":false,"excerpt":"StreamSets, the company that delivers performance management for data flows, today announced results from a global survey of more than 300 data management professionals conducted by independent research firm Dimensional Research\u00ae.","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28499,"url":"https:\/\/insidebigdata.com\/2022\/02\/27\/lxt-introduces-new-executive-survey-the-path-to-ai-maturity\/","url_meta":{"origin":29612,"position":5},"title":"LXT Introduces New Executive Survey, The Path to AI Maturity","date":"February 27, 2022","format":false,"excerpt":"LXT, an emerging leader in global AI training data, announced the findings of its first annual executive survey, The Path to AI Maturity. The new report highlights that investment in artificial intelligence is strong at mid-to-large US organizations, and that 40% rate themselves at the three highest levels of AI\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2022\/02\/LXT-AI-maturity_01-100.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/29612"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=29612"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/29612\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/27298"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=29612"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=29612"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=29612"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}