{"id":33811,"date":"2023-11-03T03:00:00","date_gmt":"2023-11-03T10:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=33811"},"modified":"2023-11-03T09:16:12","modified_gmt":"2023-11-03T16:16:12","slug":"the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/","title":{"rendered":"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0"},"content":{"rendered":"\n

Back in May of this year, the Federal Reserve was deciding whether to hike interest rates yet again. Evercore ISI strategists said in a note that<\/a>, \u201cThe absence of any such preparation [for a raise] is the signal and gives us additional confidence that the Fed is not going to hike in June absent a very big surprise in the remaining data, though we should expect a hawkish pause.\u201d<\/p>\n\n\n\n

Well, they were right. The Federal Reserve ultimately decided<\/a> to keep its key interest rate at about 5% after ten consecutive meetings during which it was hiked. This brings about an important question: Should there ever be \u201cvery big surprises\u201d (or any surprises, for that matter) in the data on which the Fed bases these critical decisions? <\/p>\n\n\n\n

In my opinion, the answer is no. There shouldn\u2019t ever be a question of making an incorrect economic decision because the right data is<\/em> indeed available. But the truth is, the Federal Reserve has been basing most of its decisions on stale, outdated data. <\/p>\n\n\n\n

Why? The Fed uses a measure of core inflation to make its most important decisions, and that measure is derived from surveys conducted by the Bureau of Labor Statistics. While they may also have some privileged information the public isn\u2019t privy to, by nature, surveys take a while to administer. By the time the data is processed and cleaned up, it’s essentially already a month old. <\/p>\n\n\n\n

Everyone can agree that having faster, more up-to-date data would be ideal in this situation. But the path to getting there isn\u2019t linear: It\u2019ll require some tradeoffs, taking a hard look at flaws in current processes, and a significant shift in mindset that the Fed may not be ready for. <\/p>\n\n\n\n

Here are some things to consider:<\/p>\n\n\n\n

Fast vs accurate: We need to find a happy medium<\/strong><\/p>\n\n\n\n

At some point, the Fed will need to decide whether it\u2019s worth trying a new strategy of using fast, imperfect data in place of the data generated by traditional survey methods. The latter may offer more statistical control, but it becomes stale quickly.<\/p>\n\n\n\n

Making the switch to using faster data will require a paradigm shift: Survey data has been the gold standard for decades at this point, and many people find comfort in its perceived accuracy. However, any data can fall prey to biases.  <\/p>\n\n\n\n

Survey data isn\u2019t a silver bullet<\/strong><\/p>\n\n\n\n

There’s a commonly held belief that surveys are conducted very carefully and adjusted for biases, while fast data that comes from digital sources can never be truly representative. While this may be the case some of the time, survey biases are a well-documented phenomenon. No one solution is perfect, but the difference is that the problems associated with survey data have existed for decades and people have become comfortable with them. When confronted with the issues posed by modern methods, they are much more risk-averse.<\/p>\n\n\n\n

In my mind, the Fed\u2019s proclivity toward survey data has a lot to do with the fact that most people working within the organization are economists, not computer scientists, developers, or data scientists (who are more accustomed to working with other data sources). While there’s a wealth of theoretical knowledge in this space, there’s also a lack of data engineering and data science talent, which may soon need to change. <\/p>\n\n\n\n

A cultural shift needs to occur<\/strong><\/p>\n\n\n\n

We need a way to balance both accuracy and forward momentum. What might this look like? To start, it would be great to see organizations like the U.S. Census, the Bureau of Labor Statistics, and the Bureau of Economic Analysis (BEA) release more experimental economic trackers. We\u2019re already starting to see this here and there: For example, the BEA released a tracker<\/a> that monitors consumer spending.<\/p>\n\n\n\n

Traditionally, these agencies have been very conservative in their approach to data, understandably shying away from methods that might produce inaccurate results. But in doing so, they\u2019ve been holding themselves to an impossibly high bar at the cost of speed. They may be forced to reconsider this approach soon, though. For years, there\u2019s been a steady decline<\/a> in federal survey response rates. How can the government collect accurate economic data if businesses and other entities aren\u2019t readily providing it? <\/p>\n\n\n\n

When it comes down to it, we\u2019ve become accustomed to methodologies that have existed for decades because we\u2019re comfortable with their level of error. But by continuing to rely solely on these methods, we may actually end up incurring more error as things like response rates continue to fall. We need to stay open to the possibility that relying on faster, external data sources might be the necessary next step to making more sound economic decisions. <\/p>\n\n\n\n

About the Author<\/strong><\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Alex Izydorczyk is the founder and CEO of\u00a0Cybersyn<\/a>, the data-as-a-service company\u00a0making the world\u2019s economic data available to businesses, governments, and entrepreneurs on\u00a0Snowflake Marketplace<\/a>. With more than seven years of experience leading the data science team at Coatue, a $70 billion investment manager,\u00a0Alex brings a wealth of knowledge and expertise to the table. As the architect of Coatue\u2019s data science practice, he led a team of over 40 people in leveraging external data to drive investment decisions. Alex\u2019s background in private equity data infrastructure also includes an investment in Snowflake. His passion for real-time economic data led him to start Cybersyn in 2022.\u00a0<\/em><\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

In this contributed article, Alex Izydorczyk, founder and CEO of Cybersyn, discusses an important question: Should there ever be \u201cvery big surprises\u201d (or any surprises, for that matter) in the data on which the Federal Reserve bases decisions on? <\/p>\n","protected":false},"author":10531,"featured_media":29328,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[115,72,180,61,56,97,1],"tags":[280,1407,1406],"acf":[],"yoast_head":"\nThe Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0 - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0 - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"In this contributed article, Alex Izydorczyk, founder and CEO of Cybersyn, discusses an important question: Should there ever be \u201cvery big surprises\u201d (or any surprises, for that matter) in the data on which the Federal Reserve bases decisions on?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-03T10:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-03T16:16:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2022\/05\/Banking_finance_shutterstock_732185581.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"174\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Contributor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Contributor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/\",\"name\":\"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0 - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-11-03T10:00:00+00:00\",\"dateModified\":\"2023-11-03T16:16:12+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87\",\"name\":\"Contributor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g\",\"caption\":\"Contributor\"},\"url\":\"https:\/\/insidebigdata.com\/author\/contributor\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0 - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/","og_locale":"en_US","og_type":"article","og_title":"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0 - insideBIGDATA","og_description":"In this contributed article, Alex Izydorczyk, founder and CEO of Cybersyn, discusses an important question: Should there ever be \u201cvery big surprises\u201d (or any surprises, for that matter) in the data on which the Federal Reserve bases decisions on?","og_url":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-11-03T10:00:00+00:00","article_modified_time":"2023-11-03T16:16:12+00:00","og_image":[{"width":300,"height":174,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2022\/05\/Banking_finance_shutterstock_732185581.jpg","type":"image\/jpeg"}],"author":"Contributor","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Contributor","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/","url":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/","name":"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0 - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-11-03T10:00:00+00:00","dateModified":"2023-11-03T16:16:12+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/11\/03\/the-government-needs-fast-data-why-is-the-federal-reserve-making-world-altering-decisions-on-stale-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"The Government Needs Fast Data: Why is the Federal Reserve Making World-altering Decisions on Stale Data?\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87","name":"Contributor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g","caption":"Contributor"},"url":"https:\/\/insidebigdata.com\/author\/contributor\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2022\/05\/Banking_finance_shutterstock_732185581.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8Nl","jetpack-related-posts":[{"id":21363,"url":"https:\/\/insidebigdata.com\/2018\/10\/31\/small-data-helps-understand-individuals-real-time\/","url_meta":{"origin":33811,"position":0},"title":"How Small Data Helps Understand Individuals in Real Time","date":"October 31, 2018","format":false,"excerpt":"In this special guest feature, Jeff McDowell, COO of Primal, discusses the importance of small data and big data analysis when providing timely and accurate AI recommendations based on interest compared to the stale irrelevant recommendations most online channels provide today.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":9402,"url":"https:\/\/insidebigdata.com\/2014\/05\/24\/big-data-analytics-big-benefits-healthcare\/","url_meta":{"origin":33811,"position":1},"title":"Big Data Analytics, Big Benefits for Healthcare","date":"May 24, 2014","format":false,"excerpt":"Federal agencies have great expectations for how big data analytics can improve healthcare, but are they doing enough to prepare to take advantage of big data? A MeritTalk survey of 150 federal executives involved in healthcare or healthcare research reveals that 62% of those surveyed believe that big data will\u2026","rel":"","context":"In "Analytics"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":14719,"url":"https:\/\/insidebigdata.com\/2016\/03\/27\/zoomdata-launches-federal-program-big-data-visual-analytics\/","url_meta":{"origin":33811,"position":2},"title":"Zoomdata Launches Federal Program for Big Data Visual Analytics","date":"March 27, 2016","format":false,"excerpt":"Zoomdata, developers of one of the world's fastest visual analytics solution for big data, announced the launch of its new federal program, designed with leading technology and professional services partners to help government agencies capitalize on the enormous amounts of data they generate and collect.","rel":"","context":"In "Analytics"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2015\/07\/Zoomdata.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":1296,"url":"https:\/\/insidebigdata.com\/2012\/04\/09\/podcast-federal-news-radio-panel-discussion-on-big-data\/","url_meta":{"origin":33811,"position":3},"title":"Podcast: Federal News Radio Panel Discussion on Big Data","date":"April 9, 2012","format":false,"excerpt":"In this podcast, Federal News Radio hosts a Panel Discussion on Big Data entitled \"Progress & Best Practices.\" Moderator:Jim Flyzik -Flyzik Group Panelists: Zach Goldstein - DCIO, NOAA Adrian Gardner - CIO, NASA Goddard Dr. Robert Norris - Chief Architect, NGA Alan Hansen - Director-Intelligence Systems & Processing Division, US\u2026","rel":"","context":"Similar post","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":20123,"url":"https:\/\/insidebigdata.com\/2018\/03\/22\/true-real-time-data-matters-risks-processing-data-rest-rather-data-motion\/","url_meta":{"origin":33811,"position":4},"title":"Why “True” Real-time Data Matters: The Risks of Processing Data-at-rest Rather than Data-in-motion","date":"March 22, 2018","format":false,"excerpt":"In this special guest feature, Guy Churchward, President and CEO of DataTorrent, discusses the risks around processing data at rest rather than data in motion, or \u201ctrue\u201d real-time data.","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2018\/03\/Guy_Churchward.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":1266,"url":"https:\/\/insidebigdata.com\/2012\/03\/30\/nsf-to-lead-federal-efforts-in-big-data\/","url_meta":{"origin":33811,"position":5},"title":"NSF to Lead Federal Efforts In Big Data","date":"March 30, 2012","format":false,"excerpt":"Clipped from: www.nsf.gov (share this clip) At a White House event yesterday, NSF Director Subra Suresh announced a new Big Data solicitation including a $10 million Expeditions in Computing award and awards in cyberinfrastructure, geosciences, and training. Data are motivating a profound transformation in the culture and conduct of scientific\u2026","rel":"","context":"In "Government"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33811"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10531"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=33811"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33811\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/29328"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=33811"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=33811"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=33811"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}