{"id":24623,"date":"2020-06-19T06:00:00","date_gmt":"2020-06-19T13:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=24623"},"modified":"2020-06-20T10:22:23","modified_gmt":"2020-06-20T17:22:23","slug":"how-to-produce-cleaner-data-for-robust-pricing","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/","title":{"rendered":"How to Produce Cleaner Data for Robust Pricing"},"content":{"rendered":"\n

These days, a lot of people are talking about using data to make decisions. However, an often- overlooked aspect of data is that it can\u2019t always be trusted. Bad data leads to bad decisions. Garbage in \u2013 garbage out.<\/p>\n\n\n\n

A common reason for the data being garbage is that it is generated by strategic players. This is common in a two-sided marketplace, where you have the buyers on one side and sellers on the other. Every action by the buyers \u2013 like deciding whether to purchase something now or wait until an upcoming sale \u2013 influences the data. Sellers take data generated from the buying side to optimize operational decisions like pricing. But what happens when the buyers are aware of this and change their behavior to influence the seller to lower prices? Now, the data is generated by buyers who are incentivized to manipulate pricing.<\/p>\n\n\n\n

This frequently happens in online advertising markets, where sellers run large numbers of auctions for ad views. The buyers are advertisers who purchase millions of ad views in a given day, leading to frequent interactions with the sellers. The buyers know their bids are used to set future prices, so they can act strategically to lower their bids. By gaming the system, the data appears to set a lower valuation on the ad views, leading to lower prices.<\/p>\n\n\n\n

I looked at this problem with Adel Javanmard of the University of Southern California and Vahab Mirrokni of Google Research and found that there are ways to limit this price manipulation. The key is the pricing algorithm. Instead of using bids to directly set prices, we designed an algorithm that uses censored bids\u2013 in this case a binary signal \u2013 to indicate whether the buyer wins in the prior auction or not.<\/p>\n\n\n\n

Why does this work? Buyers need to change the binary signal to manipulate future prices. This means that they need to change the outcome of the auctions to influence the future prices, where such a change is costly for them, as it can lead to losing the current auction. Thus, by using the binary signal, we make it costly for the buyer to do any manipulation.<\/p>\n\n\n\n

As manipulation decreases, sellers have access to cleaner date, which leads to better data-driven decision-making.<\/p>\n\n\n\n

This is good news for sellers because they can design an algorithm to generate clean data. We showed this with advertising, but this model can work in other marketplaces too. Financial markets and stock markets are similar in that buyers\u2019 behavior can influence price. The algorithm should likewise improve robust pricing in those situations.<\/p>\n\n\n\n

The bottom line is that while you shouldn\u2019t fully trust data, you can use an algorithm to censor the data to improve its reliability. It\u2019s not a foolproof solution, but it is a good place to start to clean up the data and make more effective data-driven decisions.<\/p>\n\n\n\n

About the Author<\/strong><\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

MIT Sloan School of Management <\/em>Prof. Negin Golrezaei<\/em><\/a> is coauthor of <\/em>\u201cDynamic incentive-aware learning: Robust pricing in contextual auctions.\u201d<\/em><\/a> The paper has been accepted for publication by the Operations Research Journal.<\/em><\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

In this contributed article by MIT Sloan School of Management Prof. Negin Golrezaei, found that there are ways to limit price manipulation. The key is the pricing algorithm. Instead of using bids to directly set prices, a prominent group of researchers designed an algorithm that uses censored bids\u2013 in this case a binary signal \u2013 to indicate whether the buyer wins in the prior auction or not.<\/p>\n","protected":false},"author":10513,"featured_media":22407,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[65,115,87,180,56,97,84,1],"tags":[314,870,710,899,96],"acf":[],"yoast_head":"\nHow to Produce Cleaner Data for Robust Pricing - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Produce Cleaner Data for Robust Pricing - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"In this contributed article by MIT Sloan School of Management Prof. Negin Golrezaei, found that there are ways to limit price manipulation. The key is the pricing algorithm. Instead of using bids to directly set prices, a prominent group of researchers designed an algorithm that uses censored bids\u2013 in this case a binary signal \u2013 to indicate whether the buyer wins in the prior auction or not.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-19T13:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-06-20T17:22:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2019\/04\/graph-analytics_SHUTTERSTOCK.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"300\" \/>\n\t<meta property=\"og:image:height\" content=\"174\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/\",\"url\":\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/\",\"name\":\"How to Produce Cleaner Data for Robust Pricing - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2020-06-19T13:00:00+00:00\",\"dateModified\":\"2020-06-20T17:22:23+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Produce Cleaner Data for Robust Pricing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Produce Cleaner Data for Robust Pricing - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/","og_locale":"en_US","og_type":"article","og_title":"How to Produce Cleaner Data for Robust Pricing - insideBIGDATA","og_description":"In this contributed article by MIT Sloan School of Management Prof. Negin Golrezaei, found that there are ways to limit price manipulation. The key is the pricing algorithm. Instead of using bids to directly set prices, a prominent group of researchers designed an algorithm that uses censored bids\u2013 in this case a binary signal \u2013 to indicate whether the buyer wins in the prior auction or not.","og_url":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2020-06-19T13:00:00+00:00","article_modified_time":"2020-06-20T17:22:23+00:00","og_image":[{"width":300,"height":174,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2019\/04\/graph-analytics_SHUTTERSTOCK.jpg","type":"image\/jpeg"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/","url":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/","name":"How to Produce Cleaner Data for Robust Pricing - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2020-06-19T13:00:00+00:00","dateModified":"2020-06-20T17:22:23+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2020\/06\/19\/how-to-produce-cleaner-data-for-robust-pricing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"How to Produce Cleaner Data for Robust Pricing"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2019\/04\/graph-analytics_SHUTTERSTOCK.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-6p9","jetpack-related-posts":[{"id":13846,"url":"https:\/\/insidebigdata.com\/2015\/10\/10\/teespring-powers-social-commerce-platform-insights-with-in-memory-database-from-memsql\/","url_meta":{"origin":24623,"position":0},"title":"Teespring Powers Social Commerce Platform Insights With In-Memory Database From MemSQL","date":"October 10, 2015","format":false,"excerpt":"MemSQL, a leader in real-time databases for transactions and analytics, announced that Teespring, a leader in on-demand social commerce, selected and deployed MemSQL to optimize its sales analytics and create a seamless experience for apparel buyers and sellers.","rel":"","context":"In "Data Storage"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":23896,"url":"https:\/\/insidebigdata.com\/2020\/01\/26\/proptech-and-the-rising-tide-of-technology-in-the-real-estate-industry\/","url_meta":{"origin":24623,"position":1},"title":"Proptech and the Rising Tide of Technology in the Real Estate Industry","date":"January 26, 2020","format":false,"excerpt":"In this contributed article, freelance human Avery Phillips discusses how the real estate industry has begun reaping the rewards that big data and data-driven technologies can provide. The huge amounts of data generated by the real estate industry can be leveraged to its advantage even further going forward as new\u2026","rel":"","context":"In "Analytics"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2019\/03\/Analytics_SHUTTERSTOCK.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":25346,"url":"https:\/\/insidebigdata.com\/2020\/12\/09\/garbage-in-garbage-out-how-we-got-here-and-why-we-must-get-out-now\/","url_meta":{"origin":24623,"position":2},"title":"Garbage in, Garbage Out \u2013 How We Got Here and Why We Must Get Out Now","date":"December 9, 2020","format":false,"excerpt":"This whitepaper, \"Garbage in, Garbage Out \u2013 How We Got Here and Why We Must Get Out Now,\" from our friends over at Profisee, reflects on why the state of data in most organizations is as dismal as it is, and why there is such a challenge involved in demonstrating\u2026","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2020\/11\/logo_profisee.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":17486,"url":"https:\/\/insidebigdata.com\/2017\/03\/28\/pulling-real-roi-sea-big-data-analytics\/","url_meta":{"origin":24623,"position":3},"title":"Pulling Real ROI from a Sea of Big Data Analytics","date":"March 28, 2017","format":false,"excerpt":"In this special guest feature, Jessica Hawthorne-Castro, CEO of Hawthorne Direct, provides some strategic best practices for marketers that want to extract ROI from big data in order to improve the customer experience and generate sales.","rel":"","context":"In "Analytics"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24937,"url":"https:\/\/insidebigdata.com\/2020\/09\/01\/top-3-data-analytics-challenges-and-how-to-resolve-them\/","url_meta":{"origin":24623,"position":4},"title":"Top 3 Data Analytics Challenges and How to Resolve Them","date":"September 1, 2020","format":false,"excerpt":"In this special guest feature, Jerry DiMaso, CEO and co-founder of Knarr Analytics, discusses how effective analytics has become such a determinative factor that it\u2019s now evident that those who master it will thrive. However, the journey toward that goal isn't without obstacles. What are the most common data analytics\u2026","rel":"","context":"In "Analytics"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":13799,"url":"https:\/\/insidebigdata.com\/2015\/10\/01\/first-insight-announces-predictive-analytics-solution-for-retailers-and-brands\/","url_meta":{"origin":24623,"position":5},"title":"First Insight Announces Predictive Analytics Solution for Retailers and Brands","date":"October 1, 2015","format":false,"excerpt":"First Insight, a leading provider of solutions that empower brands to incorporate the voice of the customer into the design and merchandising of new products, today announced the launch of InsightTargeting, a solution enabling retailers and brands to create highly targeted products and promotions through predictive analytics.","rel":"","context":"In "Analytics"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/24623"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=24623"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/24623\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/22407"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=24623"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=24623"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=24623"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}