{"id":25680,"date":"2021-02-26T06:00:00","date_gmt":"2021-02-26T14:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=25680"},"modified":"2021-02-27T09:53:08","modified_gmt":"2021-02-27T17:53:08","slug":"prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/","title":{"rendered":"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment"},"content":{"rendered":"\n<p><em>Platform Combines Visual Drag-and-Drop Development of Data Pipelines with Agile Software Development Practices<\/em><\/p>\n\n\n\n<div class=\"wp-block-image is-style-default\"><figure class=\"alignright size-large\"><img decoding=\"async\" loading=\"lazy\" width=\"200\" height=\"121\" src=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Prophecy_logo.png\" alt=\"\" class=\"wp-image-25681\" srcset=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Prophecy_logo.png 200w, https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Prophecy_logo-150x91.png 150w\" sizes=\"(max-width: 200px) 100vw, 200px\" \/><\/figure><\/div>\n\n\n\n<p>Low code products have been growing in popularity in the face of a severe shortage of skilled engineers. They are democratizing and accelerating the software product development from applications to websites.<\/p>\n\n\n\n<p><a href=\"http:\/\/www.prophecy.io\">Prophecy.io<\/a> announced the rollout of the new SaaS version of its unique low code data engineering platform, the only solution designed for data practitioners. Prophecy helps businesses accelerate the development and deployment of data pipelines so that massive incoming data streams can be prepared for analytics and machine learning.<\/p>\n\n\n\n<p>Backed with a $6 million investment from SignalFire LLC and an investment from Ross Mason, founder of Mulesoft (acquired by Salesforce for $6.5 billion in 2018), Prophecy already has several Fortune 500 customers for its enterprise product.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>\u201cThe Prophecy SaaS version will enable even small teams and organizations to be incredibly productive. For the first time they don\u2019t have to spend time on coding and putting open source technologies together, they can instead focus on rapidly adding business value,\u201d said Raj Bains, CEO, Prophecy.<\/p><\/blockquote>\n\n\n\n<p>Prophecy delivers a uniquely two-way interoperable product, i.e. the changes made in the visual drag-and-drop editor are visible in the code editor, and vice-versa. It combines visual drag and drop development with agile software practices including code on git, tests, continuous integration, and deployment to production. Prophecy also provides column-level lineage that enables users to track every value from the source systems all the way to final analytics.<\/p>\n\n\n\n<p>The new SaaS product is free for up to three users. While the Enterprise product works with all the major Spark distributions in multiple clouds and on-premises, the SaaS version will launch initially on Databricks (AWS and Azure clouds), and later will be expanded to other Spark providers.<\/p>\n\n\n\n<p>Prophecy provides a smart solution to the long-standing problem of the lack of available Spark coder talent. The generated code is all based on Spark (for batch and streaming dataflows) and Airflow (for scheduling), avoiding the lock-in of proprietary formats. The intuitive and easy to use interface means any data practitioner can use Prophecy to develop and deploy data pipelines rapidly.&nbsp;<\/p>\n\n\n\n<p>As organizations move to the cloud and rely on open-source technologies such as Apache Spark and Apache Airflow, Prophecy enables these companies to access a much larger pool of data practitioners who can now succeed with these technologies using a simple visual interface. Prophecy produces high-quality code that gives the visual developers parity with coders.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>\u201cAs Enterprises of all sizes gear up to manage increasingly complex data coming from the full range of operational systems (such as credit card swipes, ERP systems, airline bookings, IoT) in the cloud, Prophecy can help accelerate the digital transformation of these enterprises,&#8221; commented Ross Mason of Dig Ventures. &#8220;Prophecy\u2019s unique low code approach can help enterprises succeed with their current workforce.\u201d<\/p><\/blockquote>\n\n\n\n<p><strong>Prophecy Features:<\/strong><\/p>\n\n\n\n<ul><li>Visual or Code development of Spark workflows<\/li><li>Test development including unit and data quality tests<\/li><li>Agile practices &#8211; Git integration, CI, CD<\/li><li>Scheduling &#8211; run workflows in production<\/li><li>Governance including column-level lineage<\/li><li>Conversion from legacy ETL products to Spark code<\/li><\/ul>\n\n\n\n<p><em>Sign up for the free insideBIGDATA&nbsp;<a rel=\"noreferrer noopener\" href=\"http:\/\/insidebigdata.com\/newsletter\/\" target=\"_blank\">newsletter<\/a>.<\/em><\/p>\n\n\n\n<p><em>Join us on Twitter:&nbsp;@InsideBigData1 \u2013 <a href=\"https:\/\/twitter.com\/InsideBigData1\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Prophecy.io announced the rollout of the new SaaS version of its unique low code data engineering platform, the only solution designed for data practitioners. Prophecy helps businesses accelerate the development and deployment of data pipelines so that massive incoming data streams can be prepared for analytics and machine learning.<\/p>\n","protected":false},"author":10513,"featured_media":25681,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[115,182,87,180,56,1],"tags":[781,968,96],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"Prophecy.io announced the rollout of the new SaaS version of its unique low code data engineering platform, the only solution designed for data practitioners. Prophecy helps businesses accelerate the development and deployment of data pipelines so that massive incoming data streams can be prepared for analytics and machine learning.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2021-02-26T14:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-02-27T17:53:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Prophecy_logo.png\" \/>\n\t<meta property=\"og:image:width\" content=\"200\" \/>\n\t<meta property=\"og:image:height\" content=\"121\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Editorial Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Editorial Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/\",\"url\":\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/\",\"name\":\"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2021-02-26T14:00:00+00:00\",\"dateModified\":\"2021-02-27T17:53:08+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9\",\"name\":\"Editorial Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g\",\"caption\":\"Editorial Team\"},\"sameAs\":[\"http:\/\/www.insidebigdata.com\"],\"url\":\"https:\/\/insidebigdata.com\/author\/editorial\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/","og_locale":"en_US","og_type":"article","og_title":"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment - insideBIGDATA","og_description":"Prophecy.io announced the rollout of the new SaaS version of its unique low code data engineering platform, the only solution designed for data practitioners. Prophecy helps businesses accelerate the development and deployment of data pipelines so that massive incoming data streams can be prepared for analytics and machine learning.","og_url":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2021-02-26T14:00:00+00:00","article_modified_time":"2021-02-27T17:53:08+00:00","og_image":[{"width":200,"height":121,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Prophecy_logo.png","type":"image\/png"}],"author":"Editorial Team","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Editorial Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/","url":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/","name":"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2021-02-26T14:00:00+00:00","dateModified":"2021-02-27T17:53:08+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2021\/02\/26\/prophecy-io-launches-low-code-data-engineering-saas-platform-for-spark-with-6m-investment\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"Prophecy.io Launches Low Code Data Engineering SaaS Platform for Spark with $6M investment"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning &amp; Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/2949e412c144601cdbcc803bd234e1b9","name":"Editorial Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e137ce7ea40e38bd4d25bb7860cfe3e4?s=96&d=mm&r=g","caption":"Editorial Team"},"sameAs":["http:\/\/www.insidebigdata.com"],"url":"https:\/\/insidebigdata.com\/author\/editorial\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2021\/02\/Prophecy_logo.png","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-6Gc","jetpack-related-posts":[{"id":17997,"url":"https:\/\/insidebigdata.com\/2017\/05\/27\/cloudera-launches-altus-simplify-big-data-workloads-cloud\/","url_meta":{"origin":25680,"position":0},"title":"Cloudera Launches Altus to Simplify Big Data Workloads in the Cloud","date":"May 27, 2017","format":false,"excerpt":"Cloudera, Inc, (NYSE:CLDR) the provider of a leading modern platform for machine learning and advanced analytics, announced the release of Cloudera Altus, a Platform-as-a-Service (PaaS) offering that makes it easier to run large-scale data processing applications on public cloud.","rel":"","context":"In &quot;Big Data&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24097,"url":"https:\/\/insidebigdata.com\/2020\/03\/12\/why-data-pipelines-desperately-need-orchestration\/","url_meta":{"origin":25680,"position":1},"title":"Why Data Pipelines Desperately Need Orchestration","date":"March 12, 2020","format":false,"excerpt":"In this special guest feature, Sean Knapp, Founder and CEO of Ascend, discusses how automation can greatly reduce a data engineering team\u2019s time spent in orchestration through the enablement of data-centric pipelines.","rel":"","context":"In &quot;Big Data&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28936,"url":"https:\/\/insidebigdata.com\/2022\/04\/06\/databricks-announces-general-availability-of-delta-live-tables\/","url_meta":{"origin":25680,"position":2},"title":"Databricks Announces General Availability of Delta Live Tables","date":"April 6, 2022","format":false,"excerpt":"Databricks, the Data and AI company and pioneer of the data lakehouse paradigm, announced the general availability of Delta Live Tables (DLT), the first ETL framework to use a simple declarative approach to build reliable data pipelines and to automatically manage data infrastructure at scale. Turning SQL queries into production\u2026","rel":"","context":"In &quot;Analytics&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":28562,"url":"https:\/\/insidebigdata.com\/2022\/02\/24\/striim-announces-striim-cloud-the-unified-real-time-data-streaming-and-integration-saas\/","url_meta":{"origin":25680,"position":3},"title":"Striim Announces Striim Cloud, the Unified Real-time Data Streaming and Integration SaaS","date":"February 24, 2022","format":false,"excerpt":"Striim, Inc. announced the general availability of Strim Cloud, a fast way for customers to deliver real-time data and insights to power business intelligence and decision-making to meet the needs of the digital economy. Striim Cloud is a fully-managed software-as-a-service (SaaS) platform for real-time streaming data integration and analytics.","rel":"","context":"In &quot;Big Data&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2019\/09\/striim_Final_Logo_whitebg_20150909_CMYK.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":21552,"url":"https:\/\/insidebigdata.com\/2018\/11\/30\/new-c3-platform-delivers-enhanced-rapid-enterprise-scale-ai-deployment\/","url_meta":{"origin":25680,"position":4},"title":"New C3 Platform Delivers Enhanced Rapid Enterprise-scale AI Deployment","date":"November 30, 2018","format":false,"excerpt":"C3 announced the general availability of Version 7.8 of the C3 Platform. C3 V7.8 delivers many improvements for developers, data scientists, and end users, a new and comprehensive C3 Integrated Development Studio, (C3 IDS), enhanced security, 10x \u2013 100x improved performance and scalability, new model management capabilities, enhanced machine learning\u2026","rel":"","context":"In &quot;AI Deep Learning&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":17944,"url":"https:\/\/insidebigdata.com\/2017\/05\/22\/databricks-launches-new-edition-spark-based-cloud-platform-data-engineers\/","url_meta":{"origin":25680,"position":5},"title":"Databricks Launches New Edition of Its Spark-Based Cloud Platform for Data Engineers","date":"May 22, 2017","format":false,"excerpt":"Databricks, the company founded by the creators of the popular Apache Spark project and providers of the leading Spark-based cloud platform for data science, announced an edition of its cloud platform optimized specifically for data engineering workloads called Databricks for Data Engineering.","rel":"","context":"In &quot;Big Data&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/25680"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10513"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=25680"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/25680\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/25681"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=25680"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=25680"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=25680"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}