{"id":33971,"date":"2023-11-20T14:36:52","date_gmt":"2023-11-20T22:36:52","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=33971"},"modified":"2023-11-22T10:18:21","modified_gmt":"2023-11-22T18:18:21","slug":"genais-role-in-testing","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/","title":{"rendered":"GenAI\u2019s Role in Testing"},"content":{"rendered":"\n

Much has been said about AI\u2019s ability to generate code. But what is often overlooked is its ability to generate test scripts as well.<\/p>\n\n\n\n

Just as code generation requires a good User Story, so does generating a test script. It is important to capture all of the changes needed and to clearly define the resulting process. GenAI can help with that, but you can\u2019t overlook this step. Well written acceptance criteria is the key to a good test.<\/p>\n\n\n\n

Test scripts are susceptible to hallucinations just like code. So while GenAI can easily create the script, it is your responsibility to review the results. In fact, one good way to do this is to start with manual test steps. Ask the bot to generate a list of the manual steps required to test the new feature. It will come out as a list of actions in the UI that you can easily review. These manual steps become part of the documentation and can be shared with users to explain how the process works.<\/p>\n\n\n\n

Check to ensure the steps are correct. If not, you might need to update the User Story requirements to make them more clear and then try the prompt again. It\u2019s better to update the story rather than edit the manual steps since it documents the intent and that feeds into other steps in the process. In fact, if the AI is not generating the correct steps, you have likely made a few assumptions in your story.<\/p>\n\n\n\n

Once the manual steps are correct, feed them into a prompt and ask for a test script that automates them in the language of your choice. While it is often daunting to write a test script from scratch, even non-coders can follow scripting languages after they are written. Check the flow to make sure it seems correct and make any necessary changes.<\/p>\n\n\n\n

The script for the Happy Path is now ready when the feature is available to test. The test can be used by the Developer before committing her code and even be triggered automatically from your CICD orchestration engine as the story progresses through the stages. Many testing tools are able to create videos of the test execution along with a pass\/fail determination. These videos not only enable you to visually check that the results are correct, they are useful as part of the release notes as well.<\/p>\n\n\n\n

Release notes are quite often treated as a necessary evil of the development process. Proper documentation takes as much effort as writing the code in some cases. Then there is the challenge that Agile imposes on the release process. Instead of releasing a fixed set of features, agile teams release the features that are ready and hold back the ones that are not for the next release train. That\u2019s great for the development team, but what about the writers? They must have all of the features documented and ready, but then wait until the release to know which features made it and which did not.<\/p>\n\n\n\n

GenAI can help in a couple of ways here. <\/p>\n\n\n\n

First, AI can Generate the release notes for a feature directly from a well written User Story. Second, it can compile a document in minutes from the User Stories that made it into the release. The CICD system can trigger that upon successful Deployment. This documentation can even include the manual steps generated for the happy path test and a link to the video of the test run. <\/p>\n\n\n\n

Better yet, instead of sending a multi-page release note to all the users, send a short summary of the release highlights and provide a link to a ChatBot to answer any questions about the details. Why create an FAQ document when you can let the user ask whatever question they like?<\/p>\n\n\n\n

Generative AI has really shown to be a powerful tool, but it is still early in its development. It can act as an accelerator, but in the near term, everything it generates should be reviewed and corrected. There are also security and privacy issues that must be taken into account. With the coming of Generative AI, there really is no more excuse. Every feature can be properly tested and documented with very little effort. And that\u2019s good news for the users of our software.<\/p>\n\n\n\n

About the Author<\/strong><\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

David Brooks is the SVP of Evangelism at Copado. He is a serial entrepreneur who has worked at 6 startups with 3 successful exits over the past 34 years in the valley. He joined Salesforce.com just after their IPO in 2005 to build AppExchange for the next 8 and a half years. He ran a third of the Force.com teams during his tenure.<\/em><\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

Sign up for the free insideBIGDATA newsletter<\/a>.<\/em><\/p>\n\n\n\n

Join us on Twitter: https:\/\/twitter.com\/InsideBigData1<\/a><\/em><\/p>\n\n\n\n

Join us on LinkedIn: https:\/\/www.linkedin.com\/company\/insidebigdata\/<\/a><\/em><\/p>\n\n\n\n

Join us on Facebook: https:\/\/www.facebook.com\/insideBIGDATANOW<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

In this contributed article, David Brooks, SVP of Evangelism at Copado, discusses how much has been said about AI\u2019s ability to generate code. But what is often overlooked is its ability to generate test scripts as well. Test scripts are susceptible to hallucinations just like code. So while GenAI can easily create the script, it is your responsibility to review the results. <\/p>\n","protected":false},"author":10531,"featured_media":33232,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"categories":[526,182,180,61,67,56,97,1],"tags":[437,1245,552],"acf":[],"yoast_head":"\nGenAI\u2019s Role in Testing - insideBIGDATA<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"GenAI\u2019s Role in Testing - insideBIGDATA\" \/>\n<meta property=\"og:description\" content=\"In this contributed article, David Brooks, SVP of Evangelism at Copado, discusses how much has been said about AI\u2019s ability to generate code. But what is often overlooked is its ability to generate test scripts as well. Test scripts are susceptible to hallucinations just like code. So while GenAI can easily create the script, it is your responsibility to review the results.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"insideBIGDATA\" \/>\n<meta property=\"article:publisher\" content=\"http:\/\/www.facebook.com\/insidebigdata\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-20T22:36:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-22T18:18:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Generative_AI_shutterstock_2273007347_special.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1100\" \/>\n\t<meta property=\"og:image:height\" content=\"550\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Contributor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:site\" content=\"@insideBigData\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Contributor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/\",\"url\":\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/\",\"name\":\"GenAI\u2019s Role in Testing - insideBIGDATA\",\"isPartOf\":{\"@id\":\"https:\/\/insidebigdata.com\/#website\"},\"datePublished\":\"2023-11-20T22:36:52+00:00\",\"dateModified\":\"2023-11-22T18:18:21+00:00\",\"author\":{\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87\"},\"breadcrumb\":{\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/insidebigdata.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"GenAI\u2019s Role in Testing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/insidebigdata.com\/#website\",\"url\":\"https:\/\/insidebigdata.com\/\",\"name\":\"insideBIGDATA\",\"description\":\"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/insidebigdata.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87\",\"name\":\"Contributor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g\",\"caption\":\"Contributor\"},\"url\":\"https:\/\/insidebigdata.com\/author\/contributor\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"GenAI\u2019s Role in Testing - insideBIGDATA","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/","og_locale":"en_US","og_type":"article","og_title":"GenAI\u2019s Role in Testing - insideBIGDATA","og_description":"In this contributed article, David Brooks, SVP of Evangelism at Copado, discusses how much has been said about AI\u2019s ability to generate code. But what is often overlooked is its ability to generate test scripts as well. Test scripts are susceptible to hallucinations just like code. So while GenAI can easily create the script, it is your responsibility to review the results.","og_url":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/","og_site_name":"insideBIGDATA","article_publisher":"http:\/\/www.facebook.com\/insidebigdata","article_published_time":"2023-11-20T22:36:52+00:00","article_modified_time":"2023-11-22T18:18:21+00:00","og_image":[{"width":1100,"height":550,"url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Generative_AI_shutterstock_2273007347_special.jpg","type":"image\/jpeg"}],"author":"Contributor","twitter_card":"summary_large_image","twitter_creator":"@insideBigData","twitter_site":"@insideBigData","twitter_misc":{"Written by":"Contributor","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/","url":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/","name":"GenAI\u2019s Role in Testing - insideBIGDATA","isPartOf":{"@id":"https:\/\/insidebigdata.com\/#website"},"datePublished":"2023-11-20T22:36:52+00:00","dateModified":"2023-11-22T18:18:21+00:00","author":{"@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87"},"breadcrumb":{"@id":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/insidebigdata.com\/2023\/11\/20\/genais-role-in-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/insidebigdata.com\/"},{"@type":"ListItem","position":2,"name":"GenAI\u2019s Role in Testing"}]},{"@type":"WebSite","@id":"https:\/\/insidebigdata.com\/#website","url":"https:\/\/insidebigdata.com\/","name":"insideBIGDATA","description":"Your Source for AI, Data Science, Deep Learning & Machine Learning Strategies","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/insidebigdata.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/35a290930284d4cdbf002d457f3d5d87","name":"Contributor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/insidebigdata.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/36bffd267e38ed3f525205f67270e91b?s=96&d=mm&r=g","caption":"Contributor"},"url":"https:\/\/insidebigdata.com\/author\/contributor\/"}]}},"jetpack_featured_media_url":"https:\/\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Generative_AI_shutterstock_2273007347_special.jpg","jetpack_shortlink":"https:\/\/wp.me\/p9eA3j-8PV","jetpack-related-posts":[{"id":21159,"url":"https:\/\/insidebigdata.com\/2018\/09\/24\/3-ways-artificial-intelligence-improving-software-quality\/","url_meta":{"origin":33971,"position":0},"title":"3 Ways Artificial Intelligence is Improving Software Quality","date":"September 24, 2018","format":false,"excerpt":"In this contributed article, Jon Seaton, Director of Data Science for Functionize, explores the use of AI in software testing and how it is already being applied in a variety of ways. Jon offers three important areas in which AI is making the most immediate impact.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":33249,"url":"https:\/\/insidebigdata.com\/2023\/09\/02\/video-highlights-3-minute-genai-app-creation\/","url_meta":{"origin":33971,"position":1},"title":"Video Highlights: 3 Minute GenAI App Creation","date":"September 2, 2023","format":false,"excerpt":"In this video presentation below, from our friends over at Aible, we create a custom GenAI App using Google PaLM2, VertexAI, and BigQuery, based on the customers own data in a matter of minutes.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2313909647_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33838,"url":"https:\/\/insidebigdata.com\/2023\/11\/09\/2023-ml-pulse-report-the-latest-trends-and-challenges-in-machine-learning\/","url_meta":{"origin":33971,"position":2},"title":"2023 ML Pulse Report: The Latest Trends and Challenges in Machine Learning","date":"November 9, 2023","format":false,"excerpt":"Our friends over at Sama recently published a comprehensive report on the potential and challenges of AI as reported by Machine Learning professionals.","rel":"","context":"In "Big Data"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/08\/Machine_Learning_shutterstock_742653250_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":34046,"url":"https:\/\/insidebigdata.com\/2023\/11\/30\/happy-birthday-chatgpt\/","url_meta":{"origin":33971,"position":3},"title":"Happy Birthday ChatGPT!","date":"November 30, 2023","format":false,"excerpt":"Today, November 30, 2023, mark\u2019s the first anniversary of OpenAI\u2019s ChatGPT. In the last year, the AI chatbot has secured support from major Silicon Valley companies and seen integration across various fields including academia, the arts, marketing, medicine, gaming, and government. These are exciting times, so we decided to put\u2026","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/07\/ChatGPT_shutterstock_2249988847_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33823,"url":"https:\/\/insidebigdata.com\/2023\/11\/06\/report-highlights-policy-changes-to-manage-ai-displacement\/","url_meta":{"origin":33971,"position":4},"title":"Report Highlights Policy Changes to Manage AI Displacement","date":"November 6, 2023","format":false,"excerpt":"The Global Partnership on Artificial Intelligence (GPAI) has just released a new report, \"Generative AI, Jobs, and Policy Response,\" focused on the biggest pain points regarding GenAI, specifically how it will impact the workforce.","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/AI_shutterstock_2287025875_special-1.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":33004,"url":"https:\/\/insidebigdata.com\/2023\/08\/01\/survey-shows-top-down-pressure-to-adopt-generative-ai-but-just-30-of-enterprises-are-ready-to-do-so-today\/","url_meta":{"origin":33971,"position":5},"title":"Survey Shows Top-Down Pressure to Adopt Generative AI,\u00a0But Just 30% of Enterprises are Ready to Do So Today\u00a0","date":"August 1, 2023","format":false,"excerpt":"Executives at large enterprises across the globe are facing unprecedented pressures around adopting generative artificial intelligence (GenAI), addressing ever-increasing data complexity, and managing a growing skills gap. That\u2019s according to a new IDC survey, sponsored by\u00a0Teradata\u00a0(NYSE:\u00a0TDC).","rel":"","context":"In "AI Deep Learning"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/insidebigdata.com\/wp-content\/uploads\/2023\/06\/GenerativeAI_shutterstock_2284999159_special.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33971"}],"collection":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/users\/10531"}],"replies":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/comments?post=33971"}],"version-history":[{"count":0,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/posts\/33971\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media\/33232"}],"wp:attachment":[{"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/media?parent=33971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/categories?post=33971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/insidebigdata.com\/wp-json\/wp\/v2\/tags?post=33971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}