After carefully analyzing the current client environment, GSPANN's QA SMEs proposed using one tool to accomplish the overall goal. Three tools were evaluated – TestComplete, Tricentis Tosca, and Katalon. We did a proof-of-concept (POC) with each of the three tools in the customer’s environment. Use cases were selected which covered UI validation, accurate reading of console output, database connectivity, graph validation, upload/download of test files, and SSH connectivity to remote servers.
TestComplete exhibited an advantage over the other tools due to its scalability, API testing features, support for multiple programming languages, and ability to integrate with the client’s current set of tools. Since TestComplete also stood out in its product support, maintainability, and lower cost, the client chose TestComplete to automate its desktop, web, and backend test cases.
Here are some highlights of the newly automated testing framework:
- Created custom utilities: Custom modules read Kafka MQTT messages, upload, download, and rename files via SFTP, read Spark job logs, and start Spark jobs running via SSH. The client can now design new test cases by simply uploading XML, JSON, or Excel test files.
- Automated data verification and validation: Other custom modules developed by Team GSPANN perform automated verification of HDFS, Apache Solr, and JSON data.
- Implemented key integrations: Configured TestComplete to interact with the existing Jira/Zephyr platform to publish execution results in a Jira test plan. Another integration allows a Jenkins DevOps pipeline to execute automated test scripts, and yet another takes the form of web application tests using Selenium Grid operating remotely as a headless browser.
- Created template project: The generic Template project incorporates the custom modules and the client can easily clone this template to build additional extended testing capabilities in the future.
The following image gives a clear picture of the new implementation.