All-In-One Scriptless Test Automation Solution!

Generic selectors
Exact matches only
Search in title
Search in content

Use Case Study

How Our Automated Testing Solution Helped One of the Fastest Growing Supply Chain Service Providers in the USA

Overview

One of the fastest-growing supply chain service providers in the USA required a dedicated Automated Testing and QA Services team. They had few manual testers and wanted to onboard a dedicated testing automation team with proven experience and knowledge of using Jenkins, C#, and SQL. The company was performing manual testing of our warehouse management system (WMS) but due to resource constraint and lack of skills, they were performing a very limited amount of automated regression testing.
Regression testing will let us know when a change we make unintentionally breaks something else. The company was looking for testing automation solutions and testers with experience in Selenium running on top of Jenkins. The regression test sizes could wary vary significantly from creation and shipping of an order (in 24 steps) to editing a charge code (in 3 steps).
For this project, the company needed a trusted vendor to build and execute the approved framework and thereafter running 50 initial tests. The company would then maintain and update the tests as UI code is updated with future enhancements.

Our Solution

It provided the ability to test an application with less manpower but more thoroughly.

  • Deployed a more robust architecture with reusability of codes in mind
  • Resulted in automation code that was used for longer periods of time
  • Ensured less maintenance than a simple record/playback solution
  • Translated to a substantial savings over the course of long projects

The Requirements we Fulfilled: Meeting all Specifications on the Test Framework

  • We created and deployed a Selenium (or other) automated testing framework that integrates with the company’s infrastructure
  • Create a database-driven test framework whereby the data feeding into each automated test is database driven so additional test cases can be created without updating the test
  • Whenever the client’s team adds a test case data, the tests should run for all the data
  • Create group/suite/set of automated tests so that some tests can be run more often than others – e.g. Test Group#1, Test Group#2, etc.
  • The framework must be able to run tests – Development, Quality Assurance (QA) and Production Environments
  • It would be nice if the framework could be deployed so that tests can be run on a developer’s local environment, but this is not required
  • Allow different data sets for different environments. For example, in the Production, Dev & QA
  • In the database tables, particular test needed to be flagged to run in any or all Dev, QA, or Prod environments
  • The requirement also stated the need for creating a platform to run upon Jenkins or any similar server

Challenge: Skills required to create automated tests that are easy to maintain and extend

  • Tests were to be created in C#, JavaScript and/or SQL Server so the client’s development team can create and deploy additional tests or update existing tests when the tested functionality is updated
  • Delivery of the test to the client required integration into the client’s test catalog. However, because the client did not have enough Business Analysis/QA Resources, not all previous tests were fully defined at the beginning of the project
  • A video walk-through of each test explaining what the page does, how it works, and items to be tested were a part of the mandate
  • The project execution also had the provision for supporting the company in deployment of virtual machines needed to support the test framework

How We Helped

  1. Integration Testing

Ensuring seamless integration with existing systems like warehouse management, CRM, and financial accounting software.

Data Consistency: Verifying that data remains consistent across all integrated systems.

API Compatibility: Ensuring APIs between systems function correctly and handle errors gracefully.

Interdependencies: Identifying and testing interdependencies between the new features and existing functionalities.

  1. Performance and Load Testing

Assessing the application’s performance under realistic load conditions to ensure it can handle peak traffic.

Peak Load Simulation: Simulating high traffic volumes and transaction loads to test the system’s performance and identify bottlenecks.

Scalability Testing: Ensuring the application can scale effectively to handle increased load.

Resource Utilization: Monitoring and optimizing CPU, memory, and network usage during peak operations.

  1. Data Accuracy and Integrity

Ensuring the accuracy and integrity of data processed by the new route optimization algorithms and notification systems.

Real-time Data Testing: Testing with real-time data to uncover issues that might not appear with mock data.

Edge Cases: Identifying and testing edge cases in route optimization, such as unexpected traffic conditions or route blockages.

Data Validation: Validating that data input and output by the algorithms are accurate and reliable.

  1. User Acceptance Testing (UAT)

Ensuring the updated system meets the end-users’ requirements and expectations.

Scenario-based Testing: Developing real-world scenarios for users to test the new features.

Feedback Incorporation: Collecting and incorporating feedback from users during UAT.

Training and Documentation: Providing adequate training and documentation to users for the new features.

  1. Regression Testing

Ensuring that new updates do not adversely affect existing functionalities.

Test Coverage: Ensuring comprehensive test coverage for all existing features.

Automated Regression Tests: Implementing automated regression tests to quickly identify any issues introduced by new updates.

Test Environment Parity: Maintaining parity between test environments and production environments to ensure accurate test results.

  1. Security Testing

Ensuring that the updates do not introduce security vulnerabilities.

Vulnerability Scanning: Performing regular vulnerability scans on the updated application.

Penetration Testing: Conducting penetration tests to identify and address security weaknesses.

Data Protection: Ensuring data encryption and secure data handling practices are in place.

  1. Customer Notification System Testing

Challenge: Ensuring the new customer notification system functions correctly and provides accurate, timely notifications.

Message Accuracy: Verifying that notifications contain accurate information.

Delivery Timeliness: Ensuring notifications are sent and received promptly.

Load Handling: Testing the notification system’s ability to handle large volumes of messages without delays or errors.

  1. Change Management and Rollback Plans

Managing changes effectively and having a robust rollback plan in case of issues.

Version Control: Using version control to manage different versions of the software and ensure smooth rollbacks if needed.

Change Documentation: Documenting all changes thoroughly to facilitate quick troubleshooting and rollback if necessary.

Rollback Procedures: Developing and testing rollback procedures to ensure they can be executed quickly and effectively.

  1. Continuous Integration and Deployment (CI/CD)

Integrating continuous testing into the CI/CD pipeline to ensure quick detection and resolution of issues.

Automated Testing: Implementing automated tests within the CI/CD pipeline to catch issues early.

Build Verification: Ensuring each build passes a comprehensive suite of tests before deployment.

Deployment Automation: Automating deployment processes to reduce manual errors and improve efficiency.

  1. Communication and Coordination

Ensuring effective communication and coordination among development, testing, and operations teams.

Cross-functional Collaboration: Promoting collaboration between different teams to ensure all aspects of the update are thoroughly tested.

Issue Tracking: Using issue tracking systems to monitor and manage testing issues and resolutions.

Regular Updates: Providing regular updates to all stakeholders on the progress and status of testing and deployment activities.

Benefits for Logistics IT Leaders

  • 70% fewer hours spent on QA for new releases 
  • 90% reduction in number of production issues
  • 40% faster deployment cycles
  • 60% faster in-app load times

 

Download More Case Studies

Get inspired by some real-world examples of complex data migration and modernization undertaken by our cloud experts for highly regulated industries.

Contact Your Solutions Consultant!

India Job Inquiry / Request Form

US Job Inquiry / Request Form

Apply for Job