Roq Provides SavingsThrough Automated iOS Testing Project

Roq has recently automated a regression test pack, testing iOS devices for a global organisation, achieving 58.5% test coverage of the application, time savings of 125%, and estimated yearly cost savings of over £45,000.

Roq’s Solution

Roq delivered the solution utilising its innovative Test Automation Framework accelerator, which is our proprietary test automation framework, that was tailored and enhanced specifically for the Client’s unique mobile testing needs.

Following the initial release of iOS 13, Apple introduced an unprecedented number of defects into the mobile operating system, and as a result, had to release new beta iOS updates at a phenomenal rate. At one stage, releases were being pushed out almost weekly. This left the client needing to test each release against all of the iPhone models in use, creating a regression pack of around 50 complex tests and the need for a member of the test team to be assigned full-time to iOS testing. Time pressures often meant some devices would go untested, and the repetitive nature of the tasks increased the risk of errors being made.

Roq’s proposed automation of a large proportion of the regression pack, taking into consideration, the iOS security restrictions, but we knew the potential impact of automating tests, wherever possible, would be significant. Almost 60% test coverage was achieved, which provided a vastly improved product in rapid time.

The automated regression pack covered over half of the manual tests, integrating 15 different apps, including core business applications such as Excel, Phone, Word, Workday and much more. Roq developed the test pack in the Test Automation Framework, leveraging a .NET framework, and built a technical enhancement to enable parallel execution across multiple iPhones. This was achieved while still only using one Apple Mac laptop device as the interface between the Windows-based automation solution and the end devices – helping provide further cost savings.

Other languages and technologies used through the course of the project include C#, Appium and Nunit, highlighting the Roq team’s ability to leverage a range of opensource tools to create the most efficient test pack for the client’s requirements.

The Outcome  

The project was completed on time and around 7% under budget, leading to a series of benefits including:

• Estimated yearly cost saving of £45,540 when comparing previous manual costs to new costs of combined manual and automated regression tests

• Overall iOS regression test delivery time reduced by 125%

• Almost 60% test coverage of the core business applications on iOS

• The client now has an easily expandable and low-maintenance regression pack with no ongoing licensing costs

If you’d like to find out more about how Roq can support your business, please email us at ask@roq.co.uk.