From hours to minutes: accelerating Microsoft 365 testing with AI

Our client

Our client is a leading international law firm that relies on Microsoft 365 to support collaboration and day-to-day working across its organisation.

As part of its ongoing investment in the platform, the client needed confidence that its Microsoft 365 applications, integrated add-in services and supporting automated tests would continue to work effectively across different role-based user journeys. This included validating AI-enabled Microsoft Copilot functionality from an end-user perspective.

The client challenge

Developing and maintaining automated tests involves more than writing scripts. When a test fails or a process behaves unexpectedly, Quality Engineers must investigate the cause, research potential solutions and test different approaches before implementing a reliable fix.

Previously, much of this work was completed manually. Engineers could spend several hours researching errors, troubleshooting failures, creating test data or developing a new test from scratch. This reduced the time available to extend and improve the client’s automated test coverage.

The challenge was to accelerate these investigative and repetitive tasks without compromising quality. Any proposed solution still needed to reflect the client’s specific Microsoft 365 environment, user journeys and business processes, and remain subject to rigorous human review.

What we delivered

Roq incorporated AI tools, including Claude and Microsoft Copilot, into the team’s automation workflow. Acting as an assistant across test development, troubleshooting, test design, test data creation and documentation, AI helped our Quality Engineers identify likely causes, explore possible approaches and reach potential solutions faster.

We also tested Microsoft Copilot functionality and Microsoft 365 integrated add-in services across selected role-based user journeys. This meant Roq was not only using AI to support test delivery but also validating how AI-enabled functionality performed for the client’s end users.

AI was never treated as the final authority. Its outputs could appear convincing without accounting for the client’s particular systems, processes or risks. Every suggestion was therefore reviewed, adapted and tested by an experienced Quality Engineer before being accepted.

This approach combined the speed of AI with the contextual knowledge, critical thinking and risk awareness of a Roq Quality Engineer.

Client impact

Using AI has made automation delivery more efficient, allowing the team to spend less time on repetitive groundwork and more time building, maintaining and improving the client’s test coverage.

By shortening the journey from an issue or testing requirement to a validated solution, Roq delivered a faster and more responsive automation capability. The client benefited from:

• Troubleshooting and new test development tasks were reduced from around two to three hours to approximately 30–60 minutes with AI support.

• Quicker resolution of automation failures and technical issues.

• Faster development and improvement of automated tests.

• More engineering time available to strengthen the client’s test coverage.

• Greater confidence in Microsoft Copilot functionality across relevant role-based user journeys.

• Continued human oversight, ensuring that speed did not come at the expense of accuracy, quality or risk management.

As one of our Quality Engineers explained: “AI helps us get to the answer faster, but the tester still makes the final decision. It means we can spend less time on repetitive groundwork and more time improving quality and coverage for the client.”

The result is a pragmatic application of AI that improves delivery efficiency while keeping experienced Quality Engineers firmly in control. It enables the client to benefit from faster problem-solving and stronger testing without relying on unverified AI-generated answers.

If your organisation is introducing AI-enabled functionality or transforming its Microsoft 365 environment, please get in touch here or via ask@roq.co.uk. Our Quality Engineering experts can help you reduce risk, improve quality and deliver with confidence.