QA Consultants solves mobile testing red flags

Summary

A Toronto-based insurance company faced challenges with an iPad application developed by a major consulting firm, which failed to meet requirements. After identifying concerns, such as the vendor handling both development and testing, the company engaged a senior QA architect. This expert designed a comprehensive test strategy, covering everything from the app's user interface to backend integrations, ensuring end-to-end solution testing. The QA team provided an extensive inventory of test devices, developed test cases, and established ongoing testing protocols, enabling the company to continue testing after the project concluded.

Takeaways

• 😀 A financial institution in Toronto struggled with an iPad application for their frontline sales staff, which did not meet their requirements.
• 😀 The client had engaged a large consulting firm, but each release from the firm failed to deliver the desired outcome.
• 😀 A significant concern was the vendor conflict of interest— the same vendor handled both the development and testing, raising doubts about objectivity.
• 😀 The solution involved bringing in a senior QA architect with expertise in the insurance space to identify issues and develop a comprehensive test strategy.
• 😀 The testing approach was comprehensive, covering not just the iPad application but also downstream applications like CRM, integrations, and reporting.
• 😀 The company offered a fully equipped test lab with a wide range of devices, ensuring complete device and OS version compatibility for testing.
• 😀 The test lab supported testing on 15 different devices, each with multiple combinations of sizes and OS versions.
• 😀 In addition to testing, the company developed customized test cases, including regression, smoke, and sanity test suites, for ongoing use after the engagement ended.
• 😀 The testing process ensured end-to-end quality control, addressing both the frontend (iPad app) and backend systems.
• 😀 The client was able to continue using the test cases and testing infrastructure even after the engagement, ensuring long-term support and continued quality assurance.
• 😀 The engagement highlighted the importance of independent QA services when there is a potential conflict of interest with the development vendor.

Q & A

What was the primary challenge the client faced with their iPad application development?

The client faced issues with each release of their iPad application not meeting the expected requirements. The development was being handled by a large consulting firm, but the quality of the releases was consistently unsatisfactory.

What specific concern did the speaker have about the vendor's testing approach?

The speaker was concerned that the same vendor responsible for developing the app was also performing the testing, which presented a conflict of interest and raised questions about the integrity and thoroughness of the testing process.

How did the speaker's company address these concerns?

The speaker’s company engaged one of their senior QA architects, who had strong experience in the insurance industry, to evaluate the situation and develop a comprehensive test strategy for the entire solution, including the app, integrations, and backend systems.

What was included in the comprehensive test strategy developed by the speaker's team?

The test strategy included test case creation, building a regression test suite, developing smoke and sanity tests, and testing not only the app’s frontend but also its integrations and backend systems to ensure a complete end-to-end solution.

How many different device configurations did the speaker's company provide for testing?

The speaker’s company provided 15 different iPad device configurations, including various OS versions, sizes, and combinations, to ensure comprehensive test coverage across multiple environments.

What kind of testing did the speaker's team conduct for the iPad app?

The team conducted smoke and sanity testing, along with regression testing, to ensure the app's functionality and performance were up to standards. They also addressed the broader testing needs of the full solution, including integrations and backend systems.

What role did the senior QA architect play in this engagement?

The senior QA architect led the engagement by identifying issues with the app’s functionality and creating a robust test strategy. She ensured that all aspects of the solution, not just the app, were thoroughly tested.

What specific areas of the solution did the speaker’s team test, aside from the iPad app?

In addition to the iPad app's user interface, the speaker’s team tested integrations, reporting systems, CRM functionality, and other downstream applications to ensure the entire solution functioned seamlessly.

How did the client benefit from the testing strategies developed by the speaker’s company?

The client benefited by receiving a set of comprehensive test cases, including regression and smoke tests, which they could continue to use after the engagement ended, ensuring ongoing quality and reliability for future testing cycles.

How did the speaker’s company ensure that the client’s testing requirements were met?

The speaker’s company met the client’s testing requirements by providing a detailed and well-rounded test strategy, ensuring coverage across multiple devices and configurations, and developing reusable test cases that addressed both frontend and backend aspects of the application.