In less than five months ASB automated the core regression suite for FastNet Classic, comprising of 1,100 test cases, 11,968 test actions and 92 end-to-end business process scenarios (including multiple day scenarios) covering 1,797 verification points.
"Our TOSCA regression suite is highly maintainable, because of TOSCA’s model-based approach to test automation and its dynamic steering/functions. Defects are being detected much earlier than would have occurred with manual testing, owing primarily to the fact that the full regression suite, including integration testing, system testing and end-to-end business process testing can now be executed on-demand in less than 12 hours."
Stephan Gianonatti
Test Automation & Performance Manager, Auckland Savings Bank
Execution effort of the core regression suite is down by 95% from over 300 hours to less than 12 hours, including error log evaluation.
On demand staffing – ASB has broken the mould and is now engaging test analysts and business analysts alongside with their test automation team to develop automated test scenarios.
"Test automation has been an important strategic initiative for technology within ASB and was strongly supported by Russell Jones, Chief Operations Officer for ASB, and was included in the business plan for ASB Enterprise Services. The success of our first initiative utilising TOSCA has positioned us well to continue test automation across other key applications. The structured approach (business scenarios, test cases, and modules) brought together business and technical SMEs, testers and automation specialists. We delivered within budget for 1400 test cases as planned. Daily stand-ups allowed issues and challenges to be addressed collaboratively and promptly. Lessons have been learnt on the journey, and we are delighted with the results," says Raewyn Ludlam, Head of Test Services.
2The separation of concerns, encapsulation and polymorphism that comes with model-based testing eliminates maintenance issues inherent in script-based test automation.