CH04. L01. Test development process

Summary

This video script delves into the intricacies of the software testing process, emphasizing the importance of test analysis, design, and implementation. It introduces key concepts such as test conditions, traceability, and the significance of the expected result in test cases. The script also highlights the IEEE STD 829-1998 standard for test documentation and discusses the transition from manual to automated test procedures, including the creation of test scripts and execution schedules. The goal is to ensure comprehensive coverage and understanding of the testing terminology and process.

Takeaways

• 📑 The script discusses the completion of a fundamental test process video, adding terms to test analysis, design, and implementation stages.
• 🔍 In test analysis, the basis documentation is reviewed, and testable items or events are identified as test conditions, described in test cases, and linked to their sources through a traceability matrix.
• 🔗 The traceability process is crucial for tracking changes in requirements and ensuring all requirements are covered, with test conditions and cases linked to each other in a bidirectional traceability matrix.
• 📝 Test case design includes a test case document with components such as input values, execution preconditions, postconditions, and expected results, with a focus on the expected result to avoid defects remaining hidden.
• 📘 The 'Software Test Documentation' standard (IEEE STD 829-1998) is highlighted, emphasizing that test design specifications should contain test conditions and test case specifications.
• 🛠️ Test implementation involves preparing test cases and, if using a tool, converting the test procedure into a test script written in a programming language for automated execution.
• 📋 The sequence of test case execution is outlined in a test procedure specification and managed through a testcase execution schedule, influenced by factors like prioritization and dependencies.
• 📚 The script distinguishes between different 'specification' terms, such as 'test case specification' with its components, 'test design specification' containing test conditions and cases, and 'test procedure specification' detailing the execution sequence.
• 📝 Understanding the sequence and automation of test procedures is important, especially when transitioning from written steps to an automated form for tool execution.
• 🎯 The script aims to ensure comprehension of the terms related to the test process, including the sources of test conditions, the linking process of traceability, and the execution sequence in test procedures.
• 📁 The terms and concepts discussed in the script can be reviewed in a file named 'Test development process' for further study and reference.

Q & A

What is the purpose of the Tractability matrix in the test analysis phase?

The Tractability matrix is used to link test conditions with their sources in the test basis documentation. It is crucial for ensuring that any changes in the requirements directly affect the test conditions and for verifying that all requirements are covered.

Why is it important to define the expected results in a test case specification?

Defining the expected results is essential because if they are not clearly stated, errors may be overlooked as correct, allowing defects to remain hidden in the software.

What does the term 'test case specification' include according to the script?

A test case specification includes a set of input values, execution preconditions, execution post conditions, and the expected results that describe the test condition.

What is the IEEE STD 829-1998 standard and why is it important to remember?

The IEEE STD 829-1998 is the 'Software Test Documentation' standard that confirms test design specifications should contain test conditions and test case specifications. It's important to remember as it provides a framework for test documentation and may be referenced in professional discussions or assessments.

How does the script differentiate between 'test basis' and 'test conditions'?

The test basis refers to the sources from which testable items or events are derived, while test conditions are the specific items or events from the test basis that are written into one or more test cases.

What is the role of a 'test procedure' in the test execution phase?

A test procedure outlines the steps to be followed during the execution of test cases. It helps in determining the order or sequence of test execution.

Why might a test procedure be written in an automated form?

A test procedure is written in an automated form when the software is executed using a tool. This allows the steps to be clear for the tool and ensures the program runs correctly with successful execution.

What is a 'test script' and how does it relate to a test procedure?

A test script is the automated form of a test procedure, written in a programming language so that the steps are clear for the tool and the program can be executed successfully.

What factors control the order of test cases in the 'test case execution schedule'?

Factors controlling the order in the test case execution schedule include prioritization, regression tests, technical, and logical dependencies.

What is the significance of the 'test procedure specification' document mentioned in the script?

The test procedure specification document outlines the sequence of test cases and the desired test script during execution, which helps in organizing and planning the test execution process.

How does the script suggest reviewing the terms related to the test process?

The script suggests reviewing the terms in a file named 'Test development process' for a comprehensive understanding of the test process and its related terms.