ISTQB FOUNDATION 4.0 | Tutorial 38 | Exploratory Testing | Experience Based Testing | ISTQB Tutorial

TM SQUARE
6 Feb 202411:05

Summary

TLDRThis tutorial delves into exploratory testing, a technique often misunderstood as random application interaction. It clarifies that exploratory testing is about gaining deep insights into requirements through questions and discussions with stakeholders, not aimless clicking. The session highlights the simultaneous design, execution, and evaluation of tests, the use of session-based testing within time-boxed periods, and the importance of a test charter for documenting objectives and findings. Debriefing sessions post-testing are also emphasized for effective communication of results. The tutorial underscores the value of exploratory testing in scenarios with poor specifications or time constraints, and as a complement to formal testing methods, especially beneficial when conducted by experienced testers with strong analytical and creative skills.

Takeaways

  • πŸ˜€ Exploratory testing is a common technique used in both agile and traditional methodologies.
  • πŸ” The misconception that exploratory testing involves random clicking is clarified; it's about gaining insights into requirements.
  • πŸ€” Exploratory testing is particularly useful when specifications are poor or there is significant time pressure.
  • πŸ“ Testers should document their sessions using a test charter, which includes objectives, environment, data, and outcomes.
  • πŸ•’ Sessions are time-boxed, typically ranging from 30 minutes to 2 hours, to maintain focus and efficiency.
  • πŸ“‹ The test charter serves as a log sheet for each test session, capturing key details and observations.
  • 🀝 Debriefing sessions are conducted post-testing to discuss findings with stakeholders, similar to an interview format.
  • 🧐 Testers use exploratory testing to uncover real defects by deeply understanding and questioning requirements.
  • πŸ› οΈ Exploratory testing complements formal techniques, providing additional coverage and confidence in testing outcomes.
  • πŸ’‘ The effectiveness of exploratory testing is enhanced by the tester's experience, domain knowledge, and analytical skills.
  • πŸ”„ It's a practice to follow formal testing with exploratory testing for better defect detection and product assurance.

Q & A

  • What is the main focus of Chapter 4 in the ISTQB Foundation Level certification tutorial?

    -Chapter 4 focuses on test analysis and design, specifically discussing experience-based test techniques in segment 4.4.

  • What is the common misconception about exploratory testing mentioned in the script?

    -The common misconception is that exploratory testing involves randomly clicking on the application, which is incorrect.

  • What is the actual purpose of exploratory testing according to the script?

    -The actual purpose of exploratory testing is to explore the product requirements, gain insights, and understand the expectations to guide the testing process.

  • Why is it important for a tester to understand the requirements before testing?

    -It is important because without understanding the requirements, a tester cannot accurately test the application to meet the exact needs and expectations of the stakeholders.

  • What are the characteristics of exploratory testing mentioned in the script?

    -The characteristics include simultaneous design, execution, and evaluation of tests, use of session-based testing, and the creation of a test charter to guide the testing process.

  • What is a test charter in the context of exploratory testing?

    -A test charter is a document that contains information about each test session, including the date, time, duration, tester, environment, test data, scenario, user persona, and key objectives.

  • How long should a test session in exploratory testing typically last?

    -A test session should typically last between 30 minutes to 120 minutes.

  • What is the purpose of a debriefing session after a test session in exploratory testing?

    -The purpose of a debriefing session is to discuss the test results with stakeholders, focusing on key findings and observations from the test session.

  • Why is exploratory testing useful when there are inadequate specifications or significant time pressure?

    -Exploratory testing is useful in these situations because it allows testers to quickly gather information, understand requirements, and identify defects without the need for extensive pre-planning or documentation.

  • How does exploratory testing complement other more formal test techniques?

    -Exploratory testing complements formal techniques by providing additional coverage and confidence in the testing process, often revealing defects that formal techniques might miss.

  • What qualities are important for a tester to be effective in exploratory testing?

    -Important qualities for a tester in exploratory testing include experience, domain knowledge, analytical skills, curiosity, and creativity.

Outlines

00:00

🧐 Exploratory Testing Misconceptions and Techniques

This paragraph clarifies the common misconceptions about exploratory testing, emphasizing that it is not about random clicking but rather a structured approach to understand product requirements in the absence of detailed specifications. It highlights the importance of asking questions to stakeholders for insights and the role of experience-based techniques in gathering more information. The paragraph also introduces the characteristics of exploratory testing, such as simultaneous test design, execution, and evaluation, and the use of session-based testing within a time-boxed framework. The concept of a test charter is introduced as a mandatory document to guide and record test sessions.

05:02

πŸ“ Documentation and Debriefing in Exploratory Testing

The second paragraph delves into the documentation practices within exploratory testing, focusing on the test charter as a key document that outlines the details and objectives of each test session. It discusses the importance of debriefing sessions post-testing, where stakeholders engage with the tester to discuss findings and insights. The paragraph also touches on the reporting methods in exploratory testing, the use of test session sheets, and the conditions under which exploratory testing is particularly useful, such as with inadequate specifications or under time pressure. It concludes by emphasizing the complementary nature of exploratory testing to formal techniques and the importance of the tester's experience, domain knowledge, and essential skills.

10:02

🀝 The Complementary Role of Exploratory Testing

The final paragraph reinforces the idea that exploratory testing is a valuable addition to formal testing techniques, providing a different perspective that can uncover unique defects. It suggests that even after conducting formal testing, a round of exploratory testing can enhance coverage and confidence in the product's release. The paragraph encourages continuous learning and exploration, inviting viewers to engage with the content and seek further clarification if needed, and ends with a note of thanks for watching the tutorial.

Mindmap

Keywords

πŸ’‘Exploratory Testing

Exploratory testing is an approach where the test design and execution are conducted simultaneously by a tester who is learning about the software product. It is a key theme in the video, emphasizing that it is not about random clicking but rather a structured way to understand and test the product requirements deeply. The script mentions that exploratory testing is often misunderstood but is crucial for gaining insights, especially in the absence of detailed specifications.

πŸ’‘Agile Methodology

Agile methodology is a flexible approach to project management and product development that the script mentions as being particularly compatible with exploratory testing. It values collaboration, customer feedback, and the ability to adapt to change quickly, which aligns well with the dynamic nature of exploratory testing.

πŸ’‘Test Analysis and Design

This concept is central to the video's theme, as it discusses how to analyze and design tests effectively, especially when using exploratory techniques. The script positions test analysis and design as critical components in the foundation level certification for ISTQB, highlighting the importance of understanding requirements and expectations before testing.

πŸ’‘Experience-Based Test Techniques

Experience-based test techniques rely on the tester's knowledge and experience to guide the testing process, especially when formal documentation like detailed requirements is lacking. The script explains that these techniques, including exploratory testing, are essential for gaining a deeper understanding of the product and its requirements.

πŸ’‘Session-Based Testing

Session-based testing is a structured approach to exploratory testing mentioned in the script. Each testing session has a specific time frame and objectives, allowing testers to focus on particular aspects of the application. The video emphasizes that this method helps in organizing exploratory testing and making it more effective.

πŸ’‘Test Charter

A test charter is a document used in exploratory testing to outline the objectives, environment, test data, and other relevant details for a specific test session. The script highlights its importance for documenting the tester's approach and findings, providing a record of what was tested and any issues discovered.

πŸ’‘Debriefing

Debriefing in the context of the video refers to a discussion between the tester and stakeholders after a test session. It is a way to communicate the findings and insights gained during exploratory testing. The script uses the analogy of an interview to illustrate how debriefing sessions work, focusing on answering specific questions about the test session.

πŸ’‘Test Objective

The test objective is a clear goal or aim for a testing session, as discussed in the script. It guides the tester on what to focus on during the exploratory testing process. The video mentions that having a defined test objective is crucial for ensuring that the testing is purposeful and targeted.

πŸ’‘Time-Boxed

Time-boxing is a technique where activities are confined within a specific time frame, as mentioned in the script in relation to test sessions. This approach helps in managing the testing process effectively by ensuring that each session is completed within a predefined period, typically between 30 minutes to 2 hours.

πŸ’‘Complementary Technique

The script describes exploratory testing as a complementary technique to more formal testing methods. This means that it can be used in conjunction with traditional test case execution to provide broader coverage and increase the chances of finding defects. The video emphasizes the value of combining different testing approaches for more comprehensive testing.

πŸ’‘Domain Knowledge

Domain knowledge refers to the specific expertise and understanding a tester has within a particular industry or area of focus. The script notes that having domain knowledge is beneficial for exploratory testers, as it enables them to better understand the product and its requirements, leading to more effective testing.

Highlights

Exploratory testing is a common technique used in both agile and traditional methodologies.

A common myth about exploratory testing is that it involves random clicking on the application, which is incorrect.

Exploration in testing is about asking questions to stakeholders to gain insights about requirements.

Testers need to understand detailed expectations and requirements to effectively test.

Exploratory testing is used when specifications are poor and more information is needed.

Testers should define the approach to testing based on their understanding of the requirements.

Exploratory testing involves designing, executing, and evaluating tests simultaneously.

Session-based testing is a structured approach used within exploratory testing.

Test sessions are time-boxed, typically between 30 minutes to 2 hours.

A test charter is used to document each test session's objectives and findings.

Debriefing sessions involve discussions between testers and stakeholders about test results.

Exploratory testing is useful when there are inadequate specifications or significant time pressure.

Testers may use a test session sheet to document steps and discoveries made during testing.

Exploratory testing is a complementary technique to more formal test methods.

Experience and essential skills like analytical skills, curiosity, and creativeness are important for effective exploratory testing.

Combining formal techniques with exploratory testing can provide better coverage and confidence in product release.

The tutorial emphasizes the importance of understanding the context and continuously learning in exploratory testing.

Transcripts

play00:00

Hello friends and greetings for the day

play00:02

welcome back to another tutorial on

play00:03

istqb Foundation level certification we

play00:06

are in chapter 4 talking about test

play00:08

analysis and design and continuing with

play00:10

our same segment that is 4.4

play00:13

experience-based test techniques and as

play00:16

a part of today's tutorial we'll be

play00:17

looking into the next technique which is

play00:19

exploratory

play00:28

testing even exploratory testing is a

play00:31

very common term today and no matter

play00:33

you're doing agile or traditional

play00:35

methodologies exploratory testing has

play00:37

become one of our day-to-day activities

play00:39

to be conducted especially when it comes

play00:41

to Agile methodology and every single

play00:44

tester has a good understanding of what

play00:46

explorat testing is all about but

play00:48

there's a small myth before we start

play00:50

talking about the characteristics of

play00:52

this technique the very important and

play00:54

most misunderstood part of the

play00:56

exploratory testing is that it is about

play00:59

explor exporing and testing the product

play01:02

okay people think that randomly clicking

play01:04

on the application and explorating

play01:07

exploratory way of testing the system is

play01:10

called as exploratory testing which is

play01:12

actually incorrect the most important

play01:15

thing here to understand us when we have

play01:17

poor specification we do not even know

play01:19

what exactly is the detailed expectation

play01:21

of the system what exactly are the

play01:23

detailed requirements so exploration is

play01:26

more about asking question to the

play01:28

business stakeholders or inter

play01:30

stakeholders like designer developer Etc

play01:32

to gain more insights and understanding

play01:35

about what is the requirement now a very

play01:38

simple statement to justify that what I

play01:40

just said that given that a tester

play01:42

really understands what the requirement

play01:44

is all about you cannot test it at all

play01:46

because for example if I don't tell you

play01:48

what a login page should do you can come

play01:51

up with your standards but you cannot

play01:52

not meet my exact needs right so however

play01:56

at any point of time a customer

play01:58

expectation is equally important right

play02:00

not just the technical standards what is

play02:03

that I expect this system to behave as

play02:05

should be implemented so given that your

play02:08

requirements and specifications are

play02:10

sometime poor that's where you use

play02:12

experience-based test techniques and

play02:14

exploration here is more about Gathering

play02:16

more information more data more details

play02:18

about the requirement so that the tester

play02:20

can really understand what the

play02:22

expectation and ask is and based on that

play02:25

you can go ahead and design your

play02:27

execution process however it's not

play02:30

mandatory that you should write test

play02:31

cases here but just defining the

play02:33

approach what to test you should know

play02:35

what exactly is the requirement all

play02:37

about so let's clarify this myth

play02:39

exploratory testing is not about

play02:40

randomly clicking on the application and

play02:42

testing it it's more about exploring the

play02:44

product requirement getting to the

play02:46

common understanding and then defining

play02:49

what to test right let's have a look on

play02:51

this what the characteristics of these

play02:52

particular technique is trying to talk

play02:54

about number one and most important

play02:56

thing in exploratory testing test are

play02:59

simultaneously designed executed and

play03:01

evaluated while the tester learns about

play03:03

the test object the very first line is

play03:06

making it clear what we were talking

play03:07

about however they're just also trying

play03:09

to highlight that it's not necessary

play03:11

that you must write the test detailed in

play03:14

beginning in test design face and in

play03:16

very detailed fashion a high level

play03:18

oneliner test is also fine which can be

play03:20

created on the go right before the

play03:22

execution also but more importantly we

play03:25

will have to explore the requirement and

play03:27

while exploring the requirement you have

play03:29

to write the oneliner high level

play03:31

requirement also to add here the testing

play03:33

is used to learn more about the test

play03:35

object to explore it more deeply with

play03:38

the focus test and to create test for

play03:41

unnested areas so this is more to tell

play03:44

of course by doing a deep dive by you

play03:47

know exploring the requirements in

play03:49

different manners different expectations

play03:50

asking different questions you are

play03:52

trying to elaborate more about what is

play03:54

the real ask and based on that you

play03:56

conduct the testing and certainly you

play03:58

may find good and real defects related

play04:00

to that also to add here explorat

play04:04

testing is sometimes conducted using

play04:06

session based testing to structure the

play04:08

testing in a session based approach

play04:10

exploratory testing is conducted within

play04:13

a defined time box the testers uses a

play04:16

test Charter containing test objective

play04:19

to guide the testing so two other major

play04:22

characteristics have been disclosed very

play04:23

clearly here number one we make use of a

play04:26

session based testing approach the

play04:28

session based testing approach which

play04:29

simply means that each execution is

play04:32

called as a test session and is time

play04:35

boxed now here the time box certainly

play04:37

means it is between the duration of 30

play04:39

minutes to 120 Minutes however these are

play04:41

some of the old standards which Define

play04:43

that we may not just run a test session

play04:45

for 8 hours long so we must break our

play04:48

scenarios into smallest parts so that we

play04:50

can just accommodate that into 30

play04:52

minutes to 120 Minutes of time that

play04:54

means at least 30 minutes you would need

play04:56

to explore something or run exploratory

play04:59

test or maximum 2 hours are enough to

play05:01

get to the exact need of the scenario

play05:04

any scenario you cannot explore more

play05:05

than two hours of time right so every

play05:08

session has to be separated from the

play05:10

other session so that we can really have

play05:12

the key objectives achieved and at the

play05:14

same time we are also saying that there

play05:15

is a simple documentation used in

play05:17

exploratory testing which is mandatory

play05:20

document called as test Charter so test

play05:22

Charter is basically just like a log

play05:24

sheet just like a log sheet not the log

play05:27

sheet it's just like a log sheet which

play05:29

can contains information about each test

play05:31

session for example date time duration

play05:34

start time end time the tester

play05:36

performing it the environment in which

play05:38

you are executing what sort of test data

play05:39

is being used what is the scenario being

play05:41

considered what user Persona is being

play05:43

used and what is the key objective of

play05:45

doing this session and at the same time

play05:48

you also summarize the end outcome that

play05:51

what was your observations during the

play05:53

execution was there any good findings or

play05:55

everything is just working fine but

play05:57

there are no findings related to defects

play05:59

so it's just that test Charter is

play06:02

something really important to be there

play06:04

as a part of each test session which

play06:06

justifies that the tester has performed

play06:08

testing given that most of the

play06:10

experience-based techniques are very

play06:12

tests tests that means we don't write

play06:15

test cases we don't prefer writing test

play06:17

cases and even if we write it we write

play06:19

it very high level so it sometime

play06:21

becomes very difficult to understand

play06:23

what the tester has actually performed

play06:25

or what is that we have really achieved

play06:27

so having that small observation or

play06:29

findings at the end of the each test

play06:31

session included in the test Charter

play06:34

will give us that satisfaction and

play06:35

confidence that yes this part was tested

play06:39

exploratory however we also have

play06:41

something else to add here that is the

play06:43

test session is usually followed by a

play06:44

debriefing that involves discussion

play06:47

between the tester and the stakeholders

play06:48

interested in the test results of the

play06:50

test session quite often people ask that

play06:53

what is the reporting method in

play06:54

exploratory testing like do we really

play06:57

document the results and so on no given

play06:59

that that test chter will have a high

play07:00

level information uh on top of it the

play07:03

the tester can participate in a

play07:06

debriefing session where debriefing is

play07:08

more of like I don't want you to know or

play07:11

I don't want to know what exactly you

play07:12

did for two hours of time rather I'll

play07:14

ask you questions which will answer me

play07:17

what I really need to know so in simple

play07:19

words if I talk about a training is

play07:22

basically a briefing session training is

play07:24

an example of briefing session where I

play07:26

have the knowledge and I'm expressing it

play07:28

I'm talking about it and everyone is

play07:30

listening and grasping the skills but

play07:32

interview is an example of debriefing

play07:35

session where you have the knowledge

play07:37

that is I have the knowledge but I'm not

play07:39

allowed to speak for 8 hours to tell

play07:41

what exactly happened rather the

play07:43

interviewer will ask only what he wants

play07:45

to know from my 15 years of experience

play07:47

and I'll just have to answer that not

play07:50

what I did for 15 years for 15 days okay

play07:53

so debriefing is we ask the questions

play07:56

and only ask those questions what we

play07:58

want to know and as far as the those are

play07:59

good we are happy and satisfa

play08:02

satisfactory at that point of time now

play08:05

in addition in this approach the test

play08:07

objective may be treated as high Lev

play08:09

test conditions of course the conditions

play08:11

will be very high level and coverage

play08:13

items are identified and exercised

play08:15

during the test session the testers may

play08:17

use test session sheet to document the

play08:20

steps followed and the discoveries made

play08:23

explor testing is useful when there are

play08:26

few or inadequate specification or there

play08:29

significant time pressure on the testing

play08:31

however this part we already know that

play08:33

we have to document whatever happens

play08:35

during the explor test session and same

play08:37

time we want to let you remind remind

play08:40

that the basis of exploratory testing is

play08:43

again the same as that of experience

play08:45

based as a category that is when the

play08:47

specifications are poor or when you have

play08:49

time pressure exploratory is very

play08:51

commonly used also to add here experity

play08:54

testing is also useful to comp comp

play08:57

complement other more formal test

play09:00

techniques exploratory testing will be

play09:02

more effective if the tester is

play09:04

experienced has domain knowledge and has

play09:06

a higher degree of essential skills like

play09:09

analytical skills curiosity and

play09:11

creativeness don't forget that these

play09:13

type of techniques are completely

play09:15

dependent on testers experience if a

play09:18

testers has really worked on different

play09:19

types of similar projects or products

play09:22

they will be very good at yielding

play09:23

defects however the part one of this

play09:26

particular point is also trying to tell

play09:28

you tell you that it is a complimentary

play09:30

technique over formal techniques so what

play09:32

does that mean it simply means that even

play09:35

if I've conducted formal techniques and

play09:37

derived some formal test cases and

play09:38

executed it doing a round of exploratory

play09:41

on top of it will give you a better

play09:42

coverage and better confidence so most

play09:45

of the companies also practice this

play09:47

combined approach that they first apply

play09:49

formal techniques to derive the standard

play09:51

test cases executed formally and on top

play09:54

of it they do a round of exploratory

play09:56

testing to find something different than

play09:59

the formal so it's been understood

play10:02

practically that sometime being ad hoc

play10:05

sometime being not aligned can also help

play10:09

you find good defects right so in that

play10:12

context explorat exploratory testing is

play10:15

seen as a very very complimentary test

play10:17

technique on top of the formal so it's

play10:19

not necessary that if you're doing

play10:21

formal techniques you don't apply

play10:23

experience space at all if you want you

play10:25

can always top it up with a round off

play10:27

exploratory which will really give you a

play10:30

good confidence and better coverage to

play10:32

be releasing the product okay so put

play10:35

together that's all what we have to

play10:36

share from exploratory testing so I hope

play10:39

you had a good understanding of that so

play10:41

that's all from this particular tutorial

play10:42

team should you have anything else feel

play10:43

free to comment below I'm always there

play10:45

to address your queries and answer them

play10:47

well till then keep learning keep

play10:48

exploring keep understanding the context

play10:50

thanks for watching the video team and

play10:52

happy

play10:58

learning

play11:02

[Music]

Rate This
β˜…
β˜…
β˜…
β˜…
β˜…

5.0 / 5 (0 votes)

Related Tags
Exploratory TestingISTQBAgileTest DesignSoftware TestingTest AnalysisTest TechniquesSession-BasedTest CharterDebriefingQuality Assurance