Within Subjects Design - Research Methods in Psychology/Social Sciences

Louis Montano, MSc., RPm, RPsy
27 Sept 202023:15

Summary

TLDRThis educational video delves into the within-subjects experimental design, contrasting it with the between-subjects design. It explains the use of the same group of participants across different conditions, highlighting its advantages such as controlling for individual differences and requiring fewer participants. The script also addresses potential threats to internal validity, like environmental changes, time-related variables, and order effects, and suggests strategies like counterbalancing and pilot testing to mitigate these issues. It concludes with guidance on choosing between within-subjects and between-subjects designs based on factors like individual differences, treatment effects, and participant availability.

Takeaways

  • πŸ” The within-subjects design involves the same group of participants being tested or observed under all different conditions of an experiment.
  • πŸ“š A key advantage of within-subjects design is that it allows for the ultimate control of extraneous variables by reusing the same participants across conditions.
  • πŸ•΅οΈβ€β™‚οΈ The study by Stephens et al. (2009) demonstrated that swearing can help individuals tolerate pain more effectively, illustrating the application of within-subjects design.
  • 🧠 Schmidt's (1994) research on word recall showed that humorous sentences are more memorable than neutral ones, another example of within-subjects design.
  • ⏱️ Time-related confounding variables, such as fatigue and practice effects, can influence the results in within-subjects designs where conditions are administered at different times.
  • 🌑️ Environmental variables like room size or temperature can confound results if they change between conditions within a within-subjects design.
  • πŸ”„ Order effects, such as carryover effects from one condition to another, can bias results in within-subjects designs if not properly controlled.
  • πŸ”„ Counterbalancing the order of treatment conditions is a technique used to control for order effects in within-subjects designs.
  • πŸ‘₯ Within-subjects design requires fewer participants compared to between-subjects design, making it more efficient in terms of resources.
  • βš–οΈ The decision between using within-subjects or between-subjects design should be based on factors like anticipated individual differences, potential long-lasting treatment effects, and ease of participant recruitment.

Q & A

  • What is a within-subjects design in experimental psychology?

    -A within-subjects design is an experimental approach where the same group of participants is tested or observed under all the different conditions being compared. This design allows for each individual's performance to be compared across various conditions, making the group synonymous with conditions.

  • Why might a researcher choose a within-subjects design over a between-subjects design?

    -A researcher might choose a within-subjects design to control for individual differences, as each participant serves as their own control by being exposed to all conditions. This design is also advantageous when the number of available participants is limited.

  • What was the main finding of the study by Stephens and colleagues in 2009 on swearing and pain tolerance?

    -The study found that swearing or cursing can make it easier for individuals to tolerate pain, suggesting that expressing emotions through swear words can help people cope with discomfort.

  • How did Schmidt's 1994 study differ from the study by Stephens and colleagues in terms of within-subjects design?

    -Schmidt's study alternated between funny and neutral words, administering all treatments together, while Stephens and colleagues had a time gap between the neutral word and swear word conditions, exposing participants to one condition at a time.

  • What are the potential threats to internal validity in a within-subjects design?

    -Threats to internal validity in a within-subjects design include confounding from environmental variables, time-related confounding variables, history, maturation, instrumentation, regression towards the mean, and order effects.

  • What is the concept of 'counterbalancing' in the context of within-subjects designs?

    -Counterbalancing is a technique used to control order effects by changing the order in which treatment conditions are administered across different participants, ensuring that the order of conditions does not influence the study's results.

  • Why might a within-subjects design require fewer participants compared to a between-subjects design?

    -A within-subjects design requires fewer participants because the same individuals are tested under all conditions, eliminating the need to recruit separate groups for each condition, thus saving time and resources.

  • What are some strategies to mitigate the effects of practice and fatigue in a within-subjects design?

    -Strategies to mitigate practice and fatigue effects include conducting pilot tests to understand their impact, shortening the duration of the experiment, and considering alternative designs such as between-subjects if within-subjects design poses too many challenges.

  • How can a researcher determine whether to use a within-subjects or a between-subjects design for their study?

    -A researcher can determine the appropriate design by considering factors such as anticipated individual differences, potential long-lasting effects of treatments, ease of recruiting participants, and the specific requirements and goals of their study.

  • What are the advantages and disadvantages of using a within-subjects design?

    -Advantages include controlling for individual differences and requiring fewer participants. Disadvantages include potential practice effects, fatigue, mortality (participant dropout), and the need for participant commitment over an extended period.

Outlines

00:00

πŸ” Introduction to Within-Subjects Design

The paragraph introduces the concept of within-subjects design, contrasting it with between-subjects design. In within-subjects design, the same group of participants is tested under different conditions, unlike between-subjects design where different groups are compared. The paragraph explains that this design allows for each participant to serve as their own control, reducing the influence of individual differences. It also provides an example of a study by Stephens et al. (2009) that examined the effect of swearing on pain tolerance, illustrating how within-subjects design can be used to establish cause-and-effect relationships by manipulating one variable (swearing) while controlling for others (same participants across conditions).

05:01

πŸ•’ Time and Environmental Factors in Within-Subjects Design

This section delves into the potential threats to internal validity in within-subjects design, particularly focusing on time-related and environmental confounding variables. It discusses how changes in the environment between conditions can affect the outcome, emphasizing the need for consistency. The paragraph also addresses the issue of time, explaining how factors like fatigue, maturation, and history can influence participant performance and obscure the effect of the experimental manipulation. The discussion serves as a cautionary note on the careful planning required to conduct a within-subjects study effectively.

10:01

πŸ“Š Understanding Order Effects and Other Challenges

The paragraph explores the concept of order effects in within-subjects design, where the sequence of conditions can influence participant responses. It explains phenomena like fatigue, practice effects, and carryover effects, which can occur when the same participants are tested multiple times. The text provides an example to illustrate how the order of treatments can lead to improved performance not due to the treatment itself but because of the lingering effects of previous treatments. The paragraph also touches on the strategy of counterbalancing to mitigate order effects by varying the order of conditions across different participants.

15:04

πŸ“‰ Balancing Time Span and Participant Commitment

This section offers strategies for managing the challenges associated with the time span of experiments in within-subjects design. It suggests conducting pilot tests to understand the impact of practice and external events on results and considering the balance between a long and short experimental timeline. The paragraph also discusses the option of switching to a between-subjects design if within-subjects design poses too many complications. Additionally, it mentions the advantage of within-subjects design in requiring fewer participants and the potential issue of participant dropout, or mortality, which can skew results if not managed properly.

20:04

πŸ“š Choosing Between Within-Subjects and Between-Subjects Designs

The final paragraph provides guidance on choosing between within-subjects and between-subjects designs. It outlines scenarios where each design might be preferable, such as when individual differences are expected to be significant, when treatments are expected to have lasting effects, or when participant recruitment is challenging. The paragraph also discusses the applications of within-subjects design, including simple two-condition studies and multiple treatment designs, while acknowledging the challenges of maintaining participant commitment over an extended period. It concludes by emphasizing the importance of careful consideration in selecting an experimental design.

Mindmap

Keywords

πŸ’‘Within-Subjects Design

A within-subjects design, also known as a repeated measures design, is a type of experimental design where the same participants are tested under all conditions of the experiment. This design allows researchers to control for individual differences by using each participant as their own control, thus increasing the statistical power of the study. In the video, the concept is introduced as a contrast to between-subjects design, where different participants are used for different conditions. The video emphasizes how within-subjects design is used when the researcher wants to compare different conditions on the same group of subjects, as illustrated by the example of a study on the effects of swearing on pain tolerance.

πŸ’‘Between-Subjects Design

Between-subjects design is an experimental design where different groups of participants are used for each condition being tested. This design is useful when the researcher wants to eliminate the potential influence of individual differences on the results. In the video, it is mentioned as the design where participants in different groups should not be the same, which is the opposite of within-subjects design. The video explains that in between-subjects design, the goal is to match participants across groups to control for extraneous variables.

πŸ’‘Internal Validity

Internal validity refers to the degree to which a study can produce a clear, unambiguous explanation for the relationship between two variables, ensuring that the observed effect is due to the manipulation of the independent variable and not to external factors. The video discusses internal validity in the context of within-subjects design, emphasizing the importance of establishing a cause-and-effect relationship without interference from extraneous variables. It is crucial for researchers to ensure internal validity to make valid conclusions from their experiments.

πŸ’‘Confounding Variables

Confounding variables are extraneous factors that can affect the outcome of an experiment and make it difficult to determine the true effect of the independent variable. In the video, the speaker mentions environmental variables as a type of confounding variable that can affect internal validity in within-subjects design. An example given is the change in room temperature from one condition to another, which could influence participants' responses independent of the experimental manipulation.

πŸ’‘Time-Related Confounding Variables

Time-related confounding variables are factors that can influence the results of an experiment due to the passage of time. These can include participant fatigue, maturation, or changes in the measurement instrument. The video provides examples such as participants being more tired in the afternoon or changes in the way an observer rates behavior over time. These variables can obscure the true effects of the experimental manipulations.

πŸ’‘Order Effects

Order effects occur when the order in which treatments are administered influences the outcome of the experiment. This can happen due to practice effects, fatigue, or carryover effects from one condition to another. The video explains order effects with the example of reading books and then taking tests, where the performance on the second test might be influenced by the memory of the first book read. The video suggests counterbalancing as a method to control for order effects.

πŸ’‘Counterbalancing

Counterbalancing is a technique used in experimental designs to control for order effects by varying the order of treatment conditions across participants. This helps to ensure that any effects observed are due to the treatments themselves and not the order in which they were received. The video discusses counterbalancing as a solution to the problem of order effects, especially in within-subjects designs where the same participants are exposed to multiple conditions.

πŸ’‘Practice Effects

Practice effects refer to improvements in performance that occur as a result of repeated exposure to a task or test. In the context of the video, practice effects are mentioned as a potential issue in within-subjects designs, where participants may perform better on later conditions simply because they have become more familiar with the task, rather than due to the experimental manipulation.

πŸ’‘Fatigue Effects

Fatigue effects describe the decline in performance that can occur when participants are subjected to a lengthy or demanding experiment. The video mentions fatigue effects as a potential problem in within-subjects designs, where participants might become tired and perform worse as the experiment progresses, thus affecting the validity of the results.

πŸ’‘Carryover Effects

Carryover effects occur when the effects of one treatment condition carry over into subsequent conditions, influencing the participant's responses. The video uses the example of reading books and then taking tests to illustrate carryover effects, where the knowledge gained from the first book might affect performance on the second test, making it difficult to isolate the effects of each book.

πŸ’‘Mortality

In the context of the video, 'mortality' refers to the loss of participants over the course of a study, which can affect the validity of the results. This is particularly relevant in within-subjects designs where the same participants are tested multiple times, and some may drop out before the study is completed. The video points out that those who remain might not be representative of the original sample, thus introducing bias into the results.

Highlights

Introduction to within-subjects design, contrasting it with between-subjects design.

Explanation of within-subjects design where the same group is used across different conditions.

Example of a study by Stephens et al. (2009) on the effects of swearing on pain tolerance.

Findings from Stephens et al. that swearing can help tolerate pain.

Schmidt's (1994) study on memory retention of humorous versus non-humorous words.

Advantage of within-subjects design in matching participants by reusing the same group.

Difference between methodologies of Smith and Schmidt in handling treatment conditions.

Threats to internal validity in within-subjects design, such as environmental variables and time-related variables.

Discussion on history, maturation, and instrumentation as time-related confounding variables.

Explaining regression towards the mean as a potential threat in within-subjects design.

Order effects and their impact on experimental results.

Strategies to control for order effects, such as counterbalancing.

Advantages of within-subjects design, including fewer required participants and elimination of individual differences.

Limitations of within-subjects design, such as practice effects, fatigue, and participant mortality.

Guidelines for choosing between within-subjects and between-subjects designs based on anticipated effects and participant availability.

Applications of within-subjects design in evaluating two or more conditions with the same participants.

Conclusion and summary of key points regarding within-subjects design.

Transcripts

play00:01

hello everyone for today we are going to

play00:03

talk about another type of experimental

play00:05

design

play00:06

and this time we are going to discuss

play00:08

the within subjects design

play00:10

so if you remember our last discussion

play00:13

we talk about between subjects design

play00:15

and in between subjects design

play00:17

you learn that we compare two groups or

play00:20

more

play00:21

and the participants in these groups

play00:22

should not be the same but rather there

play00:24

are different participants

play00:26

for every group this time you will learn

play00:28

that it's also possible

play00:30

for us to conduct an experiment by using

play00:32

the same group

play00:33

again and again and that's why it's

play00:35

called within

play00:36

subjects design so even though you have

play00:39

different conditions

play00:41

you still use the same group that's why

play00:43

group

play00:44

is not synonymous with conditions all

play00:47

the time in experimental

play00:49

psychology so let's begin

play00:52

so the characteristic of a within

play00:54

subject's design is that

play00:55

it uses a single group of participants

play00:57

and tests

play00:58

or observes each individual in all the

play01:01

different treatments being compared

play01:03

so instead of recruiting other

play01:05

participants in order for you to compare

play01:07

one group or one condition to another

play01:10

what you're doing here is that you're

play01:12

exposing the same group to a lot of

play01:14

different conditions

play01:15

to conditions recondition so on and so

play01:17

forth and then you compare their

play01:19

performance

play01:20

in these different conditions let's try

play01:23

to know

play01:24

why is there a need for such approach in

play01:26

designing an experiment

play01:29

here is an example of a study that

play01:30

utilized a within subjects design

play01:33

so stephens and colleague back in 2009

play01:37

examined the effects of swearing on the

play01:39

experience of pain

play01:41

so what they did is that in one

play01:43

condition the participants were told to

play01:46

repeat their favorite swear word

play01:48

over and over for as long as their hands

play01:51

were in the water

play01:52

you may be asking right now why is there

play01:54

a need for the participant to put his

play01:56

hand in the water

play01:58

it's because that's the safest way to

play02:00

induce

play02:01

pain and this is cold water and

play02:04

if your hand is immersed on cold water

play02:06

for a long time that's

play02:08

painful in the second condition the

play02:10

participants repeated

play02:11

a neutral word so in other words you

play02:14

were told to

play02:15

put your hands on icy water then at the

play02:18

first condition you will

play02:20

repeat your favorite curse word or swear

play02:22

word

play02:23

and then in the second condition you

play02:24

will say a neutral word for example

play02:26

rabbit

play02:27

they found out if you swear or if you

play02:29

curse

play02:30

it's easier for you to tolerate pain

play02:32

that's why there are people who are

play02:34

cursing

play02:35

when they are in pain so they were able

play02:38

to prove that it's easier for people to

play02:40

cope

play02:41

when they express their emotions

play02:44

especially

play02:45

when they say swear words let's look at

play02:47

another example

play02:49

in this example sm schmidt in 1994

play02:53

investigated what types of words can we

play02:56

recall and the way that he delivered the

play02:58

sentence is deeper

play02:59

is it funny is it humorous or

play03:02

non-humorous or not funny

play03:04

and then he asks them to recall as many

play03:06

as possible

play03:07

so in other words it's a non-funny word

play03:10

followed by a funny word followed by

play03:12

another non-funny word

play03:14

so on and so forth he discovered

play03:16

eventually that people are

play03:18

more likely to remember funny sentences

play03:21

over neutral sentences both

play03:24

studies utilize a within subject's

play03:26

design

play03:27

but what is the difference

play03:31

later you will know more about that but

play03:33

now let's talk more about

play03:35

the within subjects design so the key

play03:37

element of a within subjects design is

play03:39

that

play03:40

all the individuals in one sample

play03:42

participate in all the treatment

play03:43

conditions

play03:44

so you participate more than once and if

play03:48

you take a look at it

play03:49

your performance in one condition is

play03:51

being compared to your performance

play03:53

to the previous condition or to the next

play03:56

condition

play03:58

other than that a within subject study

play04:00

is the ultimate

play04:02

and equivalent groups because the group

play04:04

in one treatment condition

play04:06

is absolutely identical to the group in

play04:08

every other condition

play04:10

that may be a little complex so let me

play04:12

explain it

play04:13

do you remember that back in between

play04:15

subjects design

play04:16

we need to match the participants or to

play04:19

find a group that's

play04:20

very similar to the group that we have

play04:23

so that there will be little extraneous

play04:26

variables but come to think of it

play04:29

instead of matching groups why don't we

play04:32

recruit the same group or make use of

play04:34

the same group

play04:35

in another condition because technically

play04:38

that is the ultimate way or the best way

play04:40

to match participants in other words the

play04:43

best way to match

play04:44

groups is to reuse your participants

play04:48

you don't have to worry about matching

play04:50

anymore because by using the same

play04:52

participants

play04:53

you are already matching so that's one

play04:56

advantage

play04:57

of a within subjects design so here's

play05:00

the difference

play05:01

between the studies of smith and

play05:04

colleagues and stephens and colleagues

play05:07

and in stephens and colleagues case they

play05:09

utilize letter a

play05:10

they recruited a sample they exposed

play05:13

them to treatment condition one

play05:14

which is the neutral word and then after

play05:18

that

play05:18

they rested for a little while and then

play05:20

they were exposed to condition too

play05:22

which is the swear word condition in

play05:25

letter a

play05:26

the treatments are not being

play05:28

administered

play05:29

at the same time but there's a time

play05:32

difference there's a gap

play05:33

between one treatment condition to

play05:35

another

play05:37

on the other hand the methodology used

play05:39

by schmidt

play05:40

made use of letter b because he

play05:43

alternated funny

play05:45

with neutral words so in other words all

play05:48

the treatment

play05:49

all the treatments were administered

play05:51

together

play05:52

in my personal experience it's easier to

play05:54

find something that follows letter a

play05:57

than letter b in this lecture you will

play05:59

learn about

play06:00

the weaknesses of the within subjects

play06:02

design but at the same time

play06:04

you will learn about its advantages so

play06:07

you

play06:07

you will also learn when should you

play06:09

utilize a between groups design

play06:11

and when should you utilize a within

play06:14

subjects design

play06:16

now that you have a basic idea about the

play06:17

characteristics of a within subject's

play06:19

design

play06:20

it's time to talk about the threats to

play06:22

internal validity and in order for us to

play06:24

talk about this in detail

play06:26

first let me remind you of the meaning

play06:28

of internal validity

play06:29

so if there's internal validity and

play06:31

research this is the extent to which a

play06:33

research study

play06:34

produces a single unambiguous

play06:38

explanation

play06:39

for the relationship between two

play06:40

variables or if i'm going to state it in

play06:43

my own words

play06:44

you achieve what we call internal

play06:46

validity if

play06:48

you have you were able to establish

play06:49

cause and effect and

play06:51

this relationship is not due to external

play06:55

factors or to extraneous variables

play06:58

another way to say it is that you are

play07:00

sure that the changes in the dv

play07:02

is caused by the changes in the iv

play07:05

now let's look at the possible threats

play07:08

in establishing cost and effect

play07:09

relationships

play07:11

when it comes to within subjects design

play07:13

so let's begin

play07:14

first we have what we call confounding

play07:16

from environmental variables

play07:18

when we say environmental variables

play07:20

these are characteristics of the

play07:22

environment

play07:22

that may change from one treatment

play07:24

condition to another

play07:26

so even though you use the same

play07:28

participant more than once

play07:31

make sure that the environment where you

play07:33

conducted your research

play07:35

are very similar if not the same

play07:39

so you cannot use a bigger room in the

play07:41

next condition

play07:42

especially if the one you use in the

play07:44

previous condition is a small room

play07:47

you cannot expose them to a warm room if

play07:50

previously

play07:50

the room was cold especially if your

play07:53

experiment

play07:54

is not about temperature you cannot make

play07:57

use of a dark room

play07:58

if your experiment is supposed to be

play08:00

conducted in a well-lit

play08:02

room so these are environmental

play08:05

variables

play08:06

even though you are using the same set

play08:08

of participants

play08:09

these environmental variables become

play08:12

extraneous factors

play08:14

that hinder internal validity or

play08:17

make it challenging to establish cause

play08:20

and effect

play08:21

other than that there can be time

play08:23

related

play08:24

confounding variables so this is a

play08:27

serious concern in within subjects

play08:28

design

play08:29

that comes from the fact that the sign

play08:31

often requires a series of measurements

play08:34

made over time so an example if i'm

play08:37

going to tell you that

play08:38

for the second condition i need you to

play08:40

return by the afternoon

play08:43

then the problem is that maybe you are

play08:46

more tired in the afternoon

play08:48

answer performance later today will not

play08:51

be the same with your performance now

play08:54

so the change in your performance is not

play08:57

due to the manipulation

play08:58

but it's due to time related elements

play09:01

what if i tell you that i want you to

play09:04

come back after

play09:05

one month for the second part of the

play09:06

experiment but

play09:08

a lot can happen in one month and the

play09:10

changes that we observe

play09:12

may not come from the experiment but

play09:14

rather it may come from time related

play09:17

elements

play09:19

what are these time-related elements

play09:21

first we have what we call history

play09:23

or the events that occur in the

play09:25

participants personal lives

play09:27

what if one of your participants get

play09:29

married what if one of them had a

play09:31

problem

play09:32

what if one of them graduated from

play09:34

college then these

play09:36

are significant events in one's life

play09:39

and these are things that are beyond our

play09:41

control

play09:43

they will change the well-being of your

play09:44

participant and that will influence

play09:47

the way your participant answer the way

play09:50

your participant performs

play09:52

during the study so that's for history

play09:55

we also have maturation so the longer

play09:58

that you make them participate in your

play10:00

experiment

play10:01

there's a possibility for them to mature

play10:03

as well

play10:04

there may be physiological or

play10:06

psychological changes

play10:07

that occur in participants during the

play10:10

study

play10:10

and influences the participants scores

play10:13

for example our research is about test

play10:17

taking

play10:18

skills i would like to expose you

play10:21

to different brain enhancing vitamins

play10:23

and i would like to take the test

play10:25

afterwards however the more tests that

play10:29

you take

play10:30

the better you are are test taking

play10:33

what if in the last condition you are

play10:36

now very good in taking tests

play10:37

i might conclude that because of the

play10:39

last vitamin i have given you

play10:41

you had an improvement in test taking

play10:43

strategies

play10:44

however the improvement is not due to

play10:46

the brain enhancing vitamin

play10:48

but rather it's because there's what we

play10:50

call

play10:51

maturation or there were psychological

play10:54

changes

play10:55

in the span of his participation we also

play10:58

have what we call

play10:59

instrumentation or changes in a

play11:01

measuring instrument

play11:03

that occur over time an example

play11:06

in the first day of an experiment i

play11:08

observed your aggressive behavior

play11:10

i saw you kick another kid in the room

play11:14

then i'm going to rate that behavior as

play11:16

very aggressive

play11:18

however since i am in that observation

play11:21

room for every day of my life

play11:23

i see a kid kick someone else every day

play11:27

then after one month the same behavior

play11:30

may not be rated in the same way after

play11:34

one month

play11:34

what i initially considered as extreme

play11:37

may now be considered

play11:39

average i may have experienced some

play11:42

changes

play11:43

in the way that i rate behaviors and

play11:46

that's

play11:47

those are the changes in instrumentation

play11:50

we also have what we call regression

play11:52

towards the mean

play11:53

or the average which means that

play11:56

for every extreme score there's a

play11:58

tendency

play11:59

to move towards the mean an example

play12:03

because you're so intelligent you got a

play12:05

high score in my experiment

play12:08

however you cannot perform excellently

play12:11

all the time

play12:13

the more tests that you take there's a

play12:14

possibility that your score will go

play12:17

closer to the average that's what we

play12:21

call regression towards the mean

play12:23

sometimes high scorers become average or

play12:26

sometimes

play12:26

low scorers become average as well

play12:30

that's another phenomenon that happens

play12:32

in within subjects

play12:34

design we also have what we call order

play12:37

effects or

play12:38

the way that we order our manipulation

play12:41

remember my example before about the

play12:42

books let's reuse the example

play12:45

read book one and then take test one

play12:48

after one week read book two then take

play12:51

test

play12:52

2. then you found out that participants

play12:55

scored better

play12:56

after taking test 2 however

play13:00

it may not be due to the book that they

play13:02

use but rather

play13:04

perhaps it's because that person can

play13:06

still remember

play13:07

what he learned back in book one hence

play13:10

there were some carry over

play13:12

effects the high scores cannot be

play13:16

attributed

play13:17

to the type of book that was used but

play13:20

rather

play13:20

because the way that the manipulations

play13:22

are ordered they are now

play13:24

carrying over to other manipulations

play13:28

so the more book that you read the more

play13:31

intelligent that you

play13:32

become that's why sometimes we also have

play13:34

to change

play13:35

the order of our manipulations so that

play13:38

the changes in scores

play13:39

will not be explained by order effects

play13:42

and what are the examples of order

play13:44

effects number one we have what we call

play13:46

fatigue

play13:47

or the more books that you read perhaps

play13:49

you will decline in your performance

play13:51

because you will be tired

play13:52

or we also have what we call practice

play13:54

the more tests that you take

play13:56

the better you are in test taking

play13:59

so these are two concepts related to

play14:01

order effects

play14:02

we also have what we call carryover

play14:05

effects which is actually related to

play14:06

practice effect

play14:07

so there may be some sort of rehearsal

play14:10

the more that you take the same

play14:12

manipulation

play14:13

the better you are in understanding the

play14:16

goal of the experiment that's why

play14:18

your performance turned out to be better

play14:21

taking one test after another

play14:24

will make you a better test taker here's

play14:27

an example

play14:28

of the effects of order effect on the

play14:30

left side this

play14:31

is these are scores with no order

play14:34

effects

play14:35

ideally there should be no carryover

play14:38

effects to the other condition

play14:41

but if you look at the second condition

play14:43

in group b

play14:44

look at this in treatment 2 all of them

play14:47

got a plus

play14:48

5 in their scores why it's because

play14:52

in treatment 2 they can still remember

play14:54

what they learned from

play14:56

treatment 1. that's why their experience

play14:59

in treatment one

play15:00

is carrying over to treatment too

play15:04

in other words even though right now

play15:06

what we are measuring is your ability to

play15:09

take the test after reading book 2

play15:12

you can still remember what you read

play15:14

back in book 1

play15:15

and that influences your performance

play15:18

after reading book 2. that's why there

play15:22

was an increase in scores

play15:24

after the second treatment

play15:28

now let's talk about what we can do in

play15:30

order for us these different sources of

play15:32

error

play15:32

and experimentation the first thing that

play15:35

you can do

play15:36

is controlling time if there's a problem

play15:38

with the time span of the study then

play15:40

let's try to conclude it for example

play15:43

if the different treatment conditions

play15:44

are scheduled over a period of weeks

play15:46

the chance has greatly increased that an

play15:48

outside event maturation

play15:50

or change in the measurement instrument

play15:52

will have an influence

play15:54

on the results so what we can do is that

play15:57

we can try to shorten the span of the

play15:59

experiment

play16:01

for example if instead of doing that for

play16:04

three weeks

play16:04

let's try to do it in three days however

play16:09

if you do it that way there's another

play16:11

threat and what is that

play16:13

practice effect or fatigue that's why

play16:15

you need to find a balance

play16:17

between stretching your experiment or

play16:20

compressing your schedule

play16:22

because the longer the time span of your

play16:24

experiment the greater the possibility

play16:26

that there are outside factors but the

play16:28

shorter your time span

play16:30

then there's a higher possibility for

play16:32

practice effects

play16:34

so what is my advice i hope that you'll

play16:37

be able to conduct

play16:38

a pilot testing first so that ahead of

play16:41

time you will know

play16:42

how can practice effect and how can

play16:44

external events

play16:45

affect the results of your experiment

play16:50

also if with if a within subject design

play16:53

will cause a lot of problem

play16:55

then you can simply switch to a between

play16:57

subject's design

play16:58

usually between subjects design the one

play17:01

with separate groups

play17:02

is available as an alternative and

play17:04

completely eliminates

play17:06

any threat of confounding from order

play17:08

effects

play17:09

however when you switch from within

play17:11

groups to between groups

play17:13

then you're going to have to deal with

play17:15

new problems and what are those

play17:17

you will have to deal with the problems

play17:19

that we talked about in the previous

play17:21

lecture

play17:21

such as matching randomization and

play17:24

other things also if there are problems

play17:28

when it comes to order effects

play17:30

you can apply what we call

play17:32

counterbalancing i think i've

play17:34

already mentioned to you what counter

play17:35

balancing is so counter balancing is

play17:38

defined as changing the order in which

play17:40

treatment conditions are administered

play17:42

from one participant to another so the

play17:44

treatment conditions are matched with

play17:46

respect to time

play17:48

example earlier in this lecture

play17:50

participants were asked to say

play17:51

either neutral or curse words but in

play17:54

that experiment

play17:55

they counter balance the treatment by

play17:58

changing the order

play17:59

some participants were told to say

play18:01

neutral words

play18:02

first while some other participants were

play18:05

told to

play18:06

say curse words first so that

play18:09

the order of the conditions will not

play18:11

affect the results of the study

play18:14

what are the limitations of

play18:15

counterbalancing with only two treatment

play18:17

conditions

play18:18

complete counter balancing is easy it's

play18:20

easy for you to order the manipulation

play18:22

in a way

play18:23

that you will reduce order effects and

play18:25

there are only two possible sequences

play18:28

however as the number of treatments

play18:30

increases

play18:31

complete counterbalancing will become

play18:33

more complex

play18:35

say for example what if you have eight

play18:37

treatments rock music

play18:39

pop music classical music then

play18:43

you're going to make one person hear

play18:46

all those types of music if you're going

play18:49

to do that to a lot of participants then

play18:51

you have to get

play18:52

all possible combinations in order for

play18:55

you to completely counterbalance

play18:58

the order of your manipulation and that

play19:01

takes a lot

play19:02

of time sometimes you might consider

play19:04

limiting your manipulations

play19:05

so that it will be easier to do counter

play19:08

balancing

play19:09

now let's talk about the advantages of a

play19:11

within subjects design one advantage is

play19:13

that it requires

play19:14

relatively few participants in

play19:16

comparison to between subjects design

play19:18

and why is that

play19:19

in between subjects design if you have

play19:21

three conditions with 30 participants

play19:23

each

play19:24

you need 90 participants but in a within

play19:26

subject design and you have three

play19:28

conditions

play19:29

you can reuse the same participants

play19:31

that's why instead of needing 90

play19:33

you can only make use of 30 participants

play19:36

and that saves a lot of time

play19:38

and effort it essentially eliminates all

play19:40

the problems based on individual

play19:42

differences

play19:43

that are the primary concern of between

play19:45

subjects design

play19:47

remember last time we talk about the

play19:48

influence of individual differences

play19:51

that is being eliminated when we do a

play19:53

within subject design however

play19:56

when you make use of within subjects

play19:57

design you will encounter new problems

play19:59

such as practice

play20:00

and fatigue and other things

play20:04

other than that you might encounter what

play20:06

we call mortality

play20:07

or because you're using the same

play20:09

participants again and again and what if

play20:11

you need their participation for eight

play20:12

weeks

play20:13

some participants who start the research

play20:16

study

play20:17

may be gone before the study is

play20:19

completed they may drop out they may

play20:21

quit

play20:22

hence your group will your group will

play20:24

not be the same

play20:25

as when you started the experiment

play20:28

that's why

play20:29

this will influence how you make

play20:31

conclusions because most of the time

play20:33

the participants who are going to stay

play20:36

are those who have very high commitment

play20:38

that is also a factor in making

play20:40

conclusions because right now

play20:42

personality is having an influence on

play20:44

your

play20:45

results now how do you know if you're

play20:47

going to use a within subject design

play20:50

or a between subjects design look at

play20:52

these three

play20:53

scenarios so if you anticipate large

play20:56

individual differences

play20:58

perhaps it's better to use within

play21:00

subjects design

play21:02

so you will know it sometimes before you

play21:05

decide and decide on conducting

play21:06

experiments you try to read the

play21:08

literature

play21:09

try to determine if individual

play21:11

differences will be a big factor

play21:14

in that study other than that whenever

play21:17

you expect one or more treatment

play21:19

conditions to have a large

play21:20

and long-lasting effects that may

play21:22

influence the participants in the future

play21:24

conditions

play21:25

meaning there can be practice effect or

play21:27

fatigue effects

play21:29

order effects then it's better to use a

play21:31

between subject design for example

play21:34

if your experiment is about test taking

play21:36

or it's about teaching

play21:38

perhaps a within subjects design is not

play21:41

the best

play21:41

it's not the best approach because if

play21:44

you use teaching as manipulation

play21:46

then that's not going to be easily

play21:48

forgotten

play21:49

it will be retained even after some time

play21:52

and lastly whenever it's difficult to

play21:54

find and recruit participants

play21:56

a within subject design is a better

play21:58

choice for example

play21:59

you want to conduct experience with

play22:01

people with learning disability

play22:04

then it might be difficult to find 100

play22:07

individuals with learning disability

play22:09

that's why it's better to make use

play22:11

of a within subject design however the

play22:13

challenge here is that

play22:14

you need to get their commitment to

play22:16

participate in your study

play22:18

so here are the applications just like

play22:20

last time a within subject design can be

play22:22

used in evaluating two conditions but

play22:25

this time you have same participants so

play22:26

that's the simplest type

play22:28

of a within subjects design also you can

play22:31

make use of multiple treatment designs

play22:33

or

play22:34

you can have three or more groups and

play22:36

multiple treatment designs also produce

play22:38

a more convincing demonstration of cost

play22:40

and effect relationships

play22:42

compared to a two group design the

play22:44

problem is that

play22:45

it may be hard to get to get their

play22:47

commitment for a long period of time

play22:50

that's why you need to weigh a lot of

play22:51

issues before choosing

play22:53

if you're going to make use of it

play22:55

between subjects or a within

play22:57

subjects design basically that's what

play22:59

you need to learn about within subjects

play23:01

design

play23:02

and i do hope that you learned a lot

play23:03

from this discussion

play23:05

and you need to be more cautious before

play23:07

deciding

play23:08

on your experimental design

play23:11

that's it and i hope you learned a lot

play23:14

thank you

Rate This
β˜…
β˜…
β˜…
β˜…
β˜…

5.0 / 5 (0 votes)

Related Tags
Experimental DesignWithin-SubjectsCause and EffectPsychology ResearchData AnalysisResearch MethodsStatistical AnalysisParticipant TestingResearch ValidityDesign Comparison