Creating Rubrics for Assessment

Advance Consulting for Education
23 Dec 201824:55

Summary

TLDRThis educational video script discusses the importance and types of rubrics in assessing students' writing and speaking skills. It differentiates between holistic, primary trait, and analytic rubrics, highlighting their advantages and disadvantages. The script emphasizes the value of rubrics in providing consistent, reliable feedback to students and suggests using rubric websites for quick development, while also reminding educators to align rubrics with their teaching philosophy.

Takeaways

  • 📝 Rubrics are essential for assessing students' extended responses in writing or speaking, requiring subjective evaluations.
  • 🔍 Rubrics provide consistency and reliability in scoring across multiple students, helping to ensure fairness.
  • 📚 Students generally appreciate rubrics as they offer clear criteria for success and areas for improvement, enhancing engagement and motivation.
  • 🛠️ Teachers often have a complex relationship with rubrics, finding them useful yet sometimes challenging to perfect.
  • ✍️ Primary Trait Rubrics focus on a single characteristic of student work, but may lack comprehensive feedback.
  • 🎯 Holistic Rubrics offer a quick and reliable method to score student work, providing a single grade that reflects overall proficiency.
  • 🔑 Holistic Rubrics can be easier to create and use, especially for high-volume assessments like placement or final exams.
  • 🔍 Analytic Rubrics break down assessment into sub-skills, allowing for more detailed feedback and the option to weight different aspects of the work.
  • ⏱️ Analytic Rubrics may take longer to score due to the need to evaluate each sub-skill individually.
  • 💡 When creating a rubric, consider the scoring scale, the sub-skills to be evaluated, and how to write clear and distinct descriptors for each level.
  • 🌐 Rubric websites can be a helpful tool for quickly generating rubrics, offering flexibility in selecting or creating sub-skills and descriptors.

Q & A

  • What is the primary purpose of using a rubric in teaching?

    -The primary purpose of using a rubric in teaching is to assess students' performance in a consistent and reliable manner, particularly for extended responses in writing or speaking that require subjective evaluation.

  • Why are rubrics beneficial for students?

    -Rubrics are beneficial for students because they provide clear criteria for success, allow students to understand their strengths and weaknesses, and can be motivational as they offer a sense of stability across multiple assignments.

  • What are the different types of rubrics mentioned in the script?

    -The script mentions three types of rubrics: primary trait rubrics, holistic rubrics, and analytic rubrics, each with their own strengths and weaknesses.

  • What is a primary trait rubric and why is it less commonly used?

    -A primary trait rubric evaluates a single trait on a piece of writing or speaking, such as persuasive ability in a persuasive essay. It is less commonly used because it does not provide a lot of feedback and does not recognize multiple aspects of an essay, like grammatical accuracy or vocabulary range.

  • How does a holistic rubric differ from an analytic rubric?

    -A holistic rubric provides a single score based on an overall assessment of a student's work, while an analytic rubric breaks down the assessment into multiple sub-skills, each with its own descriptors and scores.

  • What are some advantages of using holistic rubrics?

    -Advantages of holistic rubrics include speed and ease of use, reliability in scoring across multiple students, and the ability to yield a single score that is easy for administrators to interpret.

  • What are the potential disadvantages of holistic rubrics?

    -Disadvantages of holistic rubrics include the difficulty in accurately assessing students with varying strengths and weaknesses, the lack of detailed feedback for students, and challenges in ensuring consistency across multiple markers.

  • Why might an analytic rubric be preferred over a holistic rubric?

    -An analytic rubric might be preferred when there is a need for detailed feedback on specific sub-skills, when sub-skills can be weighted according to their importance, and when more reliable scores are needed, particularly across multiple markers.

  • What are some challenges in developing an analytic rubric?

    -Challenges in developing an analytic rubric include the time-consuming process of scoring due to the assessment of each sub-skill separately, the difficulty in creating distinct descriptors for each sub-skill, and the potential for overlap or ambiguity in descriptors.

  • How can a rubric website assist in the creation of a rubric?

    -A rubric website can assist by providing a platform to select from pre-determined sub-skills or create custom ones, choose from pre-written descriptors or write original ones, and generally offer a flexible and efficient way to develop a rubric quickly.

  • What is the importance of reflecting on the decisions made while developing a rubric?

    -Reflecting on the decisions made while developing a rubric is important because these decisions, such as the grading scale and the sub-skills chosen, reflect the teacher's values and philosophy towards teaching and learning, and ultimately influence student proficiency.

Outlines

00:00

📚 Introduction to Rubrics in Education

This paragraph introduces the concept of rubrics as essential tools in assessing students' writing and speaking assignments. It discusses the importance of rubrics in providing consistent and reliable grading across multiple students. The speaker emphasizes the practicality of rubrics in scoring, their role in offering feedback to students about their strengths and weaknesses, and their utility in enhancing accountability in education. The paragraph also touches on the common love-hate relationship teachers have with rubrics and the idea that they should be continuously improved upon use.

05:01

🔍 Types of Rubrics: An Overview

The second paragraph delves into the different types of rubrics used in education, specifically focusing on primary trait, holistic, and analytic rubrics. It explains that primary trait rubrics evaluate a single characteristic of student work, which can be limiting in providing comprehensive feedback. Holistic rubrics are described as quicker to use and more reliable, offering a single score that can be beneficial for administrative purposes. However, they may lack in providing detailed feedback to students. The paragraph also mentions the ease of creating holistic rubrics compared to analytic ones, which are not discussed in detail here.

10:05

📉 Challenges and Uses of Holistic Rubrics

This paragraph explores the advantages and disadvantages of holistic rubrics in more depth. While they allow for quick scoring and consistency, they can be less reflective of individual student abilities due to their collapsing of multiple criteria into a single score. The challenge of ensuring consistency across different markers is also highlighted. The paragraph suggests that holistic rubrics are particularly useful for high-volume assessments like placement tests or final exams, where speed is crucial.

15:06

📝 Analytic Rubrics: Detailed Feedback and Scoring

The fourth paragraph introduces analytic rubrics, which assess multiple sub-skills individually, providing specific feedback to students. It discusses the advantages of analytic rubrics, such as the ability to weight sub-skills according to their importance in a particular context, and the potential for more reliable scoring. The paragraph also addresses the challenges of developing analytic rubrics, including the time-consuming process and the difficulty of creating clear, non-overlapping descriptors.

20:07

🎯 Creating Effective Rubrics

The final paragraph provides guidance on creating effective rubrics, emphasizing the importance of decisions made during their development, which reflect the educator's values and approach to teaching. It discusses the selection of a scoring scale, the identification of sub-skills to evaluate, and the crafting of distinctive descriptors for each sub-skill at each proficiency level. The paragraph also suggests using rubric websites as a starting point for developing rubrics and the importance of pilot testing them before high-stakes use.

Mindmap

Keywords

💡Rubric

A rubric is a set of criteria or standards used to evaluate work, often in an educational context. In the video, rubrics are central to the theme as they are tools for assessing student performance in writing and speaking tasks. The script discusses different types of rubrics, such as holistic and analytic, and how they can be used to provide consistent and reliable evaluations.

💡Assessment

Assessment refers to the process of evaluating or judging the quality of student work. The video emphasizes the importance of assessment in education and how rubrics facilitate this process, particularly for extended responses that require subjective evaluation.

💡Consistency

Consistency in grading is crucial for fairness and reliability. The script mentions that rubrics help ensure consistent scoring across multiple students, which is a key advantage of using these tools in educational assessment.

💡Feedback

Feedback is information provided by teachers to students about their work. The video script explains how rubrics can offer feedback by allowing students to understand their strengths and weaknesses through the descriptors of proficiency levels.

💡Accountability

Accountability in education means being responsible for the learning outcomes of students. The script suggests that using rubrics provides a form of accountability to students by giving them detailed feedback on their performance.

💡Primary Trait Rubric

A primary trait rubric is a type of assessment tool that evaluates a single characteristic or trait of a student's work. The script mentions this as one of the less commonly used rubrics because it may not provide comprehensive feedback on all aspects of a student's performance.

💡Holistic Rubric

A holistic rubric assesses the overall quality of a student's work, providing a single score that reflects proficiency levels. The video discusses the advantages and disadvantages of holistic rubrics, such as their speed and reliability but also their limitations in providing detailed feedback.

💡Analytic Rubric

An analytic rubric breaks down the assessment into multiple sub-skills or criteria, evaluating each separately. The script highlights the advantages of providing specific feedback to students and the ability to weight sub-skills according to their importance.

💡Descriptors

Descriptors are the statements within a rubric that describe the characteristics of work at different proficiency levels. The video script discusses the importance of writing clear and distinctive descriptors for each sub-skill in an analytic rubric to provide accurate assessments.

💡Proficiency Levels

Proficiency levels are the various stages of skill or ability that a rubric measures. The script uses this term to describe the different levels of student performance that are assessed and described through the use of rubrics.

💡Reliability

Reliability in assessment refers to the consistency and stability of the results obtained. The video script notes that rubrics, particularly holistic ones, can provide reliable scores across multiple students, which is important for fair evaluation.

💡Scoring Scale

A scoring scale is the range of scores that can be assigned using a rubric. The script discusses the importance of choosing an appropriate scoring scale that reflects the level of detail and differentiation needed for the assessment.

Highlights

Importance of rubrics in assessing student writing and speaking for consistent and reliable grading.

Different types of rubrics: holistic, primary trait, and analytic, each with unique strengths and weaknesses.

Holistic rubrics provide a quick and consistent scoring method but may lack detailed feedback.

Primary trait rubrics focus on a single characteristic but may not provide comprehensive feedback.

Analytic rubrics offer specific feedback on sub-skills but can be time-consuming to score.

Students generally appreciate rubrics as they understand criteria for success and receive clear feedback on strengths and weaknesses.

Rubrics can be motivational for students, especially when they are familiar with the criteria used for evaluation.

The development of a rubric should be an ongoing process, with adjustments made after each use to improve its effectiveness.

The choice between holistic and analytic rubrics depends on the teacher's assessment needs and practicality.

Creating a rubric involves decisions that reflect the teacher's values and philosophy on language teaching.

Decisions on scoring scale and sub-skills to be evaluated are crucial in rubric development.

Descriptors in a rubric should be clear and distinctive for each proficiency level and sub-skill.

Pilot testing a rubric can provide valuable feedback for refinement before high-stakes use.

Rubric websites can be a helpful starting point for quickly developing a rubric, especially when time is limited.

The use of rubrics enhances accountability in education by providing students with detailed feedback on their performance.

Challenges of holistic rubrics include difficulty in assessing individual student abilities when criteria are collapsed into a single score.

Analytic rubrics allow for weighting of sub-skills according to their importance in the context of the course.

The development of a rubric is not value-neutral and should reflect the teacher's educational values.

Rubrics should be chosen based on the type of assessment and the desired level of feedback for students.

Transcripts

play00:00

[Music]

play00:15

[Applause]

play00:17

[Music]

play00:20

as soon as you begin to teach very

play00:22

shortly after that you begin to think

play00:24

about what you need to do in order to

play00:26

assess or to test your students and as

play00:29

soon as you have them doing any kind of

play00:31

writing or any kind of speaking you need

play00:33

to think about how you're going to grade

play00:34

that in a consistent way across multiple

play00:37

students and at that point you probably

play00:40

need to start thinking about how what

play00:43

kind of rubric to use and how to create

play00:45

a rubric and that is what I want to

play00:47

speak to you about now

play00:49

[Music]

play00:56

you may have a fairly good idea about

play00:58

what a rubric is generally we're exposed

play01:00

to them in our teacher training and you

play01:02

can see an example of a holistic kind of

play01:05

rubric it looks like a table with a

play01:07

score down the first column and then

play01:09

descriptors of criteria in the main body

play01:12

of the table and this is an example then

play01:15

of a holistic rubric but there's other

play01:17

types of rubrics and you may want to use

play01:20

a different type of rubric for a

play01:21

different type of test task so we want

play01:24

to get to the point where you can match

play01:26

the test tasks with the type of rubric

play01:28

that you need to use when do we use

play01:31

rubrics you'll want to use a rubric

play01:34

anytime you have an extended response

play01:36

from a student in speaking or in writing

play01:39

that requires a subjective evaluation as

play01:44

teachers we often really like to use

play01:46

rubrics for a variety of reasons one is

play01:50

when we're looking at extended responses

play01:52

made by our students it's actually very

play01:55

practical to have a rubric it makes your

play01:58

scoring a little bit easier it ensures

play02:01

that your scoring is consistent or we

play02:04

could say reliable across multiple

play02:06

students it does provide some type of

play02:10

feedback to students usually because

play02:13

students are able to look

play02:15

the descriptors of the proficiency level

play02:17

and get an idea of their strengths and

play02:19

weaknesses and so it enhances it's it's

play02:22

a way to provide accountability to our

play02:25

students because we're really providing

play02:28

them with as much feedback as we can so

play02:30

teachers generally like to use rubrics

play02:33

often though teachers have a love-hate

play02:36

relationship with their rubrics they

play02:37

like to use rubrics but perhaps not this

play02:39

one or they can find problems with a

play02:41

particular rubric and so when you start

play02:44

to develop or thinking about using your

play02:46

own rubric don't think ever that your

play02:48

rubric is absolutely completely finished

play02:50

you may want to tweak it as you go along

play02:51

after each use to make it and improve it

play02:54

make it a little bit better and better

play02:56

but generally teachers really like

play02:59

rubrics what about students do you think

play03:01

students like rubrics the answer to that

play03:04

question is usually yes students do like

play03:07

rubrics again because they can see the

play03:10

criteria for their success they can see

play03:14

their strengths and their weaknesses

play03:15

they usually provide quite a bit of

play03:18

feedback to students often students are

play03:21

more engaged when they know the criteria

play03:23

upon which you're basing your

play03:26

evaluations and it can be motivational

play03:29

for students and it can if they have

play03:31

worked with a rubric that you've been

play03:33

using the rubric before and they're

play03:34

familiar with it it can provide them

play03:36

with a real sense of stability across

play03:38

multiple assignments so yeah usually

play03:41

students like rubrics true

play03:43

[Music]

play03:50

there are different types of rubrics

play03:52

that teachers frequently use when they

play03:55

evaluate student speaking or writing and

play03:58

I'm going to mention three of them now

play04:00

one is a primary treat rubric the other

play04:03

is a holistic rubric and the last one is

play04:07

an analytic rubric and each of these

play04:10

types of rubrics have their own

play04:11

strengths and weaknesses that you should

play04:13

be aware of a primary trait rubric is a

play04:23

rubric that just evaluates a single

play04:25

trait on a piece of writing or speaking

play04:28

so it is the rubric that's probably the

play04:32

least commonly used and you'll be able

play04:35

to see why as I get into my explanation

play04:38

so let's say you have asked students to

play04:41

write a persuasive essay and you decide

play04:44

that the main characteristic the prime

play04:46

characteristic that you want to evaluate

play04:48

in that assignment is the persuasive

play04:51

ability of that particular student and

play04:53

so you would provide a single score that

play04:57

is dependent upon it whether that

play04:59

student managed to persuade you of their

play05:01

point of view or not so you can see a

play05:04

primary trait rubric then refers to

play05:06

evaluation of a single trait that you

play05:09

have determined to be the most important

play05:12

for that particular thing for that

play05:14

particular assignment and usually it's a

play05:17

fairly simple scale of 0 to 3 either you

play05:21

were not persuaded or you were sort of

play05:25

persuaded or you were definitely

play05:26

persuaded I guess that would be a scale

play05:28

of 0 to 2 so it's quite a simple rubric

play05:31

and you can see that that type of rubric

play05:34

would have some challenges with it in

play05:37

the sense that it doesn't provide

play05:39

students with a lot of feedback and it

play05:42

doesn't recognize that well an essay

play05:44

might be quite persuasive it may

play05:47

actually be weak in terms of its

play05:49

grammatical accuracy or its vocabulary

play05:51

range or even its organization and so

play05:55

although we mentioned primary trait

play05:57

rubrics because people do use the

play05:59

usually they're not used very frequently

play06:02

so when we want to talking about the

play06:04

other two types of rubrics now you can

play06:12

see on the screen an example of a

play06:14

holistic rubric that would be used to

play06:17

score student writing you can see in the

play06:20

first column there is a series of grades

play06:22

that range from A to E and in the main

play06:25

table are the descriptors that describe

play06:27

proficiency levels at each of those

play06:29

grade levels if you take a look at the

play06:33

top row the next to the score of a or

play06:36

the grade of a you can see that the

play06:38

descriptors include excellence in

play06:41

content as well as organization

play06:44

vocabulary range as well as spelling and

play06:48

punctuation and there's even a comment

play06:50

about coherence in there so that's a lot

play06:53

of information to contain in a single

play06:56

description of proficiency and you can

play07:00

see that this perhaps leads to the

play07:03

weakness of this particular rubric there

play07:06

are advantages to holistic rubrics and

play07:09

you may be able to guess that one of the

play07:11

advantages is that they're quite fast to

play07:13

use in terms of the scoring that you can

play07:17

accomplish with them is fairly speedy so

play07:21

and as you get more practice with using

play07:23

these types of holistic rubrics you get

play07:26

to have a very good feel about what a

play07:29

piece of student writing looks like at

play07:31

each grade and you can play students

play07:33

quite quickly in a grade level ABCD or e

play07:36

and you can move relatively quickly

play07:39

through your student writing so they are

play07:42

fast they are fairly reliable in that

play07:45

they allow you consistency in marking

play07:49

across multiple students and these are

play07:51

really good reasons to use holistic

play07:54

rubrics the other benefit of holistic

play07:56

rubrics is that they yield a single

play07:58

score this is very useful actually if

play08:01

you are going to give that score to an

play08:04

administrator really an administrator

play08:06

really wants a single score that's all a

play08:08

one just tell me how good that student

play08:10

is so that I can place them or that I

play08:12

can tell either admit them or not admit

play08:15

them and so there's always a push from

play08:18

the administrator to have a single score

play08:20

that is easy to interpret and holistic

play08:23

rubrics generate that you can see that

play08:26

based on their descriptors you will have

play08:28

a student will have a single score and

play08:30

so you might use a holistic rubric for

play08:33

that purpose the other thing about

play08:35

holistic rubrics is that although most

play08:38

rubrics are challenging to create a

play08:40

holistic rubric is perhaps a little bit

play08:43

easier to create than an analytic rubric

play08:45

so if you're thinking of developing your

play08:48

own rubric then a holistic rubric might

play08:51

be a good way to start it wherever

play08:54

possible it's much easier to work with a

play08:56

rubric that perhaps some of your

play08:58

colleagues have generated or that has

play08:59

been generated through research so use

play09:02

those if you can and if not feel free to

play09:05

generate your own but just accept the

play09:07

fact that it may take a little while and

play09:09

again the holistic rubric may be a

play09:11

little bit easier to start with than an

play09:13

analytic rubric holistic rubrics are

play09:16

also very useful for situations where

play09:19

you need to score a lot of tests or

play09:22

exams fast so often those involve

play09:25

placement tests or final exams where you

play09:29

may have large numbers of students

play09:30

completing an assessment or a test

play09:32

altogether and you need to process their

play09:35

work quite quickly in those situations

play09:37

holistic rubrics are good choices just

play09:41

as there are advantages with holistic

play09:42

rubrics there are also disadvantages and

play09:45

you may have guessed by looking at that

play09:47

example of a holistic rubric that one of

play09:50

the challenges with them is that they

play09:52

collapse a lot of criteria into a single

play09:56

grade so what happens if you have a

play09:59

student who's got really strong content

play10:01

but quite poor organization it's hard

play10:04

then to assess them accurately with

play10:08

simply a holistic rubric because the

play10:11

holistic descriptors group all of those

play10:13

things into a single unified score so

play10:17

sometimes you might find with your

play10:19

holistic rubric that you have two

play10:21

students who are really quite

play10:22

friend inabilities one has strong

play10:24

content and weak organization and the

play10:26

other has really good grammatical

play10:27

accuracy but poor content and they may

play10:30

end up with a similar grade and so the

play10:33

holistic rubric is less able to reflect

play10:36

the differences between those students

play10:38

because of the way it's constructed

play10:41

holistic rubrics also don't provide a

play10:44

lot of feedback to your students in

play10:46

terms of their strengths and their

play10:48

weaknesses again if you think of that

play10:50

student who's got really strong

play10:51

grammatical accuracy and really weak

play10:53

content they're not going to be able to

play10:56

see that from the holistic rubric so

play10:59

that's a really important weakness if

play11:03

you're scoring a test that has that

play11:05

requires multiple scores or multiple

play11:08

markers you may also find that it's

play11:10

quite difficult to get everybody marking

play11:13

in the same way using a holistic rubric

play11:15

it's a bit of a challenge to ensure

play11:18

consistency across markers and so that's

play11:21

a real shortcoming for holistic rubrics

play11:23

as well let's have a look at analytic

play11:31

rubrics then on the screen you can see

play11:34

an example of an analytic rubric you can

play11:38

see the example there it's a table

play11:40

that's actually empty analytic rubrics

play11:43

once the content is filled in in the

play11:46

table the descriptors are added in

play11:48

analytic rubrics can often be quite long

play11:50

and so it's challenging to get

play11:52

everything on one screen but you can see

play11:56

the outline for it here like a holistic

play12:00

rubric analytic rubrics have the grade

play12:03

score the grade scale in the first

play12:05

column and so you can see that here

play12:08

across the top though they have multiple

play12:11

columns and each column has a sub skill

play12:15

that broken out and then descriptors for

play12:18

each sub skill so you can see for

play12:20

writing you might have a column for

play12:24

content one for organization one for

play12:27

grammar or for more accuracy another for

play12:30

vocabulary or any other sub skill that

play12:33

you decide is important to assess

play12:35

in your context and although we were

play12:38

able to add descriptors in this

play12:41

particular example because it would have

play12:42

made it too long the middle part of the

play12:45

table usually contains descriptors of

play12:47

each of the sub skills at each of the

play12:49

proficiency levels just like holistic

play12:52

rubrics analytic rubrics have advantages

play12:54

and disadvantages so let's talk about

play12:56

the advantages first one of the most

play12:59

important advantages of an analytic

play13:02

rubric is that it provides very specific

play13:04

feedback to students so they can clearly

play13:07

see whether they have strengths and

play13:09

content or weaknesses and organization

play13:12

strengths and vocabulary range or

play13:14

weaknesses and spelling or punctuation

play13:16

and this is really important feedback

play13:19

for students to get so in that sense

play13:21

it's very helpful to the student the

play13:24

other thing a teacher can do with an

play13:26

analytic rubric is because the sub

play13:29

skills are broken out the teacher can

play13:32

actually weight the sub skills according

play13:34

to how important they think those are

play13:36

and this is an option that's not

play13:38

available to you when you use a holistic

play13:40

rubric so for example let's say you're

play13:43

teaching a grammar course where you ask

play13:46

students to write quite a bit in their

play13:49

assessment of their writing you may use

play13:51

a rubric but it would be completely

play13:53

understandable if you weighted the

play13:56

grammar component of that particular

play13:58

task more heavily than content and

play14:01

organization because that would match

play14:03

very closely with what you had been

play14:05

teaching students that would make sense

play14:07

conversely if you had an essay writing

play14:10

kind of course where you were focusing

play14:12

mostly on different rhetorical patterns

play14:15

you might choose to emphasize content

play14:18

and organization and de-emphasize the

play14:20

grammar or accuracy part you may you may

play14:23

not but you have that option when you're

play14:26

a teacher using an analytic rubric

play14:28

another advantage of an analytic rubric

play14:31

is that it produces more reliable scores

play14:34

than a holistic one particularly across

play14:37

multiple scores but also possibly just

play14:40

for your own scoring purposes because

play14:43

you're assessing each sub skill skill

play14:45

individually your

play14:47

to make a judgment on one particular sub

play14:50

skill before you move on to the next

play14:52

particular sub skill so you can evaluate

play14:54

content separately from organization

play14:57

separately from accuracy another

play15:00

advantage of analytic rubrics is that if

play15:03

for example you're using them for

play15:05

research purposes the analytic rubric

play15:09

then gives a really good picture to the

play15:11

researcher of the strengths and

play15:12

weaknesses of your student that's sort

play15:15

of an unusual circumstance but if you

play15:17

are involved in a research project it's

play15:19

a good idea probably to use an analytic

play15:23

rubric of course there are disadvantages

play15:26

to analytic rubrics as well and one of

play15:28

the bigger disadvantages is that it

play15:30

takes a longer time to score because

play15:32

you're weighing each or you're judging

play15:34

each sub skill separately it may take

play15:37

you a little bit more time than it does

play15:39

if you were using a holistic rubric you

play15:42

may also find that analytic rubrics are

play15:44

harder to develop if you have to build

play15:47

an analytic rubric yourself is probably

play15:50

a little bit more challenging because

play15:51

you have to write more descriptors for

play15:54

analytic rubrics than for a holistic

play15:56

rubric and when you're writing those

play15:58

descriptors you may have a challenging

play16:01

time avoiding overlap between one

play16:03

descriptor and another and ambiguity so

play16:07

that's always a challenge when you're

play16:08

creating an analytic rubric another

play16:11

challenge with an analytic rubric is

play16:13

that it may not allow you to assess the

play16:16

overall effect of a text and by this I

play16:19

mean that you may actually have a

play16:21

student who produces a writing text that

play16:24

is fairly weak in terms of grammar the

play16:29

accuracy is quite poor than making lots

play16:31

of mistakes and yet overall boy you

play16:34

really appreciate what they've done

play16:36

they've created a text that's creative

play16:38

that's really interesting it may not

play16:42

have superior content but perhaps

play16:44

somehow it's very appealing due to its

play16:47

rhythmic quality or almost poetic

play16:49

license perhaps that the student has

play16:52

used and so if you are very analytic

play16:55

with the rubric if you have an analytic

play16:57

rubric and you

play16:58

very analytic when you look at pieces of

play17:01

writing like that you may not actually

play17:03

be able to capture the overall effect

play17:05

with an analytic rubric so when it comes

play17:09

time for you to create a rubric you

play17:11

probably want to choose between a

play17:13

holistic rubric and the analytic rubric

play17:16

perhaps your ultimate choice will be

play17:18

determined by reasons of practicality

play17:20

and the reason for your assessment so if

play17:25

you've got a lot of tests to score

play17:27

you're probably going to choose a

play17:29

holistic type of rubric if you have

play17:32

fewer scores to do fewer students to

play17:35

score and you're really interested in

play17:38

getting good feedback to those students

play17:39

you may choose an analytic rubric all

play17:50

right so let's look at the framework

play17:52

that we looked at before when we were

play17:54

talking about analytic rubrics and for

play17:58

each area of the rubric you need to make

play18:01

decisions and your decisions really

play18:03

reflect your philosophy or your approach

play18:07

to teaching and learning a second

play18:09

language

play18:20

so keep that in mind whenever you're

play18:23

developing a rubric that your decisions

play18:25

then reflect your values so they're not

play18:28

value neutral and that's important to

play18:30

remember all right so your first

play18:33

decision then when you create a rubric

play18:34

is to decide on your scoring scale do

play18:37

you want a lot of divisions or just

play18:40

smaller number of divisions do you want

play18:42

to run from 0 to 4 or 1 to 6 or 0 to 9

play18:48

or 10 research shows that if you have

play18:51

quite a few divisions it gets quite

play18:54

difficult to write distinctive

play18:56

descriptors for each sub skill so

play18:59

oftentimes it's better to keep the

play19:01

scoring range a little bit lower so

play19:04

let's say you may want to go 0 to 6

play19:07

where you start the scoring scale is

play19:10

important

play19:11

perhaps you started at 0 and that would

play19:14

be a grade that you would assign to

play19:16

students who have 0 production but

play19:19

perhaps you want to recognize that

play19:21

students who even put a few words down

play19:24

even if they don't get to write an essay

play19:26

or a structured essay even students who

play19:28

put a few words down are deserving of at

play19:30

least 1 mark in that case if that's your

play19:33

philosophy then you would start your

play19:35

scale at 1 and the number of divisions

play19:38

that you have then really reflect how

play19:40

clearly you can write distinctive

play19:42

descriptors for each level to create an

play19:45

analytic rubric your next decision

play19:47

relates to the sub skills that you're

play19:49

going to evaluate and they're going to

play19:51

write those across the top of the

play19:53

columns so you've got to decide what

play19:55

you're going to evaluate generally if

play19:58

you're evaluating writing you're going

play20:00

to have a column for content 1 for

play20:04

organization and 1 for grammar accuracy

play20:07

or form but there are lots of other

play20:10

different sub skills that people may

play20:12

find pertinent to their teaching

play20:14

contexts so for example have you been

play20:17

really encouraging your students to

play20:19

watch their spelling and check their

play20:20

spelling then you may want to add a

play20:22

separate column for spelling that might

play20:25

be quite important to you and to what

play20:27

you're trying

play20:28

teachers students or you may really want

play20:31

to emphasize vocabulary range you've

play20:33

really been building your students

play20:35

vocabulary and you want to see them

play20:37

applying that in their written work so

play20:39

it may be really useful for you to have

play20:41

another column there where you attempt

play20:43

to assess their vocabulary range so

play20:46

whatever you pick do across the headings

play20:49

of those columns that reflect the sub

play20:51

skills that's your choice

play20:54

and it's your it reflects your values

play20:56

what you value in writing proficiency or

play20:59

in speaking proficiency in your students

play21:01

when developing a rubric you'll also

play21:04

need to spend quite a bit of time

play21:06

developing the descriptors that go in

play21:08

the middle of the table so you want to

play21:10

write distinctive descriptors at each

play21:13

grade level for each sub skill and that

play21:17

can be really challenging but it's

play21:19

really really important one good idea

play21:22

when you're developing an analytic

play21:24

rubric is to draft one and if you can

play21:28

pilot test it either with some old

play21:31

assignments that you might still have

play21:32

around that you've kept or you may ask

play21:36

some of your colleagues to have a look

play21:38

at it and make suggestions or you may

play21:41

even run it as a test with some of your

play21:43

students and ask them if they could work

play21:45

with this rubric or make suggestions or

play21:47

have them try and do a peer assessment

play21:49

with it it's good to try and get

play21:51

feedback on an analytic rubric before

play21:53

you actually use it for a higher stakes

play21:55

situation it's difficult to develop an

play21:58

analytic rubric and you may find that as

play22:00

you go along and you use it assignment

play22:03

after assignment you may want to change

play22:04

it and update it so I always think for a

play22:08

mom of my own rubrics that they're never

play22:09

really in a finished State they're

play22:11

always trying to push them to be a

play22:13

little bit more accurate in their

play22:15

descriptors a little bit to reflect a

play22:17

little bit better the skills that I want

play22:19

my students to learn one thing that you

play22:22

may find really useful when you're

play22:23

developing rubrics either holistic or

play22:26

analytic rubrics is a rubric website

play22:29

there are some really good websites on

play22:32

the internet that help create rubrics

play22:35

and you can go to one of these most of

play22:38

them are free generally they require

play22:40

just sign on with your email and to

play22:43

create an account but then you don't

play22:45

need to pay for them and you can if you

play22:48

want select from a group of

play22:52

predetermined sub skills or you can

play22:56

create your own sub skills you can then

play22:59

select from pre-written descriptors or

play23:02

you can write your own descriptors

play23:04

there's a fair amount of flexibility and

play23:07

how these rubric websites work so you

play23:09

may find that they're really useful

play23:11

particularly if you're in that situation

play23:13

very common to many teachers it's the

play23:15

night before and you wanted to hand back

play23:17

students assignments the next day and

play23:19

you really don't have a rubric that

play23:20

you're comfortable with in terms of

play23:22

assessing the writing rubric websites

play23:26

are not a bad place to start again you

play23:28

may not want to finish there or just

play23:29

leave it at that but they're really a

play23:31

pretty good place to start to develop a

play23:33

rubric quickly to conclude then when you

play23:44

are testing anytime you have an extended

play23:47

student response in either speaking or

play23:50

in writing you're going to want to use a

play23:52

rubric and you probably want to choose

play23:55

between holistic or analytic rubrics

play23:58

although you might consider primary

play23:59

treat for those situations where you

play24:02

want a really fast smart really really

play24:03

speedy but you're probably going to pick

play24:06

between a holistic and analytic rubric

play24:08

and just remember as you're developing

play24:10

your rubrics that all of your decisions

play24:12

the grading scale and the sub skills

play24:16

that you choose to evaluate and how you

play24:18

write at your descriptors they all

play24:20

reflect what you value in student

play24:22

proficiency

play24:23

[Music]

play24:39

[Applause]

play24:41

[Music]

Rate This

5.0 / 5 (0 votes)

関連タグ
Rubric DesignStudent AssessmentEducational ToolsTeaching StrategiesScoring ScaleFeedback MechanismHolistic RubricAnalytic RubricLanguage LearningEducational AssessmentPedagogical Methods
英語で要約が必要ですか?