Should we get rid of standardized testing? - Arlo Kempf

Summary

Standardized tests, originating over 2,000 years ago in China, have evolved into a global tool for assessing various skills, from government aptitude to education. These tests are typically measured by comparing performance to others or against fixed criteria, often expressed in percentiles. However, misapplication or poor design can distort results, as factors like test anxiety, cultural bias, and literacy issues may affect outcomes. While useful for broad assessments, standardized tests struggle with evaluating abstract qualities like creativity and critical thinking. Their reliability and validity are crucial, and they should be used appropriately to avoid misleading conclusions.

Takeaways

• 😀 The first standardized tests were used in China over 2,000 years ago during the Han dynasty for government appointments.
• 😀 Standardized tests have been used globally for a wide range of purposes, from firefighter evaluations in France to student assessments in schools.
• 😀 There are two main ways to evaluate standardized test results: relative (comparing test takers) and absolute (measuring against fixed criteria).
• 😀 Percentiles are used to express how well someone performs relative to others on standardized tests.
• 😀 Standardized tests are a tool, much like a ruler, but their effectiveness depends on the task and the design of the test.
• 😀 If a test is given the wrong job or designed poorly, it may measure the wrong things, leading to invalid results.
• 😀 Students with test anxiety, reading challenges, or cultural unfamiliarity may struggle with standardized tests, skewing results.
• 😀 Standardized tests are less effective at measuring abstract skills like creativity, critical thinking, and collaboration.
• 😀 Reliability and validity are essential in understanding the accuracy of standardized test results.
• 😀 A test's validity depends on using results appropriately, as results can be misleading if misinterpreted or used for the wrong purpose.
• 😀 While standardized tests can provide a broad overview of many people, they may not reveal much about individual skills or abilities.

Q & A

What is the historical origin of standardized tests?

Standardized tests were first administered in China over 2,000 years ago during the Han dynasty to determine aptitude for various government posts. They were based on subjects like philosophy, farming, and military tactics.

How are standardized tests used today?

Today, standardized tests are used in a variety of fields, including evaluating physical performance (like stair climbs for firefighters in France), language proficiency for diplomats in Canada, and academic assessments for students worldwide.

What are the two primary types of performance measurement in standardized tests?

Standardized tests either measure scores in relation to other test takers (relative performance) or evaluate how well a test taker meets predetermined criteria (absolute performance).

What is a 'bell curve' and how does it relate to standardized tests?

A bell curve represents a normal distribution of scores where most test takers score near the average, and fewer score very high or low. It's commonly used to compare the performance of test takers.

What is a percentile, and how is it interpreted?

A percentile represents the percentage of test takers who scored lower than a particular individual. For example, if a diplomat scores in the 70th percentile, 70% of other test takers scored below her.

How does the analogy of a ruler help explain the limitations of standardized tests?

The ruler analogy suggests that a test’s usefulness depends on the task it is designed for. Just as a ruler can't measure temperature, a standardized test may not measure the right qualities if it's poorly designed or used for the wrong purpose.

What challenges can arise from poorly designed standardized tests?

If a test is poorly designed, it might measure the wrong things, such as a student’s literacy skills instead of their numeracy skills, or it might be influenced by cultural bias, affecting the fairness and validity of the results.

What is the difference between reliability and validity in standardized tests?

Reliability refers to the consistency of test results over time, while validity concerns whether a test measures what it is supposed to measure. A reliable but invalid test consistently gives wrong answers, while an unreliable test fluctuates unpredictably.

Why can standardized tests be controversial, especially in education?

Standardized tests can be controversial because they often fail to capture essential skills like creativity or critical thinking, and can unfairly disadvantage students with test anxiety, reading challenges, or cultural differences.

What are the potential long-term consequences of relying too heavily on standardized test scores?

Relying too heavily on standardized test scores can lead to sweeping and often negative consequences for test takers, including life-altering decisions based on incomplete or inaccurate measures of a person's abilities or potential.