Language testing

Summary

In this video, Steve Kaufman discusses the inefficiencies and costs associated with language proficiency tests like TABE, TOEFL, TOEIC, and others. He criticizes the language testing industry for being a multi-billion dollar market that often emphasizes test preparation over genuine language learning. Kaufman argues that real language proficiency comes from practical use, not test scores, and suggests that personal motivation and communication are more effective ways to learn languages. He highlights his own experience learning multiple languages without formal tests, emphasizing practical immersion over structured assessments.

Takeaways

• 📘 Language proficiency levels are often divided into six categories, as seen in the European framework and McGraw-Hill's TABE test.
• 💰 The language learning and testing industry generates billions of dollars, with a significant portion devoted to test preparation and materials.
• 📊 There are many standardized tests like TOEFL, TOEIC, IELTS, and now TABE, all duplicating efforts to measure language skills.
• 💡 The speaker questions the effectiveness of these tests, suggesting that communication is a natural skill, unlike engineering, which requires objective standards.
• 🗣️ Speaking is about communication, and there are no physical risks if someone makes mistakes, unlike in professions like engineering.
• 🧠 Some people perform well in tests but struggle to communicate, while others may communicate effectively despite making grammar mistakes.
• 🚫 The speaker criticizes the vast amount of time and money spent on developing, administering, and studying for language tests, calling it counterproductive.
• 👩‍💻 The speaker suggests more practical alternatives, such as evaluating language skills via video calls or submitted recordings, which would be far more cost-effective.
• 🇯🇵 The speaker shares their personal experience of becoming fluent in Japanese without taking any formal tests, highlighting that tests aren’t always necessary.
• 🏫 The speaker emphasizes that making language learning more engaging could lead to better communication skills, rather than focusing on tests that don't truly measure proficiency.

Q & A

What is Steve Kaufman's general view on language proficiency testing?

Steve Kaufman believes that language proficiency testing is largely unnecessary and a waste of time and money. He argues that testing does not effectively measure communication ability, which is the primary purpose of language learning.

How does Steve Kaufman compare language proficiency testing to other types of certification?

Kaufman compares language testing to certifications for engineers, which are necessary to ensure the safety and stability of structures like bridges. However, he argues that speaking a language doesn’t carry such risks and therefore doesn’t need the same level of rigorous testing.

What are some of the language proficiency tests mentioned by Steve Kaufman?

Steve Kaufman mentions several tests, including TOEFL, TOEIC, IELTS, and TABE, as well as the European language proficiency framework and Canada’s 12 benchmarks.

Why does Steve Kaufman believe that language testing is counterproductive?

He believes it is counterproductive because it focuses too much on testing and certification rather than actual communication ability. He also notes that people may score well on tests but still struggle to communicate, and many resources are wasted on developing and studying for these tests.

How does Kaufman suggest language proficiency should be assessed instead of tests?

Kaufman suggests that language proficiency could be assessed more effectively through simple conversations, either in person or via tools like Skype, rather than formal testing.

What does Kaufman say about his own experience with language learning and testing?

Kaufman shares that he speaks 10 languages but has never taken formal tests in most of them. He believes that he learned languages better through immersion and real-life communication, such as when he studied in France.

Why does Kaufman criticize the language education system in Japan?

He criticizes the system because despite millions of people taking tests like TOEIC, the average scores remain low, and many people still struggle to communicate in English. He argues that the focus on testing in Japan does not lead to practical language skills.

What alternative does Kaufman propose to motivate people to learn languages?

Kaufman suggests making language learning more interesting and engaging rather than focusing on testing. He believes this would lead to more people being able to communicate effectively in a language.

What does Kaufman mean when he says, 'Speaking is just communicating'?

Kaufman means that the primary goal of learning a language should be the ability to communicate, not to achieve perfect grammar or pass tests. He emphasizes that communication is natural and doesn’t need to be over-complicated by formal testing.

How does Kaufman view the role of experts in language testing development?

He is skeptical of the role experts play in language testing development, suggesting that they may design tests primarily to secure government recognition and funding, rather than focusing on what truly helps learners communicate better.