ANALISIS BUTIR SOAL (TINGKAT KESUKARAN)

Summary

In this video, the presenter discusses the analysis of test item quality, focusing on two key approaches: qualitative and quantitative analysis. The qualitative analysis examines the relevance of material, clarity of the questions, and the impact of language and culture in test items. The quantitative analysis covers classical test theory, including difficulty level, discrimination power, and distractor effectiveness, particularly for multiple-choice questions. The video explains how to calculate the difficulty level of test items using a formula and demonstrates how Microsoft Excel can be used to analyze test data efficiently. The presenter provides practical examples and emphasizes the importance of accurate test item construction.

Takeaways

• 😀 The video discusses the analysis of test items, a part of the evaluation process in learning assessments.
• 😀 The analysis of test items can be divided into two types: qualitative analysis and quantitative analysis.
• 😀 Qualitative analysis is performed before testing and ensures the quality of the test material, question construction, and language usage.
• 😀 The material used in a test should be aligned with the indicators to ensure accuracy and relevance.
• 😀 Question construction should be clear, direct, and free from ambiguity to avoid confusion during testing.
• 😀 The language and cultural aspects of a test should avoid bias and adhere to Indonesian language norms, ensuring clarity for all participants.
• 😀 The quantitative analysis involves classical test theory, which includes difficulty level, discrimination power, and distractor effectiveness.
• 😀 Difficulty level is calculated using a formula (P = B/N), where B is the number of correct responses and N is the total number of participants.
• 😀 The difficulty level can be categorized as easy (P > 0.75), medium (0.25 ≤ P ≤ 0.75), and difficult (P < 0.25).
• 😀 The analysis process, including the use of tools like Microsoft Excel, can help educators easily calculate and classify the difficulty level of each test item.

Q & A

What is the purpose of analyzing exam items (butir soal)?

The purpose of analyzing exam items is to evaluate the quality of the questions developed for an exam. This ensures that the items are valid, reliable, and aligned with the learning objectives.

What are the two types of analysis performed on exam items?

The two types of analysis are qualitative analysis and quantitative analysis. Qualitative analysis is done before the test is trialed, while quantitative analysis is performed after the test data is collected.

What does qualitative analysis focus on?

Qualitative analysis focuses on the content, construction, and language/cultural aspects of the test items. This includes ensuring that the items align with the learning objectives, are clear, precise, and free of bias.

What is meant by 'content suitability' in the context of qualitative analysis?

Content suitability refers to ensuring that the test items reflect the key indicators of the material being tested. The items must align with the learning objectives or indicators.

What role does language play in qualitative analysis?

Language must be clear, communicative, and free from bias or ambiguity. It should not cause confusion or misinterpretation due to cultural or regional differences.

What are the components of quantitative analysis in exam item evaluation?

Quantitative analysis involves measuring the difficulty level (P), discrimination power, and the effectiveness of distractors (for multiple-choice questions). These metrics help assess the reliability and quality of the exam items.

What is the difficulty level (P) of an exam item?

The difficulty level (P) is the proportion of test-takers who answer a particular item correctly. It is calculated by dividing the number of correct answers by the total number of test-takers.

How is the difficulty level (P) calculated?

The difficulty level is calculated using the formula P = B / N, where B is the number of correct answers and N is the total number of test-takers.

What does a difficulty level of P = 0.75 indicate about an exam item?

A difficulty level of P = 0.75 indicates that the item is easy, as a large proportion of the test-takers answered it correctly.

How can Microsoft Excel be used in analyzing the difficulty level of exam items?

Microsoft Excel can be used to automate the calculation of the difficulty level by organizing data, such as student answers, and applying the formula to calculate the proportion of correct answers. Excel can also classify items as easy, moderate, or difficult using conditional formulas.