VALIDITAS ISI DENGAN AIKEN'S V (TEORI DAN PRAKTEK)

Summary

In this lecture, the speaker explains content validity, emphasizing how to assess whether a tool accurately measures the concept it intends to. The focus is on two types of validity: face validity and logical validity. The ICON5 formula is introduced as a method for calculating content validity, where expert panel ratings help determine how well each item aligns with the concept. The speaker provides practical instructions on calculating validity coefficients using Excel and how to interpret the results, ensuring that only the most valid items remain in the tool for reliable outcomes.

Takeaways

• 😀 Validity refers to how accurately a measurement tool assesses what it is intended to measure, ensuring the right construct is evaluated.
• 😀 Content validity is the focus of this session, which involves ensuring a measurement tool's items logically represent the construct it aims to measure.
• 😀 Face validity looks at the visual appeal and presentation of a tool, such as its design, layout, and clarity of text, which can influence user motivation.
• 😀 Logical validity involves evaluating the relevance of items to the construct being measured, ensuring each item aligns with the behavior indicators of the concept.
• 😀 Expert judgment plays a critical role in assessing validity, where specialists rate the relevance of each item on a scale, like 1-5, to ensure accuracy.
• 😀 The ICON formula is used to calculate the content validity coefficient by combining expert ratings and the number of evaluators, which helps assess item validity.
• 😀 A score closer to 1 in the ICON formula indicates that an item is highly relevant to the construct, while a score closer to 0 means the item is not valid.
• 😀 In practice, after experts rate the items, the ICON formula is applied to compute the validity coefficient, helping identify items that should be kept or discarded.
• 😀 If an item receives low validity scores (e.g., below 0.3), it should be reconsidered or removed from the measurement tool to improve overall validity.
• 😀 A well-validated measurement tool, confirmed through expert analysis and content validity testing, ensures that the instrument will perform better in real-world trials.

Q & A

What is content validity in the context of measurement tools?

Content validity refers to the extent to which a measurement tool accurately measures the construct it is intended to measure. For example, a tool measuring motivation should not measure unrelated constructs like intelligence or self-confidence.

What are the three types of validity mentioned in the script?

The three types of validity discussed are face validity, logical validity (content validity), and empirical validity. The focus of the script is on content validity, which involves logical reasoning and expert judgment.

What is the difference between face validity and logical validity?

Face validity refers to the visual appeal and general presentation of a measurement tool, while logical validity (content validity) focuses on whether the items in the tool logically and accurately measure the intended construct using expert judgment.

Why is expert judgment important in determining content validity?

Expert judgment is crucial for evaluating whether the items in a measurement tool truly align with the intended construct. Experts assess the relevance and appropriateness of each item based on their knowledge and experience.

How does the ICON formula help in assessing content validity?

The ICON formula calculates the content validity coefficient by comparing expert ratings of each item. A higher score (closer to 1) indicates that the item is highly relevant to the construct being measured, while a lower score (closer to 0) suggests less relevance.

What is the scale used by experts to rate the relevance of measurement items?

Experts use a scale from 1 to 5 to rate the relevance of items, with 5 indicating strong relevance and 1 indicating poor relevance. These ratings help determine whether an item aligns with the construct being measured.

Can you explain the ICON formula in detail?

The ICON formula is used to calculate the content validity coefficient. It is calculated by subtracting the lowest expert rating from the average score of all ratings, and then dividing this by the range of the ratings (highest score minus lowest score). The result indicates the relevance of the item.

What does a content validity coefficient close to 1 mean?

A coefficient close to 1 indicates that the item is highly relevant and closely aligns with the construct being measured. This suggests that the item is valid for use in the measurement tool.

How can you use Excel to calculate content validity using the ICON formula?

To calculate content validity using Excel, input expert ratings into a spreadsheet, then apply the ICON formula by calculating the average score, determining the range, and applying the formula to calculate the validity coefficient for each item.

What should you do with items that have a low validity coefficient (below 0.3)?

Items with a content validity coefficient below 0.3 should be reviewed, revised, or discarded, as they do not adequately reflect the construct being measured. Only items with a validity coefficient above this threshold should be retained for further use.