Reliability is the consistency of a measurement and its freedom from measurement error under relevant conditions.

How should a reliability coefficient be interpreted?

It commonly ranges from $0.00$ to $1.00$. A higher value generally indicates less error relative to observed score variation.

What does inter-rater reliability assess?

It assesses the degree of agreement among two or more people who rate or judge the same cases.

What does test-retest reliability assess?

It assesses whether scores are consistent when the same test is administered to the same people on separate occasions.

What does internal consistency reliability assess?

It assesses how consistently the items within a test behave in relation to one another.

Research methodsLesson 1 of 1 in the course Validity and reliability

Measurement Reliability: Classical Test Theory, Estimation, and Precision

5 flashcards · 5 quiz questions · 5 match pairs · 5 fill-in sentences · English

Save course

Lesson progress

0 / 5

Your progress is kept in this browser only.Sign up to save it

Summary

Reliability is the freedom of a measure from measurement error. A reliable measure tends to produce similar results under consistent conditions. If a test were repeated with the same group under comparable conditions, highly reliable scores would be reproducible and consistent.

In Classical Test Theory, reliability is the proportion of observed score variation attributable to variation in true scores. Reliability coefficients commonly range from $0.00$ to $1.00$ : values nearer $1.00$ indicate less measurement error relative to observed variation. The coefficient is an estimate, not a guarantee that every individual score is error-free.

All flashcards

What is reliability?: Reliability is the consistency of a measurement and its freedom from measurement error under relevant conditions.
How should a reliability coefficient be interpreted?: It commonly ranges from $0.00$ to $1.00$ . A higher value generally indicates less error relative to observed score variation.
What does inter-rater reliability assess?: It assesses the degree of agreement among two or more people who rate or judge the same cases.
What does test-retest reliability assess?: It assesses whether scores are consistent when the same test is administered to the same people on separate occasions.
What does internal consistency reliability assess?: It assesses how consistently the items within a test behave in relation to one another.

Quiz questions

In Classical Test Theory, how is an observed score represented?Answer: As the sum of a true score and measurement error.
How are reliability and validity related?Answer: Reliability is necessary for validity, but does not guarantee it.
A researcher administers two different, equivalent test forms to the same group and correlates their scores. What is being estimated?Answer: Parallel-forms reliability.
What does the Spearman–Brown prediction formula estimate from a split-half correlation?Answer: The reliability of the full-length test.
In Item Response Theory, what does greater test information at a trait level indicate?Answer: More precise measurement and a smaller conditional standard error.

Based on the Wikipedia article Reliability (statistics), licensed CC BY-SA 4.0. Adapted into a summary, flashcards and quizzes.

All Research methods lessons

Research methodsSurvey Methodology: Sampling, Measurement, Response, and Data Quality5 flashcards · 5 quiz questions · 4 gamesPlay free →Research methodsMeasurement Scales, Rounding, and Frequency Tables5 flashcards · 5 quiz questions · 4 gamesPlay free →Research methodsObservational Studies: Designs, Bias, and Causal Inference5 flashcards · 5 quiz questions · 4 gamesPlay free →Research methodsSystematic Reviews: Methods, Reporting, Applications, and Limitations5 flashcards · 5 quiz questions · 4 gamesPlay free →

Summary

All flashcards

Quiz questions

More in Research methods