Reliability and replicability

Psychology AS · Research methodology. The idea in plain words, the rules to remember, the mistake to avoid and a worked example, written and checked by Mega Lecture.

Test this topic freeAll Psychology AS topics

The idea

Reliability means consistency. A reliable measure gives the same result each time it is used in the same conditions, and a reliable procedure is carried out in the same way for every participant.

Two types are tested most often. Inter-rater (or inter-observer) reliability is how closely two or more researchers agree when they score or observe the same behaviour on their own. Test-retest reliability is checked by giving the same test to the same people on two occasions and comparing the two sets of scores.

Replicability means a study can be repeated in exactly the same way by another researcher. This needs a standardised procedure, operational definitions and a full description of the method.

Rules to remember

Common mistake

Students think a reliable test must also be valid. A test can give the same result every time and still measure the wrong thing.

Worked example

Two observers each record whether a child is playing alone or with others in 40 time intervals. Their records match in 34 intervals. What is the percentage agreement and what does it show?

  1. Percentage agreement = (34 ÷ 40) × 100.
  2. 34 ÷ 40 = 0.85, and 0.85 × 100 = 85%.
  3. The observers agree on most intervals, so their recording is consistent.

Answer: 85% agreement, which shows high inter-observer reliability.

Ask about this

Type what you are stuck on. The helper finds the explanation, worked examples and the notes to read, free and instant.

Keep going

← ValidityData analysis →Take a Psychology AS test