[go: up one dir, main page]
Scribd
Upload
31 views3 pages

Reliability Notes Complete

The document discusses the Standard Error of Measurement (SEM), which quantifies the error in an individual's observed score and is calculated using the standard deviation and reliability coefficient. It outlines factors influencing reliability, including extrinsic factors like testing environment and intrinsic factors like item quality, and provides methods to improve reliability, such as standardizing administration and increasing test length. Additionally, it includes practice questions to reinforce understanding of the concepts presented.

Uploaded by

Junice Lizy James
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
31 views3 pages

Reliability Notes Complete

The document discusses the Standard Error of Measurement (SEM), which quantifies the error in an individual's observed score and is calculated using the standard deviation and reliability coefficient. It outlines factors influencing reliability, including extrinsic factors like testing environment and intrinsic factors like item quality, and provides methods to improve reliability, such as standardizing administration and increasing test length. Additionally, it includes practice questions to reinforce understanding of the concepts presented.

Uploaded by

Junice Lizy James
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 3

Reliability in Psychological

Measurement
1. Standard Error of Measurement (SEM)
The Standard Error of Measurement (SEM) estimates the amount of error inherent in an
individual's observed score. It indicates how much a score might vary from the person's
true score due to imperfect reliability.

Formula:
SEM = SD × √(1 - r)

Where:
• SD = Standard deviation of test scores
• r = Reliability coefficient

Why include (1 - r)? Reliability (r) reflects the proportion of true score variance. (1 - r) is
the proportion of error variance. Taking the square root gives the standard deviation of the
error.

Example:
If SD = 12 and r = 0.84:
SEM = 12 × √(1 - 0.84) = 12 × 0.4 = 4.8
Interpretation: A person scoring 72 would have a true score likely between 67.2 and 76.8
(±4.8).
2. Factors Influencing Reliability
Reliability can be influenced by both extrinsic (external) and intrinsic (internal) factors:

Extrinsic (External) Factors Intrinsic (Internal) Factors

Testing environment (lighting, noise, Test length (too few items reduce stability)
temperature)

Administration conditions (time limits, Item quality (ambiguity, cultural bias)


instructions)

Time of testing (morning vs evening) Scoring consistency (subjectivity in


marking)

Motivation and anxiety levels Content homogeneity

Differences between test administrators Test-taker's mental/physical state

3. Methods of Improving Reliability


Method Explanation

Standardize administration Use consistent instructions, timing, and


environment.

Improve test items Use clear, unambiguous, culturally


appropriate wording.

Increase number of items Longer tests usually give more stable


measurements.

Pilot testing Identify and remove poorly performing


items.

Use clear scoring rubrics Minimize subjectivity in scoring.

Train scorers Reduce inter-rater inconsistencies.

Discourage guessing Design MCQs with plausible distractors.

Apply statistical checks Use Cronbach’s alpha to detect weak items.

4. Practice Questions
MCQs:
1. SEM decreases when:
a) Test length decreases
b) Reliability increases
c) Error variance increases
d) SD increases
Correct answer: b) Reliability increases

2. Which of the following is an intrinsic factor affecting reliability?


a) Noise in the room
b) Time of testing
c) Item ambiguity
d) Examiner's tone
Correct answer: c) Item ambiguity

Short Answer:
- Define SEM and explain why it includes (1 - r) in its formula.
- List three extrinsic and three intrinsic factors affecting reliability.
- Suggest four methods to improve the reliability of a psychology test.

You might also like