CLA 1503 EXAM PACK

1. Motivate the use of intra scorer and inters corer types of reliability as opposed to other types of reliability (5) Inter-scorer (rater) Inter-scorer (rater) reliability is used to measure the degree to which different raters/observers give consistent approximate scores/measures of the same observable fact. Examiner inconsistency is a possible source of error variance. Inter-scorer (or inter-rater) reliability can be determined by having all the test-takers' test procedures scored by two assessment practitioners. The correlation coefficient between these two sets of scores reveals the inter-scorer reliability coefficient. Advantages of inter scorer validity  Imposes level of objectivity.  Provides validation of evaluation results.  Certify skills competency  Assign the appropriate “grade”  Increase confidence that people are following the guidelines in like manner. Intra-scorer (rater) The intra-scorer reliability coefficient refers to the consistency of ratings for a single rater. Repeated ratings or scores by the same rater would give an indication of the degree of error variance between such ratings for that particular rater. Advantages of intra-scorer validity  Improve single marker consistency in evaluating candidates’ performance.  Eliminating external factors that can compromise marker’s evaluation.  Increase the confidence in marker’s ability.  Increase the m