Tests and Measurements via Shipley and McAfee

Assessment - answer-the process of collecting valid and reliable information, integrating it, and interpreting it to make a judgement or a decision about something. Diagnosis - answer-the clinical decision regarding the presence or absence of a disorder and often the assignment of a diagnostic label Why do SLPs use assessment? - answer-- to make professional diagnoses and conclusions, - to identify the need for referral to other professionals, - identify the need for treatment, - determine the focus of treatment, - determine the length and frequency of treatment, and - make decisions about the structure of treatment A good assessment is... - answer-- thorough - varied - valid - reliable - Individualized 7 steps clinician should take in completing an assessment - answer-1. Obtain historical data 2. Interview 3. Oralfacial mechanism exam 4. Evaluate speech and language (speech, language, fluency, voice, articulation, resonance) 5. Screen hearing 6. Diagnose, develop prognosis, and recommend 7. Share findings with client Norm-Referenced Tests (Standardized) - answer-allow a comparison of an individual's performance to the performance of a larger group (normative group) Advantages of Norm-Referenced Tests - answer-- Objective - skills are compared to a large group - efficient administration - reputable (well known) - easy to administer Disadvantages of Norm-Referenced Tests - answer-- do not allow for individualization - static; tell what a person knows not how they learn - Unnatural - Evaluated isolated skills - Materials may not be appropriate for CLD populations Criterion Referenced Tests - answer-identify what a client can and cannot do compared to a predefined criterion Criterion referenced tests are used most often when testing.... - answer-clients with neurogenic disorders, fluency disorders, and voice disorders Advantages of criterion referenced tests - answer-- objective - efficient administration - widely recognized - some opportunities for individualization with nonstandardized criterion referenced tests Disadvantages of criterion referenced tests - answer-- unnatural testing situation - evaluates isolated skills - standardized criterion referenced tests do not allow for individualization Alternative assessment - answer-identify what a client can do, natural environment, ongoing, evaluates client's performance during diagnostic and treatment phases Strategies recommended for evaluating clients using alternative (authentic) assessment - answer-- systematic observation - real-life situation - language sampling - structured symbolic play - short answer and extended answer responses - self-monitoring and self-assessment - use of anecdotal notes and checklists - videotaping - audiotaping - involvement of caregivers and other professionals Advantages of alternative assessments - answer-- natural, similar to real world - clients participate in self-evaluation and self monitoring - allows for individualization - offers flexibility Disadvantages of alternative assessments - answer-- may lack objectivity - reliability and validity are less assured - requires high level clinical experience - may be impractical - not well known Dynamic assessment - answer-used to evaluate a client's learning potential based on his or her ability to modify responses after the clinician provides teaching or other assistance dynamic assessment is used for... - answer-individuals with cognitive communication disorders or those from CLD backgrounds Test-teach-retest - answer-1. test administered w/o prompts or cues 2. clinician teaches strategies specific to skills being evaluated 3. test is re-administered and results from pre and post-tests are compared What is it called when a clinician teaches strategies, observes a client's response to instruction, and adjusts teaching accordingly - answer-Mediated learning experience Validity - answer-a test measures what it truly claims to measure Face validity - answer-a test looks like it assesses the skill it claims to assess Content validity - answer-a test's contents are representative of the content domain of the skill being assessed Construct validity - answer-a test measures a predetermined theoretical construct Criterion validity - answer-established by use of an external criterion Types of criterion validity - answer-concurrent validity and predictive validity Concurrent validity - answer-a test's validity in comparison to a widely accepted standard Predictive validity - answer-a test's ability to predict performance in another situation or at a later time. Reliability - answer-results are replicable test-retest reliability - answer-a test's stability over time; if a test is administered at a later time, results will be the same Split-half reliability - answer-a test's internal consistency; scores from one half correlate to scores of the other half Intra rater reliability - answer-consistent results when the same person administers the test again Inter rater reliability - answer-consistent results when more than one person rates a test alternate form reliability - answer-a test's correlation coefficient with a similar test. Standardized Test - answer-provide standard procedures for the administration and scoring of the test. A standardized test manual should include... - answer-- test purpose - age range - test construction and development - administration and scoring - normative sample and stats - reliability - validity Basal - answer-the starting point for test administration and scoring Ceiling - answer-the ending point Accomodations - answer-minor adjustments to a testing situation that do not compromise a test's standardized procedure Modifications - answer-changes to the test's standardized administration protocol Raw score - answer-the initial score obtained based on number of correct responses Types of scaled scores - answer-z-score, percentile, stanine z-score - answer-aka standard score; allows clinician to compare the client's score to the normative sample; tells how many standard deviations the raw score is from the mean