Assessment Outcomes (assessment + outcome)

Distribution by Scientific Domains


Selected Abstracts


Utility of regular medical examinations of occupational divers

INTERNAL MEDICINE JOURNAL, Issue 11 2009
C. Sames
Abstract The utility of regular medical fitness-for-diving examinations of occupational divers is unknown. The aim of this audit was to investigate the impact on the employment of occupational divers of a 5-yearly medical examination and an annual health surveillance questionnaire administered in intervening years. The medical records of all New Zealand occupational divers registered with the Department of Labour for at least 5 years were audited (n= 336). Each record included at least two full medical examinations (mean spacing of 5.6 years). An impact on career was defined as the diver being issued with either a conditional certificate of fitness or being graded as temporarily or permanently unfit for diving. The means by which the relevant medical issue was identified was recorded. Ten (3%) of 336 divers had an assessment outcome, which had a career impact. One was considered permanently unfit, four were temporarily unfit, and five were issued with conditional certification. Two were identified by respiratory function testing and eight by way of their responses to the questionnaire; none was found by the medical interview and examination process. The questionnaire system did not ,miss' any divers who developed a critically important health problem, and detected most of those with less important problems. Five yearly medical examinations have a low detection rate for important health problems, but remain useful for discussion of risk understanding, acceptance and mitigation. [source]


Screening for dyslexia, dyspraxia and Meares-Irlen syndrome in higher education

DYSLEXIA, Issue 1 2009
S. A. Nichols
Abstract This study reports a comparison of screening tests for dyslexia, dyspraxia and Meares-Irlen (M-I) syndrome in a Higher Education setting, the University of Worcester. Using a sample of 74 volunteer students, we compared the current tutor-delivered battery of 15 subtests with a computerized test, the Lucid Adult Dyslexia Screening test (LADS), and both of these with data on assessment outcomes. The sensitivity of this tutor battery was higher than LADS in predicting dyslexia, dyspraxia or M-I syndrome (91% compared with 66%) and its specificity was lower (79% compared with 90%). Stepwise logistic regression on these tests was used to identify a better performing subset of tests, when combined with a change in practice for M-I syndrome screening. This syndrome itself proved to be a powerful discriminator for dyslexia and/or dyspraxia, and we therefore recommend it as the first stage in a two-stage screening process. The specificity and sensitivity of the new battery, the second part of which comprises LADS plus four of the original tutor delivered subtests, provided the best overall performance: 94% sensitivity and 92% specificity. We anticipate that the new two-part screening process would not take longer to complete. Copyright © 2008 John Wiley & Sons, Ltd. [source]


Maxillary obturators: The relationship between patient satisfaction and speech outcome

HEAD & NECK: JOURNAL FOR THE SCIENCES & SPECIALTIES OF THE HEAD AND NECK, Issue 11 2003
Jana M. Rieger PhD
Abstract Background. Patient satisfaction with a maxillary obturator has been studied in relation to extent of surgical defect, sociodemographic characteristics, scores on mental health inventories, and psychosocial adjustment to illness scales. However, review of the literature reveals limited study of the relationship between patient satisfaction with an obturator and clinical speech outcome measures. The purpose of this study is to relate patient satisfaction scores obtained by questionnaire with those obtained by means of clinical speech measurements. Methods. Acoustical, aeromechanical, and perceptual measurements of speech were collected for 20 patients after receiving a definitive obturator. Patient satisfaction with their obturator was later measured with the Obturator Functioning Scale (OFS). Results. Results reveal that poorer aeromechanical speech results were associated with patient-reported avoidance of social events, whereas lower speech intelligibility outcomes were related to overall poorer perception of speech function on the OFS. Several background patient characteristics were significantly related to several responses on the OFS and to the aeromechanical assessment outcomes. Conclusions. Results from instrumental assessments of speech seem to be informative regarding not only speech outcome but also a patient's satisfaction with the obturator. Consideration of background patient characteristics is important when interpreting both clinically obtained and patient-perceived outcomes. © 2003 Wiley Periodicals, Inc. Head and Neck 25: 000,000, 2003 [source]


The Impact of Performance Level Misclassification on the Accuracy and Precision of Percent at Performance Level Measures

JOURNAL OF EDUCATIONAL MEASUREMENT, Issue 2 2008
Damian W. Betebenner
No Child Left Behind (NCLB) performance mandates, embedded within state accountability systems, focus school AYP (adequate yearly progress) compliance squarely on the percentage of students at or above proficient. The singular importance of this quantity for decision-making purposes has initiated extensive research into percent proficient as a measure of school quality. In particular, technical discussions have scrutinized the impact of sampling, measurement, and other sources of error on percent proficient statistics. In this article, we challenge the received orthodoxy that measurement error associated with individual students' scores is inconsequential for aggregate percent proficient statistics. Synthesizing current classification accuracy research with techniques from randomized response designs, we establish results which specify the extent to which measurement error,manifest as performance level misclassifications,produces bias and increases error variability for percent at performance level statistics. The results have direct relevance for the design of coherent and fair accountability systems based upon assessment outcomes. [source]


Reliability: on the reproducibility of assessment data

MEDICAL EDUCATION, Issue 9 2004
Steven M Downing
Context, All assessment data, like other scientific experimental data, must be reproducible in order to be meaningfully interpreted. Purpose, The purpose of this paper is to discuss applications of reliability to the most common assessment methods in medical education. Typical methods of estimating reliability are discussed intuitively and non-mathematically. Summary, Reliability refers to the consistency of assessment outcomes. The exact type of consistency of greatest interest depends on the type of assessment, its purpose and the consequential use of the data. Written tests of cognitive achievement look to internal test consistency, using estimation methods derived from the test-retest design. Rater-based assessment data, such as ratings of clinical performance on the wards, require interrater consistency or agreement. Objective structured clinical examinations, simulated patient examinations and other performance-type assessments generally require generalisability theory analysis to account for various sources of measurement error in complex designs and to estimate the consistency of the generalisations to a universe or domain of skills. Conclusions, Reliability is a major source of validity evidence for assessments. Low reliability indicates that large variations in scores can be expected upon retesting. Inconsistent assessment scores are difficult or impossible to interpret meaningfully and thus reduce validity evidence. Reliability coefficients allow the quantification and estimation of the random errors of measurement in assessments, such that overall assessment can be improved. [source]


Approaches to learning and studying in medical students: validation of a revised inventory and its relation to student characteristics and performance

MEDICAL EDUCATION, Issue 5 2004
Karen Mattick
Introduction, Inventories to quantify approaches to studying try to determine how students approach academic tasks. Medical curricula usually aim to promote a deep approach to studying, which is associated with academic success and which may predict desirable traits postqualification. Aims, This study aimed to validate a revised Approaches to Learning and Studying Inventory (ALSI) in medical students and to explore its relation to student characteristics and performance. Methods, Confirmatory factor analysis was used to validate the reported constructs in a sample of 128 Year 1 medical students. Models were developed to investigate the effect of age, graduate status and gender, and the relationships between approaches to studying and assessment outcomes. Results, The ALSI performed as anticipated in this population, thus validating its use in our sample, but a 4-factor solution had a better fit than the reported 5-factor one. Medical students scored highly on deep approach compared with other students in higher education. Graduate status and gender had significant effects on approach to studying and a deep approach was associated with higher academic scores. Conclusions, The ALSI is valid for use in medical students and can uncover interesting relationships between approaches to studying and student characteristics. In addition, the ALSI has potential as a tool to predict student success, both academically and beyond qualification. [source]


Physician-patient encounters: The structure of performance in family and general office practice

THE JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS, Issue 4 2006
Elizabeth F. Wenghofer PhD
Abstract Introduction: The College of Physicians and Surgeons of Ontario, the regulatory authority for physicians in Ontario, Canada, conducts peer assessments of physicians' practices as part of a broad quality assurance program. Outcomes are summarized as a single score and there is no differentiation between performance in various aspects of care. In this study we test the hypothesis that physician performance is multidimensional and that dimensions can be defined in terms of physician-patient encounters. Methods: Peer assessment data from 532 randomly selected family practitioners were analyzed using factor analysis to assess the dimensional structure of performance. Content validity was confirmed through consultation sessions with 130 physicians. Multiple-item measures were constructed for each dimension and reliability calculated. Analysis of variance determined the extent to which multiple-item measure scores would vary across peer assessment outcomes. Results: Six performance dimensions were confirmed: acute care, chronic conditions, continuity of care and referrals, well care and health maintenance, psychosocial care, and patient records. Discussion: Physician performance is multidimensional, including types of physician-patient encounters and variation across dimensions, as demonstrated by individual practice. A conceptual framework for multidimensional performance may inform the design of meaningful evaluation and educational recommendations to meet the individual performance of practicing physicians. [source]