Home About us Contact
|
Home About us Contact | ||
|
|
||
Measurement Properties (measurement + property)
Selected AbstractsMeasurement Properties of the MacArthur Communicative Development Inventories at Ages One and Two YearsCHILD DEVELOPMENT, Issue 2 2000Heidi M. Feldman In a prospective study of child development in relation to early-life otitis media, we administered the MacArthur Communicative Development Inventories (CDI) to a large (N = 2,156), sociodemographically diverse sample of 1- and 2-year-old children. As a prerequisite for interpreting the CDI scores, we studied selected measurement properties of the inventories. Scores on the CDI/Words and Gestures (CDI-WG), designed for children 8 to 16 months old, and on the CDI/Words and Sentences (CDI-WS), designed for children 16 to 30 months old, increased significantly with months of age. On several scales of both CDI-WG and CDI-WS, standard deviations approximated or exceeded mean values, reflecting wide variability in results. Statistically significant differences in mean scores were found according to race, maternal education, and health insurance status as an indirect measure of income, but the directionality of differences was not consistent across inventories or across scales of the CDI-WS. Correlations between CDI-WG and CDI-WS ranged from .18 to .39. Our findings suggest that the CDI reflects the progress of language development within the age range 10 to 27 months. However, researchers and clinicians should exercise caution in using results of the CDI to identify individual children at risk for language deficits, to compare groups of children with different sociodemographic profiles, or to evaluate the effects of interventions. [source] Measurement properties of the Villalta scale to define and classify the severity of the post-thrombotic syndromeJOURNAL OF THROMBOSIS AND HAEMOSTASIS, Issue 5 2009S. R. KAHN Summary., The post-thrombotic syndrome (PTS) is a frequent and important complication of deep venous thrombosis (DVT). The diagnosis of PTS is based primarily on the presence of typical symptoms and clinical signs. In the 1990s, a clinical scale known as the Villalta scale was proposed as a measure that could be used to diagnose and classify the severity of PTS. The objective of the present paper was to review the published evidence on the measurement properties of the Villalta scale. Results of the review demonstrate that the Villalta scale is a reliable and valid measure of PTS in patients with previous, objectively confirmed DVT. The scale is acceptable to research subjects and research personnel, and shows responsiveness to clinical change in PTS. Aspects of the Villalta scale that merit further evaluation include test,retest reliability, more detailed assessment of ulcer severity and assessment of responsiveness across the full range of PTS severity. Research aimed at improving the measurement of PTS will also help to improve the overall validity of findings generated by clinical studies of PTS. [source] A review of clinical upper limb assessments within the framework of the WHO ICFMUSCULOSKELETAL CARE, Issue 3 2007Cheryl Metcalf BA (Hons) MSc Abstract This paper is intended to provide a practical overview for clinicians and researchers involved in assessing upper limb function. It considers 25 upper limb assessments used in musculoskeletal care and presents a simple, straightforward comparative review of each. The World Health Organization International Classification on Functioning, Disability and Health (WHO ICF) is used to provide a relative summary of purpose between each assessment. Measurement properties of each assessment are provided, considering the type of data generated, availability of reliability estimates and normative data for the assessment. Copyright © 2007 John Wiley & Sons, Ltd. [source] Outcome measures used in forensic mental health research: a structured reviewCRIMINAL BEHAVIOUR AND MENTAL HEALTH, Issue 1 2009Jemma C. Chambers Background,The evidence base for forensic mental health (FMH) services has been developing since the late 1990s. Are outcome measures sound enough for the evaluation tasks? Aims,To identify, from published literature, outcome measures used in FMH research and, where feasible, assess their quality. Method,A structured review was undertaken of trials and intervention studies published between 1990 and 2006. Details of outcome variables and measures were abstracted. Evidence regarding most frequently occurring outcome measures was assessed. Results,Four hundred and fifty different instruments were used to assess outcomes, incorporating 1038 distinct variables. Very little evidence could be found to support the measurement properties of commonly used instruments. Conclusions and implications for practice,There is little consistency in the use of outcome measure in FMH research. Effort is required to reach consensus on validated outcome measures in this field in order to better inform practice. Copyright © 2009 John Wiley & Sons, Ltd. [source] Older people specific health status and quality of life: a structured review of self-assessed instrumentsJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 4 2005Kirstie L. Haywood DPhil Abstract Objectives, To review evidence relating to the measurement properties of older people specific self-assessed, multi-dimensional measures of health status. Design, Systematic literature searches to identify instruments. Pre-defined criteria relating to reliability, validity, responsiveness, precision and acceptability. Results, A total of 46 articles relating to 18 instruments met the inclusion criteria. Most evidence was found for the OARS Multidimensional Functional Assessment Questionnaire (OMFAQ), CARE, Functional Assessment Inventory (FAI) and Quality of Life Profile , Seniors Version (QOLPSV). Most instruments have been evaluated in single studies. Four instruments have evidence of internal consistency and test,retest reliability , LEIPAD, Philadelphia Geriatrics Centre Multilevel Assessment Inventory, Perceived Well-being Scale, Wellness Index (WI). Two instruments lack evidence of reliability , Brief Screening Questionnaire, Geriatric Quality of Life Questionnaire (GQLQ). Older people contributed to the content of the GQLQ, QOLPSV and WI. Most instruments were assessed for validity through comparisons with other instruments, global judgements of health, or clinical and socio-demographic variables. Limited evidence of responsiveness was found for five instruments , GQLQ, OMFAQ, PGCMAI, QOLPSV, Self-Evaluation of Life Scale (SELF). Conclusion, Although most evidence was found for the OMFAQ this was largely for the ADL domain; evidence for reliability and responsiveness is limited. Limited evidence of reliability, validity and responsiveness was found for the PGCMAI, QOLPSV and SELF. The lack of evidence for measurement properties restricts instrument recommendation. Instrument content should be assessed for relevance before application and the concurrent evaluation of specific and widely used generic instruments is recommended. Several instruments, including the BSQ and EASY-Care, were developed recently and further evidence of instrument performance is required. [source] Multi-item outcome measures for lateral ligament injury of the ankle: a structured reviewJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 2 2004K.L. Haywood BSc(Hons) DPhil MCSP Abstract Objective, To identify and review evidence relating to the measurement properties of published multi-item outcome measures for the conservative management of lateral ligament injuries of the ankle. Methods, Systematic literature searches were used to identify measures, which were then assessed against pre-defined criteria relating to development, item content, reliability, validity and responsiveness. Results, Seven disease-specific measures of ankle status [Ankle Joint Functional Assessment Tool, Clinical Trauma Severity Score, Composite Inversion Injury Scale, Kaikkonen Functional Scale (KFS), Karlsson Ankle Function Score (KAFS), Olerud and Molander Ankle Score (OMAS), and the Point System] and two generic measures of health (McGill Pain Questionnaire, Sickness Impact Profile) met the review inclusion criteria. While all measures had been used in acute injuries, only two had also been applied during later stages of recovery (>6 months). The studies covered a comprehensive range of graded ligament injuries. Expert opinion dominated item generation for all measures. All measures lack evidence of test-retest or internal consistency reliability in patients with ankle sprain. Several measures were assessed for validity through comparison with other measures, but there was limited evidence of construct validity and no formal assessment of responsiveness for any measure. Conclusion, The disappointing lack of evidence for measurement properties suggests that any measure should be used with caution until appropriate evidence is provided. On the basis of limited evidence, the KFS offers the most promising approach to a combined clinician- and patient-assessment of ankle function, and the KAFS or OMAS if a patient-assessed evaluation of function is required. [source] Measurement properties of the Villalta scale to define and classify the severity of the post-thrombotic syndromeJOURNAL OF THROMBOSIS AND HAEMOSTASIS, Issue 5 2009S. R. KAHN Summary., The post-thrombotic syndrome (PTS) is a frequent and important complication of deep venous thrombosis (DVT). The diagnosis of PTS is based primarily on the presence of typical symptoms and clinical signs. In the 1990s, a clinical scale known as the Villalta scale was proposed as a measure that could be used to diagnose and classify the severity of PTS. The objective of the present paper was to review the published evidence on the measurement properties of the Villalta scale. Results of the review demonstrate that the Villalta scale is a reliable and valid measure of PTS in patients with previous, objectively confirmed DVT. The scale is acceptable to research subjects and research personnel, and shows responsiveness to clinical change in PTS. Aspects of the Villalta scale that merit further evaluation include test,retest reliability, more detailed assessment of ulcer severity and assessment of responsiveness across the full range of PTS severity. Research aimed at improving the measurement of PTS will also help to improve the overall validity of findings generated by clinical studies of PTS. [source] An acute care skills evaluation for graduating medical students: a pilot study using clinical simulationMEDICAL EDUCATION, Issue 9 2002David Murray Purpose, This investigation aimed to explore the measurement properties of scores from a patient simulator exercise. Methods, Analytic and holistic scores were obtained for groups of medical students and residents. Item analysis techniques were used to explore the nature of specific examinee actions. Interrater reliability was calculated. Scores were contrasted for third year medical students, fourth year medical students and emergency department residents. Results, Interrater reliabilities for analytic and holistic scores were 0·92 and 0·81, respectively. Based on item analysis, proper timing and sequencing of actions discriminated between low- and high-ability examinees. In general, examinees with more advanced training obtained higher scores on the simulation exercise. Conclusion, Reliable and valid measures of clinical performance can be obtained from a trauma simulation provided that care is taken in the development and scoring of the scenario. [source] The Brief Pain Inventory and Its "Pain At Its Worst in the Last 24 Hours" Item: Clinical Trial Endpoint ConsiderationsPAIN MEDICINE, Issue 3 2010Thomas M. Atkinson PhD Abstract Context., In 2006, the United States Food and Drug Administration (FDA) released a draft Guidance for Industry on the use of patient-reported outcomes (PRO) Measures in Medical Product Development to Support Labeling Claims. This draft guidance outlines psychometric aspects that should be considered when designing a PRO measure, including conceptual framework, content validity, construct validity, reliability, and the ability to detect clinically meaningful score changes. When finalized, it may provide a blueprint for evaluations of PRO measures that can be considered by sponsors and investigators involved in PRO research and drug registration trials. Objective., In this review we examine the short form of the Brief Pain Inventory (BPI) and particularly the "pain at its worst in the last 24 hours" item in the context of the FDA draft guidance, to assess its utility in clinical trials that include pain as a PRO endpoint. Results and Conclusions., After a systematic evaluation of the psychometric aspects of the BPI, we conclude that the BPI and its "pain at its worst in the last 24 hours" item generically satisfy most key recommendations outlined in the draft guidance for assessing a pain-reduction treatment effect. Nonetheless, when the BPI is being considered for assessment of pain endpoints in a registration trial, sponsors and investigators should consult with the appropriate FDA division early during research design to discuss whether there is sufficient precedent to use the instrument in the population of interest or whether additional evaluations of measurement properties are advisable. [source] Population-based drug-related anaphylaxis in children and adolescents captured by South Carolina Emergency Room Hospital Discharge Database (SCERHDD) (2000,2002),PHARMACOEPIDEMIOLOGY AND DRUG SAFETY, Issue 12 2007Suzanne L. West MPH Abstract Purpose Anaphylaxis is a life-threatening condition; drug-related anaphylaxis represents approximately 10% of all cases. We assessed the utility of a statewide emergency department (ED) database for identifying drug-related anaphylaxis in children by developing and validating an algorithm composed of ICD-9-CM codes. Methods There were 1,314,760 visits to South Carolina (SC) emergency departments (EDs) for patients <19 years in 2000,2002. We used ICD-9-CM disease or external cause of injury codes (E-codes) that suggested drug-related anaphylaxis or a severe drug-related allergic reaction. We found 50 cases classifiable as probable or possible drug-related anaphylaxis and 13 as drug-related allergic reactions. We used clinical evaluation by two pediatricians as the ,alloyed gold standard'1 for estimating sensitivity, specificity, and positive predictive value (PPV) of our algorithm. Results ED-treated drug-related anaphylaxis in the SC pediatric population was 1.56/100,000 person-years based on the algorithm and 0.50/100,000 person-years based on clinical evaluation. Assuming the disease codes we used identified all potential anaphylaxis cases in the database, the sensitivity was 1.00 (95%CI: 0.79, 1.00), specificity was 0.28 (95%CI: 0.16, 0.43), and the PPV was 0.32 (0.20, 0.47) for the algorithm. Sensitivity analyses improved the measurement properties of the algorithm. Conclusions E-codes were invaluable for developing an anaphylaxis algorithm although the frequently used code of E947.9 was often incorrectly applied. We believe that our algorithm may have over-ascertained drug-related anaphylaxis patients seen in an ED, but the clinical evaluation may have under-represented this diagnosis due to limited information on the offending agent in the abstracted ED records. Post-marketing drug surveillance using ED records may be viable if clinicians were to document drug-related anaphylaxis in the charts so that billing codes could be assigned properly. Copyright © 2007 John Wiley & Sons, Ltd. [source] Adequate Early Cyclosporin Exposure is Critical to Prevent Renal Allograft Rejection: Patients Monitored by Absorption ProfilingAMERICAN JOURNAL OF TRANSPLANTATION, Issue 8 2002C. M. Clase This study used receiver operating characteristic analysis to investigate the properties of area under the concentration-time curve during the first 4 h after cyclosporin-microemulsion dosing (AUC0,4) and cyclosporin (CyA) levels immediately before and at 2 and 3 h after dosing (C0, C2 and C3) to predict the risk of biopsy-proven acute rejection (AR) at 6 months. Ninety-eight kidney transplant recipients treated with CyA-microemulsion-based triple therapy immunosuppression were studied on post-transplant days 3, 5, and 7, and at increasing intervals thereafter. The most sensitive and specific predictor of AR was AUC0,4. Of the single time-point measurements, the measurement properties of C2 were closest to those of AUC0,4, and superior to those of C3. The relationship between C0 and subsequent AR was weak and did not reach statistical significance. On day 3, CyA AUC0,4, 4400 ng . h/mL and C2, 1700 ng/mL were each associated with a 92% negative predictive value for rejection in the first 6 months. Pharmacokinetic measurements on or after day 5, and measurements on day 3 in patients with delayed graft function, were not predictive of AR. Adequate exposure within the first 3 days post transplantation may be critically important in preventing subsequent rejection. [source] Outcome measures in acne vulgaris: systematic reviewBRITISH JOURNAL OF DERMATOLOGY, Issue 1 2009H. Barratt Summary Background, Clinical trials require valid and reliable outcome measures to facilitate the interpretation and communication of results, and the secondary use of data for systematic reviews. There are numerous tools available to assess the severity of acne vulgaris in clinical trials, and extensive debate about the merits of these. Objectives, To review the literature about investigator-assessed outcome measures used in clinical trials for acne vulgaris; and to evaluate the measurement properties of these tools. Methods, A systematic literature review was conducted of articles outlining and evaluating investigator-assessed outcome measures for acne. Results, Thirty-one papers met the criteria for inclusion in the literature review, including nine papers proposing a novel means of assessing acne, and five evaluating existing outcome measures. Variable attempts had been made to evaluate these tools. Conclusions, The array of evaluation tools used in acne trials prohibits good secondary analysis of trial data, and complicates the interpretation of study results, potentially compromising clinical care. Existing outcome measures need to be assessed further and agreement reached about which should be used more widely. Other innovative methods of assessing acne should also be explored. [source] Freezing of Gait Questionnaire: validity and reliability of the Swedish versionACTA NEUROLOGICA SCANDINAVICA, Issue 5 2009M. H. Nilsson Background,,, Patient-reported assessments of freezing of gait (FOG) in Parkinson's disease (PD), such as the FOG questionnaire (FOGQ), are needed because FOG is difficult to assess objectively. However, the measurement properties of the FOGQ have been sparsely assessed. Aim,,, To assess the measurement properties of the Swedish FOGQ, and to explore relationships between FOGQ scores and other aspects of PD. Methods,,, Thirty-seven people with PD were assessed with the FOGQ, Unified PD Rating Scale (UPDRS), Hoehn and Yahr (HY), Falls-Efficacy Scale [FES(S)], timed gait tests, and the SF-36 physical functioning (PF) scale. Results,,, Mean (SD) FOGQ item scores ranged between 1.3 and 2.1 (1.2,1.5); corrected item,total correlations ranged between 0.80 and 0.94. Reliability was 0.95. Mean (SD) and median (q1,q3) FOGQ scores were 9.6 (7.4) and 10 (2,15). Floor and ceiling effects were ,5.4%. FOGQ correlated strongest with UPDRS part II (ADL), UPDRS item 14 (freezing), and HY (rS 0.65,0.66). FOGQ scores correlated with PD duration, the Timed Up and Go test, dyskinesia, motor fluctuations, FES(S), and PF scores (rS 0.40,0.62). Fallers had higher FOGQ scores than non-fallers (median 12.5 vs 5.0). Conclusion,,, Data support the measurement properties of the Swedish FOGQ by replicating and extending previous psychometric reports. [source] Measurement Properties of the MacArthur Communicative Development Inventories at Ages One and Two YearsCHILD DEVELOPMENT, Issue 2 2000Heidi M. Feldman In a prospective study of child development in relation to early-life otitis media, we administered the MacArthur Communicative Development Inventories (CDI) to a large (N = 2,156), sociodemographically diverse sample of 1- and 2-year-old children. As a prerequisite for interpreting the CDI scores, we studied selected measurement properties of the inventories. Scores on the CDI/Words and Gestures (CDI-WG), designed for children 8 to 16 months old, and on the CDI/Words and Sentences (CDI-WS), designed for children 16 to 30 months old, increased significantly with months of age. On several scales of both CDI-WG and CDI-WS, standard deviations approximated or exceeded mean values, reflecting wide variability in results. Statistically significant differences in mean scores were found according to race, maternal education, and health insurance status as an indirect measure of income, but the directionality of differences was not consistent across inventories or across scales of the CDI-WS. Correlations between CDI-WG and CDI-WS ranged from .18 to .39. Our findings suggest that the CDI reflects the progress of language development within the age range 10 to 27 months. However, researchers and clinicians should exercise caution in using results of the CDI to identify individual children at risk for language deficits, to compare groups of children with different sociodemographic profiles, or to evaluate the effects of interventions. [source] Longitudinal validity and responsiveness of the Food Allergy Quality of Life Questionnaire , Parent Form in children 0,12 years following positive and negative food challengesCLINICAL & EXPERIMENTAL ALLERGY, Issue 3 2010A. DunnGalvin Summary Background There are no published studies of longitudinal health-related quality of life (HRQL) assessments of food-allergic children using a disease-specific measure. Objective This study assessed the longitudinal measurement properties of the Food Allergy Quality of Life Questionnaire , Parent Form (FAQLQ-PF) in a sample of children undergoing food challenge. Methods Parents of children 0,12 years completed the FAQLQ-PF and the Food Allergy Independent Measure (FAIM) pre-challenge and at 2 and 6 months post food challenge. In order to evaluate longitudinal validity, differences between Group A (positive challenge) and Group B (negative challenge) were expected over time. We computed correlation coefficients between change scores in the FAQLQ-PF and change scores in the FAIM. To determine the minimally important difference (MID), we used distributional criterion and effect size approaches. A logistic regression model profiled those children falling below this point. Results Eighty-two children underwent a challenge (42 positive; 40 negative). Domains and total score improved significantly at pos-challenge time-points for both groups (all P<0.05). Sensitivity was demonstrated by significant differences between positive and negative groups at 6 months [F(2, 59)=6.221, P<0.003] and by differing improvement on relevant subscales (P<0.05). MID was 0.45 on a seven-point response scale. Poorer quality of life at baseline increased the odds by over 2.0 of no improvement in HRQL scores 6-month time-point. General maternal health (OR 1.252), number of foods avoided (OR 1.369) and children >9 years (OR 1.173) were also predictors. The model correctly identified 84% of cases below MID. Conclusion The FAQLQ-PF is sensitive to change, and has excellent longitudinal reliability and validity in a food-allergic patient population. The standard error of measurement value of 0.5 points as a threshold for meaningful change in HRQL questionnaires was confirmed. The FAQLQ-PF may be used to identify problems in children, to assess the effectiveness of clinical trials or interventions, and to guide the development of regulatory policies. Cite this as: A. DunnGalvin, C. Cullinane, D. A. Daly, B. M. J. Flokstra-de Blok, A. E. J. Dubois and J. O'B. Hourihane, Clinical & Experimental Allergy, 2010 (40) 476,485. [source] Oral health-related quality of life for 8,10-year-old children: an assessment of a new measureCOMMUNITY DENTISTRY AND ORAL EPIDEMIOLOGY, Issue 5 2005Gerry Humphris Abstract , Objectives:, The aim of the study was to assess the reliability and construct validity of the Child Oral Health-Related Quality of Life for 8,10-year-olds (COHRQoL [8,10]) using confirmatory factor analysis (CFA) and to test the measurement properties of latent variables believed to define the multidimensional construct of OHRQoL. Methods:, A convenience sample of 270, year 4 children from six schools was obtained. The administered questionnaire included the 25-item COHRQoL [8,10] and the Coopersmith Self-Esteem Inventory-School Form. The analytical method was based upon CFA using maximum likelihood estimation. A second-order factoring approach was applied to determine the extent that the latent variables tapped a single over-arching domain of quality of life. Results:, Seven items were withdrawn for low endorsement and poor association with resultant factors. The COHRQoL [8,10] was confirmed to measure a single construct of three latent variables invariant to gender. Internal consistency of the three scales derived comprising a total of 18 retained items was acceptable. Associations with self-esteem and with a single question on the extent that the mouth was a problem were confirmed and strengthened the construct validity of the COHRQoL [8,10] measure. Conclusions:, Reliability and construct validity were demonstrated for COHRQoL [8,10] and supported the scale for adoption as an epidemiological and scientific tool for group comparisons. CFA showed that the three constructs or latent variables underlying the overall COHRQoL ratings were discrete measures that can be reliably assessed in children. Further model testing with additional data will increase generalization of these findings. [source] | |||||||||||||