Home About us Contact
|
Home About us Contact | ||
|
|
||
Criterion Validity (criterion + validity)
Kinds of Criterion Validity Selected AbstractsContent Validation Is Fundamental for Optimizing the Criterion Validity of Personality TestsINDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY, Issue 4 2009THOMAS A. O'NEILL First page of article [source] Assessment Center for Pilot Selection: Construct and Criterion Validity and the Impact of Assessor TypeAPPLIED PSYCHOLOGY, Issue 2 2003Marc Damitz Cette recherche a examiné la validité d'un centre d'évaluation pour la sélection de pilotes. Les scores de N = 1,036 participants ont été utilisés pour étudier la validité de construit. Un sous-échantillon de participants performants a été suivi et les évaluations des pairs ont été retenus comme mesures du critère. Les résultats démontrent une première évidence de validité de construit et de critère pour cet outil d'évaluation des compétences interpersonnelles et liées à la performance. Par ailleurs, les résultats ont aussi montré que le type d'évaluateur (psychologue vs pilote) modère la validité prédictive des scores du centre d'évaluation. Cet effet "type d'évaluateur" dépend de la sorte de variables prédictives. Les résultats sont discutés et des implications pratiques sont suggérées. This study examined the validity of an assessment center in pilot selection as a new field of application. Assessment center ratings of N= 1,036 applicants were used to examine the construct validity. A subsample of successful applicants was followed up and peer ratings were chosen as criterion measures. The results provide first evidence of the construct and criterion validity of this assessment center approach for rating interpersonal and performance-related skills. Furthermore the type of assessor (psychologist versus pilot) moderates the predictive validity of the assessment center ratings. This type-of-assessor effect depends on the kind of predictor variables. The results are discussed and practical implications are suggested. [source] The utility of the Dutch Arthritis Impact Measurement Scales 2 for assessing health status in individuals with haemophilia: a pilot studyHAEMOPHILIA, Issue 6 2000N. L. U. Van Meeteren The aim of this pilot study was to examine the usefulness of the Dutch version of the Arthritis Impact Measurement Scales 2 (D-AIMS2)in assessing the health status of Dutch individuals with haemophilia. Sixty-eight individuals with mild, moderate, and severe haemophilia attending our clinic for their annual check-up participated. They first completed the Canadian Occupational Performance Measure (COPM). The D-AIMS2 was filled in afterwards at home. With the COPM, individuals rated their specific problematic activities of daily life (ADL), as well as the severity and importance of each problem. The D-AIMS2 is a comprehensive, self-administered questionnaire that evaluates functional health status. Fifty-seven individuals completed and returned the D-AIMS2. Reliability analysis demonstrated good internal consistency for the scales (Cronbach's ,=0.76,1.00), as well as for the components (,=0.80,0.88), except for the component ,social interaction' (,=0.44). Criterion validity of the D-AIMS2 was assessed by comparison with COPM outcomes; 80% of the problematic ADLs were included in the questionnaire, 20% were missing. Correlations between the D-AIMS2 components ,physical health' and ,symptoms' with predicted scores of those individuals by a highly experienced physiotherapist (r=0.63 and 0.53, respectively) substantiated its concurrent validity. Based on these results we concluded that the D-AIMS2, with minor adjustments, can be an appropriate tool for assessing the health status of Dutch haemophilia patients. [source] Cigarette dependence questionnaire: development and psychometric testing with male smokersJOURNAL OF ADVANCED NURSING, Issue 10 2010Chih-Ling Huang huang c.-l., lin h.-h. & wang h.-h. (2010) Cigarette dependence questionnaire: development and psychometric testing with male smokers. Journal of Advanced Nursing,66(10), 2341,2349. Abstract Aim., This paper is a report of a study conducted to develop and test a theoretically derived Cigarette Dependence Questionnaire for adult male smokers. Background., Fagerstrom questionnaires have been used worldwide to assess cigarette dependence. However, these assessments lack any theoretical perspective. A theory-based approach is needed to ensure valid assessment. Methods., In 2007, an initial pool of 103 Cigarette Dependence Questionnaire items was distributed to 109 adult smokers in Taiwan. Item analysis was conducted to select items for inclusion in the refined scale. The psychometric properties of the Cigarette Dependence Questionnaire were further evaluated 2007,08, when it was administered to 256 respondents and their saliva was collected and analysed for cotinine levels. Criterion validity was established through the Pearson correlation between the scale and saliva cotinine levels. Exploratory factor analysis was used to test construct validity. Reliability was determined with Cronbach's alpha coefficient and a 2-week test,retest coefficient. Results., The selection of 30 items for seven perspectives was based on item analysis. One factor accounting for 44·9% of the variance emerged from the factor analysis. The factor was named as cigarette dependence. Cigarette Dependence Questionnaire scores were statistically significantly correlated with saliva cotinine levels (r = 0·21, P = 0·01). Cronbach's alpha was 0·95 and test,retest reliability using an intra-class correlation was 0·92. Conclusion., The Cigarette Dependence Questionnaire showed sound reliability and validity and could be used by nurses to set up smoking cessation interventions based on assessment of cigarette dependence. [source] Validation of a client-based clinical metrology instrument for the evaluation of canine elbow osteoarthritisJOURNAL OF SMALL ANIMAL PRACTICE, Issue 6 2009C. A. Hercock Objective: To validate a disease-specific client-based clinical metrology instrument (questionnaire) for dogs with chronic osteoarthritis of the elbow joint. Materialsand Methods: This was a prospective cohort study involving 26 dogs with chronic osteoarthritis of the elbow with 24 associated clients. Validity (face and criterion), reliability and responsiveness of the metrology instrument (named "Liverpool Osteoarthritis in Dogs [elbow]") were tested in a sequence of studies. Face validity involved use of international peer review. Reliability was assessed using a test-retest scenario with a two week interval; peak vertical force as measured by a force platform was used as an external standard measure. Responsiveness was tested with a two week, single-blinded placebo-controlled intervention using a licensed non-steroidal anti-inflammatory drug. Results: The reliability of Liverpool Osteoarthritis in Dogs (elbow) in the test-retest scenario was good; intraclass correlation coefficient is 0·89, 95 per cent confidence interval 0·75 to 0·95, compared with intraclass correlation coefficient 0·92, 95 per cent confidence interval 0·74 to 0·98, for peak vertical force. Responsiveness testing indicated that the "net" effect size (allowing for placebo effect) for Liverpool Osteoarthritis in Dogs (elbow) was 0·13 compared with (,)0·18 for the force platform. Criterion validity for Liverpool Osteoarthritis in Dogs (elbow) against peak vertical force was poor; Spearman's rank correlation is ,0·24 (P=0·30). Clinical Significance: Liverpool Osteoarthritis in Dogs (elbow) was considered reliable with satisfactory responsiveness. The poor criterion validity suggests a mismatch between force platform peak vertical force and client perceptions of lameness. This instrument requires further validation in larger studies with alternative client groups and alternative therapeutic interventions, but this initial validation suggests that Liverpool Osteoarthritis in Dogs (elbow) is worthy of continued investigation. [source] Validation of a pre-anaesthetic screening questionnaireANAESTHESIA, Issue 9 2003W. G. Hilditch Summary We developed a screening questionnaire to be used by nurses to decide which patients should see an anaesthetist for further evaluation before the day of surgery. Our objective was to measure the accuracy of responses to the questionnaire. Agreement between questionnaire responses and the anaesthetist's assessment was assessed. For questions with a prevalence of 5 to 95%, the Kappa coefficient was used; percentage agreement was used for all other questions. Criterion validity was excellent/good for all questions with a prevalence between 5 and 95%, except for the question ,Do you have kidney disease?' For questions with prevalence <,5%, all demonstrated adequate criterion validity except the questions ,Has anyone in your family had a problem following an anaesthetic?' and ,If you have been put to sleep for an operation were there any anaesthetic problems?' Therefore, it is reasonable for nurses to use this questionnaire to determine which patients an anaesthetist should see before the day of surgery. [source] Validation of the Pulmonary Score: An Asthma Severity Score for ChildrenACADEMIC EMERGENCY MEDICINE, Issue 2 2002Sharon R. Smith MD Objectives: In the absence of a validated "user-friendly" method of scoring asthma severity, the authors derived the pulmonary score (PS). The purpose of this study was to begin validation trials of the PS by comparing it with the peak expiratory flow rate (PEFR). Methods: The study enrolled a convenience sample of children, aged 5-17 years, who came to the emergency department (ED) for treatment of an acute asthma exacerbation. The PEFR (best of three attempts) and the PS were measured before and after the first albuterol treatment by a physician and a nurse from a pool of 45 trained observers. The PS includes respiratory rate, wheezing, and retractions, each rated on a 0-3 scale. Decreasing PS and increasing PEFR indicate clinical improvement. Pre- and post-treatment PEFRs and PSs were compared using paired t-tests to establish construct validity. Correlation of pre- and post-treatment PSs with PEFRs was measured to establish criterion validity. Results: Forty-six subjects completed the study. Mean percent predicted PEFR improved after treatment by 20.7% (p = 0.0001), and mean PS by 1.5 for nursing-obtained scores (p < 0.0001) and 1.9 for physician-obtained scores (p < 0.0001). Pre- and post-treatment PSs were significantly correlated with PEFRs. Correlations for the nursing-obtained scores were pre-treatment r = -0.57 (p = 0.0003) and post-treatment r = -0.67 (p = 0.0001), and for the physician-obtained scores were pre-treatment r = -0.44 (p = 0.003) and post-treatment r = -0.56 (p = 0.0001). The pre-treatment interrater reliability was 0.62 and the post-treatment was 0.53. Conclusions: These data support the construct and criterion validities of the PS as a measure of asthma severity among children in the ED. The PS is a practical substitute to estimate airway obstruction in children who are too young or too sick to obtain PEFRs. [source] Self-Stigma Among Concealable Minorities in Hong Kong: Conceptualization and Unified MeasurementAMERICAN JOURNAL OF ORTHOPSYCHIATRY, Issue 2 2010Winnie W. S. Mak Self-stigma refers to the internalized stigma that individuals may have toward themselves as a result of their minority status. Not only can self-stigma dampen the mental health of individuals, it can deter them from seeking professional help lest disclosing their minority status lead to being shunned by service providers. No unified instrument has been developed to measure consistently self-stigma that could be applied to different concealable minority groups. The present study presented findings based on 4 studies on the development and validation of the Self-Stigma Scale, conducted in Hong Kong with community samples of mental health consumers, recent immigrants from Mainland China, and sexual minorities. Upon a series of validation procedures, a 9-item Self-Stigma Scale,Short Form was developed. Initial support on its reliability and construct validity (convergent and criterion validities) were found among 3 stigmatized groups. Utility of this unified measure was to establish an empirical basis upon which self-stigma of different concealable minority groups could be assessed under the same dimensions. Health-care professionals could make use of this short scale to assess potential self-stigmatization among concealable minorities, which may hamper their treatment process as well as their overall well-being. [source] Development and validation of the Diabetes Obstacles Questionnaire (DOQ) to assess obstacles in living with Type 2 diabetesDIABETIC MEDICINE, Issue 8 2007H. Hearnshaw Abstract Aims To develop and validate an easy-to-use questionnaire to identify obstacles to self management in Type 2 diabetes. Methods The Diabetes Obstacles Questionnaire (DOQ) was developed from earlier research and the literature. It was completed by 180 people with Type 2 diabetes, recruited from 22 general practices in the UK. Responders also completed a quality-of-life questionnaire (ADDQoL) and the Problem Areas in Diabetes (PAID) scale. Results From analysis of the 176 usable questionnaires, 36 items of the original 113 items were deemed redundant. The remaining 77 items were assembled into eight sub-scales covering Medication, Self Monitoring, Knowledge and Beliefs, Diagnosis, Relationships with Health-Care Professionals, Lifestyle Changes, Coping, and Advice and Support. Each sub-scale had a factor structure of no more than three factors, had Cronbach's alpha of more than 0.75, and a Kaiser,Meyer,Olkin of more than 0.75. Each sub-scale correlated significantly with the PAID scale (P < 0.01), demonstrating criterion validity. Construct validity was shown by significant correlation between HbA1c and the sub-scales which relate to managing blood glucose levels: Self Monitoring, Relationship with Health-Care Professionals, Lifestyle Changes and Coping. Construct validity was further shown by significant correlation between QoL scores and Medication, Lifestyle Changes and Coping. Discussion The DOQ, comprising eight sub-scales, is a usable, valid instrument for both clinical and research settings. It helps to identify in detail the obstacles which an individual finds in living with Type 2 diabetes. [source] Does progressive stage transition mean getting better?ADDICTION, Issue 10 2007A test of the Transtheoretical Model in alcoholism recovery ABSTRACT Aims To test two central assumptions of stage movement in the Transtheoretical Model (TTM) vis-à-vis alcoholism recovery: (assumption 1) individuals making a forward transition to the action-oriented stages (i.e. preparation/action) will manifest relatively greater drinking improvements than their counterparts remaining in the pre-action stages (i.e. pre-contemplation, contemplation); and (assumption 2) individuals remaining in the pre-action stages across time will not demonstrate clinically relevant improvement in drinking outcomes. Design and setting Secondary data analyses of data from Project MATCH, a large multi-site alcoholism treatment-matching study. Measurements At baseline and 3 months post-treatment, the following variables were measured: stage-of-change (based on the University of Rhode Island Change Assessment measure and the most recent stage assignment algorithm), drinks per drinking day (DDD) and percentage days abstinent (PDA). Findings Six of the eight tests of assumptions 1 and 2 failed to support the basic tenets of the TTM. Our study demonstrated that individuals making a progressive stage transition to the action-oriented stages (i.e. preparation/action) do not necessarily manifest greater improvements in drinking-related behavior than individuals remaining in the pre-action stages (i.e. pre-contemplation, contemplation), and that individuals remaining in the pre-action stages over time actually do manifest statistically significant and clinically important improvements in drinking-related behavior. Conclusions Our findings challenge not only the criterion validity associated with stage movement in the TTM account of alcoholism recovery, but also recent TTM-based substance abuse treatment approaches which systematically promote forward stage transition as a primary clinical goal and marker of therapeutic success. [source] Italian validation of INQoL, a quality of life questionnaire for adults with muscle diseasesEUROPEAN JOURNAL OF NEUROLOGY, Issue 9 2010V. A. Sansone Background and purpose:, A quality of life (QoL) questionnaire for neuromuscular diseases was recently constructed and validated in the United Kingdom in a sample of adult patients with a variety of muscle disorders. Preliminary results suggested it could be a more relevant and practical measure of QoL in muscle diseases than generic health measures of QoL. The purpose of our work was: (i) To validate INQoL in Italy on a larger sample of adult patients with muscle diseases (ii) to compare INQoL to SF-36. Methods:, We have translated into Italian and applied language adaptations to the original UK INQoL version. We studied 1092 patients with different muscle disorders and performed (i) test,retest reliability (n = 80); (ii) psychometric (n = 345), known-group (n = 1092), external criterion (n = 70), and concurrent validity with SF-36 (n = 183). Results:, We have translated and formally validated the Italian version of INQoL confirming and extending results obtained in the United Kingdom. In addition to good results in terms of reliability, known-group and criterion validity, a comparison with the SF-36 scales showed a stronger association between INQoL total index and SF-36 physical (r = ,0.72) than mental (r = ,0.38) summary health indexes. When considering comparable domains of INQoL and SF-36 with respect to an objective measure of muscle strength assessment (MMRC), regression analysis showed a stronger correlation using INQoL rather than SF-36 scores. Conclusions:, INQoL is recommended to assess QoL in muscle diseases because of its ability to capture physical limitations that are specifically relevant to the muscle condition. [source] Validation of the Pulmonary Score: An Asthma Severity Score for ChildrenACADEMIC EMERGENCY MEDICINE, Issue 2 2002Sharon R. Smith MD Objectives: In the absence of a validated "user-friendly" method of scoring asthma severity, the authors derived the pulmonary score (PS). The purpose of this study was to begin validation trials of the PS by comparing it with the peak expiratory flow rate (PEFR). Methods: The study enrolled a convenience sample of children, aged 5-17 years, who came to the emergency department (ED) for treatment of an acute asthma exacerbation. The PEFR (best of three attempts) and the PS were measured before and after the first albuterol treatment by a physician and a nurse from a pool of 45 trained observers. The PS includes respiratory rate, wheezing, and retractions, each rated on a 0-3 scale. Decreasing PS and increasing PEFR indicate clinical improvement. Pre- and post-treatment PEFRs and PSs were compared using paired t-tests to establish construct validity. Correlation of pre- and post-treatment PSs with PEFRs was measured to establish criterion validity. Results: Forty-six subjects completed the study. Mean percent predicted PEFR improved after treatment by 20.7% (p = 0.0001), and mean PS by 1.5 for nursing-obtained scores (p < 0.0001) and 1.9 for physician-obtained scores (p < 0.0001). Pre- and post-treatment PSs were significantly correlated with PEFRs. Correlations for the nursing-obtained scores were pre-treatment r = -0.57 (p = 0.0003) and post-treatment r = -0.67 (p = 0.0001), and for the physician-obtained scores were pre-treatment r = -0.44 (p = 0.003) and post-treatment r = -0.56 (p = 0.0001). The pre-treatment interrater reliability was 0.62 and the post-treatment was 0.53. Conclusions: These data support the construct and criterion validities of the PS as a measure of asthma severity among children in the ED. The PS is a practical substitute to estimate airway obstruction in children who are too young or too sick to obtain PEFRs. [source] Oral Impacts on Daily Performance in Norwegian adults: validity, reliability and prevalence estimatesEUROPEAN JOURNAL OF ORAL SCIENCES, Issue 4 2005A. N. Åstrøm The Oral Impacts on Daily Performance (OIDP) instrument was translated into Norwegian and reviewed for cultural and conceptual equivalence by a group of bilingual academics. A sample of employees from the University of Bergen completed the Norwegian OIDP frequency questionnaire twice. A total of 173 and 108 subjects participated in the first and the second administration, respectively, of this questionnaire. A two-stage proportionate random sample, comprising 2,000 residents (age-range 16,79 yr), was drawn from the national population register by the Central Bureau of Statistics. Information became available for 1,309 persons who completed telephone interviews. The Norwegian OIDP preserved the overall concept of the English version. Test,retest reliability, in terms of Cohen's kappa, was 0.65, and Cronbach's alpha was high (, 0.80). In both samples, variations in the OIDP scores were apparent in relation to self-reported oral health and number of remaining teeth, supporting construct and criterion validity of the inventory. Only three of the OIDP interviews were discarded, which supports face validity. A total of 18.3% confirmed that they had at least one oral impact. Age-specific rates were 17.5%, 19.0%, 17.9% and 18.4% among 16,24, 24,44, 45,66 and 67,79-yr-old participants. The satisfactory psychometric properties provide evidence for the cross-cultural use of the OIDP. The presence of a distinct floor effect indicates poor sensitivity of the OIDP to detect improvements of oral health-related quality of life at a population level. Prevalence estimates were low, suggesting that the current oral health status has little impact on the daily performance of the Norwegian adult population. [source] A validity and reliability study of assessment and screening for sustained withdrawal reaction in infancy: The Alarm Distress Baby scale,INFANT MENTAL HEALTH JOURNAL, Issue 5 2001Antoine Guedeney Sustained withdrawal behavior in infancy is an important alarm signal to draw attention to both organic and relationship disorders. A withdrawal scale, the Alarm Distress Baby scale (ADBB), for infants between 2 and 24 months of age was built. This article describes the construction of the scale and the assessment of its psychometric properties. The ADBB has good content validity, based on the advice of seven experts. The scale has good criterion validity: first, as a measure of the infant's withdrawal reaction, with a very good correlation between nurse and pediatrician on the ADBB (rs = 0.84), and second, as a screening procedure for detecting the developmental risk of the infant. The cutoff score of 5 with a sensitivity of 0.82 and a specificity of 0.78 was determined to be optimal for screening purposes. The scale has good construct validity, with good convergent validity with both the Spitz (1951) and the Herzog & Rathbun (1982) lists of symptoms of infant depression (rs = 0.61 and 0.60, respectively). Exploratory factor analysis showed two different factors, consistent with the scale's construct. Reliability was satisfactory with good internal consistency for both subscales (the Cronbach , = 0.80 for the first subscale and 0.79 for the second) and for the global scale (, = 0.83). The test-retest procedure showed good stability over time (rs = 0.90 and 0.84 for the two different raters). The scale could be used in different clinical settings, provided a sufficient level of social stimulation is given to the infant in a relatively brief period of time. The scale can be used by nurses and psychologists or by medical doctors after a short period of training. © 2001 Michigan Association for Infant Mental Health. [source] A preliminary investigation of the reliability and validity of the Brief Assessment Schedule Depression Cards and the Beck Depression Inventory-Fast Screen to screen for depression in older stroke survivorsINTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY, Issue 5 2008A. K. Healey Abstract Objective To conduct an initial assessment of the reliability and validity of the Brief Assessment Schedule Depression Cards (BASDEC) and the Beck Depression Inventory-Fast Screen (BDI-FS) to screen for depression in older stroke survivors. Methods Participants from four inpatient rehabilitation units completed the BASDEC and the BDI-FS together with the Hospital Anxiety and Depression Scale (HADS) for comparison. The Structured Clinical Interview for DSM-IV Axis 1 Disorders (SCID) was then completed with all participants to ascertain a criterion depression diagnosis. The BASDEC and BDI-FS were subsequently completed for a second time. Results Forty-nine stroke survivors (M,=,78.80, SD,=,6.79 years) were included. The BASDEC and BDI-FS demonstrated acceptable internal consistency and test,retest reliability. The BASDEC (cut-off ,7) resulted in a sensitivity of 1.0 and specificity of 0.95 for detecting major depression whereas the BDI-FS (cut-off ,4) had a sensitivity of 0.71 and specificity of 0.74. When participants with minor depression were included in analyses, sensitivity lowered to 0.69 (specificity,=,0.97) for the BASDEC and 0.62 (specificity,=,0.78) for the BDI-FS. Conclusions The BASDEC and BDI-FS were found to have acceptable reliability. The BASDEC demonstrated some advantage in criterion validity over the BDI-FS at the examined cut-offs. Copyright © 2007 John Wiley & Sons, Ltd. [source] Construction and validation of a patient- and user-friendly nursing home version of the Geriatric Depression Scale,INTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY, Issue 9 2007K. Jongenelis Abstract Objective To construct a patient- and user-friendly shortened version of the Geriatric Depression Scale (GDS) that is especially suitable for nursing home patients. Methods The study was carried out on two different data bases including 23 Dutch nursing homes. Data on the GDS (n,=,410), the Mini Mental State Examination (n,=,410) and a diagnostic interview (SCAN; n,=,333), were collected by trained clinicians. Firstly, the items of the GDS-15 were judged on their clinical applicability by three clinical experts. Subsequently, items that were identified as unsuitable were removed using the data of the Assess project (n,=,77), and internal consistency was calculated. Secondly, with respect to criterion validity (sensitivity, specitivity, area under ROC and positive and negative predictive values), the newly constructed shortened GDS was validated in the AGED data set (n,=,333), using DSM-IV diagnosis for depression as measured by the SCAN as ,gold standard'. Results The eight-item GDS that resulted from stage 1 showed good internal consistency in both the Assess data set (,,=,0.86) and the AGED dataset (,,=,0.80). In the AGED dataset, high sensitivity rates of 96.3% for major depression and 83.0% for minor depression were found, with a specificity rate of 71.7% at a cut-off point of 2/3. Conclusion The GDS-8 has good psychometric properties. Given that the GDS-8 is less burdening for the patient, more comfortable to use and less time consuming, it may be a more feasible screening test for the frail nursing home population. Copyright © 2007 John Wiley & Sons, Ltd. [source] Does the presence of anxiety affect the validity of a screening test for depression in the elderly?INTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY, Issue 4 2002Gary Sinoff Abstract Introduction Depression in the elderly is frequently detected by screening instruments and often accompanied by anxiety. We set out to study if anxiety will affect the ability to detect depression by a screening instrument. Objective To validate the short Zung depression rating scale in Israeli elderly and to study the affect of anxiety on its validity. Design The short Zung was validated against a psychiatric evaluation, in a geriatric inpatient and outpatient service. The overall validity was determined, as well as for subgroups of sufferers and non-sufferers of anxiety. Setting An urban geriatric service in Israel. Patients 150 medical inpatients and outpatients, aged 70 years and older. Measures Psychiatric evaluation of modified Anxiety Disorders Interview Schedule for DSM-IV as criterion standard for anxiety and depression and short Zung instrument for depression. Results By criterion validity, 60% suffered from depression. The overall validity of the short Zung was high (sensitivity 71.1%, specificity 88.3%, PPV 90.1%, NPV 67.1%). The validity for those not suffering from anxiety was good (sensitivity 71.1%, specificity 90.2%, PPV 84.4%, NPV 80.7%). In those with anxiety, sensitivity, specificty and PPV were high (71.2%, 77.8%, 94.9% respectively), although the specificity was less than in non-suffers. However major difference was in the NPV rate being much lower (31.8%). Conclusion The short Zung, an easily administered instrument for detecting depression, is also valid in the Israeli elderly. However, anxiety limits the usefulness of this instrument in correctly ruling out depression. The clinician must be aware, therefore, that those suffering from anxiety may score negatively for depression on a screening instrument, such as the short Zung. Copyright © 2002 John Wiley & Sons, Ltd. [source] Psychometric properties of an interviewer-administered version of the Kessler Psychological Distress scale (K10) among Dutch, Moroccan and Turkish respondentsINTERNATIONAL JOURNAL OF METHODS IN PSYCHIATRIC RESEARCH, Issue 3 2009T. Fassaert Abstract The Kessler Psychological Distress scale (K10) is an instrument that is widely used to screen for mental disorders, but information is lacking on its psychometric qualities in non-Western samples. This study used a population-based sample (N = 725) to assess the reliability and validity of the K10 across ethnic groups in an urban area. The results were generally supportive of the K10 as a reliable and valid instrument to screen for anxiety and depression in all three groups. Cronbach's alpha was high (0.93) and the results indicated the existence of a solid single factor structure. Item bias in relation to ethnic background was minor. In each group, there was good criterion validity with respect to one-month DSM-IV diagnosis for depressive and/or anxiety disorder. The results nevertheless highlight the importance of cross-cultural validation, as we found different cut-off values for ethnic subgroups to obtain optimal sensitivity and specificity for detecting depressive and/or anxiety disorders. Copyright © 2009 John Wiley & Sons, Ltd. [source] Evaluation of NOC Measures in Home Care Nursing PracticeINTERNATIONAL JOURNAL OF NURSING TERMINOLOGIES AND CLASSIFICATION, Issue 2003Gail M. Keenan PURPOSE To evaluate the reliability, validity, usefulness, and sensitivity of 89 NOC outcomes in two Visiting Nurse Associations in Michigan. METHODS Of a total 190 NOC outcomes 89 were assigned for testing. Interrater reliability and criterion validity were assessed a total of 50 times per outcome (on 50 different patients) across the study units. The total number of times the reliability and validity were assessed for each of the 89 measures studied ranged from 5,45. Three RN research assistants (RNRAs) oversaw and participated in data collection with the help of 15 clinicians. Convenience sampling was used to identify subjects. A roster of outcomes to be studied was maintained and matched with patient conditions whenever possible until the quota of outcomes assigned had been evaluated. Clinicians and RNRAs independently rated the outcomes and indicators applicable to the patient. NANDA diagnoses, NIC interventions, and medical diagnoses were recorded. FINDINGS A total of 258 patients (mean age 62) enrolled; 60% were women, 23% were from minority groups, and 78% had no college degree. Thirty-six of the 89 NOC measures were designated "clinically useful." The 10 outcomes with the highest interrater reliability were Caregiver Home Care Readiness; Caregiver Stressors; Caregiving Endurance Potential; Infection Status; Mobility Level; Safety Status: Physical Injury; Self-Care: Activities of Daily Living; Self-Care: Bathing; Self-Care: Hygiene; and Wound Healing: Secondary Intention. Criterion measurement and repeated ratings provided evidence to support the validity and sensitivity of the NOC outcomes. Evidence also suggested that NOC label level ratings could be a feasible, reliable, and valid method of evaluating nursing outcomes under actual use. For some measures, adjustments in the scales and anchors are needed to enhance reliability. For others, it may be unrealistic to reliably score in one encounter, thus scoring should be deferred until the clinician has adequate knowledge of the patient. CONCLUSIONS Continued study and refinement that are coordinated and integrated systematically strongly recommended. Comprehensive study in an automated system with a controlled format will increase the efficiency of future studies. [source] Translation and validation of a Chinese language version of the Early Childhood Oral Health Impact Scale (ECOHIS)INTERNATIONAL JOURNAL OF PAEDIATRIC DENTISTRY, Issue 6 2009GILLIAN H. M. LEE Objective., This study aimed to adapt the Early Childhood Oral Health Impact Scale (ECOHIS) for pre-school children in a Chinese speaking community and to investigate its psychometric properties (validity and reliability). Methods., A Chinese language version of the ECOHIS was derived through a forward,backward translation and tested for face and content validity among a focus group. A convenient sample of pre-school children (n = 111) was recruited (including a sub-sample with early childhood caries and caries-free children). Parents of the children self-completed the derived Chinese-ECOHIS measure. Validity of the measure was assessed by investigating the relationship between dental caries status and Chinese-ECOHIS scores (construct and criterion validity). A sub-sample of the parents repeated the ratings of the measure to enable reliability assessments. Both internal and test,retest reliability were determined. Results., A Chinese version of ECOHIS was derived with minor modification to the original version. Chinese-ECOHIS scores were associated with children's caries experience (dmft) (r = 0.66, P < 0.05) supporting convergent validity. In addition, variations in ECOHIS scores were apparent with respect to caries and caries-free groups (P < 0.001), supporting the ability to distinguish between patient groups. Cronbach's alpha values (internal reliability) for total ECOHIS score were 0.91 and intraclass correlation coefficient value (test,retest reliability) was 0.64. Conclusions., A Chinese version of the ECOHIS was developed and demonstrated acceptable validity and reliability. These findings can enable assessments of pre-school child oral health-related quality of life in Chinese speaking communities. [source] Distinguishing between task and contextual performance for nurses: development of a job performance scaleJOURNAL OF ADVANCED NURSING, Issue 6 2007Jaimi H. Greenslade Abstract Title.,Distinguishing between task and contextual performance for nurses: development of a job performance scale Aim., This paper is a report of a development and validation of a new job performance scale based on an established job performance model. Background., Previous measures of nursing quality are atheoretical and fail to incorporate the complete range of behaviours performed. Thus, an up-to-date measure of job performance is required for assessing nursing quality. Methods., Test construction involved systematic generation of test items using focus groups, a literature review, and an expert review of test items. A pilot study was conducted to determine the multidimensional nature of the taxonomy and its psychometric properties. All data were collected in 2005. Findings., The final version of the nursing performance taxonomy included 41 behaviours across eight dimensions of job performance. Results from preliminary psychometric investigations suggest that the nursing performance scale has good internal consistency, good convergent validity and good criterion validity. Conclusion., The findings give preliminary support for a new job performance scale as a reliable and valid tool for assessing nursing quality. However, further research using a larger sample and nurses from a broader geographical region is required to cross-validate the measure. This scale may be used to guide hospital managers regarding the quality of nursing care within units and to guide future research in the area. [source] Reliability and Validity of Prehospital Case Finding for Depression and Cognitive ImpairmentJOURNAL OF AMERICAN GERIATRICS SOCIETY, Issue 4 2009Manish N. Shah MD OBJECTIVES: To evaluate the test,retest reliability, the concurrent criterion validity, and the construct validity of prehospital, emergency medical service (EMS) case finding for depression and cognitive impairment in older adults. DESIGN: Cross-sectional study. SETTING: Prehospital EMS system and hospital emergency department. PARTICIPANTS: EMS providers and community-dwelling older adult (aged ,60) patients. INTERVENTIONS: Case finding instruments for depression (Patient Health Questionnaire-2; PHQ-2) and cognitive impairment (Six-Item Screener). MEASUREMENTS: The reliability and validity of these instruments. RESULTS: Moderate test,retest reliability was found for prehospital application of the PHQ-2 (kappa=0.50) and Six-Item Screener (kappa=0.52), fair concurrent criterion validity for depression (kappa=0.36), and slight to fair concurrent criterion validity for cognitive impairment (kappa=0.11,0.23). Construct validity was demonstrated using the Multitrait-Multimethod Matrix. CONCLUSION: Moderate test,retest reliability and construct validity were demonstrated for prehospital case finding by EMS providers for cognitive impairment and depression using these instruments. Slight to fair concurrent criterion validity was found, a result that methodological limitations could explain. These findings provide additional support for the concept of using EMS providers to detect older adults at risk for these conditions. Further work is needed to confirm the validity and effectiveness of prehospital screening before such programs are implemented. [source] Estimating Cardiorespiratory Fitness in Well-Functioning Older Adults: Treadmill Validation of the Long Distance Corridor WalkJOURNAL OF AMERICAN GERIATRICS SOCIETY, Issue 1 2006Eleanor M. Simonsick PhD Objectives: To determine criterion validity of the 400-m walk component of the Long Distance Corridor Walk (LDCW) and develop equations for estimating peak oxygen consumption (VO2) from 400-m time and factors intrinsic to test performance (e.g., heart rate (HR) and systolic blood pressure (SBP) response) in older adults. Design: Cross-sectional validation study. Setting: Gerontology Research Center, National Institute on Aging, Baltimore, Maryland. Participants: Healthy volunteers (56 men and 46 women) aged 60 to 91 participating in the Baltimore Longitudinal Study of Aging between August 1999 and July 2000. Measurements: The LDCW, consisting of a 2-minute walk followed immediately by a 400-m walk "done as quickly as possible" over a 20-m course was administered the day after maximal treadmill testing. HR and SBP were measured before testing and at the end of the 400-m walk. Weight, height, activity level, perceived effort, and stride length were also acquired. Results: Peak VO2 ranged from 12.2 to 31.1 mL oxygen/kg per minute, and 400-m time ranged from 2 minutes 52 seconds to 6 minutes 18 seconds. Correlation between 400-m time and peak VO2 was ,0.79. The estimating equation from linear regression included 400-m time (partial coefficient of determination (R2)=0.625), long versus short stride (partial R2=0.090), ending SBP (partial R2=0.019), and a correction factor for fast 400-m time (<240 seconds; partial R2=0.020) and explained 75.5% of the variance in peak VO2 (correlation coefficient=0.87). Conclusion: A 400-m walk performed as part of the LDCW provides a valid estimate of peak VO2 in older adults. Incorporating low-cost, safe assessments of fitness in clinical and research settings can identify early evidence of physical decline and individuals who may benefit from therapeutic interventions. [source] Care dependency of children in EgyptJOURNAL OF CLINICAL NURSING, Issue 3 2008Hanan Tork RN Aims., This study aimed to modify the Care Dependency Scale so that it could be used for children, to apply its Arabic version to Egyptian children to test the reliability and validity of the modified scale and to compare the care dependency of disabled and non-disabled Egyptian children. Background., A higher dependence of children in their daily tasks undoubtedly places a greater burden on their caregivers. To estimate the extent of the problem of care dependency, data from different countries and proper standard instruments are required. Method., The Care Dependency Scale was modified for children by Delphi technique. This study assessed the care dependency of non-disabled children compared with children with physical and mental disabilities using the modified version of the Care Dependency Scale for paediatrics. The total sample included 260 Egyptian school-age children (50·8% of whom were disabled and 49·2% were non-disabled). Results., Reliability was examined in terms of internal consistency using Cronbach's alpha (0·91). Inter-rater reliability revealed moderate to very good Kappa statistics between 0·57,0·89. Content validity and criterion validity were evaluated. Differences regarding care dependency were found between disabled and non-disabled children. Conclusion., The psychometric properties of the Care Dependency Scale for paediatrics support its usefulness in measuring the care dependency of children in Egypt. This study provides an Arabic version of the Care Dependency Scale for paediatrics that is easy to administer and may be useful to measure the care dependency in various Arabic countries. Relevance to clinical practice., The findings raise concerns regarding the extent to which disabled and also non-disabled school-age children are care dependent leading to an increased burden of care on nurses or on caregivers in general. The Care Dependency Scale for Paediatrics can help nurses conduct an appropriate assessment of children's care dependency so that any nursing care can be planned according to the children's needs. [source] Validity of an instrument to measure the impact of valve heart disease on the patient's daily lifeJOURNAL OF CLINICAL NURSING, Issue 7 2007Kátia Melissa Padilha RN Aim., This study was to verify the psychometric properties of the Heart Valve Disease Impact on daily life, an instrument for measuring the impact of illness in the daily life of the heart valve disease patient, related to its construct validity, criterion-related validity and reliability. Methods., One hundred and twenty heart valve disease outpatients were enrolled. Data were submitted to descriptive analysis, factor analysis, Pearson's correlation coefficient and Cronbach's alpha coefficient. Results., The factor analysis generated four factors that explained 58% of the variance in response to the Heart Valve Disease Impact on daily life. Weak to moderate correlation was measured between the Heart Valve Disease Impact on daily life total score and two of its factors and the General Measure of Impact of illness, indicating criterion-related validity. A Cronbach's alpha of 0·74 was measured. Conclusion., The results of the current study confirm both the construct and criterion validity and the internal consistency of the Heart Valve Disease Impact on daily life. Future studies are necessary to confirm its reliability and provide a better understanding of the meaning of the Heart Valve Disease Impact on daily life dimensions, as well as to evaluate its response to health interventions. Relevance to clinical practice., The Heart Valve Disease Impact on daily life could be a useful instrument to measure the impact of heart valve disease and to evaluate the response to health interventions. [source] Willingness to pay for a hearing aid: comparing the payment scale and open-ended questionJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 1 2009Janneke P. C. Grutters MSc Abstract Rationale & objectives, Different question formats elicit different willingness-to-pay (WTP) results, but there is no consensus on which method elicits the most valid WTP. In spite of the methodological controversies, WTP is a potentially valuable tool in health economics to value health services. Our general objective was to provide additional evidence on the validity of two WTP elicitation formats: the open-ended question and the payment scale. Methods, We elicited WTP for a hearing aid among hearing aid users (n = 108), using both a payment scale and an open-ended question. We compared the results from both formats. We tested criterion validity by comparing both formats with the actual out-of-pocket payment. Construct validity was tested by examining whether WTP was consistent with positive income elasticity. Results, The WTP results elicited with the payment scale and open-ended question were not statistically significantly different. Both formats showed good criterion validity, although the open-ended question showed a stronger association with the actual out-of-pocket payment. The open-ended format showed better construct validity, as it was influenced by family income. Conclusion, The results of the present study showed that the open-ended question was more valid than the payment scale question. We, therefore, recommend that in future WTP studies on hearing aids the open-ended question is used to directly elicit WTP values. The same recommendation may apply to other studies where respondents are familiar with costs or payments for the intervention under evaluation. [source] Measuring physiotherapists' guideline adherence by means of clinical vignettes: a validation studyJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 5 2006Geert M.J. Rutten MPH Abstract Rationale, aims and objectives, To assess the criterion validity of paper-and-pencil vignettes to assess guideline adherence by physiotherapists in the Netherlands. The evidence-based physiotherapy practice guideline for low back pain was used as an example. Methods, Four vignettes were constructed and pre-tested. Three vignettes were found to represent an adequate case-mix. They described one patient with specific low back pain, one with non-specific low back pain and a normal recovery process and one with non-specific low back pain and a delay in the recovery process. Invited to participate were 113 primary care physiotherapists who had joined an randomized controlled trial study 8 months before, in which guideline adherence had been measured by means of semi-structured treatment recording forms. The criterion validity was determined with Spearman's rs, using Cohen's classification for the behavioural sciences to categorize its effect size. Results, Of the 72 physiotherapists who agreed to participate, 39 completed the questions on the vignettes. In the end, both adherence measures were available for 34 participants, providing 102 vignettes and 268 recording forms. Mean guideline adherence scores were 57% (SD = 17) when measured by vignettes and 74% (SD = 15) when measured by recording forms. Spearman's rs was 0.31 (P = 0.036), which, according to Cohen's classification, is a medium effect size. Conclusion, Vignettes are of acceptable validity, and are an inexpensive and manageable instrument to measure guideline adherence among large groups of physiotherapists. Further validation studies could benefit from the use of standardized patients as a gold standard, a more diverse case mix to better reflect real physiotherapy practice, and the inclusion of longitudinal vignettes that cover the patients' course of treatment. [source] Validation of video versus electromyography for chewing evaluation of the elderly wearing a complete dentureJOURNAL OF ORAL REHABILITATION, Issue 8 2007E. NICOLAS summary, Chewing efficiency may affect nutritional status in the elderly. Many elderly patients are complete denture wearers, and often present cognitive problems. Those two factors make evaluation of mastication difficult with experimental methods. Analysis of video recording may be a simple way to routinely assess chewing parameters. This study aimed at validating several parameters of video evaluation versus electromyography (EMG), which is considered the ,gold standard'. The design was a prospective randomized study, carried out at the Faculty of Dentistry, University of Auvergne, Clermont-Ferrand, France. Twelve complete denture wearers chewed four model foods differing in hardness. Sessions were videotaped and EMG recordings were registered. Mastication time, number of masticatory cycles and cleaning time were recorded simultaneously by video and EMG. Two investigators independently analyzed the videos twice, in random order. Evaluation of criterion validity: a positive video/EMG correlation was found for the parameters ,chewing time' (0·89, Pearson) and ,number of masticatory cycles' (0·94, Spearman), whereas no statistical difference was found between these two EMG and video variables (t -test). Inter and intra-rater reliability gave a positive intraclass coefficient (ICC) for duration of mastication (0·86,0·98), number of masticatory cycles (0·90,0·97) and cleaning time (0·90,0·98). Discriminatory ability was studied using anova (P = 0·01): variation was significant in masticatory duration (F = 10), number of masticatory cycles (F = 10) and cleaning time (F = 4). Video may be a useful assessment tool in prosthetic rehabilitation and can be applied to help choose the type of food (solid, semi-liquid or liquid) to administer to dependent persons, particularly those suffering from dementia. [source] Synovial fluid biomarker levels predict articular cartilage damage following complete medial meniscectomy in the canine kneeJOURNAL OF ORTHOPAEDIC RESEARCH, Issue 1 2002Cathy S. Carlson The purposes of this study were to document the histological changes present in the tibial plateaus 12 weeks after complete medial meniscectomy in dogs and to determine if synovial lavage fluid biomarker levels are predictive of the severity of joint damage. Twelve adult dogs underwent complete unilateral medial meniscectomy and synovial lavage fluid biomarker levels, including cartilage oligomeric matrix protein (COMP), keratan sulfate (5D4), 3B3(,), and 3B3(+), were measured serially at 4-week intervals. The dogs were euthanized 12 weeks after surgery and each medial and lateral tibial plateau from the meniscectomized and contralateral knees was graded histologically. Histological data were analyzed using principal components analysis, which resulted in 4 factors that explained 70% of the variation in the data. Factor 2 (weighted most heavily by subchondral bone thickness) and Factor 3 (representative of articular cartilage damage) were significantly affected by compartmental site (P < 0.01 for both). Both of these factors were highest in the medial tibial plateau of the meniscectomized knee, and Factor 3 was significantly higher in this site than in the medial tibial plateau of the contralateral knee (P < 0.01). Peak levels of all 4 synovial lavage fluid biomarkers occurred at 4 weeks post-meniscectomy and 4-week minus baseline levels of all biomarkers were significantly correlated with the Factor 3 scores. This study demonstrates that significant articular cartilage damage occurs relatively quickly following complete medial meniscectomy in dogs and establishes the content and criterion validity for these synovial fluid lavage biomarkers in canine meniscectomy as surrogate measures of articular cartilage damage. © 2002 Orthopaedic Research Society. Published by Elsevier Science Ltd. All rights reserved. [source] The Alcohol Use Disorders Identification Test: An Update of Research FindingsALCOHOLISM, Issue 2 2007Duane F. Reinert Background: The Alcohol Use Disorders Identification Test (AUDIT) has been extensively researched to determine its capability to accurately and practically screen for alcohol problems. Methods: During the 5 years since our previous review of the literature, a large number of additional studies have been published on the AUDIT, abbreviated versions of it, its psychometric properties, and the applicability of the AUDIT for a diverse array of populations. The current article summarizes new findings and integrates them with results of previous research. It also suggests some issues that we believe are particularly in need of further study. Results: A growing body of research evidence supports the criterion validity of English version of the AUDIT as a screen for alcohol dependence as well as for less severe alcohol problems. Nevertheless, the cut-points for effective detection of hazardous drinking as well as identification of alcohol dependence or harmful use in women need to be lowered from the originally recommended value of 8 points. The AUDIT-C, the most popular short version of the AUDIT consisting solely of its 3 consumption items, is approximately equal in accuracy to the full AUDIT. Psychometric properties of the AUDIT, such as test,retest reliability and internal consistency, are quite favorable. Continued research is urged to establish the psychometric properties of non-English versions of the AUDIT, use of the AUDIT with adolescents and with older adults, and selective inclusion of alcohol biomarkers with the AUDIT in some instances. Conclusions: Research continues to support use of the AUDIT as a means of screening for the spectrum of alcohol use disorders in various settings and with diverse populations. [source] | ||||||||||||||||||||||||||||||||||