Home About us Contact | |||
Criterion-related Validity (criterion-related + validity)
Selected AbstractsFunctional cognitive assessment scale (FUCAS): a new scale to assess executive cognitive function in daily life activities in patients with dementia and mild cognitive impairmentHUMAN PSYCHOPHARMACOLOGY: CLINICAL AND EXPERIMENTAL, Issue 5 2006Fotini Kounti Abstract Background Several tests have been developed to examine performance of demented patients in daily life activities. However, most of them are based either on the subjective evaluation of performance by the patient him/herself, or on the reports of relatives. Functional Cognitive Assessment Scale (FUCAS) is a new reliable (,,>,0.89,,,0.92) cognitive-behavioral scale that assesses executive function in daily life activities directly in patients with dementia. Aims This study aimed at testing FUCAS' internal consistency of items, criterion-related validity, interrater reliability, discriminative ability, and effect of age, sex, and education on FUCAS scores. Results Criterion-related validity was supported by significant correlations between FUCAS, CAMCOG, MMSE, and FRSSD. The interrater reliability of FUCAS' total score for two raters was r 0.997 and we found no significant effect of age, sex, or education on FUCAS' total performance. Discriminant analysis has identified that FUCAS was able to sufficiently discriminate the patients with MCI from those with moderate-severe dementia. Conclusion FUCAS is a useful and reliable diagnostic tool for MCI. Cognitive-behavioral assessment such as that provided by FUCAS can provide objective information that can serve to enhance the quality of clinical decision-making. Copyright © 2006 John Wiley & Sons, Ltd. [source] Complexity Prediction Instrument to detect ,complex cases' in respiratory wards: instrument developmentJOURNAL OF ADVANCED NURSING, Issue 1 2008Elena Lobo Abstract Title.,Complexity Prediction Instrument to detect ,complex cases' in respiratory wards: instrument development. Aim., This paper is a report of a study to test the hypothesis that the Spanish version of the Complexity Prediction Instrument is a reliable and valid measure of complexity of patients with respiratory disease and to identify the frequency of positive indicators of potential complexity. Background., Respiratory patients are often disabled and severely ill, with co-morbid physical conditions and associated psychosocial problems and need complex nursing care. Method., Trained nurses assessed 299 consecutive adult patients admitted to a respiratory service in Spain from May 2003 until June 2004 with the new, Spanish version of the instrument. Criterion-related validity was tested by studying its ability to predict complexity of care in terms of: severity of illness, scored using the Cumulative Illness Rating Scale; length of hospital stay; ,multiple consultations' during admission; and ,multiple specialists' after discharge. Findings., The hypothesis was supported: patients rating above the standard cut-off point on the Complexity Prediction Instrument scored statistically significantly higher on most of the measures of care complexity studied. Linear regression models showed that the tool was associated with ,length of hospital stay', and predicted both ,multiple consultations' and ,multiple specialists', after controlling for potential confounders. The proportion of ,probable complex cases' was 59·5%. Five positive indicators of potential complexity had a frequency higher than 50%. Conclusion., The Complexity Prediction Instrument is reliable and valid in a new clinical area, respiratory disease. It may be used by nurses for the early prediction of complexity of care. International comparisons may be facilitated with this new Spanish version. [source] The Lille Apathy Rating Scale: Validation of a caregiver-based versionMOVEMENT DISORDERS, Issue 6 2008Kathy Dujardin PhD Abstract Apathy is reported in 16.5% to 70% of Parkinson's disease (PD) patients. Our recently developed Lille Apathy Rating Scale (LARS) has been specifically validated for patient-based assessment of apathy in PD. The aim of the present study was to validate a caregiver-based version of the LARS. Sixty consecutive PD patients and their respective caregivers participated in the study. An informant-based version of the LARS (LARS-i) was developed to rate apathy via a caregiver-based structured interview. Apathy was also assessed in a patient-based interview using the LARS and the informant- and clinician-rated versions of the Apathy Evaluation Scale (AES). Cronbach's alpha and standardized alpha coefficients were 0.872 and 0.877, respectively, and the split-half reliability was 0.901 (revealing good internal consistency). The test-retest and inter-rater reliability values were 0.960 and 0.996, respectively. Criterion-related validity (according to an independent, expert diagnosis) was good. Scores on the LARS and the LARS-i were highly correlated. However, apathy was rated significantly more severely by the caregiver than by the patient. This difference was significantly higher for demented than nondemented PD patients. The LARS-i was seen to have excellent psychometric properties and appears to be valid for use in PD with respect to the patient-based LARS and the informant- and clinician-rated versions of the AES. © 2008 Movement Disorder Society [source] EXPLORING RELATIONS BETWEEN TYPICAL AND MAXIMUM PERFORMANCE RATINGS AND THE FIVE FACTOR MODEL OF PERSONALITYPERSONNEL PSYCHOLOGY, Issue 4 2001ROBERT E. PLOYHART The study tests the distinction between typical and maximum criteria with ratings of transformational leadership performance, and examines whether the criterion-related validities of the five factor model differ for the two types of criteria. Using an East Asian military sample (n= 1,259) where multiple ratings of typical and maximum performance were obtained from different sources, we used structural equation modeling to test the typical/maximum performance distinction. Results found that typical and maximum performance are different latent constructs and that this distinction is present even after considering rating method factors (i.e., rater source, time). The importance of this distinction is shown by the fact that validities for the personality constructs were not equally predictive of both criteria: Openness was most predictive of maximum performance, Neuroticism was most predictive of typical performance, and Extroversion was predictive of both. By distinguishing typical from maximum performance constructs, relationships between personality and transformational leadership were found to be stronger than previous research suggested. [source] Validation of the Depression and Somatic Symptoms Scale by comparison with the Short Form 36 scale among psychiatric outpatients with major depressive disorderDEPRESSION AND ANXIETY, Issue 6 2009Ching-I Hung M.D. Abstract Background: The Depression and Somatic Symptoms Scale (DSSS) is a self-administered scale developed for monitoring both depression and somatic symptoms. The aims of this study were to establish the criterion-related validity of the DSSS by testing the correlation between the DSSS and the Short Form 36 (SF-36) scale and to compare the ability of the DSSS and two other scales in predicting the outcome of the SF-36. Methods: The study enrolled 135 outpatients with a major depressive episode, 95 of whom received treatment for 1 month. Four scales were administered and evaluated: the DSSS, the SF-36, the Hospital Anxiety and Depression Scale, and the Hamilton Depression Rating Scale. Pearson correlation was used to test correlations among scales. Multiple linear regressions were used to find the scales most effective in predicting the SF-36. Results: The three scales were significantly correlated with most of the SF-36 subscales. The depression and somatic subscales of the DSSS significantly correlated with the mental and physical subscales of the SF-36, respectively. The DSSS and the Hospital Anxiety and Depression Scale were better able to predict physical and mental subscales of the SF-36, respectively. The Hamilton Depression Rating Scale had a good ability to predict functional impairment. Conclusions: Psychometric scales with appropriate somatic symptoms might be more compatible with both physical and mental dimensions of the SF-36. DSSS proved to be a valid scale for monitoring both depression and somatic symptoms in patients with depression. Future studies should test whether the DSSS is better at predicting the treatment and prognosis of depression than conventional scales for depression. Depression and Anxiety, 2009. © 2009 Wiley-Liss, Inc. [source] Proposed diagnostic criteria for internet addictionADDICTION, Issue 3 2010Ran Tao ABSTRACT Objective The objective of this study was to develop diagnostic criteria for internet addiction disorder (IAD) and to evaluate the validity of our proposed diagnostic criteria for discriminating non-dependent from dependent internet use in the general population. Methods This study was conducted in three stages: the developmental stage (110 subjects in the survey group; 408 subjects in the training group), where items of the proposed diagnostic criteria were developed and tested; the validation stage (n = 405), where the proposed criteria were evaluated for criterion-related validity; and the clinical stage (n = 150), where the criteria and the global clinical impression of IAD were evaluated by more than one psychiatrist to determine inter-rater reliability. Results The proposed internet addiction diagnostic criteria consisted of symptom criterion (seven clinical symptoms of IAD), clinically significant impairment criterion (functional and psychosocial impairments), course criterion (duration of addiction lasting at least 3 months, with at least 6 hours of non-essential internet usage per day) and exclusion criterion (exclusion of dependency attributed to psychotic disorders). A diagnostic score of 2 + 1, where the first two symptoms (preoccupation and withdrawal symptoms) and at least one of the five other symptoms (tolerance, lack of control, continued excessive use despite knowledge of negative effects/affects, loss of interests excluding internet, and use of the internet to escape or relieve a dysphoric mood) was established. Inter-rater reliability was 98%. Conclusion Our findings suggest that the proposed diagnostic criteria may be useful for the standardization of diagnostic criteria for IAD. [source] Functional cognitive assessment scale (FUCAS): a new scale to assess executive cognitive function in daily life activities in patients with dementia and mild cognitive impairmentHUMAN PSYCHOPHARMACOLOGY: CLINICAL AND EXPERIMENTAL, Issue 5 2006Fotini Kounti Abstract Background Several tests have been developed to examine performance of demented patients in daily life activities. However, most of them are based either on the subjective evaluation of performance by the patient him/herself, or on the reports of relatives. Functional Cognitive Assessment Scale (FUCAS) is a new reliable (,,>,0.89,,,0.92) cognitive-behavioral scale that assesses executive function in daily life activities directly in patients with dementia. Aims This study aimed at testing FUCAS' internal consistency of items, criterion-related validity, interrater reliability, discriminative ability, and effect of age, sex, and education on FUCAS scores. Results Criterion-related validity was supported by significant correlations between FUCAS, CAMCOG, MMSE, and FRSSD. The interrater reliability of FUCAS' total score for two raters was r 0.997 and we found no significant effect of age, sex, or education on FUCAS' total performance. Discriminant analysis has identified that FUCAS was able to sufficiently discriminate the patients with MCI from those with moderate-severe dementia. Conclusion FUCAS is a useful and reliable diagnostic tool for MCI. Cognitive-behavioral assessment such as that provided by FUCAS can provide objective information that can serve to enhance the quality of clinical decision-making. Copyright © 2006 John Wiley & Sons, Ltd. [source] Is the Political Skill Inventory Fit for Personnel Selection?INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 2 2010An Experimental Field Study The political skill inventory (PSI) assesses social effectiveness in organizations by self-reports and has demonstrated strong evidence of validity. It was the purpose of this experimental field study to investigate construct and criterion-related validity of the PSI when used under conditions of personnel selection. In the experimental group (n=102), the instructions asked job incumbents to work on the PSI, a social desirability scale, and a Big-Five personality inventory as if they took part in a personnel selection procedure for a personally very attractive position. Additionally, they were asked to report yearly income. In the control group (n=110), job incumbents were asked to answer the items honestly. As expected, in both conditions, the PSI did not correlate with social desirability, but it correlated positively with extraversion, conscientiousness, and income, and negatively with neuroticism, thus demonstrating construct and incremental criterion-related validity under both conditions. Implications and limitations are discussed. [source] Faking on Personality Measures: Implications for selection involving multiple predictorsINTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1 2009Patrick D. Converse The potential for faking on noncognitive measures in high stakes testing situations remains a concern for many selection researchers and practitioners. However, the majority of previous research examining the practical effects of faking on noncognitive assessments has focused on these measures in isolation, rather than the more common situation in which they are used in combination with other predictors. The present simulation examined the effects of faking on a conscientiousness measure on criterion-related validity, mean performance of those selected, and selection decision consistency when hiring decisions were based on this measure alone vs in combination with two other predictors across a range of likely selection scenarios. Overall, results indicated that including additional predictors substantially reduced , but did not eliminate , the negative effects of faking. Faking effects varied across outcomes and selection scenarios, with effects ranging from trivial to noteworthy even for multiple-predictor selection. Implications for future research and practice are discussed. [source] Integrity Tests and Other Criterion-Focused Occupational Personality Scales (COPS) Used in Personnel SelectionINTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1-2 2001Deniz S. Ones This article focuses on personality measures constructed for prediction of individual differences in particular work behaviors of interest (e.g., violence at work, employee theft, customer service). These scales can generically be referred to as criterion-focused occupational personality scales (COPS). Examples include integrity tests (which aim to predict dishonest behaviors at work), violence scales (which aim to predict violent behaviors at work), drug and alcohol avoidance scales (which aim to predict substance abuse at work), stress tolerance scales (which aim to predict handling work pressures well) and customer service scales (which aim to predict serving customers well). We first review the criterion-related validity, construct validity and incremental validity evidence for integrity tests, violence scales, stress tolerance scales, and customer service scales. Specifically, validities for counterproductive work behaviors and overall job performance are summarized as well as relations with the Big Five personality scales (conscientiousness, emotional stability, openness to experience, agreeableness and extraversion). Second, we compare the usefulness of COPS with traditional, general purpose, adult personality scales. We also highlight the theoretical and practical implications of these comparisons and suggest a research agenda in this area. [source] Job Requirements Biodata as a Predictor of Performance in Customer Service RolesINTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 3 2000Elizabeth Allworth A job requirements approach to biodata item specification, similar to the content-valid job analysis approach developed by Pannone (1984), is used to predict customer service. Applicants rate the extent to which their current and previous jobs involve tasks and behaviours that have been identified through an analysis of the target job. On a sample of 245 employees in an international hotel, the criterion-related validity of job requirements biodata compares favourably with traditional construct-oriented biodata measures of customer service, cognitive ability and personality (Conscientiousness, Agreeableness and Extroversion). The job requirements approach provides a simple, direct and content-valid method of biodata item specification. As the approach can also be tailored for particular jobs or organizations, validity is also potentially optimized. [source] Care dependency of hospitalized children: testing the Care Dependency Scale for Paediatrics in a cross-cultural comparisonJOURNAL OF ADVANCED NURSING, Issue 2 2009Hanan Tork Abstract Title.,Care dependency of hospitalized children: testing the Care Dependency Scale for Paediatrics in a cross-cultural comparison. Aim., This paper is a report of a study to examine the psychometric properties of the Care Dependency Scale for Paediatrics in Germany and Egypt and to compare the care dependency of school-age children in both countries. Background., Cross-cultural differences in care dependency of older adults have been documented in the literature, but little is known about the differences and similarities with regard to children's care dependency in different cultures. Method., A convenience sample of 258 school-aged children from Germany and Egypt participated in the study in 2005. The reliability of the Care Dependency Scale for Paediatrics was assessed in terms of internal consistency and interrater reliability. Factor analysis (principal component analysis) was employed to verify the construct validity. A Visual Analogue Scale was used to investigate the criterion-related validity. Findings., Good internal consistency was detected both for the Arabic and German versions. Factor analysis revealed one factor for both versions. A Pearson's correlation between the Care Dependency Scale for Paediatrics and Visual Analogue Scale was statistically significant for both versions indicating criterion-related validity. Statistically significant differences between the participants were detected regarding the mean sum score on the Care Dependency Scale for Paediatrics. Conclusion., The Care Dependency Scale for Paediatrics is a reliable and valid tool for assessing the care dependency of children and is recommended for assessing the care dependency of children from different ethnic origins. Differences in care dependency between German and Egyptian children were detected, which might be due to cultural differences. [source] Validity of an instrument to measure the impact of valve heart disease on the patient's daily lifeJOURNAL OF CLINICAL NURSING, Issue 7 2007Kátia Melissa Padilha RN Aim., This study was to verify the psychometric properties of the Heart Valve Disease Impact on daily life, an instrument for measuring the impact of illness in the daily life of the heart valve disease patient, related to its construct validity, criterion-related validity and reliability. Methods., One hundred and twenty heart valve disease outpatients were enrolled. Data were submitted to descriptive analysis, factor analysis, Pearson's correlation coefficient and Cronbach's alpha coefficient. Results., The factor analysis generated four factors that explained 58% of the variance in response to the Heart Valve Disease Impact on daily life. Weak to moderate correlation was measured between the Heart Valve Disease Impact on daily life total score and two of its factors and the General Measure of Impact of illness, indicating criterion-related validity. A Cronbach's alpha of 0·74 was measured. Conclusion., The results of the current study confirm both the construct and criterion validity and the internal consistency of the Heart Valve Disease Impact on daily life. Future studies are necessary to confirm its reliability and provide a better understanding of the meaning of the Heart Valve Disease Impact on daily life dimensions, as well as to evaluate its response to health interventions. Relevance to clinical practice., The Heart Valve Disease Impact on daily life could be a useful instrument to measure the impact of heart valve disease and to evaluate the response to health interventions. [source] SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META-ANALYSISPERSONNEL PSYCHOLOGY, Issue 1 2007MICHAEL A. McDANIEL Situational judgment tests (SJTs) are personnel selection instruments that present job applicants with work-related situations and possible responses to the situations. There are typically 2 types of instructions: behavioral tendency and knowledge. Behavioral tendency instructions ask respondents to identify how they would likely behave in a given situation. Knowledge instructions ask respondents to evaluate the effectiveness of possible responses to a given situation. Results showed that response instructions influenced the constructs measured by the tests. Tests with knowledge instructions had higher correlations with cognitive ability. Tests with behavioral tendency instructions showed higher correlations with personality constructs. Results also showed that response instructions had little moderating effect on criterion-related validity. Supplemental analyses showed that the moderating effect of response instructions on construct validity was not due to systematic differences in item content. SJTs have incremental validity over cognitive ability, the Big 5, and over a composite of cognitive ability and the Big 5. [source] |