Home About us Contact
|
Home About us Contact | ||
|
|
||
Construct Validity (construct + validity)
Kinds of Construct Validity Selected AbstractsIMPLICATIONS OF TRAIT-ACTIVATION THEORY FOR EVALUATING THE CONSTRUCT VALIDITY OF ASSESSMENT CENTER RATINGSPERSONNEL PSYCHOLOGY, Issue 1 2002STEPHANIE HAALAND Assessment centers have often been criticized for lacking evidence supporting the construct validity of dimension ratings. This study examines whether the poor convergence of assessment center ratings is a result of correlating ratings from exercises that differ in the extent that behavior relevant to personality traits can be observed. Using data from a promotional assessment center for law enforcement officers (n= 79), the convergence of assessment center ratings was evaluated within the context of the five factor model by comparing the average within-dimension correlation of ratings from exercises that allowed for more opportunity to observe trait-relevant behavior to the average of those involving exercises where there was less opportunity. For each personality trait, ratings from exercises judged by experts to be high in trait-activation potential displayed stronger convergence (mean r= .30) than did ratings from exercises that were low in activation potential for that trait (mean r= .15). Implications for evaluating the construct validity of assessment centers are discussed along with future directions for classifying exercises based on situational similarity. [source] Factorial and Construct Validity of the Revised Short Form Integrative Psychotherapy Alliance Scales for Family, Couple, and Individual TherapyFAMILY PROCESS, Issue 3 2008WILLIAM M. PINSOF PH.D The Integrative Psychotherapy Alliance model brought an interpersonal and systemic perspective to bear on theory, research, and practice on the psychotherapeutic alliance. Questions have been raised about the independence of the theoretical factors in the model and their operationalization in the Individual, Couple, and Family Therapy Alliance Scales. This paper presents results of a confirmatory factor analysis of the scales that delineated at least three distinct interpersonal factors as well as shorter versions of the three scales to facilitate their use in research and practice. The paper also presents the results of a study testing each factor's association with client retention and progress over the first eight sessions in individual and couple therapy. At least two of the interpersonal factors were uniquely associated with progress in individual and couple functioning. Implications of the results for theory, research, practice, and training in individual, couple, and family therapy are elaborated. RESUMEN Validez de constructo y factorial de las versiones cortas revisadas de las escalas de alianza en psicoterapia integradora para la terapia familiar, de pareja e individual El modelo de alianza psicoterapéutica integradora aplicó una perspectiva sistémica e interpersonal en la teoría, la investigación y la práctica de la alianza psicoterapéutica. Se cuestionó la independencia de los factores teóricos en el modelo y su operacionalización en las escalas de alianza en terapia individual, de pareja y familiar. Este artículo presenta resultados de un análisis factorial confirmativo de las escalas que delinearon por lo menos tres factores interpersonales distintos, como también versiones más cortas de las tres escalas para facilitar su uso en la investigación y la práctica. El artículo también presenta los resultados de un estudio que analiza la asociación de cada factor con la fidelización de clientes y la evolución durante las primeras ocho sesiones en terapia individual y de pareja. Por lo menos dos de los factores interpersonales estuvieron asociados exclusivamente con la evolución en el funcionamiento individual y de pareja. Se elaboran las implicancias de los resultados para la teoría, la investigación, la práctica y la capacitación en terapia individual, de pareja y familiar. Palabras clave: alianza, análisis factorial, validez de constructo, evolución/resultado, integración [source] The Algorithmically Structured Systematic Exploration of Subject's State of Mind: II Reliability and Construct ValidityINTERNATIONAL JOURNAL OF APPLIED PSYCHOANALYTIC STUDIES, Issue 4 2007Marie-Noëlle Le Mer Abstract Objective: To investigate the reliability and validity of a newly developed semistructured interview, the Algorithmically Structured Systematic Exploration of Subject's State of Mind (Assess_Mind). Method: Twelve scales have been developed and used to rate 86 Assess_Mind interviews conducted with patients undergoing in vitro fertilization treatment. For each rating scale, we assessed interrater reliability, interviewer effect, and construct validity. In addition, a factor analysis of scales was performed. To study the validity of scales and of the factors yielded by factor analysis, patients were assessed with a psychopathological battery including the Child Project Questionnaire, the State-Trait Anxiety Inventory, the Perceived Stress Scale, and the Ways of Coping Checklist. Results: For 11 of the 12 scales, interrater reliability was fair to excellent. There was no significant interviewer effect affecting any of the scales. In addition, the validity of nine of these 11 scales was demonstrated by their correlations with questionnaires measuring similar constructs. Conclusion: Nine of the Assess_Mind scales appear to have adequate psychometric properties. Copyright © 2007 John Wiley & Sons, Ltd. [source] Situational Tests in Student Selection: An Examination of Predictive Validity, Adverse Impact, and Construct ValidityINTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 4 2002Filip Lievens The Flemish Admission Exam ,Medical and Dental Studies' is comprised of four cognitive ability tests and four situational tests, namely two work samples (i.e., a lecture and a medical text) and two video-based situational judgement tests (i.e., a physician,patient interaction and a medical expert discussion). On the basis of the Admission Exam scores of 941 candidates (359 men, 582 women) this study shows that situational tests significantly can predict better than cognitive ability tests, with lecture and text emerging as significant predictors. When situational tests are combined with cognitive ability tests, there are no mean gender differences. Situational tests also enable us to measure a broader range of constructs. For example, in this study, the personality factor Openness is related to better situational test performance. Overall, this study demonstrates that situational tests may be a useful complement to traditional student selection procedures. [source] On the Construct Validity of Integrity Tests: Individual and Situational Factors as Predictors of Test PerformanceINTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 3 2001Michael D. Mumford Although integrity tests are widely applied in screening job applicants, there is a need for research for examining the construct validity of these tests. In the present study, a theoretical model examining the causes of destructive behavior in organizational settings was used to develop background data measures of individual and situational variables that might be related to integrity test scores. Subsequently, 692 undergraduates were asked to complete these background data scales along with (a) two overt integrity tests , the Reid Report and the Personnel Selection Inventory, and (b) two personality-based measures , the delinquency and socialization scales of the California Psychological Inventory. When scores of these measures were correlated with and regressed on the background data scales, it was found that relevant individual variables, such as narcissism and power motives, and relevant situational variables, such as alienation and exposure to negative peer groups, were related to scores on both types of integrity tests. However, a stronger pattern of validity evidence was obtained for the personality-based measures and, in all cases, situational variables were found to be better predictors than individual variables. The implications of these findings for the validity of inferences drawn from overt and personality-based integrity tests are discussed. [source] Improving Construct Validity With Cognitive Psychology PrinciplesJOURNAL OF EDUCATIONAL MEASUREMENT, Issue 4 2001Susan Embretson Cognitive psychology principles have been heralded as possibly central to construct validity. In this paper, testing practices are examined in three stages: (a) the past, in which the traditional testing research paradigm left little role for cognitive psychology principles, (b) the present, in which testing research is enhanced by cognitive psychology principles, and (c) the future, for which we predict that cognitive psychology's potential will be fully realized through item design. An extended example of item design by cognitive theory is given to illustrate the principles. A spatial ability test that consists of an object assembly task highlights how cognitive design principles can lead to item generation. [source] Psychometric properties of the Chinese version of the Mini-Mental Adjustment to Cancer (MINI-MAC) scalePSYCHO-ONCOLOGY, Issue 6 2003Samuel M.Y. Ho The psychometric properties of a Chinese version of the Mini-Mental Adjustment to Cancer scale (Mini-MAC) were examined among 115 Chinese cancer patients in Hong Kong. The five subscales from the original Mini-MAC (Anxious Preoccupation, Helpless,Hopeless, Fighting Spirit, Fatalism, Cognitive Avoidance) had acceptable internal reliabilities (Cronbach's , ranged from 0.65 to 0.88) and construct validities in our sample. Factor analysis suggested three factors: (1) Negative Emotion (,=0.91) contained items of the Anxious Preoccupation and the Helpless,Hopeless subscales of the original Mini-MAC, (2) Positive Attitude (,=0.77) combined the Fighting Spirit and the Fatalism subscales of the original version, and (3) Cognitive Avoidance (,=0.65) which was identical to the Cognitive Avoidance subscale of the original Mini-MAC. Construct validities of the novel factors were shown by their correlations with HADS Anxiety and Depression scores in the predicted directions. It was concluded that both the 5-factor model from the original Mini-MAC and the 3-factor model from the present study were valid in Hong Kong Chinese cancer patients. The results were discussed in terms of the meaning of the original Mini-MAC factors and cultural differences in coping functions between Chinese and UK cancer patients. Copyright © 2003 John Wiley & Sons, Ltd. [source] Selective Control Assessment of the Lower Extremity (SCALE): development, validation, and interrater reliability of a clinical tool for patients with cerebral palsyDEVELOPMENTAL MEDICINE & CHILD NEUROLOGY, Issue 8 2009EILEEN G FOWLER PhD PT Normal selective voluntary motor control (SVMC) can be defined as the ability to perform isolated joint movement without using mass flexor/extensor patterns or undesired movement at other joints, such as mirroring. SVMC is an important determinant of function, yet a valid, reliable assessment tool is lacking. The Selective Control Assessment of the Lower Extremity (SCALE) is a clinical tool developed to quantify SVMC in patients with cerebral palsy (CP). This paper describes the development, utility, validation, and interrater reliability of SCALE. Content validity was based on review by 14 experienced clinicians. Mean agreement was 91.9% (range 71.4,100%) for statements about content, administration, and grading. SCALE scores were compared with Gross Motor Function Classification System Expanded and Revised (GMFCS-ER) levels for 51 participants with spastic diplegic, hemiplegic, and quadriplegic CP (GMFCS levels I , IV, 21 males, 30 females; mean age 11y 11mo [SD 4y 9mo]; range 5,23y). Construct validity was supported by significant inverse correlation (Spearman's r=-0.83, p<0.001) between SCALE scores and GMFCS levels. Six clinicians rated 20 participants with spastic CP (seven males, 13 females, mean age 12y 3mo [SD 5y 5mo], range 7,23y) using SCALE. A high level of interrater reliability was demonstrated by intraclass correlation coefficients ranging from 0.88 to 0.91 (p<0.001). [source] Development and validation of the Diabetes Obstacles Questionnaire (DOQ) to assess obstacles in living with Type 2 diabetesDIABETIC MEDICINE, Issue 8 2007H. Hearnshaw Abstract Aims To develop and validate an easy-to-use questionnaire to identify obstacles to self management in Type 2 diabetes. Methods The Diabetes Obstacles Questionnaire (DOQ) was developed from earlier research and the literature. It was completed by 180 people with Type 2 diabetes, recruited from 22 general practices in the UK. Responders also completed a quality-of-life questionnaire (ADDQoL) and the Problem Areas in Diabetes (PAID) scale. Results From analysis of the 176 usable questionnaires, 36 items of the original 113 items were deemed redundant. The remaining 77 items were assembled into eight sub-scales covering Medication, Self Monitoring, Knowledge and Beliefs, Diagnosis, Relationships with Health-Care Professionals, Lifestyle Changes, Coping, and Advice and Support. Each sub-scale had a factor structure of no more than three factors, had Cronbach's alpha of more than 0.75, and a Kaiser,Meyer,Olkin of more than 0.75. Each sub-scale correlated significantly with the PAID scale (P < 0.01), demonstrating criterion validity. Construct validity was shown by significant correlation between HbA1c and the sub-scales which relate to managing blood glucose levels: Self Monitoring, Relationship with Health-Care Professionals, Lifestyle Changes and Coping. Construct validity was further shown by significant correlation between QoL scores and Medication, Lifestyle Changes and Coping. Discussion The DOQ, comprising eight sub-scales, is a usable, valid instrument for both clinical and research settings. It helps to identify in detail the obstacles which an individual finds in living with Type 2 diabetes. [source] Validation of the World Health Organization Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): report of results from the Australian siteDRUG AND ALCOHOL REVIEW, Issue 3 2005DAVID A. L. NEWCOMBE Abstract The concurrent, construct, discriminative and predictive validity of the World Health Organization's Alcohol Substance Involvement Screening Test (ASSIST) were examined in an Australian sample. One hundred and fifty participants, recruited from drug treatment (n = 50) and primary health care (PHC) settings (n = 100), were administered a battery of instruments at baseline and a modified battery at 3 months. Measures included the ASSIST; the Addiction Severity Index-Lite (ASI-Lite); the Severity of Dependence Scale (SDS); the MINI International Neuropsychiatric Interview (MINI-Plus); the Rating of Injection Site Condition (RISC); the Drug Abuse Screening Test (DAST); the Alcohol Use Disorders Identification Test (AUDIT); the Revised Fagerstrom Tolerance Questionnaire (RTQ); and the Maudsely Addiction Profile (MAP). Concurrent validity was demonstrated by significant correlations between ASSIST scores and scores from the ASI-lite, SDS, AUDIT and DAST; and significantly greater ASSIST scores for those with diagnoses of abuse or dependence. Construct validity was established by significant correlations between ASSIST scores and measures of risk factors for the development of drug and alcohol problems. Participants diagnosed with attention deficit/hyperactivity disorder or antisocial personality disorder had significantly higher ASSIST scores than those not diagnosed as such. Discriminative validity was established by the capacity of the ASSIST to discriminate between substance use, abuse and dependence. ROC analysis was able to establish cut-off scores for an Australian sample, with suitable specificities and sensitivities for most substances. Predictive validity was demonstrated by similarity in ASSIST scores obtained at baseline and at follow-up. The findings demonstrated that the ASSIST is a valid screening test for psychoactive substance use in individuals who use a number of substances and have varying degrees of substance use. [source] Validation of the alcohol, smoking and substance involvement screening test (ASSIST)ADDICTION, Issue 6 2008Rachel Humeniuk ABSTRACT Aim The concurrent, construct and discriminative validity of the World Health Organization's Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) were examined in a multi-site international study. Participants One thousand and 47 participants, recruited from drug treatment (n = 350) and primary health care (PHC) settings (n = 697), were administered a battery of instruments. Measurements Measures included the ASSIST; the Addiction Severity Index-Lite (ASI-Lite); the Severity of Dependence Scale (SDS); the MINI International Neuropsychiatric Interview (MINI-Plus); the Rating of Injection Site Condition (RISC); the Drug Abuse Screening Test (DAST); the Alcohol Use Disorders Identification Test (AUDIT); the Revised Fagerstrom Tolerance Questionnaire (RTQ); and the Maudsley Addiction Profile (MAP). Findings Concurrent validity was demonstrated by significant correlations between ASSIST scores and scores from the ASI-Lite (r = 0.76,0.88), SDS (r = 0.59), AUDIT (r = 0.82) and RTQ (r = 0.78); and significantly greater ASSIST scores for those with MINI-Plus diagnoses of abuse or dependence (P < 0.001). Construct validity was established by significant correlations between ASSIST scores and measures of risk factors for the development of drug and alcohol problems (r = 0.48,0.76). Discriminative validity was established by the capacity of the ASSIST to discriminate between substance use, abuse and dependence. Receiver operating characteristic (ROC) analysis was used to establish cut-off scores with suitable specificities (50,96%) and sensitivities (54,97%) for most substances. Conclusions The findings demonstrated that the ASSIST is a valid screening test for identifying psychoactive substance use in individuals who use a number of substances and have varying degrees of substance use. [source] Construct validity and generalizability of the Carver,White behavioural inhibition system/behavioural activation system scalesEUROPEAN JOURNAL OF PERSONALITY, Issue 5 2001Luigi Leone The factorial structure and invariance of the BIS/BAS scales of Carver and White were assessed across three samples from the USA, UK, and Italy. Previous validation studies of the BIS/BAS scales relied on individual samples drawn from English-speaking populations only and failed to formally assess generalizability. The current study shows that the four-factor structure proposed by Carver and White,i.e. one BIS and three BAS facets,achieved satisfactory psychometric properties in all three samples and that measurement invariance was obtained across countries. Latent mean differences due to gender and country were also investigated. Theoretical issues concerning the validity of the BIS/BAS scales are addressed. Copyright © 2001 John Wiley & Sons, Ltd. [source] A Self-Report Measure of Clinicians' Orientation toward Integrative MedicineHEALTH SERVICES RESEARCH, Issue 5p1 2005An-Fu Hsiao Objective. Patients in the U.S. often turn to complementary and alternative medicine (CAM) and may use it concurrently with conventional medicine to treat illness and promote wellness. However, clinicians vary in their openness to the merging of treatment paradigms. Because integration of CAM with conventional medicine can have important implications for health care, we developed a survey instrument to assess clinicians' orientation toward integrative medicine. Study Setting. A convenience sample of 294 acupuncturists, chiropractors, primary care physicians, and physician acupuncturists in academic and community settings in California. Data Collection Methods. We used a qualitative analysis of structured interviews to develop a conceptual model of integrative medicine at the provider level. Based on this conceptual model, we developed a 30-item survey (IM-30) to assess five domains of clinicians' orientation toward integrative medicine: openness, readiness to refer, learning from alternate paradigms, patient-centered care, and safety of integration. Principal Findings. Two hundred and two clinicians (69 percent response rate) returned the survey. The internal consistency reliability for the 30-item total scale and the five subscales ranged from 0.71 to 0.90. Item-scale correlations for the five subscales were higher for the hypothesized subscale than other subscales 75 percent or more of the time. Construct validity was supported by the association of the IM-30 total scale score (0,100 possible range, with a higher score indicative of greater orientation toward integrative medicine) with hypothesized constructs: physician acupuncturists scored higher than physicians (71 versus 50, p<.001), dual-trained practitioners scored higher than single-trained practitioners (71 versus 62, p<.001), and practitioners' self-perceived "integrativeness" was significantly correlated (r=0.60, p<.001) with the IM-30 total score. Conclusion. This study provides support for the reliability and validity of the IM-30 as a measure of clinicians' orientation toward integrative medicine. The IM-30 survey, which we estimate as requiring 5 minutes to complete, can be administered to both conventional and CAM clinicians. [source] Development of a Scale to Measure Patients' Trust in Health InsurersHEALTH SERVICES RESEARCH, Issue 1 2002Article first published online: 18 MAR 200 Objective.,To develop a scale to measure patients' trust in health insurers, including public and private insurers and both indemnity and managed care. A scale was developed based on our conceptual model of insurer trust. The scale was analyzed for its factor structure, internal consistency, construct validity, and other psychometric properties. Data Sources/Study Setting.,The scale was developed and validated on a random national sample (n=410) of subjects with any type of insurance and further validated and used in a regional random sample of members of an HMO in North Carolina (n=1152). Study Design.,Factor analysis was used to uncover the underlying dimensions of the scale. Internal consistency was assessed by Cronbach's alpha. Construct validity was established by Pearson or Spearman correlations and t tests. Data Collection.,Data were collected via telephone interviews. Principal Findings.,The 11-item scale has good internal consistency (alpha=0.92/0.89) and response variability (range=11,55, M=36.5/37.0, SD=7.8/7.0). Insurer trust is a unidimensional construct and is related to trust in physicians, satisfaction with care and with insurer, having enough choice in selecting health insurer, no prior disputes with health insurer, type of insurer, and desire to remain with insurer. Conclusions.,Trust in health insurers can be validly and reliably measured. Additional studies are required to learn more about what factors affect insurer trust and whether differences and changes in insurer trust affect actual behaviors and other outcomes of interest. [source] Reliability and validity of the Junior Temperament and Character InventoryINTERNATIONAL JOURNAL OF METHODS IN PSYCHIATRIC RESEARCH, Issue 4 2001Klaus Schmeck Abstract The Junior Temperament and Character Inventory (JTCI) was developed to assess the temperament (,novelty seeking', ,harm avoidance', ,reward dependence', ,persistence') and character (,self-directedness', ,cooperativeness', ,self-transcendence') dimensions of Cloninger's biosocial model of personality in children and adolescents. The psychometric properties of the JTCI are presented. We used the German version of JTCI in a clinical sample of 188 adolescent psychiatric patients (aged 12 to 18 years) and in a non-referred sample of 706 German adolescents of the same age range. Aspects of reliability and validity are discussed. We subjected the JTCI to confirmatory factor analysis and were able to replicate the temperament and character scales of the original TCI. The internal consistency of the scales was satisfactory with the exception of ,reward dependence' and ,persistence'. Construct validity was supported by good correspondence of JTCI dimensions with related constructs. Psychometric properties of the German version of JTCI are very promising. Results yield strong support for Cloninger's psychobiological theory. Copyright © 2001 Whurr Publishers Ltd. [source] Insomnia Severity Index: psychometric properties with Chinese community-dwelling older peopleJOURNAL OF ADVANCED NURSING, Issue 10 2010Doris S.F. Yu yu d.s.f. (2010) Insomnia Severity Index: psychometric properties with Chinese community-dwelling older people. Journal of Advanced Nursing,66(10), 2350,2359. Abstract Aim., This paper is a report of a study to evaluate the psychometric properties of the Chinese version of the Insomnia Severity Index. Background., Despite the high prevalence of insomnia in older people and its detrimental impact on well-being and healthcare costs, this problem is almost always undetected and consequently under-treated. The Insomnia Severity Index is psychometrically sound in measuring perceived insomnia severity. However, it has had very limited application in non-White populations. Methods., An instrument validation study was carried out between October 2008 and April 2009. The Insomnia Severity Index was translated into Chinese using Brislin's model and administered to a convenience sample of 585 older Chinese people recruited from three community centres for elders. Other instruments were also administered, including the Chinese version of the Pittsburgh Sleep Quality Index and the Geriatric Depression Scale. Results., Cronbach's alpha of the Chinese version of the Insomnia Severity Index was 0·81, with item-to-total correlations in the range of 0·34,0·67. Construct validity was supported by its moderate relationship with the Chinese Pittsburgh Sleep Quality Index and sleep efficiency. The Chinese version of the Insomnia Severity Index also indicated more severe level of insomnia in older people who reported depressed mood on the Geriatric Depression Scale. Discriminant validity was supported as the Chinese version of the Insomnia Severity Index could discriminate poorer sleepers from normal sleepers. Exploratory factor analysis identified a two-factor structure for the Chinese version of the Insomnia Severity Index in measuring the severity and impacts of insomnia on the Chinese older people. Conclusion., The Chinese version of the Insomnia Severity Index is a culturally-relevant and psychometrically-sound instrument for assessing severity and impact of insomnia in Chinese community-dwelling older people. Nurses can use this tool to assess older people's perceptions of insomnia. [source] Trust in Nurses Scale: construct validity and internal reliability evaluationJOURNAL OF ADVANCED NURSING, Issue 3 2010Laurel E. Radwin radwin l.e. & cabral h.j. (2010) Trust in Nurses Scale: construct validity and internal reliability evaluation. Journal of Advanced Nursing66(3), 683,689. Abstract Aim., This paper is a report of the continued psychometric evaluation of the Trust in Nurses Scale. Background., Qualitative analyses indicate that trust in nurses is critically important to adult patients. Instruments that distinctively measure this concept are lacking. A middle-range theory of patient-centred nursing care provided the theoretical basis for the Trust in Nurses Scale. Content validity was assessed by an expert panel and patient interviews. Construct validity and reliability were found acceptable using multi-trait/multi-item analysis techniques. These findings were previously reported. Methods., Construct validity and reliability of the Trust in Nurses Scale was assessed in 2007 using data collected during 2004,2005 from 187 hospitalized patients in a haematology-oncology setting. Trust in nurses (the latent factor) was operationalized by five items (manifest variables) using confirmatory factor analyses. Fit statistics included comparative fit index, Tucker-Lewis Index, root mean square error of approximation and the standardized root mean square residual. Internal consistency reliability was assessed using coefficient alpha. Findings., Both a five-item and a four-item version demonstrate acceptable psychometric properties. The five-item version met three fit statistics criteria. Fifty-nine per cent of the variance was explained. A four-item version met all fit statistics criteria. Sixty-six per cent of the variance was explained. Acceptable internal consistency reliability was found for both versions. Conclusion., Previous psychometric testing of the Trust in Nurses Scale provided evidence of the instrument's reliability, content validity and construct validity. The presented analyses further support construct validity. Thus, cumulative findings indicate that the instrument measures with a few items the underlying concept of trust. [source] Reliability and Validity of Prehospital Case Finding for Depression and Cognitive ImpairmentJOURNAL OF AMERICAN GERIATRICS SOCIETY, Issue 4 2009Manish N. Shah MD OBJECTIVES: To evaluate the test,retest reliability, the concurrent criterion validity, and the construct validity of prehospital, emergency medical service (EMS) case finding for depression and cognitive impairment in older adults. DESIGN: Cross-sectional study. SETTING: Prehospital EMS system and hospital emergency department. PARTICIPANTS: EMS providers and community-dwelling older adult (aged ,60) patients. INTERVENTIONS: Case finding instruments for depression (Patient Health Questionnaire-2; PHQ-2) and cognitive impairment (Six-Item Screener). MEASUREMENTS: The reliability and validity of these instruments. RESULTS: Moderate test,retest reliability was found for prehospital application of the PHQ-2 (kappa=0.50) and Six-Item Screener (kappa=0.52), fair concurrent criterion validity for depression (kappa=0.36), and slight to fair concurrent criterion validity for cognitive impairment (kappa=0.11,0.23). Construct validity was demonstrated using the Multitrait-Multimethod Matrix. CONCLUSION: Moderate test,retest reliability and construct validity were demonstrated for prehospital case finding by EMS providers for cognitive impairment and depression using these instruments. Slight to fair concurrent criterion validity was found, a result that methodological limitations could explain. These findings provide additional support for the concept of using EMS providers to detect older adults at risk for these conditions. Further work is needed to confirm the validity and effectiveness of prehospital screening before such programs are implemented. [source] Validation of the Chinese version of the Satisfaction with the Nursing Home InstrumentJOURNAL OF CLINICAL NURSING, Issue 12 2006Linda YK Lee MNurs Aim., To assess the psychometric properties of the Chinese version of the Satisfaction with the Nursing Home Instrument. Background., Resident's satisfaction has been regarded by the literature as a gold standard for quality of nursing home care. Accurate assessment of resident's satisfaction can provide valuable information for implementation of quality nursing home care. However, there is not a validated Chinese tool to serve the purpose. Design., A cross-sectional descriptive survey design. Methods., Content validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was assessed by the use of expert panel. Construct validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was determined by assessing the correlation between satisfaction with other theoretically related constructs. Internal consistency and stability of the Chinese version of the Satisfaction with the Nursing Home Instrument were determined by Cronbach's method and two-week test,retest reliability. The six-factor structure of the Chinese version of the Satisfaction with the Nursing Home Instrument was assessed by confirmatory factor analysis. Testing was performed on a cluster sample of 330 residents from 16 nursing homes in Hong Kong. Results., The Chinese version of the Satisfaction with the Nursing Home Instrument demonstrated good content validity by having content validity index of 0·93. High construct validity of the Chinese version of the Satisfaction with the Nursing Home Instrument was supported by its significant correlation with depression (r = ,0·42, P = 0·000), health-related quality of life (physical component) (r = 0·16, P = 0·042), health-related quality of life (mental component) (r = 0·41, P = 0·000) and global quality of care (r = 0·49, P = 0·000). The Chinese version of the Satisfaction with the Nursing Home Instrument demonstrated satisfactory internal consistency and good stability by having Cronbach's alpha of 0·79 and intra-class correlation coefficient of 0·94, respectively. The six-factor structure of the Chinese version of the Satisfaction with the Nursing Home Instrument was not fully supported by confirmatory factor analysis. Conclusions., The Chinese version of the Satisfaction with the Nursing Home Instrument is a useful instrument for assessing satisfaction of cognitively intact Chinese nursing home residents. Findings provided initial evidence on its validity and reliability. Further empirical testing is recommended to explore its factor structure. Relevance to clinical practice., The Chinese version of the Satisfaction with the Nursing Home Instrument can provide guidance to enhance delivery of high-quality nursing home care for the Chinese population. [source] Willingness to pay for a hearing aid: comparing the payment scale and open-ended questionJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 1 2009Janneke P. C. Grutters MSc Abstract Rationale & objectives, Different question formats elicit different willingness-to-pay (WTP) results, but there is no consensus on which method elicits the most valid WTP. In spite of the methodological controversies, WTP is a potentially valuable tool in health economics to value health services. Our general objective was to provide additional evidence on the validity of two WTP elicitation formats: the open-ended question and the payment scale. Methods, We elicited WTP for a hearing aid among hearing aid users (n = 108), using both a payment scale and an open-ended question. We compared the results from both formats. We tested criterion validity by comparing both formats with the actual out-of-pocket payment. Construct validity was tested by examining whether WTP was consistent with positive income elasticity. Results, The WTP results elicited with the payment scale and open-ended question were not statistically significantly different. Both formats showed good criterion validity, although the open-ended question showed a stronger association with the actual out-of-pocket payment. The open-ended format showed better construct validity, as it was influenced by family income. Conclusion, The results of the present study showed that the open-ended question was more valid than the payment scale question. We, therefore, recommend that in future WTP studies on hearing aids the open-ended question is used to directly elicit WTP values. The same recommendation may apply to other studies where respondents are familiar with costs or payments for the intervention under evaluation. [source] The ComFor: an instrument for the indication of augmentative communication in people with autism and intellectual disabilityJOURNAL OF INTELLECTUAL DISABILITY RESEARCH, Issue 9 2006I. Noens Abstract Background The ComFor (Forerunners in Communication) is an instrument to explore underlying competence for augmentative communication. More specifically, it measures perception and sense-making of non-transient forms of communication at the levels of presentation and representation. The target group consists primarily of individuals with autism and intellectual disability (ID) without or with only limited verbal communication. The ComFor is suitable for children and adults with a developmental level between 12 and 60 months. This paper describes the theoretical framework and structure of the ComFor, the results of a study on its psychometric properties and its clinical uses. Method The ComFor was tested on a sample of 623 children and adults from the Netherlands and Flanders: a group with autism and ID (n = 310); a group with ID without autism (n = 174); and a control group of typically developing children (n = 139). Results The data generally support the reliability and validity of the ComFor. Internal consistency, inter-rater and test,retest reliability were found to be good. Construct validity (internal structure, convergent and divergent patterns) was established in different ways. The criterion-related validity has yet to be established, as predictive data are not available at the moment. Conclusion Taken together, the results indicate that the ComFor is a promising instrument to explore underlying competence for augmentative communication. Areas for future research are outlined and the clinical relevance is discussed. [source] The Self-Injury Questionnaire: evaluation of the psychometric properties in a clinical populationJOURNAL OF PSYCHIATRIC & MENTAL HEALTH NURSING, Issue 2 2006E. E. SANTA MINA rn ba baan msc phd This paper presents the findings, from a clinical study, on the reliability and validity of a new measure for intentions in self-harm behaviour, the Self-Injury Questionnaire (SIQ). Eighty-three patients, who had presented to an emergency department with an episode of self-harm/suicidal behaviour, were given the SIQ as part of a battery of measures to evaluate differentiation in self-harm intentions based upon a history of childhood physical and/or sexual abuse. The internal consistency for the total scale was strong (, = 0.83). Construct validity demonstrated significant correlations with standardized measures. A principle component analysis of responses yielded a five-factor solution with ,affect regulation' items loading on the first factor. Cronbach's alphas were adequate for each subscale (, = 0.72,0.77). These preliminary findings indicate that the SIQ is a valid and reliable measure for research in an acute self-harming population. [source] Validation of a Hebrew Version of the Oral Health Impact Profile 14JOURNAL OF PUBLIC HEALTH DENTISTRY, Issue 2 2004Daniel Kushnir DMD Abstract Objective: This study determined the validity of a Hebrew version of the Oral Health Impact Profile in a cross-sectional study of a general dental practice in Israel. Methods: The original English version of a short-form oral health impact profile (OHIP-14) was translated into Hebrew using the back-translation technique. Participants were interviewed and examined clinically by a calibrated dentist. Information on the subjects' sociodemographic background and oral health conditions was collected. Results: A total of 142 persons were interviewed and clinically examined. The Cronbach's alpha and the standardized item alpha for OHIP-14 were both 0.88. Cronbach's alpha of the translated OHIP-14 subscales ranged from 0.48 to 0.76. Construct validity of the translated Hebrew version was supported by the finding that the total OHIP score correlated with the number of decayed teeth, missing teeth, need for prosthodontic treatment, and pattern of dental attendance. Participants with oral pain were more likely to report impact on one of the OHIP subscales and to have more impacts than participants who were pain free. Conclusions: The Hebrew version of OHIP-14 presented acceptable validity and reliability. Further research is needed to assess the value of this measure in Israel. [source] Validation of a brief symptom questionnaire (ReQuest in Practice) for patients with gastro-oesophageal reflux diseaseALIMENTARY PHARMACOLOGY & THERAPEUTICS, Issue 9 2008G. RUBIN Summary Background, A clinical need exists for a means of assessing symptom control in patients with gastro-oesophageal reflux disease. The ReQuest questionnaire has been extensively validated for symptom assessment in both erosive and non-erosive gastro-oesophageal reflux disease but was designed for research purposes. We derived a shorter version (ReQuest in Practice) that would be more convenient for clinical practice. Aim, To validate ReQuest in Practice in patients suffering from gastro-oesophageal reflux disease. Methods, Multicentre, non-interventional, crossover comparison. Patients completed ReQuest in Practice followed by ReQuest or vice versa. Before and after a planned endoscopy, patients completed the health-related quality of life questionnaire GERDyzer. Internal consistency and the Intraclass Correlation Coefficient were calculated. Construct validity was evaluated by correlation with ReQuest and GERDyzer. Results, There was high internal consistency of ReQuest in Practice (Cronbach's alpha: 0.9) and a high Intraclass Correlation Coefficient of 0.99. The measurement error of ReQuest in Practice was 4.1. High correlation between ReQuest in Practice and ReQuest (Spearman correlation coefficient: 0.9) and GERDyzer (Spearman correlation coefficient: 0.8) demonstrated construct validity. Conclusions, ReQuest in Practice was proven to be valid and reliable. Its close correlation with ReQuest makes it a promising tool to guide the clinical management of patients across the full spectrum of both erosive and non-erosive gastro-oesophageal reflux disease. [source] Validation of a 7-point Global Overall Symptom scale to measure the severity of dyspepsia symptoms in clinical trialsALIMENTARY PHARMACOLOGY & THERAPEUTICS, Issue 4 2006S. J. O. VELDHUYZEN VAN ZANTEN Summary Background, Currently there is no consensus on the optimal method to measure the severity of dyspepsia symptoms in clinical trials. Aim, To validate the 7-point Global Overall Symptom scale. Methods, The Global Overall Symptom scale uses a 7-point Likert scale ranging from 1 = no problem to 7 = a very severe problem. Validation was performed in two randomized-controlled trials (n = 1121 and 512). Construct validity: Global Overall Symptom was compared with the Quality of Life in Reflux And Dyspepsia, Gastrointestinal Symptom Rating Scale, Reflux Disease Questionnaire and 10 specific symptoms using Spearman correlation coefficients. Test,retest reliability: The Intraclass Correlation Coefficient was calculated for patients with stable dyspepsia defined by no change in Overall Treatment Effect score over two visits. Responsiveness: effect size and standardized response mean were also calculated. Results, Construct validity: Change in Global Overall Symptom score correlated significantly with Quality of Life for Reflux And Dyspepsia, Gastrointestinal Symptom Rating Scale, Reflux Disease Questionnaire and specific symptoms (all P < 0.0002). Reliability: The Intraclass Correlation Coefficient was 0.62 (n = 205) and 0.42 (n = 270). Responsiveness: There was a positive correlation between change in Global Overall Symptom and change in symptom severity. The effect size and standardized response mean were 1.1 and 2.1, respectively. Conclusion, The Global Overall Symptom scale is a simple, valid outcome measure for dyspepsia treatment trials. [source] International validation of ReQuest in patients with endoscopy-negative gastro-oesophageal reflux diseaseALIMENTARY PHARMACOLOGY & THERAPEUTICS, Issue 8 2004K. D. Bardhan Summary Background :,Reflux Questionnaire (ReQuest), a newly developed gastro-oesophageal reflux disease-sensitive scale, can be used to reliably evaluate the effect of treatment on gastro-oesophageal reflux disease symptoms. Aim :,International validation of this scale, in patients suffering from endoscopy-negative gastro-oesophageal reflux disease. Methods :,In this open, multicentre and multinational clinical trial 840 endoscopy-negative gastro-oesophageal reflux disease patients received pantoprazole 20 mg daily for 28 days. The long and short versions of ReQuest were completed both in the pre-treatment and treatment phases. For scale development an item reduction analysis was performed. Internal consistency, test,retest reliability and responsiveness were calculated for psychometric analysis. Construct validity was evaluated by comparison with the Gastrointestinal Symptom Rating Scale and the Psychological General Well-being questionnaire by means of correlation coefficients. Results :,Factor analyses confirmed the content validity of both long and short version of ReQuest. Psychometric calculations proved high internal consistency (Cronbach's alpha: 0.9), test,retest reliability [Intraclass Correlation Coefficient: 0.9 (long vs. long) and 0.8 (short vs. short)], and responsiveness (Responsiveness Index 320.3) of the scale, for which also good construct validity was achieved (correlation coefficient: Gastrointestinal Symptom Rating Scale ,0.6; Psychological General Well-being ,0.4). Conclusion :,ReQuest proved valid, reliable, and responsive in this multinational clinical trial to evaluate treatment response in endoscopy-negative gastro-oesophageal reflux disease patients. [source] The reliability and validity of a matrix to assess the completed reflective personal development plans of general practitionersMEDICAL EDUCATION, Issue 4 2006Chris Roberts Introduction, We wished to determine whether assessors could make reliable and valid judgements about the quality of completed reflective personal development plans (PDPs) for the purpose of accrediting UK general practitioners (GPs) for a postgraduate education allowance using a marking matrix, and secondly, to plan a feasible model of PDP assessment in the context of forthcoming GP appraisal/revalidation that would overcome the main sources of error identified from this study. Methods, Within generalisability theory, a variance components analysis on PDP scores estimated reliability and the effect on them of varying, for example, the number of assessors. We investigated the construct validity of the matrix through its internal consistency and detection of differences in the quality of PDPs. Results, For a single PDP and one assessor, 37.6% of the variance in scores was due to true differences in the quality of the PDP. Between 5 and 7 PDP assessors are needed to achieve summative reliability of greater than 0.8. While increasing the number of judges is important, reliability could also be improved by addressing assessor subjectivity. Construct validity was demonstrated, as the matrix distinguished between good, satisfactory and poor PDPs, and it had good internal consistency. Conclusion, PDP assessment has reasonable summative characteristics for the purpose of assessing GPs' reflective continuing professional development. If doctors could include their PDPs within their revalidation folders as evidence of their reflections on pursuing better clinical performance, we have described a reliable, valid and feasible method of external assessment. [source] Parkinson's disease-cognitive rating scale: A new cognitive scale specific for Parkinson's diseaseMOVEMENT DISORDERS, Issue 7 2008Javier Pagonabarraga MD Abstract Cognitive defects associated with cortical pathology may be a marker of dementia in Parkinson's disease (PD). There is a need to improve the diagnostic criteria of PD dementia (PDD) and to clarify the cognitive impairment patterns associated with PD. Current neuropsychological batteries designed for PD are focused on fronto-subcortical deficits but are not sensitive for cortical dysfunction. We developed a new scale, the Parkinson's Disease-Cognitive Rating Scale (PD-CRS), that was designed to cover the full spectrum of cognitive defects associated with PD. We prospectively studied 92 PD patients [30 cognitively intact (CogInt), 30 mild cognitive impairment (MCI), 32 PDD] and 61 matched controls who completed the PD-CRS and neuropsychological tests assessing the cognitive domains included in the PD-CRS. Acceptability, construct validity, reliability, and the discriminative properties of the PD-CRS were examined. The PD-CRS included items assessing fronto-subcortical defects and items assessing cortical dysfunction. Construct validity, test-retest and inter-rater reliability of PD-CRS total scores showed an intraclass correlation coefficient >0.70. The PD-CRS showed an excellent test accuracy to diagnose PDD (sensitivity 94%, specificity 94%). The PD-CRS total scores and confrontation naming item scores-assessing "cortical" dysfunction,independently differentiated PDD from non-demented PD. Alternating verbal fluency and delayed verbal memory independently differentiated the MCI group from both controls and CogInt. The PD-CRS appeared to be a reliable and valid PD-specific battery that accurately diagnosed PDD and detected subtle fronto-subcortical deficits. Performance on the PD-CRS showed that PDD is characterized by the addition of cortical dysfunction upon a predominant and progressive fronto-subcortical impairment. © 2008 Movement Disorder Society [source] Assessment of psychiatric complications in Parkinson's disease: The SCOPA-PCMOVEMENT DISORDERS, Issue 15 2007Martine Visser PhD Abstract The objective of this study was to develop a clinimetric sound scale that addresses both psychotic and compulsive complications in Parkinson's disease (PD). The SCales for Outcomes in PArkinson's disease-Psychiatric Complications (SCOPA-PC) was developed by modifying the items of the Parkinson Psychosis Rating Scale (PPRS) and including an item on compulsive behavior in PD. To evaluate the validity of the SCOPA-PC, 106 PD patients were assessed. A subsample of 43 patients was assessed for interrater and test,retest reliability. Construct validity was evaluated using the Neuropsychiatric Inventory (NPI) and the South Oaks Gambling Scale (SOGS). Interrater and test,retest reliability for the total score was 0.95 and 0.91 (intraclass correlation coefficient), respectively. For the items, the interrater reliability ranged from 0.62 to 0.96 (weighted kappa) and the test,retest reliability ranged from 0.54 to 0.88 (weighted kappa). Cronbach's alpha was 0.68. The correlation between the SCOPA-PC total score and the NPI was 0.41. The correlation between SCOPA-PC items and NPI items that addressed similar constructs ranged from 0.34 to 0.68, whereas the correlation between the item on compulsive behavior and the SOGS was 0.49. In conclusion, the SCOPA-PC is a reliable, valid, and easily-administered semistructured questionnaire for both psychotic and compulsive complications in PD. © 2007 Movement Disorder Society [source] Reliability, validity and responsiveness of a new leisure index: The Patient-Specific Leisure Scale (PSLS)MUSCULOSKELETAL CARE, Issue 3 2009Ingegerd Wikström Abstract Objectives:,To investigate the reliability, validity and responsiveness of a new Patient-Specific Leisure Scale (PSLS), constructed to identify goals and outcomes for individual patients with rheumatoid arthritis (RA). Methods:,Forty-nine patients with RA were used to evaluate test,retest reliability, and 100 consecutive RA patients were used for construct validity. Twenty-five RA patients, commencing with treatment on tumour necrosis factor (TNF) inhibitors, were evaluated before the start and after three months of therapy, to test responsiveness. The most important leisure activity (as judged by the patients) was used when evaluating reliability and validity. The perceived difficulty with each activity was scored from 0 to 10 (0 = able to perform activity without difficulty, 10 = unable to perform activity). Results:,Test,retest reliability indicated a good agreement (0.62,0.87) using weighted kappa. Construct validity was demonstrated by modest positive correlation between leisure activity and Health Assessment Questionnaire (HAQ) (rs = 0.27, p = 0.005) visual analogue scale (VAS) pain (rs = 0.28, p = 0.004) VAS global (rs = 0.22, p = 0.027), VAS fatigue (rs = 0.24, p = 0.013), joint index of 28 swollen joints (rs = 0.22, p = 0.027) and negative correlations with short-form-36 (SF-36) physical functioning (rs = ,0.18, p = 0.008), bodily pain (rs = ,0.31, p < 0.001), general health (rs = ,0.23, p = 0.019), vitality (rs = ,0.31, p < 0.001), social function (rs = ,0.24, p = 0.016) and role-emotional (rs = ,0.28, p = 0.005). Mean improvement for the most important leisure activity was 1.36, (p = 0.036, 95% confidence interval 0.10,2.62). Standardized response mean and effect size for the most important activity in PSLS was 1.05 and 0.72, respectively, and for HAQ 0.34 and 0.28, respectively. Conclusions:,PSLS appears to be feasible, reliable, valid and responsive for measuring leisure activities in RA. It provides both an individual result which is useful in clinical work, and results at a group level. Copyright © 2009 John Wiley & Sons, Ltd. [source] | ||||||||||||||||||||||||||||||||||||||||