Home About us Contact
|
Home About us Contact | ||
|
|
||
Convergent Validity (convergent + validity)
Kinds of Convergent Validity Selected AbstractsValidity Study of Kessler's Psychological Distress Scales Conducted Among Patients Admitted to French Emergency Department for Alcohol Consumption,Related DisordersALCOHOLISM, Issue 7 2010Benjamin Arnaud Background:, Alcohol-related disorders (ARD) encountered in emergency departments (ED) have a high prevalence and are underestimated. It is necessary to provide professionals with a tool to identify patients in whom there is a risk that alcohol-related and mental health problems may be associated. Kessler's K6/10 psychological distress scales are fast, easy-to-use, and have been shown to achieve a good performance in the identification of psychological distress associated with ARD. Aim:, The aim of this study was to evaluate the psychometric properties of the Kessler scales, version 6 and 10, with a sample of patients admitted to EDs for alcohol consumption. Methods:, On the day after their admission, with a zero "blood" alcohol concentration, 71 patients were randomly assigned to be assessed using 6 or 10 items version. The internal consistency and factor structure of the K6/10 versions were examined. Convergent validity was measured using the Hospital Anxiety and Depression Scale (HADS) and the Hamilton Depression Rating Scale (HDRS). Results:, The prevalence of psychological distress in our sample was approximately 60%. The selected threshold scores were 10 for K6 (Sensitivity: 0.92; Specificity: 0.62) and 14 for K10 (Sensitivity: 0.95; Specificity: 0.54). The Cronbach coefficients for K6 and K10 were 0.76 and 0.84, respectively. The factor analyses indicated the multidimensional nature of K6/10. The 2 versions, containing 6 and 10 items respectively, correlated better with the HADS (0.83 and 0.70, respectively) than with the HDRS (0.51 and 0.49, respectively). The areas under the ROC Curve indicated a high level of accuracy for both the K6 (0.87) and the K10 (0.77). The difference was not statistically significant. Conclusions:, This study confirms the good psychometric characteristics of Kessler's psychological distress scale. Even though similar performances were observed for K6/10, the brevity of the K6 makes it more suitable for use in EDs. [source] Assessing and Documenting General Competencies in Otolaryngology Resident Training Programs,THE LARYNGOSCOPE, Issue 5 2006Rick M. Roark PhD Abstract Objectives: The objectives of this study were to: 1) implement web-based instruments for assessing and documenting the general competencies of otolaryngology resident education, as outlined by the Accreditation Council of Graduate Medical Education (ACGME); and 2) examine the benefit and validity of this online system for measuring educational outcomes and for identifying insufficiencies in the training program as they occur. Methods: We developed an online assessment system for a surgical postgraduate education program and examined its feasibility, usability, and validity. Evaluations of behaviors, skills, and attitudes of 26 residents were completed online by faculty, peers, and nonphysician professionals during a 3-year period. Analyses included calculation and evaluation of total average performance scores of each resident by different evaluators. Evaluations were also compared with American Board of Otolaryngology-administered in-service examination (ISE) scores for each resident. Convergent validity was examined statistically by comparing ratings among the different evaluator types. Results: Questionnaires and software were found to be simple to use and efficient in collecting essential information. From July 2002 to June 2005, 1,336 evaluation forms were available for analysis. The average score assigned by faculty was 4.31, significantly lower than that by nonphysician professionals (4.66) and residents evaluating peers (4.63) (P < .001), whereas scores were similar between nonphysician professionals and resident peers. Average scores between faculty and nonphysician groups showed correlation in constructs of communication and relationship with patients, but not in those of professionalism and documentation. Correlation was observed in respect for patients but not in medical knowledge between faculty and resident peer groups. Resident ISE scores improved in the third year of the study and demonstrated high correlation with faculty perceptions of medical knowledge (r = 0.65, P = .007). Conclusions: Compliance for completion of forms was 97%. The system facilitated the educational management of our training program along multiple dimensions. The small perceptual differences among a highly selected group of residents have made the unambiguous validation of the system challenging. The instruments and approach warrant further study. Improvements are likely best achieved in broad consultation among other otolaryngology programs. [source] The Finnish version of The National Institutes Of Health Chronic Prostatitis Symptom Index correlates well with the visual pain scale: translation and results of a modified linguistic validation studyBJU INTERNATIONAL, Issue 3 2003M.J. Leskinen Authors from Finland have assessed a version in their language of the National Institutes of Health-Chronic Prostatitis Symptom Index; they found that their translated version was valid and easily understandable in the management of the symptoms of chronic pelvic pain syndrome. They felt it should be used as a primary outcome measure in studies with these patients. There are three papers in this issue relating to the effect of drugs on LUTS; the first of these is a pooled analysis of three double-blind placebo-controlled studies into the safety and efficacy of the 10 mg dose of alfuzosin. The second evaluates the effect on quality-of-life issues of treatment with dutasteride. Finally, authors from Australia compare the effect of a Serenoa repens extract with placebo for LUTS. OBJECTIVES To provide a fluent and easily comprehensible Finnish version of the National Institutes of Health Chronic Prostatitis Symptom Index (NIH-CPSI) and to study its linguistic validity and correlation with a visual pain scale (VAS). PATIENTS AND METHODS The double-back translation method with two interim modifications was used to produce the Finnish version of the NIH-CPSI. The validity was tested by presenting the questionnaire to 155 men with clinically confirmed chronic pelvic pain syndrome (CPPS) and 12 controls with no previous urological symptoms. Convergent validity of the NIH-CPSI was tested by determining the correlation between the Finnish NIH-CPSI and VAS. Patients' and urologists' opinions about the utility of the Finnish NIH-CPSI were also reviewed. RESULTS The total Finnish NIH-CPSI scores and the pain domain and voiding symptom domain scores differed significantly (P < 0.001) between the groups, suggesting good discriminant validity of the symptom index. The NIH-CPSI scores correlated well with the VAS (Pearson's correlation 0.76). The preciseness and comprehensibility of the questionnaire were consistently evaluated to be ,good' or ,excellent' both by patients and urologists. CONCLUSIONS The Finnish version of the NIH-CPSI is valid and easily comprehensible for measuring CPPS symptoms. In addition, it provides good discriminant and convergent validity in distinguishing CPPS symptoms and should be used as primary outcome measure in CPPS studies. [source] Self-perceived health and burden of diabetes in teenagers with type 1 diabetes: psychometric properties of the Swedish measure ,Check your health'ACTA PAEDIATRICA, Issue 3 2010G Viklund Abstract The aim of this study was to test the psychometric properties of the instrument ,Check your health' in teenagers with type 1 diabetes. The instrument measures ,self-reported health' and ,burden of diabetes'. A convenience sample of 199 teenagers, 12,17 years of age, completed the questionnaires ,Check your health' and DisabKids when visiting the diabetes clinic. Forty-seven patients completed the questionnaires at home a second time. In the reliability test, the correlation between test and retest was found to be satisfactory, (0.94,0.62, except for social burden, 0.41). Convergent validity was moderate (0.62,0.38), while the instrument showed good discriminant validity. Self-reported health and burden of diabetes were different in boys and girls, in patients with good or poor metabolic control or who reported high and low disease severity. The domain burden of diabetes turned out to be very sensitive. Conclusion:, The instrument ,Check your health' showed clinical utility in teenagers with diabetes. Reliability and validity tests of the measure showed promising results in Swedish teenagers, and it can probably be used in clinical settings. To further strengthen the convergent validity, it should be compared with other QoL instruments, and to obtain normative values, it has to be used in a larger context. [source] The Forensic Inpatient Observation Scale (FIOS): development, reliability and validityCRIMINAL BEHAVIOUR AND MENTAL HEALTH, Issue 3 2001Irma G.H. Timmerman Introduction Re-offending, as a measure of success in forensic psychiatry, gives no information about other behaviours that may have changed. The development of the Forensic Inpatient Observation Scale (FIOS), an observation instrument to assess the non-offending functioning of forensic patients, is described. Study 1 In the first study the development of the initial item pool of the FIOS is described. This resulted in an instrument consisting of 78 items and seven scales. The internal reliability of the scales ranged from 0.78 to 0.91. The inter-rater reliability of the scales varied from 0.50 to 0.85 and the test,retest reliability over a period of three weeks was high for most scales, ranging from 0.74 to 0.89. Study 2 In the second study the FIOS was developed further in another sample of forensic patients. This time exploratory factor analysis with Varimax rotation and post hoc reliability analysis were applied to determine the factor structure among the items. This resulted in an item pool of 35 items, among which six factors could be distinguished that closely resemble the factor structure of the FIOS in study one: (1) self-care, (2) social behaviour, (3) oppositional behaviour, (4) insight offence/ problems, (5) verbal skills and (6) distress. Most items have high loadings on the factor they are assigned; 29 items have a loading of 0.60 or higher. The internal consistency of the scales ranges from 0.73 to 0.91 and the scales appear to be measuring independent constructs. Twenty-five out of the 35 items have an inter-rater correspondence of 90% or higher and 30 out of 35 items have an inter-rater correspondence of 87.5% or higher. The inter-rater reliability on the scale level, however, was somewhat less satisfying with correlations ranging from 0.50 to 0.69. Discussion It is argued that training the observers on a more regular basis will improve the inter-rater reliability. There is some evidence for the convergent validity of the FIOS. The FIOS has some advantages over existing inpatient scales in that it is developed specifically for forensic patients, it does not particularly focus on axis 1 symptoms but includes oppositional behaviour and attitudes to offending. Copyright © 2001 Whurr Publishers Ltd. [source] Psychometric evaluation of the mini-social phobia inventory (Mini-SPIN) in a treatment-seeking sample,DEPRESSION AND ANXIETY, Issue 6 2007Justin W. Weeks M.A. Abstract The Mini-Social Phobia Inventory (Mini-SPIN) is a 3-item, self-rated screening instrument to assess social anxiety disorder, but its psychometric properties have not yet been examined in a sample seeking treatment for psychiatric disorders. We analyzed responses from 291 adults who telephoned the Adult Anxiety Clinic of Temple (AACT) seeking treatment for social anxiety or generalized anxiety and worry. The Mini-SPIN demonstrated strong internal consistency. Support for the convergent validity of the Mini-SPIN was provided by moderate correlations with several self-report measures and a clinician-administered measure of social anxiety completed by the subsample of callers who later came to the AACT for evaluation. Furthermore, the Mini-SPIN correlated significantly with two of three measures of functional disability, but not with a measure of life satisfaction. Correlations with measures of other constructs were nonsignificant, providing support for the discriminant validity of the Mini-SPIN. In addition, a cutoff score of 6 on the Mini-SPIN yielded strong sensitivity and diagnostic efficiency in the subsample of treatment seekers that later completed pretreatment evaluation, although the specificity of this cutoff score was not optimal in this sample. Overall, the Mini-SPIN demonstrated sound psychometric properties in this treatment-seeking sample. Depression and Anxiety 24:382,391, 2007. Published 2006 Wiley-Liss, Inc. [source] The development and validation of the Indigenous Risk Impact Screen (IRIS): a 13-item screening instrument for alcohol and drug and mental health riskDRUG AND ALCOHOL REVIEW, Issue 2 2007CARLA M. SCHLESINGER Abstract The study aimed to assess the psychometric properties of the Indigenous Risk Impact Screen (IRIS) as a screening instrument for determining (i) the presence of alcohol and drug and mental health risk in Indigenous adult Australians and (ii) the cut-off scores that discriminate most effectively between the presence and absence of risk. A cross-sectional survey was used in clinical and non-clinical Indigenous and non-Indigenous services across Queensland Australia. A total of 175 Aboriginal and Torres Strait Islander people from urban, rural, regional and remote locations in Queensland took part in the study. Measures included the Indigenous Risk Impact Screen (IRIS), the Severity of Dependence Scale (SDS), the Alcohol Use Disorders Identification Test (AUDIT) and the Leeds Dependence Questionnaire (LDQ). Additional Mental Health measures included the Depression Anxiety and Stress Scale (DASS-21) and the Self-Report Questionnaire (SRQ). Principle axis factoring analysis of the IRIS revealed two factors corresponding with (i) alcohol and drug and (ii) mental health. The IRIS alcohol and drug and mental health subscales demonstrated good convergent validity with other well-established screening instruments and both subscales showed high internal consistency. A receiver operating characteristics (ROC) curve analysis was used to generate cut-offs for the two subscales and t-tests validated the utility of these cut-offs for determining risky levels of drinking. The study validated statistically the utility of the IRIS as a screen for alcohol and drug and mental health risk. The instrument is therefore recommended as a brief screening instrument for Aboriginal and Torres Strait Islander people. [source] Reliability and construct validity of the compatible MRI scoring system for evaluation of elbows in haemophilic childrenHAEMOPHILIA, Issue 2 2008A. S. DORIA Summary., We assessed the reliability and construct validity of the Compatible MRI scale for evaluation of elbows, and compared the diagnostic performance of MRI and radiographs for assessment of these joints. Twenty-nine MR examinations of elbows from 27 boys with haemophilia A and B [age range, 5,17 years (mean, 11.5)] were independently read by four blinded radiologists on two occasions. Three centres participated in the study: (Toronto, n = 24 examinations; Atlanta, n = 3; Cuiaba, n = 2). The number of previous joint bleeds and severity of haemophilia were reference standard measures. The inter-reader reliability of MRI scores was substantial (ICC = 0.73) for the additive (A)-scale and excellent (ICC = 0.83) for the progressive (P)-scale. The intrareader reliability was excellent for both P-scores (ICC = 0.91) and A-scores (ICC = 0.93). The total P- and A-scores correlated poorly (r = 0.36) or moderately (r = 0.54), but positively, with clinical-laboratory measurements. The total MRI scores demonstrated high accuracy for discrimination of presence or absence of arthropathy [P-scale, area-under-the-curve (AUC) = 0.94 ± 0.05; A-scale, AUC = 0.89 ± 0.06], as did the soft tissue scores of both scales (P-scale, AUC = 0.90 ± 0.06; A-scale, AUC = 0.86 ± 0.06). Areas-under-the-curve used to discriminate severe disease demonstrated high accuracy for both P-MRI scores (AUC = 0.83 ± 0.09) and A-MRI scores (AUC = 0.87 ± 0.09), but non-diagnostic ability to discriminate mild disease. Similar results were noted for radiographic scales. In conclusion, both MRI scales demonstrated substantial to excellent reliability and accuracy for discrimination of presence/absence of arthropathy, and severe/non-severe disease, but poor to moderate convergent validity for total scores and non-diagnostic discriminant validity for mild/non-mild disease. Compared with radiographic scores, MRI scales did not perform better for discrimination of severity of arthropathy. [source] A comparison of the performance of the EQ-5D and SF-6D for individuals aged , 45 yearsHEALTH ECONOMICS, Issue 7 2008Garry R. Barton Abstract We sought to compare the performance of the EQ-5D and SF-6D with regard to the criteria of practicality, convergent validity, and construct validity, the level of agreement between the two measures was also assessed. Responses from 1865 individuals aged , 45 years in one general practice were analysed. Of these, 93.1% completed the EQ-5D, compared with 86.4% for the SF-6D, where individuals who were older, female, of a lower occupational skill level, from an area of lower deprivation, or used prescribed medication were significantly less likely to complete the SF-6D. The performance of both measures was comparable with regard to both convergent and construct validities, as both the EQ-5D and SF-6D scores were closely related to scores on the EuroQol visual analogue scale (VAS) (p<0.001) and able to discriminate between people who did and did not take: (i) analgesics and (ii) other prescribed medication. Despite EQ-5D and SF-6D scores being highly correlated (p<0.001), individuals who were healthier (according to the VAS) had higher mean scores on the EQ-5D (p<0.001), whereas less healthy individuals had higher mean scores on the SF-6D (individuals with knee pain, osteoarthritis, back pain, rheumatoid arthritis, and hip pain had significantly lower mean scores on the EQ-5D, p<0.001). Copyright © 2007 John Wiley & Sons, Ltd. [source] Testing the convergent validity of the contingent valuation and travel cost methods in valuing the benefits of health careHEALTH ECONOMICS, Issue 2 2002Philip M. Clarke Abstract In this study, the convergent validity of the contingent valuation method (CVM) and travel cost method (TCM) is tested by comparing estimates of the willingness to pay (WTP) for improving access to mammographic screening in rural areas of Australia. It is based on a telephone survey of 458 women in 19 towns, in which they were asked about their recent screening behaviour and their WTP to have a mobile screening unit visit their nearest town. After eliminating missing data and other non-usable responses the contingent valuation experiment and travel cost model were based on information from 372 and 319 women, respectively. Estimates of the maximum WTP for the use of mobile screening units were derived using both methods and compared. The highest mean WTP estimated using the TCM was $83.10 (95% C.I. $99.06,$68.53), which is significantly less than the estimate of $148.09 ($131.13,$166.60) using the CVM. This could be due to the CVM estimates also reflecting non-use values such as altruism, or a range of potential biases that are known to affect both methods. Further tests of validity are required in order to gain a greater understanding of the relationship between these two methods of estimating WTP. Copyright © 2001 John Wiley & Sons, Ltd. [source] Self-Construal Scales Lack ValidityHUMAN COMMUNICATION RESEARCH, Issue 2 2003Timothy R. Levine Self-construal is thought to mediate and explain the effects of culture on a wide variety of outcome variables. A meta-analysis of published cross-cultural self-construal research is reported in this article, and the results across studies suggests that the evidence for the predicted cultural differences is weak, inconsistent, or nonexistent. The results of 3 priming experiments (N = 121, N = 99, and N = 361) suggest that (a) priming does not account for the inconsistent results observed in the meta-analysis, (b) that scores on a self-construal scale appear to be measuring trait-like constructs that are not sensitive to priming, and (c) that measures of self-construals lack convergent validity. The results of several measurement studies (N = 121, 223, 230, 323, 214, 206, 126, 204, 148, 141, and 150) were inconsistent with the a priori two-factor measurement model in every case. Self-construal scales were found to be radically multidimensional and highly unstable within and across cultures. These results lead us to conclude that catastrophic validity problems exist in research involving the use of self-construal scales in cross-cultural research. [source] Further examination of the convergent and discriminant validity of the student,teacher relationship scaleINFANT AND CHILD DEVELOPMENT, Issue 6 2009Sarah Doumen Abstract Two studies extended psychometric research on the Student,Teacher Relationship Scale (STRS) with kindergarten and preschool children (N1 = 60,71; N2 = 35) and their teachers. These studies used a multi-method approach to replicate and extend previous findings concerning the convergent validity of the STRS Closeness, Conflict, and Dependency scale and to further examine the discriminant validity of the STRS. Study 1 investigated convergence between the STRS scales and child- and peer-reports of the same constructs based on a multi-trait multi-method approach. Study 2 examined the pattern of associations between the STRS and indicators of teacher,child relationship quality rated by external observers. Support was found for the convergent validity and to a lesser extent the discriminant validity of the STRS Closeness and Conflict scale. For the STRS Dependency scale, additional research remains necessary. Copyright © 2009 John Wiley & Sons, Ltd. [source] A validity and reliability study of assessment and screening for sustained withdrawal reaction in infancy: The Alarm Distress Baby scale,INFANT MENTAL HEALTH JOURNAL, Issue 5 2001Antoine Guedeney Sustained withdrawal behavior in infancy is an important alarm signal to draw attention to both organic and relationship disorders. A withdrawal scale, the Alarm Distress Baby scale (ADBB), for infants between 2 and 24 months of age was built. This article describes the construction of the scale and the assessment of its psychometric properties. The ADBB has good content validity, based on the advice of seven experts. The scale has good criterion validity: first, as a measure of the infant's withdrawal reaction, with a very good correlation between nurse and pediatrician on the ADBB (rs = 0.84), and second, as a screening procedure for detecting the developmental risk of the infant. The cutoff score of 5 with a sensitivity of 0.82 and a specificity of 0.78 was determined to be optimal for screening purposes. The scale has good construct validity, with good convergent validity with both the Spitz (1951) and the Herzog & Rathbun (1982) lists of symptoms of infant depression (rs = 0.61 and 0.60, respectively). Exploratory factor analysis showed two different factors, consistent with the scale's construct. Reliability was satisfactory with good internal consistency for both subscales (the Cronbach , = 0.80 for the first subscale and 0.79 for the second) and for the global scale (, = 0.83). The test-retest procedure showed good stability over time (rs = 0.90 and 0.84 for the two different raters). The scale could be used in different clinical settings, provided a sufficient level of social stimulation is given to the infant in a relatively brief period of time. The scale can be used by nurses and psychologists or by medical doctors after a short period of training. © 2001 Michigan Association for Infant Mental Health. [source] Validation of the modified telephone interview for cognitive status (TICS-m) in HebrewINTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY, Issue 5 2003Michal Schnaider Beeri Abstract Introduction The validity of the Hebrew version of the Telephone Interview for Cognitive Status-Modified (TICS-m) for Mild Cognitive Impairment (MCI), for dementia, and for cognitive impairment (either MCI or dementia) was investigated. Methods Of the 10,059 who took part of the Israel Ischemic Heart Disease Cohort, 1902 of the 2901 survivors in 1999 had TICS-m interviews. Those with a score of 27 or below and a random sample with a score of 28 or 29 were invited to have a physician's examination for the diagnosis of dementia. The analysis was performed on the 576 who agreed. Results Based on physician's diagnosis, 269 were diagnosed as suffering from dementia, 128 as suffering from MCI, and 179 were diagnosed with no cognitive impairment. The TICS-m Hebrew version's internal consistency was very high (Cronbach's alpha,=,0.98) and showed a strong convergent validity with the MMSE (r,=,0.82; p,<,0.0005). The sensitivity was 100% for each of the conditions. Finally, after controlling for age, education and hearing impairment, TICS-m was a strong predictor of dementia, MCI and cognitive impairment. Conclusion At a cut-off of 27/50 the Hebrew version of the TICS-m is a useful screening instrument to identify subjects suffering from mild cognitive impairment, dementia and cognitive impairment (MCI or dementia). Copyright © 2003 John Wiley & Sons, Ltd. [source] The development and initial validation of the Terminally Ill Grief or Depression Scale (TIGDS)INTERNATIONAL JOURNAL OF METHODS IN PSYCHIATRIC RESEARCH, Issue 4 2005Vyjeyanthi S. Periyakoil Abstract Patients often experience ,preparatory-grief' as they cope with the dying process. Some may be depressed. The Terminally Ill Grief or Depression Scale (TIGDS), comprising grief and depression sub-scales, is a new self-report measure designed to differentiate between preparatory-grief and depression in adult inpatients. The initial 100-item inventory was assembled based on literature review, interviews with clinicians and dying patients and then shortened to 42 items based on consensus expert opinion. Validity and reliability were tested in a sample of 55 terminally ill adults. The consensus clinical opinion was used as the gold standard to differentiate between preparatory grief and depression. The intra-class correlation coefficient was high (it was calculated to estimate the test-retest reliability for the 47 patients who had completed the TIGDS twice , retest was administered 2 to 7 days after the initial test), ranging from 0.86 (grief) to 0.97 (depression). The validity of TIGDS was assessed using a receiver operating characteristic curve analysis, comparing the first test with the clinical criterion. The first and only variable and cut-point was the depression score (chi-square = 18.4,p < 0.001, cut point = 3). The sensitivity of the TIGDS was 0.727 and specificity was 0.886 for the depression = 3 cutoff score. The construct validity of the TIGDS was tested by comparing with the Hospital Anxiety and Depression Scale (HADS). The TIGDS depression subscale showed strong convergent validity and the TIGDS grief subscale showed strong discriminant validity with the HADS total score. Copyright © 2005 John Wiley & Sons, Ltd. [source] Translation and validation of a Chinese language version of the Early Childhood Oral Health Impact Scale (ECOHIS)INTERNATIONAL JOURNAL OF PAEDIATRIC DENTISTRY, Issue 6 2009GILLIAN H. M. LEE Objective., This study aimed to adapt the Early Childhood Oral Health Impact Scale (ECOHIS) for pre-school children in a Chinese speaking community and to investigate its psychometric properties (validity and reliability). Methods., A Chinese language version of the ECOHIS was derived through a forward,backward translation and tested for face and content validity among a focus group. A convenient sample of pre-school children (n = 111) was recruited (including a sub-sample with early childhood caries and caries-free children). Parents of the children self-completed the derived Chinese-ECOHIS measure. Validity of the measure was assessed by investigating the relationship between dental caries status and Chinese-ECOHIS scores (construct and criterion validity). A sub-sample of the parents repeated the ratings of the measure to enable reliability assessments. Both internal and test,retest reliability were determined. Results., A Chinese version of ECOHIS was derived with minor modification to the original version. Chinese-ECOHIS scores were associated with children's caries experience (dmft) (r = 0.66, P < 0.05) supporting convergent validity. In addition, variations in ECOHIS scores were apparent with respect to caries and caries-free groups (P < 0.001), supporting the ability to distinguish between patient groups. Cronbach's alpha values (internal reliability) for total ECOHIS score were 0.91 and intraclass correlation coefficient value (test,retest reliability) was 0.64. Conclusions., A Chinese version of the ECOHIS was developed and demonstrated acceptable validity and reliability. These findings can enable assessments of pre-school child oral health-related quality of life in Chinese speaking communities. [source] The Ankylosing Spondylitis Quality of Life Questionnaire: validation in a New Zealand cohortINTERNATIONAL JOURNAL OF RHEUMATIC DISEASES, Issue 4 2010Katherine JENKS Abstract Aim:, To examine the validity of the Ankylosing Spondylitis Quality of Life Questionnaire (ASQoL) in a New Zealand population with defined axial spondyloarthritis (SpA). Once validated, the ASQoL will be included as an outcome measure in a proposed multicentre New Zealand study. Methods:, Five healthy participants were interviewed to identify any issues related to local dialect or linguistic comprehension of the questionnaire. Cognitive debriefing interviews were conducted with four participants with SpA to assess the relevance and comprehensiveness of the questionnaire. Internal consistency was established by determining the Cronbach's alpha. Finally, convergent validity of the ASQoL was assessed by testing the correlation with the Bath Ankylosing Spondylitis Functional Index (BASFI), Bath Ankylosing Spondylitis Disease Activity Index (BASDAI) and patient global visual analogue scale (VAS) scores in a cohort of 63 SpA patients. Results:, The language used in the ASQoL was considered clear, comprehensible and accessible to speakers of New Zealand English. The questionnaire displayed content validity for patients with SpA. The ASQoL had good internal consistency in the present sample (, = 0.854). A positive correlation was found between the ASQoL and the BASFI (rho = 0.635, P < 0.001), BASDAI (rho = 0.521, P < 0.001) and patient global assessment VAS (rho = 0.546, P < 0.001), providing evidence that the ASQoL has convergent validity among patients with SpA in New Zealand. Test,retest reliability was good over 16 weeks (rho = 0.730, P < 0.001). Conclusions:, The ASQoL has been demonstrated in this study to be feasible, internally consistent and to have content and convergent validity in a New Zealand population of patients with axial spondyloarthritis; it is a measure of quality of life which is both easy to employ and reliable. [source] Distinguishing between task and contextual performance for nurses: development of a job performance scaleJOURNAL OF ADVANCED NURSING, Issue 6 2007Jaimi H. Greenslade Abstract Title.,Distinguishing between task and contextual performance for nurses: development of a job performance scale Aim., This paper is a report of a development and validation of a new job performance scale based on an established job performance model. Background., Previous measures of nursing quality are atheoretical and fail to incorporate the complete range of behaviours performed. Thus, an up-to-date measure of job performance is required for assessing nursing quality. Methods., Test construction involved systematic generation of test items using focus groups, a literature review, and an expert review of test items. A pilot study was conducted to determine the multidimensional nature of the taxonomy and its psychometric properties. All data were collected in 2005. Findings., The final version of the nursing performance taxonomy included 41 behaviours across eight dimensions of job performance. Results from preliminary psychometric investigations suggest that the nursing performance scale has good internal consistency, good convergent validity and good criterion validity. Conclusion., The findings give preliminary support for a new job performance scale as a reliable and valid tool for assessing nursing quality. However, further research using a larger sample and nurses from a broader geographical region is required to cross-validate the measure. This scale may be used to guide hospital managers regarding the quality of nursing care within units and to guide future research in the area. [source] The psychometric properties of the Miller Behavioural Style Scale with adult daughters of women with early breast cancer: a literature review and empirical studyJOURNAL OF ADVANCED NURSING, Issue 2 2000Charlotte E. Rees BSc PhD The psychometric properties of the Miller Behavioural Style Scale with adult daughters of women with early breast cancer: a literature review and empirical study Several researchers have suggested that the information-seeking behaviours of patients need to be taken into consideration when assessing their information needs. This study reviews published evidence of the psychometric properties of the Miller Behavioural Style Scale, a tool commonly used to identify the information-seeking behaviours of individuals under threat, and examines its reliability and validity with adult daughters of women with early breast cancer. Ninety-seven adult daughters completed the MBSS and a 30-item, self-administered questionnaire, a tool designed to explore the information needs of adult daughters of women with breast cancer. The internal consistency of the monitoring and blunting sub-scales of the MBSS was ,=0·65 and 0·41 respectively. The blunting sub-scale fell substantially below acceptable limits and was discarded from subsequent analyses. The monitoring sub-scale possessed good test,retest reliability (n=17) with a 5-week time interval (r=0·71, P < 0·005), as measured using a Pearson's correlation coefficient. Furthermore, the majority (73·4%) of monitoring items possessed moderate or substantial test,retest reliability, as indicated by kappa coefficients. Finally, the monitoring sub-scale possessed good construct validity, both discriminant and convergent validity, as measured by the univariate associations between monitoring behaviour and selected items from the information questionnaire and a demographic questionnaire. In conclusion, adequate support exists for the psychometric properties of the monitoring sub-scale of the MBSS and its use with adult daughters of women with early breast cancer in future research. These findings have a number of implications for nursing research and these are discussed in this paper. [source] Bayesian strategy assessment in multi-attribute decision makingJOURNAL OF BEHAVIORAL DECISION MAKING, Issue 3 2003Arndt Bröder Abstract Behavioral Decision Research on multi-attribute decision making is plagued with the problem of drawing inferences from behavioral data on cognitive strategies. This bridging problem has been tackled by a range of methodical approaches, namely Structural Modeling (SM), Process Tracing (PT), and comparative model fitting. Whereas SM and PT have been criticized for a number of reasons, the comparative fitting approach has some theoretical advantages as long as the formal relation between theories and data is specified. A Bayesian method is developed that is able to assess, whether an empirical data vector was most likely generated by a ,Take The Best' heuristic (Gigerenzer et al., 1991), by an equal weight rule, or a compensatory strategy. Equations are derived for the two- and three-alternative cases, respectively, and a simulation study supports its validity. The classification also showed convergent validity with Process Tracing measures in an experiment. Potential extensions of the general approach to other applications in behavioral decision research are discussed. Copyright © 2003 John Wiley & Sons, Ltd. [source] Random error reduction in analytic hierarchies: a comparison of holistic and decompositional decision strategiesJOURNAL OF BEHAVIORAL DECISION MAKING, Issue 3 2001Osvaldo F. Morera Abstract The principle of ,divide and conquer' (DAC) suggests that complex decision problems should be decomposed into smaller, more manageable parts, and that these parts should be logically aggregated to derive an overall value for each alternative. Decompositional procedures have been contrasted with holistic evaluations that require decision makers to simultaneously consider all the relevant attributes of the alternatives under consideration (Fischer, 1977). One area where decompositional procedures have a clear advantage over holistic procedures is in the reduction of random error (Ravinder, 1992; Ravinder and Kleinmuntz, 1991; Kleinmuntz, 1990). Adopting the framework originally developed by Ravinder and colleagues, this paper details the results of a study of the random error variances associated with another popular multi-criteria decision-making technique, the Analytic Hierarchy Process (AHP); (Saaty, 1977, 1980), as well as the random error variances of a holistic version of the Analytic Hierarchy Process (Jensen, 1983). In addition, data concerning various psychometric properties (e.g. the convergent validity and temporal stability) and values of AHP inconsistency are reported for both the decompositional and holistic evaluations. The results of the study show that the Ravinder and Kleinmuntz (1991) error-propagation framework extends to the AHP and decompositional AHP judgments are more consistent than their holistic counterparts. Copyright © 2001 John Wiley & Sons, Ltd. [source] The assessment of positivity and negativity in social networks: the reliability and validity of the social relationships index,JOURNAL OF COMMUNITY PSYCHOLOGY, Issue 4 2009Rebecca A. Campo The Social Relationships Index (SRI) was designed to examine positivity and negativity in social relationships. Unique features of this scale include its brevity and the ability to examine relationship positivity and negativity at the level of the specific individual and social network. The SRI's psychometric properties were examined in three studies. The SRI demonstrated good psychometric properties, including test,retest reliability for the assessment of positivity and negativity, and of relationship classifications across social networks. Additionally, discriminant and convergent validity was established with existing social relationship and personality scales. Finally, the SRI showed some generalizability across different contexts. These studies suggest that the SRI is a reliable and valid alternative measure for use in health studies that require a shorter assessment of relationships. © 2009 Wiley Periodicals, Inc. [source] Take Me Back: Validating the Wayback MachineJOURNAL OF COMPUTER-MEDIATED COMMUNICATION, Issue 1 2008Jamie Murphy Although fields such as e-commerce, information systems, and computer-mediated communication (CMC) acknowledge the importance of validity, validating research tools or measures in these domains seems the exception rather than the rule. This article extends the concept of validation to one of an emerging genre of web-based tools that provide new measures, the Wayback Machine (WM). Drawing in part on social science tests of validity, the study progresses from testing for and demonstrating the weakest form of validity, face validity, to the more demanding tests for content, predictive, and convergent validity. Finally, the study tests and shows nomological validity, using the diffusion of innovations theory. In line with prior diffusion research, the results of tests for predictive and nomological validity showed significant relationships with organizational characteristics and two WM measures: website age and number of updates. The results help validate these measures and demonstrate the utility of the WM for studying evolving website use. [source] An Application of Item Response Time: The Effort-Moderated IRT ModelJOURNAL OF EDUCATIONAL MEASUREMENT, Issue 1 2006Steven L. Wise The validity of inferences based on achievement test scores is dependent on the amount of effort that examinees put forth while taking the test. With low-stakes tests, for which this problem is particularly prevalent, there is a consequent need for psychometric models that can take into account differing levels of examinee effort. This article introduces the effort-moderated IRT model, which incorporates item response time into proficiency estimation and item parameter estimation. In two studies of the effort-moderated model when rapid guessing (i.e., reflecting low examinee effort) was present, one based on real data and the other on simulated data, the effort-moderated model performed better than the standard 3PL model. Specifically, it was found that the effort-moderated model (a) showed better model fit, (b) yielded more accurate item parameter estimates, (c) more accurately estimated test information, and (d) yielded proficiency estimates with higher convergent validity. [source] Increasing the Reliability of Ability-Achievement Difference Scores: An Example Using the Kaufman Assessment Battery for ChildrenJOURNAL OF EDUCATIONAL MEASUREMENT, Issue 1 2002John C. Caruso In this study, we focused on increasing the reliability of ability-achievement difference scores using the Kaufman Assessment Battery for Children (KABC) as an example. Ability-achievement difference scores are often used as indicators of learning disabilities, but when they are derived from traditional equally weighted ability and achievement scores, they have suboptimal psychometric properties because of the high correlations between the scores. As an alternative to equally weighted difference scores, we examined an orthogonal reliable component analysis, (RCA) solution and an oblique principal component analysis (PCA) solution for the standardization sample of the KABC (among 5- to 12-year-olds). The components were easily identifiable as the simultaneous processing, sequential processing, and achievement constructs assessed by the KABC. As judged via the score intercorrelations, all three types of scores had adequate convergent validity, while the orthogonal RCA scores had superior discriminant validity, followed by the oblique PCA scores. Differences between the orthogonal RCA scores were more reliable than differences between the oblique PCA scores, which were in turn more reliable than differences between the traditional equally weighted scores. The increased reliability with which the KABC differences are assessed with the orthogonal RCA method has important practical implications, including narrower confidence intervals around difference scores used in individual administrations of the KABC. [source] Adolescent Drug Abuse Diagnosis (ADAD) vs.JOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 5 2006Adolescents (HoNOSCA) in clinical outcome measurement, Health of Nation Outcome Scale for Children Abstract Background, The Adolescent Drug Abuse Diagnosis (ADAD) and Health of Nation Outcome Scales for Children and Adolescents (HoNOSCA) are both measures of outcome for adolescent mental health services. Aims, To compare the ADAD with HoNOSCA; to examine their clinical usefulness. Methods, Comparison of the ADAD and HoNOSCA outcome measures of 20 adolescents attending a psychiatric day care unit. Results, ADAD change was positively correlated with HoNOSCA change. HoNOSCA assesses the clinic's day-care programme more positively than the ADAD. The ADAD detects a group for which the mean score remains unchanged whereas HoNOSCA does not. Conclusions, A good convergent validity emerges between the two assessment tools. The ADAD allows an evidence-based assessment and generally enables a better subject discrimination than HoNOSCA. HoNOSCA gives a less refined evaluation but is more economic in time and possibly more sensitive to change. Both assessment tools give useful information and enabled the Day-care Unit for Adolescents to rethink the process of care and of outcome, which benefited both the institution and the patients. [source] Assessment of the convergent validity of the Questions About Behavioral Function scale with analogue functional analysis and the Motivation Assessment ScaleJOURNAL OF INTELLECTUAL DISABILITY RESEARCH, Issue 6 2001T. R. Paclawskyj Abstract The present study examined the convergent validity of the Questions About Behavioral Function (QABF) scale, a behavioural checklist for assessing variables maintaining aberrant behaviour, with analogue functional analyses and the Motivation Assessment Scale (MAS). The two checklists were more highly correlated with each other than either checklist with results from the analogue sessions, and the QABF was more highly correlated with analogue sessions than the MAS. Using analogue sessions, the experimenters failed to ascertain behavioural function for a number of subjects because the behaviour problems in question were low frequency/high intensity and failed to appear during the course of the analysis, pointing out a limitation of this technology. These findings, taken together with recent research outlining the psychometric properties of the QABF, seem to support the use of the QABF in a hierarchical model of functional analysis. The implications of the findings are discussed. [source] Supply-Side Innovation and Technology CommercializationJOURNAL OF MANAGEMENT STUDIES, Issue 4 2009Gideon D. Markman abstract The majority of research and practice tends to conceptualize innovation as a vertically coupled, intra-organizational process. We expand this perspective by conceptualizing innovation as a vertically decoupled, inter-organizational process and by studying the role of research universities as suppliers of discoveries to this market for innovation. We combined logic from agency and real options theories to explain why the outcomes of technology commercialization are a function of licensing strategies, the autonomy of technology licensing offices (TLOs), and the incentives bestowed on scientists, research departments, and TLO officers. We rely on data from licensing surveys, interviews with 128 TLO directors, and , for convergent validity , from web-based searches of the TLOs of American universities and the US Patent and Trademark Office. Results suggest that commercialization outcomes (in this case, revenue and start-up creation) are enhanced when TLOs employ diverse licensing strategies, TLOs enjoy greater autonomy, universities share revenues with scientists' departments, and universities compensate TLOs officers well. Results also show that late entrants , typically underperforming universities , inflate royalty shares to scientists as a means to rectify their commercialization record. We conclude with a discussion of this study's contribution to the literature on innovation and technology commercialization. [source] Reducing subjectivity in the assessment of the job environment: development of the Factual Autonomy Scale (FAS)JOURNAL OF ORGANIZATIONAL BEHAVIOR, Issue 4 2003Paul E. Spector Self-report measures of job stressors have been criticized for being too subjective, rendering relations with other variables inconclusive. The Factual Autonomy Scale (FAS) was developed to reduce subjectivity by careful choice of fact-based items. Results of two studies showed that when compared to the Job Diagnostic Survey autonomy scale, the FAS demonstrated superior convergent validity with alternate sources (supervisors in Study 1 and coworkers in Study 2), and discriminant validity when correlated with the remaining JDS core characteristics subscales. In addition, the FAS was correlated to a lesser extent than the JDS autonomy scale with job satisfaction. Incumbent FAS scores and not JDS scores correlated significantly with job performance as assessed by supervisors. It is suggested that it is feasible to develop fact-based items for scales of the work environment that reduce the degree of subjectivity of responses. Copyright © 2003 John Wiley & Sons, Ltd. [source] Development and validation of a new instrument to assess lifetime trauma and victimization historyJOURNAL OF TRAUMATIC STRESS, Issue 5 2005Cathy Spatz Widom This article describes a new easy-to-administer and understand, interview-based instrument that systematically and comprehensively assesses a person's Lifetime Trauma and Victimization History (LTVH). The LTVH inquires about 30 traumas and victimization experiences (including general traumas, physical assault/abuse, sexual assault/abuse, kidnapping/stalking, family/friend murdered or committed suicide, witnessed trauma to someone else, and crime victimizations) and age of onset, perpetrator, degree of danger and fear experienced, duration, and frequency of each experience. We present evidence of predictive validity of the LTVH as well as convergent and criterion validity for the child abuse items using information from individuals with documented histories of child abuse and neglect and matched comparisons (without documented histories of childhood victimization). The 896 individuals (mean age = 39.5 years) reported 11,850 traumas or victimization experiences. The LTVH demonstrates good predictive, criterion-related, and convergent validity and a high level of agreement between earlier and current reports of certain types of traumas. [source] | |||||||||||||||||||||||||||||||||||||