Home About us Contact
|
Home About us Contact | ||
|
|
||
Validity
Kinds of Validity Terms modified by Validity Selected AbstractsEVIDENCE FOR THE VALIDITY OF THE AMERICAN MEDICAL ASSOCIATION'S CAREGIVER SELF-ASSESSMENT QUESTIONNAIRE AS A SCREENING MEASURE FOR DEPRESSIONJOURNAL OF AMERICAN GERIATRICS SOCIETY, Issue 2 2010Gary Epstein-Lubow MD No abstract is available for this article. [source] VALIDITY AND RELIABILITY OF QUANTITATIVE GAIT ANALYSIS IN GERIATRIC PATIENTS WITH AND WITHOUT DEMENTIAJOURNAL OF AMERICAN GERIATRICS SOCIETY, Issue 4 2007Marianne B. Van Iersel MD No abstract is available for this article. [source] SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META-ANALYSISPERSONNEL PSYCHOLOGY, Issue 1 2007MICHAEL A. McDANIEL Situational judgment tests (SJTs) are personnel selection instruments that present job applicants with work-related situations and possible responses to the situations. There are typically 2 types of instructions: behavioral tendency and knowledge. Behavioral tendency instructions ask respondents to identify how they would likely behave in a given situation. Knowledge instructions ask respondents to evaluate the effectiveness of possible responses to a given situation. Results showed that response instructions influenced the constructs measured by the tests. Tests with knowledge instructions had higher correlations with cognitive ability. Tests with behavioral tendency instructions showed higher correlations with personality constructs. Results also showed that response instructions had little moderating effect on criterion-related validity. Supplemental analyses showed that the moderating effect of response instructions on construct validity was not due to systematic differences in item content. SJTs have incremental validity over cognitive ability, the Big 5, and over a composite of cognitive ability and the Big 5. [source] IMPLICATIONS OF TRAIT-ACTIVATION THEORY FOR EVALUATING THE CONSTRUCT VALIDITY OF ASSESSMENT CENTER RATINGSPERSONNEL PSYCHOLOGY, Issue 1 2002STEPHANIE HAALAND Assessment centers have often been criticized for lacking evidence supporting the construct validity of dimension ratings. This study examines whether the poor convergence of assessment center ratings is a result of correlating ratings from exercises that differ in the extent that behavior relevant to personality traits can be observed. Using data from a promotional assessment center for law enforcement officers (n= 79), the convergence of assessment center ratings was evaluated within the context of the five factor model by comparing the average within-dimension correlation of ratings from exercises that allowed for more opportunity to observe trait-relevant behavior to the average of those involving exercises where there was less opportunity. For each personality trait, ratings from exercises judged by experts to be high in trait-activation potential displayed stronger convergence (mean r= .30) than did ratings from exercises that were low in activation potential for that trait (mean r= .15). Implications for evaluating the construct validity of assessment centers are discussed along with future directions for classifying exercises based on situational similarity. [source] ASSESSING THE INCREMENTAL VALIDITY OF TEAM CONSENSUS RATINGS OVER AGGREGATION OF INDIVIDUAL-LEVEL DATA IN PREDICTING TEAM EFFECTIVENESSPERSONNEL PSYCHOLOGY, Issue 3 2001BRADLEY L. KIRKMAN Using data collected from 98 work teams, empowerment levels were assessed based on the aggregation of individual team member ratings as well as on a team consensus approach utilized after aggregation. These 2 methods of measuring team empowerment were then compared on their ability to predict manager ratings of team effectiveness on 4 dimensions. Findings demonstrated that the consensus method of measuring team empowerment explained significantly greater variance in team effectiveness than did the aggregation method alone. We discuss implications for team research and practice based on these findings and include a discussion on when using consensus after aggregation may be most appropriate. [source] INCREMENTAL VALIDITY OF EMPIRICALLY KEYED BIODATA SCALES OVER GMA AND THE FIVE FACTOR PERSONALITY CONSTRUCTSPERSONNEL PSYCHOLOGY, Issue 2 2000MICHAEL K. MOUNT The major purpose of this study was to determine whether empirically keyed, cross-validated biodata scales accounted for incremental variance over that accounted for by the five factor model (FFM) of personality and GMA predictors. A concurrent validation study was employed using 376 employees in a clerical job (222 in the developmental sample and 154 in the cross-validation sample). Results for the cross-validation sample provided support for the hypothesis that biodata predictors accounted for substantial incremental variance beyond that accounted for by the FFM predictors and GMA for 3 of the 4 criteria. Support was also found for the hypothesized zero-order correlations between GMA, FFM, and biodata predictors and the 4 criteria. Theoretical and practical implications are discussed. [source] THE INCREMENTAL VALIDITY OF INTERVIEW SCORES OVER AND ABOVE COGNITIVE ABILITY AND CONSCIENTIOUSNESS SCORESPERSONNEL PSYCHOLOGY, Issue 2 2000JOSE M. CORTINA Recent research has suggested that scores on measures of cognitive ability, measures of Conscientiousness, and interview scores are positively correlated with job performance. There remains, however, a question of incremental validity: To what extent do interviews predict above and beyond cognitive ability and Conscientiousness? This question was addressed in this paper by (a) conducting meta-analyses of the relationships among cognitive ability, Conscientiousness, and interviews, (b) combining these results with predictive validity results from previous meta-analyses to form a "meta-correlation matrix" representing the relationships among cognitive ability, Conscientiousness, interviews, and job performance, and (c) performing 9 hierarchical regressions to examine the incremental validity of 3 levels of structured interviews in best, actual, and worst case scenarios for prediction. Results suggested that interview scores contribute to the prediction of job performance over and above cognitive ability and Conscientiousness to the extent that they are structured, with scores from highly structured interviews contributing substantially to prediction. Directions for future research are discussed. [source] RAPID VERSUS FULL SYSTEMATIC REVIEWS: VALIDITY IN CLINICAL PRACTICE?ANZ JOURNAL OF SURGERY, Issue 11 2008Amber Watt Introduction: Rapid reviews are being produced with greater frequency by health technology assessment (HTA) agencies in response to increased pressure from end-user clinicians and policy-makers for rapid, evidence-based advice on health-care technologies. This comparative study examines the differences in methodologies and essential conclusions between rapid and full reviews on the same topic, with the aim of determining the validity of rapid reviews in the clinical context and making recommendations for their future application. Methods: Rapid reviews were located by Internet searching of international HTA agency websites, with any ambiguities resolved by further communication with the agencies. Comparator full systematic reviews were identified using the University of York Centre for Reviews and Dissemination HTA database. Data on a number of review components were extracted using standardized data extraction tables, then analysed and reported narratively. Results: Axiomatic differences between all the rapid and full reviews were identified; however, the essential conclusions of the rapid and full reviews did not differ extensively across the topics. For each of the four topics examined, it was clear that the scope of the rapid reviews was substantially narrower than that of full reviews. The methodology underpinning the rapid reviews was often inadequately described. Conclusions: Rapid reviews do not adhere to any single validated methodology. They frequently provide adequate advice on which to base clinical and policy decisions; however, their scope is limited, which may compromise their appropriateness for evaluating technologies in certain circumstances. [source] Validity of a Discharge Diagnosis of Heart Failure: Implications of MisdiagnosingCONGESTIVE HEART FAILURE, Issue 4 2008Cândida Fonseca MD Heart failure (HF) costs are largely due to hospitalization. The validity of a death/discharge diagnosis of HF (DDHF) is largely unknown. The authors assessed the validity of DDHF and the impact of misdiagnosing. The case notes of patients consecutively admitted to a medical department between January and June 2001 were reviewed. Cases with DDHF or cardiovascular diseases, potential precursors of HF (PPHF), were included. The diagnosis of HF (European Society of Cardiology guidelines) was classified as definite, possible, or miscoded. Of the 1038 patients admitted, 234 were enrolled: 157 with DDHF and 77 with PPHF. One hundred eighty patients had a definite diagnosis of HF. Of the 157 diagnoses coded as definite HF, 130 were correct, 21 had possible HF, and 6 were miscoded. Of the 77 patients classified as having PPHF, 38 had definite HF. The accuracy of the DDHF diagnosis was 72.2%: 21.1% were underdiagnosed and 8.3% overdiagnosed. DDHF failed to capture many HF admissions and therefore alone underestimates the prevalence, burden, and costs of the syndrome. [source] Validity and ethics of the human 4-h patch test as an alternative method to assess acute skin irritation potentialCONTACT DERMATITIS, Issue 1 2001Michael K. Robinson For more than 50 years, the Draize rabbit skin irritation test has reigned supreme as the regulatory method of choice for the identification of skin irritant chemicals. To date no in vitro alternative test has been validated as an adequate replacement. However, one potential option, to test the endpoint of concern (skin irritation) in the species of concern (man) has been overlooked. The advent of predictive in vitro tools for the identification of substances corrosive to the skin has opened up the practical possibility of carrying out safe and ethical studies on small panels of humans. The human 4-h patch test has been developed to meet the needs of identifying chemical skin irritation potential, providing data which is inherently superior to that given by a surrogate model, such as the rabbit. This paper reviews in detail the present state of the human 4-h patch test, highlighting its advantages and noting its utility as the ,gold standard' on which to build future in vitro models. [source] Validity of ,post-traumatic stress disorder with secondary psychotic features': a review of the evidenceACTA PSYCHIATRICA SCANDINAVICA, Issue 1 2009M. H. Braakman Objective:, To review the evidence from empirical studies regarding the validity of ,post-traumatic stress disorder with secondary psychotic features' (PTSD-SP) as a separate diagnostic entity. Method:, The authors performed a review tracing publications between 1980 and January 2008. Results:, Twenty-four comparative studies were included. These studies indicate that PTSD-SP is a syndrome that comprises PTSD-symptoms followed in time by the additional appearance of psychotic features. The psychotic features are not confined to episodes of re-experiencing, but remain present continuously. PTSD-SP seems to have some biological features differentiating it from schizophrenia and PTSD, e.g. there are differences in smooth pursuit eye movement patterns, concentrations of corticotropin-releasing factor and dopamine ,-hydroxylase activity. Conclusion:, There is currently not yet full support for PTSD-SP as a nosological entity. However, the delineation of PTSD-SP from other psychiatric syndromes is notable and biological studies seem to support the validity as a separate diagnostic entity. [source] Validity and reliability of the guidelines of the Surveillance of Cerebral Palsy in Europe for the classification of cerebral palsyDEVELOPMENTAL MEDICINE & CHILD NEUROLOGY, Issue 11 2008Mary Gainsborough MRCPCH The validity and reliability of the guidelines of the Surveillance of Cerebral Palsy in Europe (SCPE) for the classification of cerebral palsy (CP) were tested by administering 10 written case vignettes via an interactive web-based link to 30 SCPE partners. There was a moderately good level of agreement (,=0.59) about inclusion as a CP case on the SCPE database. Classification by CP subtype differed in two main areas: assigning spastic versus dyskinetic and judgement of distribution of spastic involvement. Agreement on Gross Motor Function Classification System (GMFCS) level was less good than reported in previous studies. Twenty respondents repeated the test 5 months later and there was good repeatability for case inclusion (,= 0.72) but considerable variation in assignment of CP subtype and GMFCS level. There is a need for further collaborative work and training to improve harmonization of the classification of CP, including examination, application of SCPE guidelines, and register coding. [source] Reliability and validity of the Observational Gait Scale in children with spastic diplegiaDEVELOPMENTAL MEDICINE & CHILD NEUROLOGY, Issue 1 2003Anna H Mackey MS PT The aim of this study was to establish the reliability and validity of visual gait assessment in children with spastic diplegia, who were community or household ambulators, using a modified version of the Physicians Rating Scale, known as the Observational Gait Scale (OGS). Two clinicians viewed edited split-screen video recordings of 20 children/adolescents (11 males, 9 females; mean age 12 years, range 6 to 21 years) made at the time of three-dimensional gait analysis (3-DGA). Walking ability in each child was scored at initial assessment and reassessed from the same videos three months later using the first seven sections of the OGS. Validity of the OGS score was determined by comparison with 3-DGA. The OGS was found to have acceptable interrater and intrarater reliability for knee and foot position in mid-stance, initial foot contact, and heel rise with weighted kappas (wk) ranging from 0.53 to 0.91 (intrarater) and 0.43 to 0.86 (interrater). Comparison with 3-DGA suggests that these sections might also have high validity(wk range 0.38,0.94). Base of support and hind foot position had lower interrater and intrarater reliabilities (wk 0.29 to 0.71 and wk 0.30 to 0.78 respectively) and were not easily validated by 3-DGA. [source] Reproducibility, validity, and responsiveness of a disease-specific symptom questionnaire for gastroesophageal reflux diseaseDISEASES OF THE ESOPHAGUS, Issue 4 2000C. J. Allen The purpose of this study was to establish the reproducibility, validity, and responsiveness of a symptom questionnaire to assess patients with gastroesophageal reflux disease (GERD). A total of 300 patients with GERD completed questionnaires before and 6 months after laparoscopic Nissen fundoplication. Forty-six GERD patients who continued on omeprazole served as controls. Lower esophageal sphincter pressure, 24-h pH, and quality of life (SF36) were measured at baseline and follow-up. Reproducibility was calculated as an intraclass correlation coefficient (ICC) from a repeated-measures analysis of variance on symptom scores (SS) on two consecutive days. Validity was established by correlating SS with 24-h pH and SF36 scores. Responsiveness was calculated as the the ratio of the mean paired difference in score in the surgical group to the within-subject variability in control subjects. Reproducibility was very high, as revealed by an ICC of 0.92. Strong correlations between SS and SF36 scores at baseline and after surgery demonstrated high cross-sectional validity. Correlation between change in SS and change in pH, SF36 pain, general health, and physical health scores demonstrated longitudinal validity. The mean (95% confidence interval) paired differences in SS were 25.6 (23.7, 27.5) in the study and 2.0 (,3.2, 7.3) in the control groups, and the responsive index was 1.0. The estimated minimally important clinical difference was 7. We conclude that the symptom score is a reproducible, valid, and responsive instrument for assessing symptoms caused by GERD. [source] Online test using displacement,force mixed controlEARTHQUAKE ENGINEERING AND STRUCTURAL DYNAMICS, Issue 8 2005Peng Pan Abstract This paper proposes an online test technique that employs mixed control of displacement and force. Two types of mixed control, ,displacement,force combined control' and ,displacement,force switching control' are proposed. In displacement,force combined control, one jack is operated by displacement-control, and another is operated by force-control. Validity of the combined control technique is demonstrated by a series of online tests applied to a base-isolated structure subjected to horizontal and vertical ground motions simultaneously. The substructuring technique is employed in the tests, and the base-isolation layer is tested, with the rest of the structure modeled in the computer. Displacement-control and force-control were adopted for simulating the horizontal and vertical response, respectively. Both displacement- and force-control were implemented successfully despite interference between the two jacks. Earthquake responses of the base-isolated structure involving the effects of varying axial forces on the horizontal hysteretic behavior of the base-isolation layer were simulated. In the displacement,force switching control, the jack was operated by displacement-control when the test specimen was flexible but switched to force-control once the specimen became stiff. Validity of the switching control technique was also checked by a series of online tests applied to the base-isolated structure subjected to vertical ground motions. Switching between displacement-control and force-control was achieved when the axial force applied to the base-isolation layer changed from tension to compression or from compression to tension. Both the displacement- and force-control were successful even with many rounds of switching. The test revealed that large accelerations occurred on the floor immediately above the base-isolation layer at the instants when the axial force of the base-isolation layer changed from tension to compression. Copyright © 2005 John Wiley & Sons, Ltd. [source] Validity of suspected alcohol and drug violations in aviation employeesADDICTION, Issue 10 2010Guohua Li ABSTRACT Aims In the United States, transportation employees who are suspected of using alcohol and drugs are subject to reasonable-cause testing. This study aims to assess the validity of suspected alcohol and drug violations in aviation employees. Methods Using reasonable-cause testing and random testing data from the Federal Aviation Administration for the years 1995,2005, we calculated the positive predictive value (PPV) and positive likelihood ratio (LR+) of suspected alcohol and drug violations. The true status of violations was based on testing results, with an alcohol violation being defined as a blood alcohol concentration of ,0.04 mg/dl and a drug violation as a test positive for marijuana, cocaine, amphetamines, phencyclidine or opiates. Results During the 11-year study period, a total of 2284 alcohol tests and 2015 drug tests were performed under the reasonable-cause testing program. The PPV was 37.7% [95% confidence interval (CI), 35.7,39.7%] for suspected alcohol violations and 12.6% (95% CI, 11.2,14.1%) for suspected drug violations. Random testing revealed an overall prevalence of 0.09% for alcohol violations and 0.6% for drug violations. The LR+ was 653.6 (95% CI, 581.7,734.3) for suspected alcohol violations and 22.5 (95% CI, 19.6,25.7) for suspected drug violations. Conclusion The discriminative power of reasonable-cause testing suggests that, despite its limited positive predictive value, physical and behavioral observation represents an efficient screening method for detecting alcohol and drug violations. The limited positive predictive value of reasonable-cause testing in aviation employees is due in part to the very low prevalence of alcohol and drug violations. [source] Validity of Revised Doppler Echocardiographic Algorithms and Composite Clinical and Angiographic Data in Diagnosis of Diastolic DysfunctionECHOCARDIOGRAPHY, Issue 10 2006Kofo O. Ogunyankin M.D. Background: Commonly used echocardiographic indices for grading diastolic function predicated on mitral inflow Doppler analysis have a poor diagnostic concordance and discriminatory value. Even when combined with other indices, significant overlap prevents a single group assignment for many subjects. We tested the relative validity of echocardiographic and clinical algorithms for grading diastolic function in patients undergoing cardiac catheterization. Method: Patients (n = 115), had echocardiograms immediately prior to measuring left ventricular (LV) diastolic (pre-A, mean, end-diastolic) pressures. Diastolic function was classified into the traditional four stages, and into three stages using a new classification that obviates the pseudonormal class. Summative clinical and angiographic data were used in a standardized fashion to classify each patient according to the probability for abnormal diastolic function. Measured LV diastolic pressure in each patient was compared with expected diastolic pressures based on the clinical and echocardiographic classifications. Result: The group means of the diastolic pressures were identical in patients stratified by four-stage or three-stage echocardiographic classifications, indicating that both classifications schemes are interchangeable. When severe diastolic dysfunction is diagnosed by the three-stage classification, 88% and 12%, respectively, were clinically classified as high and intermediate probability, and the mean LV pre-A pressures was >12 mmHg (P < 0.005). Conversely, the mean LV pre-A pressure in the clinical low probability or echocardiographic normal groups was <11 mmHg. Conclusion: Use of a standardized clinical algorithm to define the probability of diastolic function identifies patients with elevated LV filing pressure to the same extent as echocardiographic methods. [source] Validity of High-Stakes Assessment: Are Students Engaged in Complex Thinking?EDUCATIONAL MEASUREMENT: ISSUES AND PRACTICE, Issue 3 2004Suzanne Lane The validity of high-stakes assessments and accountability systems is discussed in relation to the requirements of No Child Left Behind (NCLB). The extent to which content standards and assessments are cognitively rich, the challenges in setting performance standards, and the impact of high-stakes assessments on instruction and student learning are addressed. The article argues for quality content standards, cognitively rich assessments, and a cohesive, balanced assessment system. [source] SAT Validity for Linguistic Minorities at the University of California, Santa BarbaraEDUCATIONAL MEASUREMENT: ISSUES AND PRACTICE, Issue 1 2004Rebecca Zwick The validity of the SAT as an admissions criterion for Latinos and Asian Americans who are not native English speakers was examined. The analyses, based on 1997 and 1998 UCSB freshmen, focused on the effectiveness of SAT scores and high school grade-point average (HSGPA) in predicting college freshman grade-point average (FGPA). When regression equations were estimated based on all students combined, some systematic prediction errors occurred. For language minorities, using only high school grades as a predictor led to predicted FGPAs that tended to exceed actual FGPAs, particularly for Latinos. Including SAT scores in the equation notably reduced prediction bias. Further analyses showed that, while HSGPA had the highest correlation with FGPA for most groups, SAT verbal score was the strongest predictor of FGPA for language minorities in 1998. An overriding conclusion is that combining data across language groups can obscure important test validity information. [source] Reconceptualizing Validity for Classroom AssessmentEDUCATIONAL MEASUREMENT: ISSUES AND PRACTICE, Issue 4 2003Pamela A. Moss This article explores the shortcomings of conventional validity theory for guiding classroom assessment practice and suggests additional theoretical resources from sociocultural theory and hermeneutics to complement and challenge conventional theory. To illuminate these concerns and possibilities in a concrete context, the author uses her own classroom experience in teaching a qualitative research methods course. The importance of examining cases of assessment practice in context for developing, teaching, and evaluating validity theory is discussed. [source] Teaching for the Test: Validity, Fairness, and Moral ActionEDUCATIONAL MEASUREMENT: ISSUES AND PRACTICE, Issue 3 2003Linda Crocker In response to heightened levels of assessment activity at the K-12 level to meet requirements of the No Child Left Behind Act of 2001, measurement professionals are called to focus greater attention on four fundamental areas of measurement research and practice: (a) improving the research infrastructure for validation methods involving judgments of test content; (b) expanding the psychometric definition of fairness in achievement testing; (c) developing guidelines for validation studies of test use consequences; and (d) preparing teachers for new roles in instruction and assessment practice. Illustrative strategies for accomplishing these goals are outlined. [source] A missing values imputation method for time series data: an efficient method to investigate the health effects of sulphur dioxide levelsENVIRONMETRICS, Issue 2 2010Swarna Weerasinghe Abstract Environmental data contains lengthy records of sequential missing values. Practical problem arose in the analysis of adverse health effects of sulphur dioxide (SO2) levels and asthma hospital admissions for Sydney, Nova Scotia, Canada. Reliable missing values imputation techniques are required to obtain valid estimates of the associations with sparse health outcomes such as asthma hospital admissions. In this paper, a new method that incorporates prediction errors to impute missing values is described using mean daily average sulphur dioxide levels following a stationary time series with a random error. Existing imputation methods failed to incorporate the prediction errors. An optimal method is developed by extending a between forecast method to include prediction errors. Validity and efficacy are demonstrated comparing the performances with the values that do not include prediction errors. The performances of the optimal method are demonstrated by increased validity and accuracy of the , coefficient of the Poisson regression model for the association with asthma hospital admissions. Visual inspection of the imputed values of sulphur dioxide levels with prediction errors demonstrated that the variation is better captured. The method is computationally simple and can be incorporated into the existing statistical software. Copyright © 2009 John Wiley & Sons, Ltd. [source] Validity of Three Measures of Health-related Quality of Life in Children with Intractable EpilepsyEPILEPSIA, Issue 10 2002Elisabeth M. S. Sherman Summary: ,Purpose: Validity studies on health-related quality of life (HRQOL) scales for pediatric epilepsy are few, and cross-validation with other samples has not been reported. This study was designed to assess the validity of three parent-rated measures of HRQOL in pediatric epilepsy: (a) the Impact of Childhood Illness Scale (ICI), (b) the Impact of Child Neurologic Handicap Scale (ICNH), and (c) the Hague Restrictions in Epilepsy Scale (HARCES). Methods: Retrospective data were examined for 44 children with intractable epilepsy. Validity was assessed by evaluating differences across epilepsy severity groups as well as correlations between HRQOL scales and neurologic variables (seizure severity, epilepsy duration, current/prior antiepileptic medications) and psychosocial measures (emotional functioning, IQ, social skills, adaptive behavior). Scale overlap with a global QOL rating also was assessed. Results: The HRQOL measures were moderately to highly intercorrelated. The scales differed in terms of their associations with criterion measures. The HARCES was related to the highest number of neurologic variables and the ICNH to the fewest. All three scales were related to psychosocial functioning and to global quality of life. Conclusions: The results of this study suggest that the three measures are likely adequate measures of HRQOL for use in intractable childhood epilepsy. The measures were highly intercorrelated, and they were all broadly related to criterion measures reflecting specific domains of HRQOL as well as global QOL. Some differences between scales emerged, however, that suggest care in choosing HRQOL instruments for children with epilepsy. [source] The Family Daily Hassles Inventory: A Preliminary Investigation of Reliability and ValidityFAMILY & CONSUMER SCIENCES RESEARCH JOURNAL, Issue 2 2002Suzanne Z. Rollins This study investigated the preliminary reliability and validity of a new family daily hassles assessment using two well-established instruments that measure daily hassles and health status. Participants (140 mothers) completed a self-administered survey. The results indicated adequate reliability of the new assessment and supported the concurrent and construct validity of the scores obtained with the new assessment as a measure of daily hassles. [source] Factorial and Construct Validity of the Revised Short Form Integrative Psychotherapy Alliance Scales for Family, Couple, and Individual TherapyFAMILY PROCESS, Issue 3 2008WILLIAM M. PINSOF PH.D The Integrative Psychotherapy Alliance model brought an interpersonal and systemic perspective to bear on theory, research, and practice on the psychotherapeutic alliance. Questions have been raised about the independence of the theoretical factors in the model and their operationalization in the Individual, Couple, and Family Therapy Alliance Scales. This paper presents results of a confirmatory factor analysis of the scales that delineated at least three distinct interpersonal factors as well as shorter versions of the three scales to facilitate their use in research and practice. The paper also presents the results of a study testing each factor's association with client retention and progress over the first eight sessions in individual and couple therapy. At least two of the interpersonal factors were uniquely associated with progress in individual and couple functioning. Implications of the results for theory, research, practice, and training in individual, couple, and family therapy are elaborated. RESUMEN Validez de constructo y factorial de las versiones cortas revisadas de las escalas de alianza en psicoterapia integradora para la terapia familiar, de pareja e individual El modelo de alianza psicoterapéutica integradora aplicó una perspectiva sistémica e interpersonal en la teoría, la investigación y la práctica de la alianza psicoterapéutica. Se cuestionó la independencia de los factores teóricos en el modelo y su operacionalización en las escalas de alianza en terapia individual, de pareja y familiar. Este artículo presenta resultados de un análisis factorial confirmativo de las escalas que delinearon por lo menos tres factores interpersonales distintos, como también versiones más cortas de las tres escalas para facilitar su uso en la investigación y la práctica. El artículo también presenta los resultados de un estudio que analiza la asociación de cada factor con la fidelización de clientes y la evolución durante las primeras ocho sesiones en terapia individual y de pareja. Por lo menos dos de los factores interpersonales estuvieron asociados exclusivamente con la evolución en el funcionamiento individual y de pareja. Se elaboran las implicancias de los resultados para la teoría, la investigación, la práctica y la capacitación en terapia individual, de pareja y familiar. Palabras clave: alianza, análisis factorial, validez de constructo, evolución/resultado, integración [source] Assessment of Family Functioning in Caucasian and Hispanic Americans: Reliability, Validity, and Factor Structure of the Family Assessment DeviceFAMILY PROCESS, Issue 4 2007GREGORY A. AARONS PH.D. The purpose of this study was to examine the factor structure, reliability, and validity of the Family Assessment Device (FAD) among a national sample of Caucasian and Hispanic American families receiving public sector mental health services. A confirmatory factor analysis conducted to test model fit yielded equivocal findings. With few exceptions, indices of model fit, reliability, and validity were poorer for Hispanic Americans compared with Caucasian Americans. Contrary to our expectation, an exploratory factor analysis did not result in a better fitting model of family functioning. Without stronger evidence supporting a reformulation of the FAD, we recommend against such a course of action. Findings highlight the need for additional research on the role of culture in measurement of family functioning. [source] Validity and reliability of the Physical Activity Scale for the Elderly (PASE) in Japanese elderly peopleGERIATRICS & GERONTOLOGY INTERNATIONAL, Issue 3 2008Akiko Hagiwara Aim: In Japan, there are no valid and reliable physical activity questionnaires for elderly people. In this study, we translated the Physical Activity Scale for the Elderly (PASE) into Japanese and assessed its validity and reliability. Methods: Three hundred and twenty-five healthy and elderly subjects over 65 years were enrolled. Concurrent validity was evaluated by Spearman's rank correlation coefficient between PASE scores and an accelerometer (waking steps and energy expenditure), a physical activity questionnaire for adults in general (the Japan Arteriosclerosis Longitudinal Study Physical Activity Questionnaire, JALSPAQ), grip strength, mid-thigh muscle area per bodyweight, static valance and bodyfat percentage. Reliability was evaluated by the test,retest method over a period of 3,4 weeks. Results: The mean PASE score in this study was 114.9. The PASE score was significantly correlated with walking steps (, = 0.17, P = 0.014), energy expenditure (, = 0.16, P = 0.024), activity measured with the JALSPAQ (, = 0.48, P < 0.001), mid-thigh muscle area per bodyweight (, = 0.15, P = 0.006) and static balance (, = 0.19, P = 0.001). The proportion of consistency in the response between the first and second surveys was adequately high. The intraclass correlation coefficient for the PASE score was 0.65. Conclusions: The Japanese version of PASE was shown to have acceptable validity and reliability. The PASE is useful to measure the physical activity of elderly people in Japan. [source] Validity and Reliability of the Turkish Migraine Disability Assessment (MIDAS) QuestionnaireHEADACHE, Issue 8 2004Mustafa Erta Objectives.,The aim of this study is to assess the comprehensibility, internal consistency, patient-physician reliability, test-retest reliability, and validity of Turkish version of Migraine Disability Assessment (MIDAS) questionnaire in patients with headache. Background.,MIDAS questionnaire has been developed by Stewart et al and shown to be reliable and valid to determine the degree of disability caused by migraine. Design and Methods.,This study was designed as a national multicenter study to demonstrate the reliability and validity of Turkish version of MIDAS questionnaire. Patients applying to 17 Neurology Clinics in Turkey were evaluated at the baseline (visit 1), week 4 (visit 2), and week 12 (visit 3) visits in terms of disease severity and comprehensibility, internal consistency, test-retest reliability, and validity of MIDAS. Since the severity of the disease has been found to change significantly at visit 2 compared to visit 1, test-retest reliability was assessed using the MIDAS scores of a subgroup of patients whose disease severity remained unchanged (up to ±3 days difference in the number of days with headache between visits 1 and 2). Results.,A total of 306 patients (86.2% female, mean age: 35.0 ± 9.8 years) were enrolled into the study. A total of 65.7%, 77.5%, 82.0% of patients reported that "they had fully understood the MIDAS questionnaire" in visits 1, 2, and 3, respectively. A highly positive correlation was found between physician and patient and the applied total MIDAS scores in all three visits (Spearman correlation coefficients were R= 0.87, 0.83, and 0.90, respectively, P < .001). Internal consistency of MIDAS was assessed using Cronbach's , and was found at acceptable (>0.7) or excellent (>0.8) levels in both patient and physician applied MIDAS scores, respectively. Total MIDAS score showed good test-retest reliability (R= 0.68). Both the number of days with headache and the total MIDAS scores were positively correlated at all visits with correlation coefficients between 0.47 and 0.63. There was also a moderate degree of correlation (R= 0.54) between the total MIDAS score at week 12 and the number of days with headache at visit 2 + visit 3, which quantify headache-related disability over a 3-month period similar to MIDAS questionnaire. Conclusion.,These findings demonstrated that the Turkish translation is equivalent to the English version of MIDAS in terms of internal consistency, test-retest reliability, and validity. Physicians can reliably use the Turkish translation of the MIDAS questionnaire in defining the severity of illness and its treatment strategy when applied as a self-administered report by migraine patients themselves. [source] Assessing the Validity of Insurance Coverage Data in Hospital Discharge Records: California OSHPD DataHEALTH SERVICES RESEARCH, Issue 5 2003Thomas C. Buchmueller Objective. To assess the accuracy of data on "expected source of payment" in the patient discharge database compiled by the California Office of Statewide Health Planning and Development (OSHPD). Data Sources. The OSHPD discharge data for the years 1993 to 1996 linked with administrative data from the University of California (UC) health benefits program for the same years. The linked dataset contains records for all stays in California hospitals by UC employees, retirees, and spouses. Study Design. The accuracy of the OSHPD data is assessed using cross-tabulations of insurance type as coded in the two data sources. The UC administrative data is assumed to be accurate, implying that differences between the two sources represent measurement error in the OSHPD data. We cross-tabulate insurance categories and analyze the concordance of dichotomous measures of health maintenance organization (HMO) enrollment derived from the two sources. Principal Findings. There are significant coding errors in the OSHPD data on expected source of payment. A nontrivial percentage of patients with preferred provider organization (PPO) coverage are erroneously coded as being in HMOs, and vice versa. The prevalence of such errors increased after OSHPD introduced a new expected source of payment category for PPOs. Measurement problems are especially pronounced for older patients. Many patients over age 65 who are still covered by a commercial insurance plan are erroneously coded as having Medicare coverage. This, combined with the fact that during the period we analyzed, Medicare HMO enrollees and beneficiaries in the fee-for-service (FFS) program are combined in a single payment category, means that the OSHPD data provides essentially no information on insurance coverage for older patients. Conclusions. Researchers should exercise caution in using the expected source of payment in the OSHPD data. While measures of HMO coverage are reasonably accurate, it is not possible in these data to clearly identify PPOs as a distinct insurance category. For patients over age 65, it is not possible at all to distinguish among alternative insurance arrangements. [source] Permutation tests for factorially designed neuroimaging experimentsHUMAN BRAIN MAPPING, Issue 3 2004John Suckling Abstract Permutation methods for analysis of functional neuroimaging data acquired as factorially designed experiments are described and validated. The F ratio was estimated for main effects and interactions at each voxel in standard space. Critical values corresponding to probability thresholds were derived from a null distribution sampled by appropriate permutation of observations. Spatially informed, cluster-level test statistics were generated by applying a preliminary probability threshold to the voxel F maps and then computing the sum of voxel statistics in each of the resulting three-dimensional clusters, i.e., cluster "mass." Using simulations comprising two between- or within-subject factors each with two or three levels, contaminated by Gaussian and non-normal noise, the voxel-wise permutation test was compared to the standard parametric F test and to the performance of the spatially informed statistic using receiver operating characteristic (ROC) curves. Validity of the permutation-testing algorithm and software is endorsed by almost identical performance of parametric and permutation tests of the voxel-level F statistic. Permutation testing of suprathreshold voxel cluster mass, however, was found to provide consistently superior sensitivity to detect simulated signals than either of the voxel-level tests. The methods are also illustrated by application to an experimental dataset designed to investigate effects of antidepressant drug treatment on brain activation by implicit sad facial affect perception in patients with major depression. Antidepressant drug effects in left amygdala and ventral striatum were detected by this software for an interaction between time (within-subject factor) and group (between-subject factor) in a representative two-way factorial design. Hum. Brain Mapping 22:193,205, 2004. © 2004 Wiley-Liss, Inc. [source] | ||||||||||||||||||||||||||||||||||||||||||||||||||||