Home About us Contact
|
Home About us Contact | ||
|
|
||
Psychological Testing (psychological + testing)
Selected AbstractsDoes an Argument-Based Approach to Validity Make a Difference?EDUCATIONAL MEASUREMENT: ISSUES AND PRACTICE, Issue 1 2010Carol A. Chapelle Drawing on experience between 2000 and 2007 in developing a validity argument for the high-stakes Test of English as a Foreign LanguageÔ (TOEFL®), this paper evaluates the differences between the argument-based approach to validity as presented byKane (2006)and that described in the 1999 AERA/APA/NCME Standards for Educational and Psychological Testing. Based on an analysis of four points of comparison,framing the intended score interpretation, outlining the essential research, structuring research results into a validity argument, and challenging the validity argument,we conclude that an argument-based approach to validity introduces some new and useful concepts and practices. [source] Current Concerns in Validity TheoryJOURNAL OF EDUCATIONAL MEASUREMENT, Issue 4 2001Michael T. Kane We are at the end of the first century of work on models of educational and psychological measurement and into a new millennium. This certainly seems like an appropriate time for looking backward and looking forward in assessment. Furthermore, a new edition of the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 1999) has been published, and the previous editions of the Standards have served as benchmarks in the development of measurement theory. This backward glance will be just that, a glance. After a brief historical review focusing mainly on construct validity, the current state of validity theory will be summarized, with an emphasis on the role of arguments in validation. Then how an argument-based approach might be applied will be examined in regards to two issues in validity theory: the distinction between performance-based and theory-based interpretations, and the role of consequences in validation. [source] The validation of a rating scale to assess dietitians' use of behaviour change skillsJOURNAL OF HUMAN NUTRITION & DIETETICS, Issue 4 2008G. Bonner Background:, Evidence suggests that education alone is unlikely to elicit dietary-behavioural change (Contento, 1995). Consequently, many dietitians are moving from a traditional advice-giving role to one which utilises ,behaviour change skills' (BCS) in dietary counselling. BCS is an umbrella term used to cover a wide range of skills and techniques drawn from the fields of counselling, motivational interviewing (MI) and cognitive behavioural therapy (CBT). In order to assess the efficacy of this approach, a means of quantifying BCS-use is required. This two-stage study aimed to validate a newly-devised scale to assess dietitians' BCS-use in one-to-one dietary counselling. Methods:, Items for the scale were generated by drawing on the literature, syllabi for training in BCS and its parent disciplines (counselling, MI and CBT), and specialist dietitians. The resulting scale and manual were revised following assessment of content validity by expert panel and piloting. In stage one, 21 dietetic consultations were audiotaped and rated for BCS-use by three BCS-trained dietitians. Inter-rater agreement was calculated using the kappa statistic and intra-class correlation (ICC), to give a ,chance corrected' measure of agreement. Validity was tested using a psychologist's subjective assessment of BCS-use as a proxy ,gold-standard' compared with the dietitians' ratings, again using kappa and ICC. In stage two the scale was further revised before an additional 20 audiotaped consultations were analysed using the same procedure. Ethical approval for the study was given by the appropriate NHS and university research ethics committees. Results:, At stage one, although kappas were fairly poor for agreement on individual criteria, the ICC for overall scores indicated a ,fair' level of agreement, according to Shrout's (1998) classifications: ICC = 0.584 (CI 0.339,0.784). Results for validity were poor with the psychologist frequently rating higher than the dietitians. At stage two, following scale revision, results for inter-rater agreement improved with more criteria showing ,moderate' or ,substantial' agreement. Ten out of the 21 criteria achieved levels of agreement classified as ,fair' or higher for all three rater pairs. The ICC for overall scores improved to indicate ,moderate' agreement: ICC = 0.640 (CI 0.404,0.821). Validity results remained poor. Discussion:, The moderate level of overall inter-rater agreement observed in the revised scale is considered acceptable (Jones, 2006) and indicates this tool is useful. This measure is more relevant to the purpose of the tool than agreement on individual criteria given it is intended to classify consultations overall as low/medium/high use of BCS rather than to examine individual skills. However, in terms of validity, the discrepancy between dietitian and psychologist ratings requires further investigation. It is hypothesized that the dietitians had higher expectations of what a dietitian could achieve in terms of proficiency in BCS and, as such, rated more stringently than the psychologist. Achieving a clear picture of validity usually necessitates a series of assessments (Murphy & Davidshofer, 2005); the BCS rating scale is no exception with further testing required. Conclusions:, The revised scale shows acceptable inter-rater reliability and robust content validity in our study sample. However, quantitative examination of validity gave poor results and further assessment is required to provide a tool with which we can confidently assess dietitians' use of BCS. References, Contento, I., Balch, G.I., Bronner, Y.L. et al. (1995) The effectiveness of nutrition education and implications for nutrition education policy, programs, and research: a review of the research. J. Nutr. Educ.27, 355,364. Jones, J.M. (2006) Nutritional Screening and Assessment Tools. New York: Nova Science Publishers. Murphy, K.R. & Davidshofer, C.O. (2005) Psychological Testing , Principles and Applications, 6th edn. New Jersey: Pearson Education Inc. Shrout, P. (1998) Measurement reliability and agreement in psychiatry. Stat. Methods Med. Res. 7, 301,317. [source] MMPI Profile as an Outcome "Predictor" in the Treatment of Noncancer Pain Patients Utilizing Intraspinal Opioid TherapyNEUROMODULATION, Issue 3 2001Daniel M. Doleys PhD Objective. To evaluate changes in Minnesota Multiphasic Personality Inventory (MMPI) profiles pre- and post-treatment involving intrathecal opioid therapy. Patients and Methods. This study reports on 30 patients that were evaluated pre- and post-intraspinal opioid therapy. Treatment duration was slightly more than four years. Each patient experienced chronic non-cancer pain deemed suitable for trialing and subsequent implantation of a drug administration system (DAS). On average the patients had experienced pain for 8.4 years and had a mean of 3.2 pain-related surgeries. Results. The patients could be divided into "positive change group" and "negative change group" based upon pre- and post-treatment MMPI profiles. Those patients in the negative change group had more "normal profiles" pretreatment. This group evidenced less reduction in pain and was found to be using slightly higher levels of intraspinal opioids. Conclusions. These results would suggest that the MMPI profile may not be a good "predictor" of long-term outcome utilizing intraspinal opioid therapy. Indeed, patients with the more normal profile pretreatment did not fare as well as those with the more elevated profile. A positive change in MMPI profile from pre- to post-treatment was associated with a higher level of pain reduction. Patient selection therefore should be based not on a single test such as the MMPI, but on consistency across multiple sources of information including physical examination, complaints of pain and disability, behavioral observations, and psychological testing. [source] Central nervous system-related permanent consequences in patients with Langerhans cell histiocytosis,PEDIATRIC BLOOD & CANCER, Issue 1 2007Edda Mittheisz MD Abstract Background Permanent consequences in Langerhans cell histiocytosis (LCH) are irreversible late sequelae related to the disease that may severely impair the quality of life of survivors. The frequency and pattern of permanent consequences affecting the central nervous system (CNS) remains to be determined. Procedure In this single center study, 25 LCH patients observed for a median time of 10 years 3 months underwent a uniform thorough follow-up program including neuropsychological testing and electrophysiological evaluation. Results Overall permanent consequences were seen in 9 of 25 patients. Intracranial abnormalities were the most frequent including diabetes insipidus (DI) in seven patients, anterior pituitary deficiencies in five patients, and neurodegenerative CNS disease in five patients. No patient had overt neurological symptoms upon neurological evaluation, but psychological testing revealed subtle deficits in short-term auditory memory (STAM) in 14 patients. Brain stem evoked potentials showed abnormalities in four of nine tested patients, all of these four had neurodegeneration on MRI. Conclusion Psychoneuroendocrine sequelae were found in an unexpectedly high number of patients in this single center study. Long-term follow-up focusing on such sequelae are important in LCH survivors, in order to detect early deficits, to monitor the evolution of the disease, and to provide specific support. Pediatr Blood Cancer 2007;48:50,56. © 2006 Wiley-Liss, Inc. [source] Psychological tests used in child custody evaluations,BEHAVIORAL SCIENCES & THE LAW, Issue 4 2001Francella A. Quinnell Ph.D. Controversy has long surrounded the use of psychological testing in child custody evaluations. The present study explored the current status of psychological testing in these evaluations using a national survey of 198 psychologists. Findings revealed that participants viewed testing as one source among many for data collection, neither under- nor over-valuing its importance. Results also indicated that participants were more discriminating in their test selection, with a greater focus on objective assessment, particularly in the use of parent inventories and rating scales. These findings tend to negate much of the past criticism and reflect closer adherence to APA guidelines. Copyright © 2001 John Wiley & Sons, Ltd. [source] Assessment in Clinical Psychology: A Perspective on the Past, Present Challenges, and Future ProspectsCLINICAL PSYCHOLOGY: SCIENCE AND PRACTICE, Issue 3 2006James N. Butcher Assessment emerged during the early twentieth century with the development of tests for assessing characteristics such as intelligence, personality, and suitability for employment. The long, interwoven relationship between clinical psychology and assessment began to change during the 1970s when many clinical psychologists became more involved in behavioral therapy and moved away from psychological testing and with the expanding role of managed care in the mental health services. Clinical assessment broadened into forensic, medical, and personnel applications with psychologists expanding professional roles. The status of assessment was reviewed and some challenges were highlighted. The potential for assessment to contribute to the understanding of mental health problems through collaborative cross-cultural study of psychopathology was suggested with the growing development of clinical psychology internationally. [source] | ||||||||||||||||