Home About us Contact
|
Home About us Contact | ||
|
|
||
Assessment Instruments (assessment + instruments)
Selected AbstractsAutomating Standard Alcohol Use Assessment Instruments Via Interactive Voice Response TechnologyALCOHOLISM, Issue 2 2002James C. Mundt Background: Interactive voice response (IVR) technology integrates touch-tone telephones with computer-automated data processing. IVR offers a convenient, efficient method for remote collection of self-report data. Methods: Twenty-six subjects recruited from an outpatient alcohol treatment center completed IVR and paper/pencil versions of a demographic and drinking history questionnaire, Stages of Change Readiness and Treatment Eagerness Scale, Drinker Inventory of Consequences, Obsessive-Compulsive Drinking Scale, Alcohol Dependence Scale, and two numerical rating scales of craving and desire to drink during the prior week. Administration of the instruments in both formats was repeated 1 week later. The order of administration method was counterbalanced between subjects and reversed across data collection sessions. Scale and subscale scores from both methods were correlated within sessions. Test-retest correlations were also calculated for each method. A criterion of ,= 0.01 was used to control type I statistical error. Results: Intermethod correlations within each session were significant for all of the instruments administered. Test-retest correlations for both methods were also significant, except for the numerical ratings. Scores on the Alcohol Dependence Scale obtained via IVR were significantly lower than those collected by paper/pencil. Other differences between the data collection methods or across the sessions were inconsistent. The average IVR call length was 34 min and 23 sec. Paper/pencil forms required an average of 18 min and 38 sec to complete and an additional 10 min and 17 sec for data entry. Conclusions: IVR technology provides a convenient alternative to collecting self-report measures of treatment outcomes. Both paper/pencil and IVR assessments provide highly convergent data and demonstrate good test-retest reliability. Alcohol Dependence Scale score differences between methods highlight special considerations for IVR adaptation of existing paper/pencil instruments. Benefits of IVR include procedural standardization, automatic data scoring, direct electronic storage, and remote accessibility from multiple locations. [source] Panic Disorder Severity Scale: Reliability and validity of the Turkish version,,DEPRESSION AND ANXIETY, Issue 1 2004E. Serap Monkul M.D. Abstract We assessed the reliability and validity of the Turkish version of the seven-item Panic Disorder Severity Scale (PDSS). We recruited 174 subjects, including 104 with current DSM-IV panic disorder with (n = 76) or without(n = 28)agoraphobia, 14 with a major depressive episode, 24 with a non-panic anxiety disorder, and 32 healthy controls. Assessment instruments were Panic Disorder Severity Scale, Panic and Agoraphobia Scale, both the observer-rated (P&Ao) and self-rating (P&Asr); Clinical Global Impression Scale (CGI); Hamilton Anxiety Scale, and Beck Depression Inventory. We repeated the measures for a group of panic disorder patients (n = 51) after 4 weeks to assess test,retest reliability. The internal consistency (Cronbach's ,) of the PDSS was .92,94. The inter-rater correlation coefficient was .79. The test,retest correlation coefficient after 4 weeks was .63. In discriminant validity analyses, the highest correlation for PDSS was with P&Ao, P&Asr (r=.87 and .87, respectively) and CGI (r=.76) and the lowest with Beck Depression Inventory (r=.29). The cut-off point was six/seven, associated with high sensitivity (99%) and specificity (98%). This study confirmed the objectivity, reliability and validity of the Turkish version of the PDSS. Depression and Anxiety 00:000,000, 2004. © 2004 Wiley-Liss, Inc. [source] Clinical correlates of clozapine prescription for schizophrenia in ChinaHUMAN PSYCHOPHARMACOLOGY: CLINICAL AND EXPERIMENTAL, Issue 1 2007Yu-tao Xiang Abstract Aims Few studies have investigated the prescription patterns of clozapine in outpatients with schizophrenia in China. It is an important issue due to clozapine's high efficacy and potentially fatal side effect profile. This study examined the use of clozapine and its correlates in China. Methods Three hundred ninety-eight clinically stable outpatients with schizophrenia were randomly selected and interviewed in Hong Kong (HK) and Beijing (BJ). Assessment instruments included the Structured Clinical Interview for DSM-IV, Brief Psychiatric Rating Scale, Simpson and Angus Scale of Extrapyramidal Symptoms, Barnes Akathisia Rating Scale and the Hong Kong and Mainland China World Health Organization Quality of Life Schedule-Brief version. Assessments were performed by the same investigator in both sites. Results Clozapine was prescribed to 15.6% of (n,=,62) patients. There was a wide inter-site variation between HK and BJ. Use of clozapine was associated with age, age at onset, extrapyramidal side effects (EPS), having health insurance, use of depot and typical antipsychotic and anticholinergic drugs and benzodiazepines as well as history of suicidal attempts. On multiple logistic regression analysis, the number of hospitalizations, site (HK vs. BJ), use of typical antipsychotics, polypharmacy and co-prescription with anticholinergics were significantly associated with the prescription of clozapine. No significant differences were found between the clozapine and non-clozapine groups with regard to any of the quality of life domains. Conclusion A combination of economical and clinical factors, health policies and the characteristics of the treatment settings plays important roles in determining clozapine use. Clozapine appears to have little significant influence on quality of life in clinical stable Chinese patients with schizophrenia. Copyright © 2007 John Wiley & Sons, Ltd. [source] Forensic Risk Assessment in Intellectual Disabilities: The Evidence Base and Current Practice in One English RegionJOURNAL OF APPLIED RESEARCH IN INTELLECTUAL DISABILITIES, Issue 4 2000Stephen Turner The growing interest in forensic risk assessment in intellectual disability services reflects the perception that deinstitutionalization has exposed more people to a greater risk of offending. However, ,risk' and the related idea of ,dangerousness' are problematic concepts because of connotations of dichotomous definition, stability and predictability. Assessment instruments in mainstream forensic psychiatry often combine actuarial and clinical data, and increasingly stress the dynamic nature of risk as well as the importance of situational and accidental triggers. Despite this increasing sophistication of research in mainstream forensic psychiatry, the ability to predict future offending behaviour remains very limited. Furthermore, actuarial predictors developed in studies of psychiatric or prison populations may not be valid for individuals with intellectual disabilities. Offending behaviour among people with intellectual disabilities is also hard to circumscribe because it often does not invoke full legal process or even reporting to the police. In order to discover how such problems were reflected in practice, a survey of providers in the North-west Region of England was undertaken. Seventy out of 106 providers identified as possibly relevant to this inquiry responded to a short postal questionnaire. Twenty-nine (42%) respondents , mainly in the statutory sector , reported operating a risk assessment policy relating to offending. The number of risk assessments completed in the previous year varied from none to ,several hundred'. Providers reported three main kinds of problems: (1) resources or service configuration; (2) interagency or interdisciplinary cooperation or coordination; and (3) issues relating to the effectiveness, design and content of assessment. [source] Recruiting and Retaining Students in Family and Consumer Sciences Education: El Puente Para El Futuro (The Bridge to the Future) Mentoring ProjectFAMILY & CONSUMER SCIENCES RESEARCH JOURNAL, Issue 1 2006Wanda A. Eastman El Puente Para El Futuro (The Bridge to the Future) mentoring project was undertaken to meet the need for family and consumer sciences (FCS) teachers. The centerpiece of the project was one-on-one mentoring relationships between family and consumer sciences education (FCSE) mentor students from New Mexico State University and mentee students from the Education Program at Dona Ana Branch Community College. During fall 2003, the researchers developed curricula, recruitment materials, and assessment instruments. Seven mentor-mentee pairs completed the project during spring 2004. The researchers planned monthly structured events, and each mentor-mentee pair arranged for unstructured events. Valid and reliable cognitive and affective assessments were administered to participants at the beginning and end of the project. Mentees had significant increases in both cognitive and affective mean scores regarding teaching FCS. This mentoring model is recommended to FCSE educators and others working in recruitment settings. [source] Potentially inappropriate management of depressive symptoms among Ontario home care clientsINTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY, Issue 6 2008Dawn M. Dalby Abstract Objective To examine the prevalence and correlates of potentially inappropriate pharmacotherapy (including potential under-treatment) for depression in adult home care clients. Methods A cross-sectional study of clients receiving services from Community Care Access Centres in Ontario. Three thousand three hundred and twenty-one clients were assessed with the Resident Assessment Instrument for Home Care (RAI-HC). A score of 3 or greater on the Depression Rating Scale (DRS), a validated scale embedded within the RAI-HC, indicates the presence of symptoms of depression. Medications listed on the RAI-HC were used to categorize treatment into two groups: potentially appropriate and potentially inappropriate antidepressant drug therapy. Adjusted logistic regression models were used to explore relevant predictors of potentially inappropriate pharmacotherapy. Results 12.5% (n,=,414) of clients had symptoms of depression and 17% received an appropriate antidepressant. Over half of clients (64.5%) received potentially inappropriate pharmacotherapy (including potential under-treatment). Age 75 years or older, higher levels of caregiver stress and the presence of greater comorbidity were associated with a higher risk of potentially inappropriate pharmacotherapy in multivariate analyses. Documentation of any psychiatric diagnosis on the RAI-HC and receiving more medications were significantly associated with a greater likelihood of appropriate drug treatment. Conclusion Most clients with significant depressive symptoms were not receiving appropriate pharmacotherapy. Having a documented diagnosis of a psychiatric condition on the RAI-HC predicted appropriate pharmacotherapy. By increasing recognition of psychiatric conditions, the use of standardized, comprehensive assessment instruments in home care may represent an opportunity to improve mental health care in these settings. Copyright © 2008 John Wiley & Sons, Ltd. [source] Beyond bone mineral density: can existing clinical risk assessment instruments identify women at increased risk of osteoporosis?JOURNAL OF INTERNAL MEDICINE, Issue 5 2004L. E. Wehren Abstract. Objective., Although osteoporosis and fragility fracture are common amongst postmenopausal women, the extent of risk varies, and measurement of bone mineral density (BMD) is the standard tool used to diagnose and assess fracture risk. Rates of diagnosis remain relatively low, and several groups have developed instruments to help identify individuals who would most benefit from BMD testing. In this paper, we review and compare the performance of these instruments to identify those most useful in the primary care setting. Design., Review of screening instruments comprised osteoporosis clinical risk factors and comparison of the sensitivity and specificity of these algorithms. Results., Validated instruments have varying complexity, but similar sensitivity and specificity for identifying individuals who are likely to have low BMD. The area under the receiver operating characteristic curve ranges from 0.75 (SOFSURF) to 0.81 (SCORE). The simplest of the instruments (OST) uses only age and weight and has an AUC of 0.79. Conclusions., The Osteoporosis Self-assessment Tool, the simplest of the instruments, performs as well as more complex tools and, because of its simplicity, may be the most useful means for the busy clinician to identify postmenopausal women who would most benefit from BMD testing. [source] Successfully Translating Language and Culture when Adapting Assessment MeasuresJOURNAL OF POLICY AND PRACTICE IN INTELLECTUAL DISABILITIES, Issue 2 2010Juan Bornman Abstract A need exists for culturally valid and reliable developmental assessment tools for children with disabilities that are able to accommodate multiple languages. One way in which this goal can be achieved is through test translations. The purpose of this preliminary study was to examine the use of translations of select developmental assessment instruments from English to Afrikaans and from one cultural context to another (Western to South African). Specifically, we examined children's performance on two measures of development: the Mullen Scales of Early Learning and the Ages and Stages Questionnaires (ASQ). Both measures were completed for 47 typically developing South African preschool children between 3 and 6 years of age. The Mullen was completed by a speech and language therapist and the ASQ by a parent. Both of the measures used yielded similar results, and compared favorably with the existing norms. The procedures provide a framework for expanding such adaptations in other applications. [source] Views of nature of science questionnaire: Toward valid and meaningful assessment of learners' conceptions of nature of scienceJOURNAL OF RESEARCH IN SCIENCE TEACHING, Issue 6 2002Norm G. Lederman Helping students develop informed views of nature of science (NOS) has been and continues to be a central goal for kindergarten through Grade 12 (K,12) science education. Since the early 1960s, major efforts have been undertaken to enhance K,12 students and science teachers' NOS views. However, the crucial component of assessing learners' NOS views remains an issue in research on NOS. This article aims to (a) trace the development of a new open-ended instrument, the Views of Nature of Science Questionnaire (VNOS), which in conjunction with individual interviews aims to provide meaningful assessments of learners' NOS views; (b) outline the NOS framework that underlies the development of the VNOS; (c) present evidence regarding the validity of the VNOS; (d) elucidate the use of the VNOS and associated interviews, and the range of NOS aspects that it aims to assess; and (e) discuss the usefulness of rich descriptive NOS profiles that the VNOS provides in research related to teaching and learning about NOS. The VNOS comes in response to some calls within the science education community to go back to developing standardized forced-choice paper and pencil NOS assessment instruments designed for mass administrations to large samples. We believe that these calls ignore much of what was learned from research on teaching and learning about NOS over the past 30 years. The present state of this line of research necessitates a focus on individual classroom interventions aimed at enhancing learners' NOS views, rather than on mass assessments aimed at describing or evaluating students' beliefs. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 497,521, 2002 [source] A model for quantitative evaluation of an end-to-end question-answering systemJOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, Issue 8 2007Nina Wacholder We describe a procedure for quantitative evaluation of interactive question-answering systems and illustrate it with application to the High-Quality Interactive Question-Answering (HITIQA) system. Our objectives were (a) to design a method to realistically and reliably assess interactive question-answering systems by comparing the quality of reports produced using different systems, (b) to conduct a pilot test of this method, and (c) to perform a formative evaluation of the HITIQA system. Far more important than the specific information gathered from this pilot evaluation is the development of (a) a protocol for evaluating an emerging technology, (b) reusable assessment instruments, and (c) the knowledge gained in conducting the evaluation. We conclude that this method, which uses a surprisingly small number of subjects and does not rely on predetermined relevance judgments, measures the impact of system change on work produced by users. Therefore this method can be used to compare the product of interactive systems that use different underlying technologies. [source] The development and validation of a new coeliac disease quality of life survey (CD-QOL)ALIMENTARY PHARMACOLOGY & THERAPEUTICS, Issue 6 2010S. D. DORN Aliment Pharmacol Ther,31, 666,675 Summary Background, Previous studies on coeliac disease (CD)-related quality of life (QOL) have been limited by their use of a ,generic' rather than coeliac disease-specific assessment instruments. Aim, To develop and psychometrically validate a new coeliac disease-specific instrument, the CD-QOL. Methods, Through a series of focus groups, we elicited items from patients that related to the specific nature of their disease and its impact on their basic needs. Through expert review, cognitive debriefing with patients and pilot testing, a scale was developed, refined and administered to 387 patients on a gluten-free diet from both community-based support groups and a tertiary care referral centre. Finally, a formal validation study was conducted to assess the psychometric properties of the CD-QOL. Results, The final CD-QOL has 20 items across four clinically relevant subscales (Limitations, Dysphoria, Health Concerns, and Inadequate Treatment). The CD-QOL has high internal consistency, reliability, and psychometric validation indicates both convergent and discriminate validity. Conclusions, The CD-QOL is a reliable and valid measure of coeliac disease related QOL. As a new disease-specific instrument, it is likely to be a useful tool for evaluating patients with this disorder. [source] Which instruments are most commonly used to assess traumatic event exposure and posttraumatic effects?: A survey of traumatic stress professionalsJOURNAL OF TRAUMATIC STRESS, Issue 5 2005Jon D. Elhai We report findings from a Web-based survey of the International Society for Traumatic Stress Studies' members (n = 227) regarding use of trauma exposure and posttraumatic assessment instruments. Across clinical and research settings, the most widely used tests included the Posttraumatic Stress Diagnostic Scale, Trauma Symptom Inventory, Life Events Checklist, Clinician-Administered Post-traumatic Stress Disorder (PTSD) Scale, PTSD Checklist, Impact of Event Scale,Revised, and Trauma Symptom Checklist for Children. Highest professional degree, time since degree award, and student status yielded no differences in extent of reported trauma assessment test use. [source] Comparison of clinical outcome parameters, the Patient Benefit Index (PBI-k) and patient satisfaction after ablative fractional laser treatment of peri-orbital rhytides,LASERS IN SURGERY AND MEDICINE, Issue 3 2010Syrus Karsai MD Abstract Background Laser treatment of facial rhytides has evolved as a major modality of aesthetic surgery. Published results, while generally encouraging, feature highly diverse evaluation methods, which makes an evidence-based assessment of treatment efficacy and safety all but impossible. Objective To compare the results of different instruments of measurement. Patients/Methods Twenty-eight patients were enrolled and completed the entire study. They received a single ablative fractional treatment of the peri-orbital region. The evaluation included the Fitzpatrick wrinkle score, the profilometric measurement of wrinkle depth and the Patient Benefit Index (both before and 3 months after treatment) as well as the assessment of patient satisfaction (1, 3, 6 days and 3 months after treatment). Results All assessment instruments showed a significant, albeit moderate, improvement. The agreement between assessment methods was poor. Despite claiming to assess basically the same parameter, the Fitzpatrick wrinkle score and profilometry differed significantly, and neither assessment instrument showed any appreciable correlation with any other. Conclusions The outcome assessment of rhytide therapy,regardless of the method used,shows substantial room for improvement. Strict methodological precautions ought to be applied for ,objective' evaluation methods like photographic scoring and profilometry. Subjective methods of assessment are essential and might serve as a main outcome parameter. Finally, critical reappraisal of published treatment results seems warranted to review the quality of their methodology. Lasers Surg. Med. 42:215,223, 2010. © 2010 Wiley-Liss, Inc. [source] Predictive validity of the multiple mini-interview for selecting medical traineesMEDICAL EDUCATION, Issue 8 2009Kevin W Eva Introduction, In this paper we report on further tests of the validity of the multiple mini-interview (MMI) selection process, comparing MMI scores with those achieved on a national high-stakes clinical skills examination. We also continue to explore the stability of candidate performance and the extent to which so-called ,cognitive' and ,non-cognitive' qualities should be deemed independent of one another. Methods, To examine predictive validity, MMI data were matched with licensing examination data for both undergraduate (n = 34) and postgraduate (n = 22) samples of participants. To assess the stability of candidate performance, reliability coefficients were generated for eight distinct samples. Finally, correlations were calculated between ,cognitive' and ,non-cognitive' measures of ability collected in the admissions procedure, on graduation from medical school and 18 months into postgraduate training. Results, The median reliability of eight administrations of the MMI in various cohorts was 0.73 when 12 10-minute stations were used with one examiner per station. The correlation between performance on the MMI and number of stations passed on an objective structured clinical examination-based licensing examination was r = 0.43 (P < 0.05) in a postgraduate sample and r = 0.35 (P < 0.05) in an undergraduate sample of subjects who sat the MMI 5 years prior to sitting the licensing examination. The correlation between ,cognitive' and ,non-cognitive' assessment instruments increased with time in training (i.e. as the focus of the assessments became more tailored to the clinical practice of medicine). Discussion, Further evidence for the validity of the MMI approach to making admissions decisions has been provided. More generally, the reported findings cast further doubt on the extent to which performance can be captured with trait-based models of ability. Finally, although a complementary predictive relationship has consistently been observed between grade point average and MMI results, the extent to which cognitive and non-cognitive qualities are distinct appears to depend on the scope of practice within which the two classes of qualities are assessed. [source] Consultants' opinion on a new practice-based assessment programme for first-year residents in anaesthesiologyACTA ANAESTHESIOLOGICA SCANDINAVICA, Issue 9 2002C. Ringsted Background: Assessment in postgraduate education is moving towards using a broad spectrum of practice-based assessment methods. This approach was recently introduced in first-year residency in anaesthesiology in Denmark. The new assessment programme covers: clinical skills, communication skills, organizational skills and collaborative skills, scholarly proficiencies and professionalism. Eighteen out of a total of 21 assessment instruments were used for pass/fail decisions. The aim of this study was to survey consultants' opinions of the programme in terms of the representativeness of competencies tested, the suitability of the programme as a basis for pass/fail decisions and the relevance and sufficiency of the content of the different assessment instruments. Methods: A description of the assessment programme and a questionnaire were sent to all consultants of anaesthesiology in Denmark. The questionnaire consisted of items, to be answered on a five-point scale, asking the consultants' opinions about representativeness, suitability and content of the programme. Results: The response rate was 251/382 (66%). More than 75% of the respondents agreed that the assessment programme offered adequate coverage of the competencies of a first-year resident and was appropriate for making pass/fail decisions. There was strong agreement that the content of the 18 tests used for pass/fail decisions was relevant and sufficient for pass/fail decisions. Conclusion: Judging from the consultants' opinions, the assessment programme for first-year residency in anaesthesiology appears to be appropriate regarding the range of competencies assessed, the appropriateness as a basis for pass/fail decisions, and regarding the content of the tests used for pass/fail decisions. Further studies are needed to assess the feasibility and acceptability of the programme in practice. [source] Persistent Pain After Breast Cancer SurgeryPAIN MEDICINE, Issue 7 2007B Lau Purpose of the study:, To identify strengths and weaknesses in current studies with a view to carrying out a major multi-center study in Australia. Methods:, The literature was reviewed using standard Medline and Ovid methods. Bibliography of well known key recent papers were used to identify further papers. Results:, Studies evaluating persistent pain after breast cancer surgery have been small and few were prospective controlled studies with adequate power. Like Jung et al[1] we found that the literature was inconsistent in defining chronic pain and differentiating the breast cancer surgery pain syndromes. Marked variations in prior studies are due to differences in: study size (n = 22 to 282 patients), methodology, diagnostic criteria, pain assessment instruments, and distribution of demographic and clinical characteristics in the samples studied. Unfortunately the largest study to date, the ALMANAC Trial (n = 1031) which compared sentinel node biopsy vs "standard axillary dissection" evaluated arm and shoulder function and quality of life, but not pain[2]. From the current literature, it appears that neuropathic breast and arm pain are most common. Widely varying prevalence estimates of different neuropathic pain syndromes have been reported: phantom breast pain (3,44%); intercostobrachial neuralgia (ICBN) (16,39%); ICBN in breast conserving surgery (14,61%); and "neuroma pain" (23,49%). The most established risk factors for surgically related neuropathic pain syndromes are intraoperative nerve trauma, severe acute postoperative pain, and high use of postoperative analgesics[1]. Psychosocial distress is reported to be a risk factor and a consequence of chronic pain[1]. Conclusions:, Well-designed large multi-center studies are required to identify prevalences of various pain types, associated risk factors and treatment success for pain after breast cancer surgery. Such a study is in progress through the collaboration of our group with the Sentinel Node vs Axillary Clearance (SNAC) Study of 1000 women following breast surgery, conducted by the Royal Australian College of Surgeons (RACS). [source] Pilot study of continuous co-infusion of morphine and naloxone in children with sickle cell pain crisisAMERICAN JOURNAL OF HEMATOLOGY, Issue 9 2008Josh Koch Patients with sickle cell disease experience painful crises that often require hospitalization for a continuous infusion of morphine that may cause significant pruritus. We conducted a pilot study to determine the feasibility of simultaneous continuous co-infusion of naloxone with morphine, test novel assessment instruments for pruritus, and explore whether pruritus could be reduced while maintaining effective analgesia. Patients with sickle cell disease and painful crisis requiring continuous infusion morphine received continuous co-infusion of naloxone at 0.25 (low dose) or 1.0 mcg/kg·hr (high dose). Pain scores were obtained using the FACES scale and a 100-mm visual analog scale (VAS). Itching was quantified by a modified VAS score. Evaluable data were obtained on 16 patients. Simultaneous co-infusion of naloxone and morphine was feasible, did not seem to reduce the analgesic efficacy of morphine, and was associated with no adverse effects. The high dose group reported a lower median "VAS worst itch" score than the low dose group (4.8 vs. 7.3, P = 0.08). Simultaneous continuous infusion of naloxone with morphine in pediatric patients with sickle cell disease and pain crisis was feasible and well tolerated. A quantitative pruritus score allowed us to systematically measure pruritus. Further evaluation by randomized, placebo-controlled study of 1 mcg/kg·hr naloxone in this setting is required. Am. J. Hematol., 2008. © 2008 Wiley-Liss, Inc. [source] More than smile sheets: Rasch analysis of training reactions in a medical centerPERFORMANCE IMPROVEMENT QUARTERLY, Issue 3 2009Daniel McLinden EdD Reaction questionnaires administered at the conclusion of a training program are a common method of evaluation. Because such questionnaires are often constructed and analyzed in an ad hoc manner, their usefulness is often difficult to gauge. However, if properly constructed and analyzed, such instruments can help to make clear the strengths and weaknesses of programs. This article presents a framework for questionnaire development and analysis to ensure that such questionnaires are psychometrically sound and useful for decision making. The data used for this research were from over 5,000 questionnaires completed by individuals at the conclusion of educational programs. The Rasch model was used to evaluate the data. Results suggest that the posttraining questionnaire is a valid and reliable indicator of program quality. In addition, the Rasch analysis provided empirically based methods for diagnosing needed improvements to assessment instruments. [source] Strong opinions are no substitute for balanced arguments: Comments on Cicchetti, Kaufman, and Sparrow's critical appraisal of PCB cohort studiesPSYCHOLOGY IN THE SCHOOLS, Issue 6 2004Gerhard Winneke This paper comments on a critical review of cohort studies on PCB-related neurodevelopmental deficit in young children by D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow (CKS). Major points of criticism of CKS, namely alleged violation of statistical principles, presumed lack of clinical significance of findings, and alleged insufficient control of confounding are dealt with in appropriate detail. It is argued that much of this criticism is inappropriate and biased, and that, in particular, arguments dealing with basic rules of statistical inference rely too heavily on the narrow principles of Neyman-Pearson testing which are discussed controversially in modern epidemiology. Other critical arguments concerning the presumed lack of validity of assessment instruments, the apparent lack of reliability checks in some studies, and the presumed inappropriate treatment of longitudinal data are also discussed as being poorly founded. It is finally concluded that, although there are inconsistencies and weaknesses both within and between individual PCB-studies, the almost unconditional rejection of the full set of cohort studies by CKS is in no way supported by good reasoning. © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 655,663, 2004. [source] Reliability and comparability of a Spanish-language form of the preschool and kindergarten behavior scalesPSYCHOLOGY IN THE SCHOOLS, Issue 4 2002Amy G. Carney Comparability of a Spanish language translation of the Preschool and Kindergarten Behavior Scales was examined in relation to the English language version. Children ages 3,6 enrolled in preschool, kindergarten, or Head Start programs were rated concurrently by respondents on English and Spanish versions of the PKBS. Results showed virtually identical internal consistency of scores on both forms on Social Skills (.93) and Problem Behavior (.96) Scales. Correlations between forms for Social Skills and Problem Behavior scores were .93 and .94, respectively. Implications of these findings, directions for future research and the importance of continued work toward development/translation of other Spanish language assessment instruments for the early childhood population are discussed. © 2002 Wiley Periodicals, Inc. [source] Teamwork Training for Interdisciplinary ApplicationsACADEMIC EMERGENCY MEDICINE, Issue 2009Bev Foster Safe healthcare delivery in the emergency department is a team sport. Medical educators seek efficient and effective methods to teach and practice teamwork skills to all levels of interdisciplinary learners with the goal of enhancing communication, insuring smooth clinical operations, and improving patient safety. We present a new interdisciplinary, health professions teamwork curriculum, modified from TeamSTEPPS, that is efficient, effective, and can be delivered using multiple teaching modalities. This flexible curriculum structure begins with a brief didactic core designed to orient the learners to team concepts and invest them in the rationale for focusing on teamwork skills. This is followed by one of four additional instructional modalities: traditional didactic, interactive audience response didactic, low-fidelity simulation (role play), and high-fidelity patient simulation. Each of these additional modalities can be utilized singly or in combination to enhance the learners' attitudes, knowledge, and skills in team-based behaviors. Interdisciplinary cases have been defined, piloted, modified, and deployed at two major universities across more than 400 learners. Interdisciplinary simulation scenarios range from team-based role play to high-fidelity human patient simulation. Assessment cases using standardized patients are designed for interdisciplinary applications and focus on observable team-based behaviors rather than clinical knowledge. All of these cases have accompanying assessment instruments for attitudes, knowledge, and skills. These instruments may be used for formative assessment to provide feedback to the learners and standardize the faculty's information delivery. If used in a summative manner they provide data for course completion criteria, remediation, or competency assessment. [source] Bridging the educational research-teaching practice gapBIOCHEMISTRY AND MOLECULAR BIOLOGY EDUCATION, Issue 1 2010Tools for evaluating the quality of assessment instruments Abstract Student assessment is central to the educational process and can be used for multiple purposes including, to promote student learning, to grade student performance and to evaluate the educational quality of qualifications. It is, therefore, of utmost importance that assessment instruments are of a high quality. In this article, we present various tools that instructors could use, both to improve instrument design and validity before presentation to students and, to evaluate the reliability and quality of the assessment after students have answered the questions. In keeping with our goals of the Bridging-the-Gap series, we also present various ideas from the educational literature regarding the evaluation of assessment quality and end with a list of criteria that instructors could use to guide their evaluation process. [source] Teaching and Assessing Procedural Skills Using Simulation: Metrics and MethodologyACADEMIC EMERGENCY MEDICINE, Issue 11 2008Richard L. Lammers MD Abstract Simulation allows educators to develop learner-focused training and outcomes-based assessments. However, the effectiveness and validity of simulation-based training in emergency medicine (EM) requires further investigation. Teaching and testing technical skills require methods and assessment instruments that are somewhat different than those used for cognitive or team skills. Drawing from work published by other medical disciplines as well as educational, behavioral, and human factors research, the authors developed six research themes: measurement of procedural skills; development of performance standards; assessment and validation of training methods, simulator models, and assessment tools; optimization of training methods; transfer of skills learned on simulator models to patients; and prevention of skill decay over time. The article reviews relevant and established educational research methodologies and identifies gaps in our knowledge of how physicians learn procedures. The authors present questions requiring further research that, once answered, will advance understanding of simulation-based procedural training and assessment in EM. [source] Missed bipolarity and psychiatric comorbidity in women with postpartum depressionBIPOLAR DISORDERS, Issue 6 2008Verinder Sharma Objective:, To investigate the diagnostic profile of women referred for postpartum depression. Methods:, Fifty-six women seen consecutively with the referral diagnosis of postpartum depression were administered structured instruments to gather information about their DSM-IV Axis I diagnoses. Results:, In terms of frequency of occurrence, the primary diagnoses in this sample were: major depressive disorder (46%), bipolar disorder not otherwise specified (29%), bipolar II disorder (23%), and bipolar I disorder (2%). A current comorbid disorder, with no lifetime comorbidity, occurred among 32% of the sample; by contrast, lifetime comorbidity alone (i.e., with no currently comorbid disorder) was found among 27%. Both a lifetime and a current comorbidity were found among 18% of the women, and 23% had no comorbid disorder. The most frequently occurring current comorbid disorder was an anxiety disorder (46%), with obsessive-compulsive disorder (62%) being the most common type of anxiety disorder. For lifetime comorbidity, substance use (20%) and anxiety disorders (12%) were the two most common. Over 80% of patients who scored positive on either the Highs Scale or the Mood Disorder Questionnaire met the diagnostic criteria for a bipolar disorder. Conclusion:, The results suggest that postpartum depression is a heterogeneous entity and that misdiagnosis of bipolar disorder in the postpartum period may be quite common. The findings have important clinical implications, which include the need for early detection of bipolarity through the use of reliable and valid assessment instruments, and implementation of appropriate prevention and treatment strategies. [source] Psychological aspects of adductor spasmodic dysphonia: a prospective population controlled questionnaire studyCLINICAL OTOLARYNGOLOGY, Issue 1 2010A.A. Kaptein Clin. Otolaryngol. 2010, 35, 31,38. Objective:, To examine psychosocial concomitants, illness perceptions, and treatment perceptions in patients with adductor spasmodic dysphonia. Design:, Prospective controlled cohort study. Setting:, A tertiary care facility. Participants:, Forty-nine out-patients (38 women, 11 men; average age of 52 years) with adductor spasmodic dysphonia completed a battery of reliable and validated psychometric assessment instruments. Control patients' data were derived from scores in questionnaires by samples in the formal Manuals of the questionnaires used. Main outcome measures:, Psychosocial functioning, illness perceptions, and treatment perceptions. Results:, Scores on psychosocial measures were elevated in male patients especially, indicating levels of psychological morbidity significantly above those seen in the general population. Assessments of illness perceptions and treatment perceptions indicated that patients perceive that they have a very low degree of control over the disorder, and experience a high emotional impact from it. Voice Handicap Index scores illustrated substantial degrees of perceived handicap. Conclusions:, Adductor spasmodic dysphonia is associated with significant negative psychosocial concomitants, coupled with low perceived control over the condition. Future research should elucidate the implications of illness perceptions and treatment perceptions for the biopsychosocial care of persons with adductor spasmodic dysphonia in order to improve self-management and enhance quality of life. [source] Assessment of somatoform disorders: a review of strategies and instrumentsACTA NEUROPSYCHIATRICA, Issue 4 2003Wolfgang Hiller We provide an overview of methods and instruments developed for the assessment of somatoform disorders. Four diagnostic purposes have been identified: (i) classification according to a diagnostic system; (ii) screening for probable cases; (iii) dimensional measurement of syndrome severity; and (iv) assessment of associated clinical features. Existing instruments designed for each of these strategies are described, including specifications of their psychometric properties, particular features, advantages and disadvantages. A conclusion of this review is that the currently existing ,family of assessment instruments' in the field of somatoform disorders should be used to improve the comparability of scientific findings in different cultures and settings. [source] | |||||||||||||||||||||||||||||||