			Home About us Contact

Evaluation Research (evaluation + research)

Distribution by Scientific Domains

Medical Sciences	62%
Humanities and Social Sciences	12%
Education	12%

Selected Abstracts

Getting Real about What It Takes to Conduct Evaluation Research

ANNALS OF ANTHROPOLOGICAL PRACTICE, Issue 1 2005
Elaine L. Simon
First page of article [source]

Evaluation: Using evaluation research to improve medical education

THE CLINICAL TEACHER, Issue 3 2010
Mohsen Tavakol
Summary Background:, Evaluation research is a form of applied research that scrutinises how well a particular programme, practice, procedure or policy is operating. Evaluation researchers use both quantitative and qualitative research data to construct a collective picture of the programme under evaluation. Context:, Medical educators need to provide information about a particular programme using the methods of evaluation research in order to make a decision on the potential adoption, improvements and refinements of the programme. Improving curricula and pedagogical methods using these methods may enhance health care education. Innovation:, We provide an overview of the methods of evaluation research in the context of medical education. We discuss the application, general methodology, methods of collecting data and analysis for each type of evaluation research. Implications:, The methods of evaluation research described in this article enable medical educators to gain a comprehensive understanding of evaluation research in the context of medical education. The use of evaluation research findings helps medical educators to make informed decisions regarding a programme and any future actions related to it. [source]

Museum Outreach Programs to Promote Community Engagement in Local Environmental Issues

AUSTRALIAN JOURNAL OF PUBLIC ADMINISTRATION, Issue 2 2007
Ruth Lane
Ideas of ,community' and ,community voice' have been mobilised in collaborative programs developed between the National Museum of Australia and the Murray-Darling Basin Commission since 1992. This collaboration is set within a broader context of changing ideas and practice around governance, community and environmental issues. The recent Murray-Darling Outreach Project (MDOP), a series of museum outreach projects with regional communities aiming to increase community engagement in local environmental issues in the Murray-Darling Basin, is specifically examined. Evaluation research on the MDOP found that the approach to program development significantly shaped the types of voices, range of issues presented and the nature of the communicative forums established. The potential impacts on online audiences are discussed along with broader implications for government agencies involved in community partnerships. [source]

Drug education: myth and reality

DRUG AND ALCOHOL REVIEW, Issue 1 2001
GRAEME HAWTHORNE
Abstract Recently there has been an increase in Australian public funds for drug education. The accompanying rhetoric asserts that it is to enable abstinence among young people. This contradicts some State Government education guidelines endorsing harm minimization. A literature search of the key electronic databases, drug agency libraries, the Internet and reference lists identified evaluation research in school-based drug education. There is little evidence to support the new public rhetoric. The predictors of adolescent drug use are social and personal; schools can have little effect on these. Four models of drug education are described. Schools, however, mix-and-match activities from different models, and exposure is too slight for major effects on behaviours. Although methodological difficulties affect findings, none of the drug education models show consistent behavioural effects over time. There is a mismatch between the new public rhetoric and the evaluation research literature. Reasons for this are explored, including that there are two stakeholder groups, one with exaggerated ideological anti-drug messages and the other with more realistic perspectives about what schools can reasonably achieve. The paradox is that the rhetoric is needed for continued funding, yet this same rhetoric sets up criteria which doom drug education to failure. [source]

Do Premarital Education Programs Really Work?

FAMILY RELATIONS, Issue 3 2010
A Meta-analytic Study
Previous studies (J. S. Carroll & W. J. Doherty, 2003) have asserted that premarital education programs have a positive effect on program participants. Using meta-analytic methods of current best practices to look across the entire body of published and unpublished evaluation research on premarital education, we found a more complex pattern of results. We coded 47 studies and found that premarital education programs do not improve relationship quality/satisfaction when unpublished studies are included in the analysis, although studies that follow couples past the honeymoon stage to detect prevention effects are rare. In contrast, premarital education programs appear to be effective at improving couple communication, with studies that employed observational measures rather than self-report measures producing large effects. Still, given the mixed, modest results, there is ample room and a real need to improve the practice of premarital education. [source]

Measuring the value and impact of health library and information services: past reflections, future possibilities

HEALTH INFORMATION & LIBRARIES JOURNAL, Issue 2007
Joanne Gard Marshall
Objectives:, To summarize the context, history and results of research studies conducted on the value and impact of health library and information services by the author since 1975 and to use this as a basis for examining ongoing developments related to evaluation research. To provide a comprehensive bibliography of library value and impact studies. Methods:, Literature review and background based on personal involvement in the studies under discussion. Results:, The author's studies demonstrate an ongoing evolution of value and impact studies since the mid-1970s. In health sciences libraries, the approach taken to measuring value and impact has been strongly influenced by the type of research being conducted in the health sciences field as a whole. As a result, health sciences library researchers have become early adopters of methods that incorporate outcome and impact measures and rigorous research designs, and the concept of evidence-based library and information practice. The paper recommends that a range of research approaches from various disciplines be used to guide future evaluation research. Conclusions:, Value and impact studies will continue to be important resources for evidence-based practice as health information professionals deal with evolving user needs and new ways of delivering information to a variety of audiences. [source]

Review: evaluating information systems in nursing

JOURNAL OF CLINICAL NURSING, Issue 5 2008
Cristina Oroviogoicoechea MSc
Aims., To review existing nursing research on inpatient hospitals' information technology (IT) systems in order to explore new approaches for evaluation research on nursing informatics to guide further design and implementation of effective IT systems. Background., There has been an increase in the use of IT and information systems in nursing in recent years. However, there has been little evaluation of these systems and little guidance on how they might be evaluated. Methods., A literature review was conducted between 1995 and 2005 inclusive using CINAHL and Medline and the search terms ,nursing information systems', ,clinical information systems', ,hospital information systems', ,documentation', ,nursing records', ,charting'. Results., Research in nursing information systems was analysed and some deficiencies and contradictory results were identified which impede a comprehensive understanding of effective implementation. There is a need for IT systems to be understood from a wider perspective that includes aspects related to the context where they are implemented. Conclusions., Social and organizational aspects need to be considered in evaluation studies and realistic evaluation can provide a framework for the evaluation of information systems in nursing. Relevance to clinical practice., The rapid introduction of IT systems for clinical practice urges evaluation of already implemented systems examining how and in what circumstances they work to guide effective further development and implementation of IT systems to enhance clinical practice. Evaluation involves more factors than just involving technologies such as changing attitudes, cultures and healthcare practices. Realistic evaluation could provide configurations of context-mechanism-outcomes that explain the underlying relationships to understand why and how a programme or intervention works. [source]

Adolescents with Type 1 Diabetes: transition between diabetes services

JOURNAL OF CLINICAL NURSING, Issue 6 2006
Kate Visentin MN
Aim., The research aimed to develop a sustainable and coordinated approach to facilitating the transition between diabetes services for adolescents. The objectives were to: (1) involve key diabetes health delivery stakeholders in expressing their concerns and issues about current service delivery and ways to improve same, and (2) reveal from the perspective of the adolescents living with Type 1 Diabetes their experiences surrounding the process of transition. Background., This paper presents research that sought to identify the major concerns and issues that stakeholders had about transition and to reveal the experience of transition for the adolescent with Type 1 Diabetes. Key representatives from seven public diabetes services in Adelaide, South Australia worked collaboratively to answer the objectives of this inquiry. Approach., Interview data were generated and analysed using a response focus framework provided by fourth generation evaluation research. In this study, the focus was on common concerns, claims and issues raised by health care professionals (n = 21) and adolescents (n = 10) aged between 15 and 18 years about transferring from children's to adult diabetes services. Findings., Data revealed education and dietetic advice was reactive rather than proactive and that the paediatric model of care is philosophically and practically different to the adult model of diabetes care. Three phases of transition were identified: preparation, formal transition and evaluation. Our findings indicated that these stages of transition were not being fully implemented in health units. Conclusion., The project findings have set the scene to establish a multidisciplinary working party to work collaboratively across agencies to develop effective transition pathways. Relevance to clinical practice., The role of diabetes nurse educators and dietitians in South Australia is under-used throughout the transition process. Diabetes nurse educators are in an ideal position to prepare, coordinate and evaluate transitional processes. [source]

Psychometric reevaluation of the Women in Science Scale (WiSS)

JOURNAL OF RESEARCH IN SCIENCE TEACHING, Issue 10 2007
Steven V. Owen
The Women in Science Scale (WiSS) was first developed in 1984, and is still being used in contemporary studies, yet its psychometric properties have not been evaluated with current statistical methods. In this study, the WiSS was administered in its original 27-item form to 1,439 middle and high school students. Confirmatory factor analysis based upon the original description of the WiSS was modestly supportive of the proposed three-factor structure, but the claimed dimensions showed substantial redundancy. Therefore, we split our sample and performed exploratory factor analyses on one half. The most satisfactory solution, a two-factor model, was then applied to the crossvalidation sample with a confirmatory factor analysis. This two-factor structure was supported with a total of 14 items. Factor 1, Equality, contains eight items, and factor 2, Sexism, six items. Although our data are limited to adolescents, the WiSS, with improved psychometric properties, may be used descriptively to assess attitudes toward women in science and with additional stability and repeatability testing, may be used in evaluation research. The shortened WiSS should result in shorter administration time, fewer missing data, and increased acceptance among survey administrators in classroom settings. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 44: 1461,1478, 2007 [source]

The Rigidity and Comfort of Habits: A Cultural and Philosophical Analysis of the Ups and Downs of Mainstreaming Evaluation

NEW DIRECTIONS FOR EVALUATION, Issue 99 2003
Nancy Grudens-Schuck
Mainstreaming evaluation requires establishing aesthetic and ethical frameworks, as well as developing knowledge and skills that make "doing evaluation" seem like the right thing. Mainstreaming, however, can pose challenges to good evaluation practice; a view from cultural anthropology suggests that evaluation can have distinct meanings in different settings. Stories from program evaluation research in Indonesia illustrate the ways comforts and rigidities associated with mainstreamed evaluation processes may hinder high-quality evaluation. [source]

International Family, Adult, and Child Enhancement Services (FACES): A Community-Based Comprehensive Services Model for Refugee Children in Resettlement

AMERICAN JOURNAL OF ORTHOPSYCHIATRY, Issue 1 2008
Dina Birman PhD
The development of evidence-based mental health interventions for refugees is complicated by the cultural and linguistic diversity of the participants, and the need to balance treatment of past traumatic experiences with ongoing support during the process of acculturation. In an effort to gather "practice-based evidence" from existing mental health services for refugees, a collaborative study of International Family, Adult, and Child Enhancement Services (FACES), a comprehensive, community-based mental health program working with refugee children, was conducted to describe the program participants and service delivery model and to assess whether participants improved over time as a function of services. Results showed that participants improved, but that the improvement was not related to dosage of services. Implications of these findings for refugee mental health services are discussed and suggestions are made for future evaluation research of mental health services with refugees. [source]

Evaluation: Using evaluation research to improve medical education

Development and validation of a questionnaire for the assessment of bowel and lower urinary tract symptoms in women

BJOG : AN INTERNATIONAL JOURNAL OF OBSTETRICS & GYNAECOLOGY, Issue 4 2002
L. Hiller
Objective To develop a simple but sensitive instrument to evaluate and document symptoms of both bowel and urinary dysfunction in women. Design A 22-item questionnaire covering a range of bowel and urinary symptoms was developed and underwent rigorous psychometric testing. Setting The gynaecology departments of three hospitals, a urogynaecology clinic, a functional bowel clinic and a general practice. Population Six hundred and thirty women, comprising four groups: 1. women awaiting hysterectomy (n= 379), 2. women following hysterectomy (n= 45), 3. women referred with functional bowel and/or urinary symptoms (n= 65), 4. asymptomatic controls (n= 141). Main outcome measures The content, construct and criterion validity, internal consistency, reliability and responsiveness of the questionnaire were measured. Results Peer and patient reports and missing data patterns supported face and content validity. Factor analysis showed a clinically relevant four-factor structure with low content replication able to distinguish between patient groups, indicating good internal structure. Comparison with clinical, anorectal physiological, videoproctographic, transit time and urodynamic test results provide provisional indication of criterion validity. Key domain question analysis and Cronbach's alphas showed internal consistency. Kappa values demonstrated good test,retest reliability and key question correlation over time proved responsiveness. Conclusions Our findings support the suitability, clinical validity, reliability and responsiveness of a simple questionnaire, which is sensitive to the constraints of clinical practice. The authors recommend its use in health care evaluation research assessing the effects of pelvic surgery and as a useful tool in comparing treatment efficacy. [source]

The Family Dermatology Life Quality Index: measuring the secondary impact of skin disease

BRITISH JOURNAL OF DERMATOLOGY, Issue 3 2007
M.K.A. Basra
Summary, Background, Skin diseases are known to have a major impact on the lives of patients and their families. Many instruments are available to measure the health-related quality of life (HRQoL) of patients but no measure has been developed so far to quantify the secondary impact on family members of the patients. Objectives, To develop and validate a dermatology-specific instrument to measure the adverse impact on the HRQoL of family members of patients with skin disease. Methods, Detailed semi-structured interviews were conducted with family members of patients to identify different aspects of HRQoL affected. An initial draft version of the questionnaire based on the main topic areas was pilot tested to assess the face and content validity. A 10-item questionnaire, the Family Dermatology Life Quality Index (FDLQI), was finalized after modifications to the draft questionnaire based on feedback from families and dermatology professionals and on item reduction. Psychometric evaluation was conducted on a new cohort of family members (n = 132) who completed the FDLQI and the patients (n = 109) who completed the Dermatology Life Quality Index (DLQI). Results, Fifty-nine different aspects of family members' HRQoL were identified from the analysis of the interviews, which were categorized into main topic areas. Factor analysis of 10 items of the final questionnaire revealed two factors and together these explained 60% of the common variance. The FDLQI demonstrated high internal consistency (Cronbach's , = 0·88) and test,retest (intraclass correlation coefficient = 0·94) reliabilities. The responsiveness of the instrument to change was shown by significant change in the family members' FDLQI scores in cases where patients' clinical condition either improved or worsened. Construct validity was assessed by testing a number of a priori hypotheses. A strong correlation was seen between the family members' FDLQI scores and patients' DLQI scores (r = 0·69), a significantly higher FDLQI score was seen for inflammatory skin diseases compared with noninflammatory diseases/isolated lesions (P < 0·0001), and there was a positive relationship between the family members' FDLQI scores and patients' disease severity (r = 0·49). Conclusions, The FDLQI is simple and practical and seems to have the potential to be used as an additional outcome measure in clinical practice and evaluation research. [source]