Evaluation Activities (evaluation + activity)

Distribution by Scientific Domains


Selected Abstracts


Applying Human Systems Integration to the Rapid Acquisition Process

NAVAL ENGINEERS JOURNAL, Issue 1 2007
DEMETRIUS D. MACK
The rapidly changing complexity of the Global War on Terrorism has changed the approach to equipping forward-deployed military forces. Combatant Commanders conducting operations now require timely materiel solutions to enhance mission capabilities and reduce the risk for individual soldiers. To address this challenge, the US Army established the Rapid Equipping Force to assess emerging requirements, to propose solutions to those requirements, and to implement those solutions in an expedient time frame. Unfortunately, the REF lacks a consistent analytical methodology for assessing alternative materiel solutions. To address the need for a human systems integration (HSI) analysis method, the authors developed an Assessment-Based Rapid Acquisition HSI Analysis Method (ABRAHAM) capable of generating tailored surveys and evaluating these surveys for unacceptable risks to soldiers. To validate ABRAHAM's concept and content, ABRAHAM was showcased in three Department of Defense settings: the Human Factors Engineering Technical Advisory Group, the REF, and the US Marine Corps' Operational Test and Evaluation Activity. The ABRAHAM appears to fill a gap in the current library of HSI tools. Based on the feedback provided during the product showcases, there is sufficient interest and technological maturity to further develop ABRAHAM to serve both the traditional and rapid acquisition processes. [source]


The Functions of Participation in a Village-Based Health Pre-Payment Scheme: What Can Participation Actually Do?

IDS BULLETIN, Issue 1 2000
Andreas Wilkes
Summary This article analyses micro-level interactions in one case study to argue that participation does not necessarily lead to accountability. The case study covers the process of establishment, implementation and evaluation of a village-based health pre-payment scheme in a poor village in China. Judged on widely used criteria, the scheme and evaluation activities represent examples of ,high degrees of community participation'. However, analysis of the process points to the influence that different interests, different channels for voicing interests, and unequal power relations have in determining the outcome of decision-making processes. [source]


Pathways to prevention: A training and technical assistance initiative to increase program capacity to address infant mental health issues in Early Head Start

INFANT MENTAL HEALTH JOURNAL, Issue 2 2007
Tammy L. Mann
This article provides an overview of a training and consultation program aimed at enhancing the capacity of Early Head Start (EHS) and Migrant and Seasonal Head Start (MSHS) programs to address infant mental health issues from a promotion, prevention, and treatment perspective. This program was implemented by the Early Head Start National Resource Center (EHS NRC), operated by ZERO TO THREE. The EHS NRC is funded by the Head Start Bureau to provide a diverse array of training and technical assistance support services to Early Head Start programs throughout the country. In the fall of 2001, ZERO TO THREE was funded to design and implement the Pathways Initiative. While ZERO TO THREE was not funded to test the efficacy of the Pathways Initiative as a research intervention similar to other papers described in this special issue, we worked creatively to identify resources that allowed us to engage an external evaluator to look at both process and outcome measures. This paper describes the consultation program, evaluation activities, and key lessons learned. [source]


A case example of assessment and evaluation: Building capability in a corporate university

PERFORMANCE IMPROVEMENT, Issue 6 2009
Shawn Overcast
One corporate university makes measurement a priority by dedicating resources and assigning responsibilities to a centralized analytics function: the assessment, measurement, and evaluation team. As more measurement became a focus for learning and business leaders alike, the more the team became motivated to take a critical look at how it was approaching assessment, measurement, and evaluation activities and how it could leverage its capabilities, technology, and processes to have a greater reach across the organization. [source]


Europäische Ansätze für Energieeffizienz-Monitoring auf der Basis von Energieausweis-Daten

BAUPHYSIK, Issue 3 2009
Tobias Loga Dipl.-Phys.
Energieeinsparung; Gebäudebestand Abstract Das DATAMINE-Projekt wurde angesichts des Bedarfs nach konkreten Daten über den tatsächlichen energetischen Zustand des europäischen Gebäudebestands und die bestehenden Potentiale zur Energieeinsparung und CO2-Emissionsminderung ins Leben gerufen. Diese Daten sollen längerfristig helfen, das politische Instrumentenbündel (ordnungsrechtliche, steuerliche, Förder-Maßnahmen, Informationsvermittlung) so zu gestalten, dass es wirkungsvoll und kosteneffizient ist. Entsprechend dem DATAMINE-Konzept basieren die Informationen auf Energieausweisen, die gemäß EU-Gebäuderichtlinie ausgestellt werden, sobald ein Gebäude gebaut, verkauft oder vermietet wird. Im Rahmen des DATAMINE-Projekts wurden in zwölf Ländern Feldversuche mit größeren Gebäudedaten-Sammlungen durchgeführt, jeder mit unterschiedlichen Analysezielen. Dabei nutzte jedes Land die gleiche Datenstruktur für die Sammlung seiner Energieausweis-Daten, die im Vorfeld gemeinsam entwickelt worden war. Diese lässt sich auf die verschiedenen Zertifizierungssysteme anwenden, die die europäischen Länder auf Grund der Unterschiede in Informationsbedürfnissen, Gebäudearten und Klima entwickelt haben. Rund 19.000 Datensätze wurden im gemeinsamen DATAMINE-Format gesammelt. In einem Ländervergleich konnten verschiedene Energieeffizienz-Indikatoren gegenübergestellt werden. Das Ergebnis der Analysen ergibt einen genaueren Einblick in den aktuellen Stand der energetischen Modernisierung spezifischer Gebäudegruppen in den beteiligten Ländern. Schließlich wurden Schlussfolgerungen in Bezug auf die Entwicklung von Monitoringsystemen in jedem Land und auf EU-Ebene gezogen. European attempt at energy performance monitoring based on data collections and certification schemes. The launch of the DATAMINE project has been driven by the need for concrete data on the actual energy performance of the European building stock as well as the potential energy savings and CO2 reductions. In the longer term data can help develop tailored, cost-efficient complementary measures to energy performance legislation, such as soft loans and tax incentives. DATAMINE aims to construct a knowledge base using the information on the energy performance certificates issued when buildings are constructed, sold or rented. In the framework of DATAMINE test projects were carried out on large samples of buildings in 12 countries, each with individual monitoring targets. In each country the same data structure was used for data collection which had been developed at the forefront. Full allowance is made for the Europe-wide differences in certification schemes, since each country has a scheme tailored to its specific needs, building stock and climate. Around 19,000 datasets have been collected in the common DATAMINE format. Cross-country analysis of the collected data was performed comparing different energy performance indicators. The result of the evaluation activities gives a clearer insight into the current state of refurbishment of specific building subsets in each country. Finally conclusions were drawn regarding the development of monitoring systems in each country and on EU level. [source]


Summative Assessment in Medicine: The Promise of Simulation for High-stakes Evaluation

ACADEMIC EMERGENCY MEDICINE, Issue 11 2008
John R. Boulet PhD
Abstract Throughout their careers, physicians are exposed to a wide array of assessments, including those aimed at evaluating knowledge, clinical skills, and clinical decision-making. While many of these assessments are used as part of formative evaluation activities, others are employed to establish competence and, as a byproduct, to promote patient safety. In the past 10 years, simulations have been successfully incorporated in a number of high-stakes physician certification and licensure exams. In developing these simulation-based assessments, testing organizations were able to promote novel test administration protocols, build enhanced assessment rubrics, advance sophisticated scoring and equating algorithms, and promote innovative standard-setting methods. Moreover, numerous studies have been conducted to identify potential threats to the validity of test score interpretations. As simulation technology expands and new simulators are invented, this groundbreaking work can serve as a basis for organizations to build or expand their summative assessment activities. Although there will continue to be logistical and psychometric problems, many of which will be specialty- or simulator-specific, past experience with performance-based assessments suggests that most challenges can be addressed through focused research. Simulation, whether it involves standardized patients (SPs), computerized case management scenarios, part-task trainers, electromechanical mannequins, or a combination of these methods, holds great promise for high-stakes assessment. [source]


Research and development at the health and social care interface in primary care: a scoping exercise in one National Health Service region

HEALTH & SOCIAL CARE IN THE COMMUNITY, Issue 6 2002
Jo Cooke MA
Abstract The present project aimed to identify research activity at the health and social care interface in primary care within one National Health Service region, and to determine levels of research capacity and support within social services. The study was commissioned by a primary care research network (PCRN) in order to assess opportunities to increase research capacity within social services. Data were collected in two phases from 61 managers, team leaders and senior practitioners in social care, and six public health representatives in health authorities, using telephone interviews and focus groups. The findings highlighted a lack of infrastructure and support for research and development in social care. However, many social care respondents wanted opportunities to develop research skills with healthcare colleagues. Despite poor support, many small-scale projects were described, and many respondents showed an enthusiasm for engaging with research. Methods in use included surveys, action research, needs analysis and evaluation of service developments. Many examples of user involvement were given. Interface projects were usually instigated by interagency forums and funded from multiple sources. Most project work was motivated by service improvement or development, rather than aiming to produce generalisable knowledge. Barriers to conducting research included lack of confidence, research skills and time, as well as workload demands, lack of cover to release staff for research and lack of supervision. Research was not seen as legitimate work in some social care environments or as part of a career path. Existing joint working initiatives (such as the National Service Frameworks) were highlighted as flashpoints for potential research and evaluation activity. The findings suggest clear opportunities for PCRNs to develop research capacity at the interface with social care; for example, by signposting available resources, providing training grants and secondments for social care staff, and supporting interagency networks with a focus on evaluation. In turn, experience in promoting user involvement in social services could add value to research expertise at the primary care,social care interface. [source]