Home About us Contact | |||
Real-time Evaluation (real-time + evaluation)
Selected AbstractsReal-time evaluation in humanitarian emergenciesNEW DIRECTIONS FOR EVALUATION, Issue 126 2010Emery Brusset The authors describe real-time evaluation (RTE) as a specific tool in disaster management and within the literature on formative evaluation, monitoring, and impact assessment. RTE offers the possibility of exploring innovative ways to empower frontline disaster response staff, possibly even beneficiaries of assistance. The authors describe conditions for the success of RTE, including field credibility, organization, and rapid analysis. © Wiley Periodicals, Inc., and the American Evaluation Association. [source] Intermethod Reliability of Real-time Versus Delayed Videotaped Evaluation of a High-fidelity Medical Simulation Septic Shock ScenarioACADEMIC EMERGENCY MEDICINE, Issue 9 2009Justin B. Williams MD Abstract Objectives:, High-fidelity medical simulation (HFMS) is increasingly utilized in resident education and evaluation. No criterion standard of assessing performance currently exists. This study compared the intermethod reliability of real-time versus videotaped evaluation of HFMS participant performance. Methods:, Twenty-five emergency medicine residents and one transitional resident participated in a septic shock HFMS scenario. Four evaluators assessed the performance of participants on technical (26-item yes/no completion) and nontechnical (seven item, five-point Likert scale assessment) scorecards. Two evaluators provided assessment in real time, and two provided delayed videotape review. After 13 scenarios, evaluators crossed over and completed the scenarios in the opposite method. Real-time evaluations were completed immediately at the end of the simulation; videotape reviewers were allowed to review the scenarios with no time limit. Agreement between raters was tested using the intraclass correlation coefficient (ICC), with Cronbach's alpha used to measure consistency among items on the scores on the checklists. Results:, Bland-Altman plot analysis of both conditions revealed substantial agreement between the real-time and videotaped review scores by reviewers. The mean difference between the reviewers was 0.0 (95% confidence interval [CI] = ,3.7 to 3.6) on the technical evaluation and ,1.6 (95% CI = ,11.4 to 8.2) on the nontechnical scorecard assessment. Comparison of evaluations for the videotape technical scorecard demonstrated a Cronbach's alpha of 0.914, with an ICC of 0.842 (95% CI = 0.679 to 0.926), and the real-time technical scorecard demonstrated a Cronbach's alpha of 0.899, with an ICC of 0.817 (95% CI = 0.633 to 0.914), demonstrating excellent intermethod reliability. Comparison of evaluations for the videotape nontechnical scorecard demonstrated a Cronbach's alpha of 0.888, with an ICC of 0.798 (95% CI = 0.600 to 0.904), and the real-time nontechnical scorecard demonstrated a Cronbach's alpha of 0.833, with an ICC of 0.714 (95% CI = 0.457 to 0.861), demonstrating substantial interrater reliability. The raters were consistent in agreement on performance within each level of training, as the analysis of variance demonstrated no significant differences between the technical scorecard (p = 0.176) and nontechnical scorecard (p = 0.367). Conclusions:, Real-time and videotaped-based evaluations of resident performance of both technical and nontechnical skills during an HFMS septic shock scenario provided equally reliable methods of assessment. [source] Discrete modeling of the air-gap field of synchronous machines for computation of torque and radial forcesEUROPEAN TRANSACTIONS ON ELECTRICAL POWER, Issue 2 2008Marc Bekemans Abstract In this paper, we exploit the multiple symmetries and the discrete character of the current distribution to express the torque and the radial forces in a PM synchronous machine. Under some assumptions, the magnetic field can be built with a limited number of discrete functions. These functions can constitute an orthogonal base of a vector space for the representation of the machine magnetic state. The representation of the stator and rotor fields as vectors of this space makes it possible to interpret the torque and the radial forces from the concept of distance between these vectors. The proposed method for torque and radial forces computation is well suited for a real-time evaluation and can be used for a generalization of the Field-Oriented Control to machines with non-sinusoidal flux distribution. Copyright © 2007 John Wiley & Sons, Ltd. [source] Real-time evaluation in humanitarian emergenciesNEW DIRECTIONS FOR EVALUATION, Issue 126 2010Emery Brusset The authors describe real-time evaluation (RTE) as a specific tool in disaster management and within the literature on formative evaluation, monitoring, and impact assessment. RTE offers the possibility of exploring innovative ways to empower frontline disaster response staff, possibly even beneficiaries of assistance. The authors describe conditions for the success of RTE, including field credibility, organization, and rapid analysis. © Wiley Periodicals, Inc., and the American Evaluation Association. [source] Quantitative Analysis of Human Platelet Adhesions Under a Small-Scale Flow DeviceARTIFICIAL ORGANS, Issue 4 2010Katsuko S. Furukawa Abstract To realize real-time evaluation of human platelet adhesions onto material surfaces with small volumes of human platelet suspensions, we developed an apparatus consisting of a modified cone and plate-type viscometer, combined with an upright epi-fluorescence microscope. The apparatus allowed real-time evaluation of platelet,material interactions and the initial event of thrombus formation, using small platelet suspension volumes (7.5 µL) under shear flow conditions. To study the dynamic behavior of platelet,material interaction, we chose five representative opaque and transparent materials: acrylate resin (AC), polytetrafluoroethylene (PTFE), polyvynylchrolide (PVC), glass, and a monolayer of human normal umbilical cord vein endothelial cells (EC) on glass under shear flow conditions. The values of adhesiveness of human platelets to the test materials in descending order were as follows: AC > PTFE > PVC > glass > human EC. Under this new small-scale flow system, we could obtain highly reproducible data, which were comparable with results from a previously developed large-scale flow system. Therefore, the newly developed cone and plate-type rheometer is a useful instrument for testing and screening materials, and allows precise quantitative evaluation of human platelet adhesion. [source] A technology valuation model to support technology transfer negotiationsR & D MANAGEMENT, Issue 2 2007Dong-Hyun Baek The development and commercialization of advanced technologies will depend increasingly on efficient technology transfer and technology trading systems. This requires the development of technology markets or exchanges and hence a reliable technology valuation methodology. This paper develops a methodology for an objective and impartial valuation of fully developed technologies. A web-based technology valuation system is developed with which interested users can make efficient and real-time evaluations of technologies. [source] Real-Time Inter-Rater Reliability of the Council of Emergency Medicine Residency Directors Standardized Direct Observation Assessment ToolACADEMIC EMERGENCY MEDICINE, Issue 2009Joseph LaMantia MD Abstract Objectives:, Developed by the Council of Emergency Medicine Residency Directors (CORD), the standardized direct observation assessment tool (SDOT) is an evaluation instrument used to assess residents' clinical skills in the emergency department (ED). In a previous study examining the inter-rater agreement of the tool, faculty scored simulated resident,patient encounters. The objective of the present study was to evaluate the inter-rater agreement of the SDOT in real-time evaluations of residents in the ED. Methods:, This was a multi-center, prospective, observational study in which faculty raters were paired to simultaneously observe and independently evaluate a resident's clinical performance using the SDOT. Data collected from eight emergency medicine (EM) residency programs produced 99 unique resident,patient encounters and reported on 26 individual behaviors related to specific core competencies, global evaluation scores for each core competency, and an overall clinical competency score. Inter-rater agreement was assessed using percentage agreement analyses with three constructs: exact agreement, liberal agreement, and binary (pass/fail) agreement. Results:, Inter-rater agreement between faculty raters varied according to category of measure used. Exact agreement ranged from poor to good, depending on the measure: the overall competency score (good), the competency score for each of the six core competencies (poor to good), and the individual item scores (fair to very good). Liberal agreement and binary agreement were excellent for the overall competency score and the competency score for each of the six core competencies and very good to excellent for the individual item scores. Conclusions:, The SDOT demonstrated excellent inter-rater agreement when analyzed with liberal agreement and when dichotomized as a pass/fail measure and fair to good agreement for most measures with exact agreement. The SDOT can be useful and reliable when evaluating residents' clinical skills in the ED, particularly as it relates to marginal performance. [source] |