Home About us Contact
|
Home About us Contact | ||
|
|
||
Face Validity (face + validity)
Selected AbstractsValidation of a client-based clinical metrology instrument for the evaluation of canine elbow osteoarthritisJOURNAL OF SMALL ANIMAL PRACTICE, Issue 6 2009C. A. Hercock Objective: To validate a disease-specific client-based clinical metrology instrument (questionnaire) for dogs with chronic osteoarthritis of the elbow joint. Materialsand Methods: This was a prospective cohort study involving 26 dogs with chronic osteoarthritis of the elbow with 24 associated clients. Validity (face and criterion), reliability and responsiveness of the metrology instrument (named "Liverpool Osteoarthritis in Dogs [elbow]") were tested in a sequence of studies. Face validity involved use of international peer review. Reliability was assessed using a test-retest scenario with a two week interval; peak vertical force as measured by a force platform was used as an external standard measure. Responsiveness was tested with a two week, single-blinded placebo-controlled intervention using a licensed non-steroidal anti-inflammatory drug. Results: The reliability of Liverpool Osteoarthritis in Dogs (elbow) in the test-retest scenario was good; intraclass correlation coefficient is 0·89, 95 per cent confidence interval 0·75 to 0·95, compared with intraclass correlation coefficient 0·92, 95 per cent confidence interval 0·74 to 0·98, for peak vertical force. Responsiveness testing indicated that the "net" effect size (allowing for placebo effect) for Liverpool Osteoarthritis in Dogs (elbow) was 0·13 compared with (,)0·18 for the force platform. Criterion validity for Liverpool Osteoarthritis in Dogs (elbow) against peak vertical force was poor; Spearman's rank correlation is ,0·24 (P=0·30). Clinical Significance: Liverpool Osteoarthritis in Dogs (elbow) was considered reliable with satisfactory responsiveness. The poor criterion validity suggests a mismatch between force platform peak vertical force and client perceptions of lameness. This instrument requires further validation in larger studies with alternative client groups and alternative therapeutic interventions, but this initial validation suggests that Liverpool Osteoarthritis in Dogs (elbow) is worthy of continued investigation. [source] Development, validity and reliability of the food allergy independent measure (FAIM)ALLERGY, Issue 5 2010J. L. Van Der Velde To cite this article: van der Velde JL, Flokstra-de Blok BMJ, Vlieg-Boerstra BJ, Oude Elberink JNG, DunnGalvin A, Hourihane JO'B, Duiverman EJ, Dubois AEJ. Development, validity and reliability of the food allergy independent measure (FAIM). Allergy 2010; 65: 630,635. Abstract Background:, The Food Allergy Quality of Life Questionnaire-Child Form, -Teenager Form and -Adult Form (FAQLQ-CF, -TF and -AF) have recently been developed. To measure construct validity in the FAQLQs, a suitable independent measure was needed with which FAQLQ scores could be correlated. However, in food allergy, no appropriate independent measure existed, which could be used for this purpose. Aims of the study:, The aim of this study was to describe the development of a Food Allergy Independent Measure Child-Form, -Teenager Form and -Adult Form (FAIM-CF, -TF and -AF) and to assess their validity and reliability. Methods:, The FAIMs were developed using previously established methodology to capture the patients' expectation of outcome (EO). Face validity was determined by expert opinion. FAIM questions showing no correlation to any potential items in the FAQLQs were considered irrelevant and eliminated. To measure test-retest reliability, one-hundred and one patients were included and completed the FAIM twice with a 10,14 day interval. The intraclass correlation coefficient (ICC), Lin's concordance correlation coefficient (CCC) and Bland-Altman plots were used to assess test-retest reliability. Results:, Six FAIM questions were developed and considered relevant for the FAIM-CF and -AF, and five questions were relevant for the FAIM-TF. The FAIMs showed good reliability with ICCs and CCCs above 0.70 and with mean differences all close to zero. Conclusions:, Food allergy independent measures were developed for children, adolescents and adults and were shown to be valid, relevant and reliable. This supports the suitability of the FAIMs for evaluating construct validity. [source] Surgical e-learning: validation of multimedia web-based lecturesMEDICAL EDUCATION, Issue 2 2007Paul F Ridgway Background, Distance learning has been advocated increasingly as a modern efficient method of teaching surgery. Efficiency of knowledge transfer and validity of web-based courses have not been subjected to rigorous study to date. Methods, An entirely web-based surgical 5-week lecture course was designed. Fifty per cent of the lectures were prepared as HTML slides with voice-over while the other group was presented in the text-only form. Only written material presented was examined. The lectures were presented via an educational web module. The lecture series was balanced specifically to reduce the pre-existent knowledge bias. Web usage was estimated utilising surrogates, including the number of hits as well as log-on timing. Face validity was assessed by a standardised questionnaire. Results, Eighty-eight students took part in the lecture series and subsequent examination and questionnaire. Median multiple choice questionnaire (MCQ) marks were significantly higher in the aural lecture-derived stems versus the non-aural (P = 0.012, Mann,Whitney U -test). There was widespread approval of web-based learning as an adjunct to conventional teaching. Usage rates were augmented significantly in the final week when compared to the previous 4 weeks (mean total hits weeks 1,4 ± SEM: 100.9 ± 9.7 and mean total hits week 5: 152.1 ± 13.1; P < 0.001, Kruskal,Wallis). However, total hits did not correlate with overall examination results (r2 = 0.16). The aural lectures demonstrated higher face validity than the non-aural for content and presentation (P < 0.05, Kruskal,Wallis). Conclusions, The addition of aural files to the novel web-based lecture series is face valid and results in significantly increased examination performance. [source] Applicant Reactions to Selection Procedures: An Updated Model and Meta-AnalysisPERSONNEL PSYCHOLOGY, Issue 3 2004John P. Hausknecht An updated theoretical model of applicant reactions to selection procedures is proposed and tested using meta-analysis. Results from 86 independent samples (N= 48,750) indicated that applicants who hold positive perceptions about selection are more likely to view the organization favorably and report stronger intentions to accept job offers and recommend the employer to others. Applicant perceptions were positively correlated with actual and perceived performance on selection tools and with self-perceptions. The average correlation between applicant perceptions and gender, age, and ethnic background was near zero. Face validity and perceived predictive validity were strong predictors of many applicant perceptions including procedural justice, distributive justice, attitudes towards tests, and attitudes towards selection. Interviews and work samples were perceived more favorably than cognitive ability tests, which were perceived more favorably than personality inventories, honesty tests, biodata, and graphology. The discussion identifies remaining theoretical and methodological issues as well as directions for future research. [source] Validity of the Danish Prostate Symptom Score questionnaire in strokeACTA NEUROLOGICA SCANDINAVICA, Issue 6 2009S. Tibaek Objective,,, To determine the content and face validity of the Danish Prostate Symptom Score (DAN-PSS-1) questionnaire in stroke patients. Materials and methods,,, Content validity was judged among an expert panel in neuro-urology. The judgement was measured by the content validity index (CVI). Face validity was indicated in a clinical sample of 482 stroke patients in a hospital-based, cross-sectional survey. Results,,, I-CVI was rated >0.78 (range 0.94,1.00) for 75% of symptom and bother items corresponding to adequate content validity. The expert panel rated the entire DAN-PSS-1 questionnaire highly relevant (S-CVI = 1.00). No experts suggested items omitted or improved. The response rate was 84% and face validity had an acceptable level of completed response for each symptom items (96,98%) and bother items (93,96%) indicating that all items were well interpreted. Conclusion,,, The DAN-PSS-1 questionnaire appears to be content and face valid for measuring lower urinary tract symptoms after stroke. [source] Psychometric validation of a monitoring-blunting measure for social anxiety disorder: the coping styles questionnaire for social situations (CSQSS)DEPRESSION AND ANXIETY, Issue 1 2005Peter G. Mezo Ph.D. Abstract The purpose of this investigation was to conduct a psychometric validation of the Coping Styles Questionnaire for Social Situations (CSQSS). The CSQSS was developed to measure monitoring and blunting coping styles in social situations based on Miller's conceptualization of how individuals cope with threat-related information. Study 1 evaluated the content validity of the CSQSS monitoring and blunting items. Study 2 examined factor structure, reliability, and construct validity of the CSQSS in a sample of 443 college students. Evidence supported the content and face validity of the CSQSS. In addition, an exploratory factor analysis revealed a two-factor solution consistent with the monitoring and blunting constructs. Both monitoring and blunting scores were positively correlated with measures of social anxiety, with blunting having a stronger relationship. Moreover, individuals with high social anxiety engaged in a significantly higher degree of monitoring and blunting than did individuals with low social anxiety. Taken together, these results provide support for the reliability and validity of the CSQSS. The CSQSS may serve as a useful measure for further examination of monitoring and blunting coping styles in a social anxiety disorder sample. Depression and Anxiety 22:20,27, 2005. © 2005 Wiley-Liss, Inc. [source] Designing mouse behavioral tasks relevant to autistic-like behaviors,DEVELOPMENTAL DISABILITIES RESEARCH REVIEW, Issue 4 2004Jacqueline N. Crawley Abstract The importance of genetic factors in autism has prompted the development of mutant mouse models to advance our understanding of biological mechanisms underlying autistic behaviors. Mouse models of human neuropsychiatric diseases are designed to optimize (1) face validity, i.e., resemblance to the human symptoms; (2) construct validity, i.e., similarity to the underlying causes of the disease; and (3) predictive validity, i.e., expected responses to treatments that are effective in the human disease. There is a growing need for mouse behavioral tasks with all three types of validity for modeling the symptoms of autism. We are in the process of designing a set of tasks with face validity for the defining features of autism: deficits in appropriate reciprocal social interactions, deficits in verbal social communication, and high levels of ritualistic repetitive behaviors. Social approach is tested in an automated three-chambered apparatus that offers the subject a choice between a familiar environment, a novel environment, and a novel environment containing a stranger mouse. Preference for social novelty is tested in the same apparatus, with a choice between the start chamber, the chamber containing a familiar mouse, and the chamber containing a stranger mouse. Social communication is evaluated by measuring the ultrasonic distress vocalizations emitted by infant mouse pups and the parental response of retrieving the pup to the nest. Resistance to change in ritualistic repetitive behaviors is modeled by forcing a change in habit, including reversal of the spatial location of a reinforcer in a T-maze task and in the Morris water maze. Mouse behavioral tasks that may model additional features of autism are discussed, including tasks relevant to anxiety, seizures, sleep disturbances, and sensory hypersensitivity. Applications of these tests include (1) behavioral phenotyping of transgenic and knockout mice with mutations in genes relevant to autism, (2) characterization of mutant mice derived from random chemical mutagenesis, (3) DNA microarray analyses of genes in inbred strains of mice that differ in social interaction, social communication and resistance to change in habit, and (4) evaluation of proposed therapeutics for the treatment of autism. Published 2004 Wiley-Liss, Inc. MRDD Research Reviews 2004;10:248,258. [source] Assessing the validity of potential alcohol-related non-fatal injury indicatorsADDICTION, Issue 3 2008John Langley ABSTRACT Aim To assess critically the face validity of the World Health Organization's (WHO's) International Guide for Monitoring Alcohol Consumption and Related Harm (MACRH) for deriving indicators, for the purposes of developing non-fatal alcohol-related injury indicators in New Zealand. Design MACRH's five solutions for deriving indicators are: (i) use only alcohol-specific cases; (ii) identify subsets of events known to be highly alcohol-related; (iii) utilize control indicators that are rarely alcohol-related; (iv) estimate alcohol attributable fractions (AAFs) and adjust indicators accordingly; and (v) develop composite indicators. These were assessed in terms of their face validity with particular reference to New Zealand. Findings There are significant face validity issues with each of the five options. Solution 4 offers the greatest promise, provided that: (i) valid AAFs can be derived and they are updated regularly; and (ii) appropriate adjustment is made for extraneous influences on the estimates of alcohol-related harm. To date, the latter has not been carried out. Conclusions Most potential sources of data on alcohol-related harm are subject to extraneous influences, which vary over time and space. While the attempt by WHO to offer solutions to this problem is laudable, the solutions do not address the problem adequately. MACRH guidelines need to be revised to include criteria for a valid outcome indicator. [source] Oral Impacts on Daily Performance in Norwegian adults: validity, reliability and prevalence estimatesEUROPEAN JOURNAL OF ORAL SCIENCES, Issue 4 2005A. N. Ĺstrřm The Oral Impacts on Daily Performance (OIDP) instrument was translated into Norwegian and reviewed for cultural and conceptual equivalence by a group of bilingual academics. A sample of employees from the University of Bergen completed the Norwegian OIDP frequency questionnaire twice. A total of 173 and 108 subjects participated in the first and the second administration, respectively, of this questionnaire. A two-stage proportionate random sample, comprising 2,000 residents (age-range 16,79 yr), was drawn from the national population register by the Central Bureau of Statistics. Information became available for 1,309 persons who completed telephone interviews. The Norwegian OIDP preserved the overall concept of the English version. Test,retest reliability, in terms of Cohen's kappa, was 0.65, and Cronbach's alpha was high (, 0.80). In both samples, variations in the OIDP scores were apparent in relation to self-reported oral health and number of remaining teeth, supporting construct and criterion validity of the inventory. Only three of the OIDP interviews were discarded, which supports face validity. A total of 18.3% confirmed that they had at least one oral impact. Age-specific rates were 17.5%, 19.0%, 17.9% and 18.4% among 16,24, 24,44, 45,66 and 67,79-yr-old participants. The satisfactory psychometric properties provide evidence for the cross-cultural use of the OIDP. The presence of a distinct floor effect indicates poor sensitivity of the OIDP to detect improvements of oral health-related quality of life at a population level. Prevalence estimates were low, suggesting that the current oral health status has little impact on the daily performance of the Norwegian adult population. [source] Autism-like behavioral phenotypes in BTBR T+tf/J miceGENES, BRAIN AND BEHAVIOR, Issue 2 2008H. G. McFarlane Autism is a behaviorally defined neurodevelopmental disorder of unknown etiology. Mouse models with face validity to the core symptoms offer an experimental approach to test hypotheses about the causes of autism and translational tools to evaluate potential treatments. We discovered that the inbred mouse strain BTBR T+tf/J (BTBR) incorporates multiple behavioral phenotypes relevant to all three diagnostic symptoms of autism. BTBR displayed selectively reduced social approach, low reciprocal social interactions and impaired juvenile play, as compared with C57BL/6J (B6) controls. Impaired social transmission of food preference in BTBR suggests communication deficits. Repetitive behaviors appeared as high levels of self-grooming by juvenile and adult BTBR mice. Comprehensive analyses of procedural abilities confirmed that social recognition and olfactory abilities were normal in BTBR, with no evidence for high anxiety-like traits or motor impairments, supporting an interpretation of highly specific social deficits. Database comparisons between BTBR and B6 on 124 putative autism candidate genes showed several interesting single nucleotide polymorphisms (SNPs) in the BTBR genetic background, including a nonsynonymous coding region polymorphism in Kmo. The Kmo gene encodes kynurenine 3-hydroxylase, an enzyme-regulating metabolism of kynurenic acid, a glutamate antagonist with neuroprotective actions. Sequencing confirmed this coding SNP in Kmo, supporting further investigation into the contribution of this polymorphism to autism-like behavioral phenotypes. Robust and selective social deficits, repetitive self-grooming, genetic stability and commercial availability of the BTBR inbred strain encourage its use as a research tool to search for background genes relevant to the etiology of autism, and to explore therapeutics to treat the core symptoms. [source] Development and utility of a multi-dimensional grid to assess individual mineral metabolism control in hemodialysis patients: A potential aid for therapeutic decision making?HEMODIALYSIS INTERNATIONAL, Issue 2 2010A. Ross MORTON Abstract A grid was developed to evaluate control of serum calcium, phosphate, and parathyroid hormone levels in hemodialysis patients, based on guideline recommendations (National Kidney Foundation Kidney Disease Outcomes Quality Initiative and Canadian Society of Nephrology), and its face validity was examined in a representative sample of Canadian patients. A retrospective chart review was undertaken in hemodialysis patients from 7 Canadian units. Patients >18 years, on hemodialysis for ,12 months, and ,3 parathyroid hormone levels measured ,1 month apart were included. The grid classified mineral metabolism control as optimal, suboptimal, or poor (mean of 3 measurements). Medication use, hospitalization, and Emergency Department visits were evaluated in relation to grid occupancy. A second comparative analysis of grid occupancy was undertaken on prevalent hemodialysis cases in British Columbia in 2008. Data from 268 patients (mean age 62.3 years) were analyzed. Using National Kidney Foundation Kidney Disease Outcomes Quality Initiative guidelines, 17.5%, 28.8%, and 53.7% of patients had optimal, suboptimal, and poor control, respectively, of all 3 parameters (calcium, phosphate, and parathyroid hormone). Using Canadian Society of Nephrology criteria, optimal, suboptimal, and poor control rates were 6.3%, 4.2%, and 89.5%, respectively. Poor control was a possible or a probable cause of hospitalization or Emergency Department attendance in 8 patients. Data from British Columbia in 2008 (n=1858) show optimal, suboptimal, and poor control rates of 15.8%, 24.5%, and 59.7%, respectively. Poor mineral metabolism control among Canadian hemodialysis patients is not showing improvement. The therapeutic grid is a valid tool and may help guide therapeutic decisions, quality control initiatives, and patient counseling. http://www.ukidney.com/bone-and-mineral-metabolism-resource. [source] How valuable are animal models in defining antidepressant activity?HUMAN PSYCHOPHARMACOLOGY: CLINICAL AND EXPERIMENTAL, Issue 1 2001M Bourin Abstract Animal models of depression have been utilised to screen novel compounds with antidepressant potential although uncertainty lingers concerning their clinical relevance. In order for a model to be considered of any value, it must possess predictive validity (does drug action in the model correspond to that in the clinic?), face validity (are there phenomenological similarities between the model and the clinic?) and construct validity (does the model possess a strong theoretical rationale?). On the one hand, there are models based on stress such as the learned helplessness model, the forced swimming test and the chronic mild stress model and, on the other hand, models based on neuronal deficits such as the olfactory bulbectomy model. To date, among models more frequently used in depression, none of them meet all these criteria. Moreover, improvements to tests are often poorly validated and estimating time of onset of action of antidepressants remains a major challenge in animal model research. Finally, reproducing the tests outside the laboratory of origin continues to be problematic and leads to variability in results. Although animal models of depression fail to be unequivocally valid, they represent the best tool to define potential antidepressant activity of drugs, to investigate their mechanism of action and, to a greater extent, explore this complex heterogeneous illness. Copyright © 2001 John Wiley & Sons, Ltd. [source] Improving Australian pharmacists' attitudes to internet use in community pharmacy practiceINTERNATIONAL JOURNAL OF PHARMACY PRACTICE, Issue 2 2005Margaret Bearman Lecturer Objective The internet now provides a significant part of consumers' healthcare information. While little is known about how community pharmacists regard the internet, there is some suggestion that issues of confidence and motivation may provide significant barriers to appropriate use. The objectives of this study were to measure any changes in pharmacists' attitudes towards the internet after completing a four-module educational course, ,Advanced web skills for pharmacists: finding quality on the internet'. Method We developed a 30-item instrument measuring pharmacists' attitudes toward the internet. Pharmacists completed the survey upon enrolment, then again on completion of the CD ROM course and for a third time three months after completing the course. Key findings The instrument was completed prior to the course by 147 participating pharmacists. The numbers of responses at the end of the course and 3,4 months post-course were 104 and 88 respectively. We established a reliable measure of pharmacists' attitudes to the internet with an appropriate degree of face validity. There was a significant improvement in attitude after course completion (P <0.005) and a further significant improvement in attitude three months after course completion (P <0.01). Conclusions A short distance education programme in internet skills can markedly improve community pharmacists' attitudes to the internet. [source] Fairness Reactions to Personnel Selection Techniques in Spain and PortugalINTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1-2 2004Silvia Moscoso This paper examines the reactions to personnel selection methods in Spain and Portugal using a sample composed of 125 and 104 students, respectively. The results found are very similar in both countries. The best rated and most favorable methods are interviews, résumés and work sample tests, while contacts, integrity tests and graphology were the least favorable ones. With regard to the process dimensions used, face validity and opportunity to perform are the most important bases for considering personnel techniques favorably. The results show some similarities with the ones found by Steiner and Gilliland (1996) in French and American samples. The similarities among the countries are examined and directions for future research are discussed. [source] Development and Validation of Quality Indicators for Dementia Diagnosis and Management in a Primary Care SettingJOURNAL OF AMERICAN GERIATRICS SOCIETY, Issue 3 2010Marieke Perry MD OBJECTIVES: To construct a set of quality indicators (QIs) for dementia diagnosis and management in a primary care setting. DESIGN: RAND modified Delphi method, including a postal survey, a stakeholders consensus meeting, a scientific expert consensus meeting, and a demonstration project. SETTING: Primary care. PARTICIPANTS: General practitioners (GPs), primary care nurses (PCNs), and informal caregivers (ICs) in postal survey and stakeholders consensus meeting. Eight national dementia experts in scientific consensus meeting. Thirteen GPs in the demonstration project. MEASUREMENTS: Mean face validity and feasibility scores. Compliance rates using GPs' electronic medical record data. RESULTS: The initial set consisted of 31 QIs. Most indicators showed moderate or good face validity and feasibility scores. Consensus panels reduced the preliminary set used in the demonstration project to 24 QIs. The overall compliance to the QIs was 45.3%. Discriminative validity of the set was good; significant differences in adherence were found between GPs with high and low levels of patients aged 65 and older in their practice, with and without PCNs, and with positive and negative attitudes toward dementia (all P<.05). Based on the demonstration project, one QI was excluded. The final set consisted of 23 QIs; 15 QIs contained innovative quality criteria on collaboration between GPs and PCNs, referral criteria, and assessment of caregivers' needs. CONCLUSION: This new set of dementia QIs is feasible, reliable, and valid and can be used to improve primary dementia care. Because of the innovative quality criteria, the set is complementary to the existing dementia QIs. [source] Development of Geriatric Competencies for Emergency Medicine Residents Using an Expert Consensus ProcessACADEMIC EMERGENCY MEDICINE, Issue 3 2010Teresita M. Hogan MD Abstract Background:, The emergency department (ED) visit rate for older patients exceeds that of all age groups other than infants. The aging population will increase elder ED patient utilization to 35% to 60% of all visits. Older patients can have complex clinical presentations and be resource-intensive. Evidence indicates that emergency physicians fail to provide consistent high-quality care for elder ED patients, resulting in poor clinical outcomes. Objectives:, The objective was to develop a consensus document, "Geriatric Competencies for Emergency Medicine Residents," by identified experts. This is a minimum set of behaviorally based performance standards that all residents should be able to demonstrate by completion of their residency training. Methods:, This consensus-based process utilized an inductive, qualitative, multiphase method to determine the minimum geriatric competencies needed by emergency medicine (EM) residents. Assessments of face validity and reliability were used throughout the project. Results:, In Phase I, participants (n = 363) identified 12 domains and 300 potential competencies. In Phase II, an expert panel (n = 24) clustered the Phase I responses, resulting in eight domains and 72 competencies. In Phase III, the expert panel reduced the competencies to 26. In Phase IV, analysis of face validity and reliability yielded a 100% consensus for eight domains and 26 competencies. The domains identified were atypical presentation of disease; trauma, including falls; cognitive and behavioral disorders; emergent intervention modifications; medication management; transitions of care; pain management and palliative care; and effect of comorbid conditions. Conclusions:, The Geriatric Competencies for EM Residents is a consensus document that can form the basis for EM residency curricula and assessment to meet the demands of our aging population. ACADEMIC EMERGENCY MEDICINE 2010; 17:316,324 © 2010 by the Society for Academic Emergency Medicine [source] Take Me Back: Validating the Wayback MachineJOURNAL OF COMPUTER-MEDIATED COMMUNICATION, Issue 1 2008Jamie Murphy Although fields such as e-commerce, information systems, and computer-mediated communication (CMC) acknowledge the importance of validity, validating research tools or measures in these domains seems the exception rather than the rule. This article extends the concept of validation to one of an emerging genre of web-based tools that provide new measures, the Wayback Machine (WM). Drawing in part on social science tests of validity, the study progresses from testing for and demonstrating the weakest form of validity, face validity, to the more demanding tests for content, predictive, and convergent validity. Finally, the study tests and shows nomological validity, using the diffusion of innovations theory. In line with prior diffusion research, the results of tests for predictive and nomological validity showed significant relationships with organizational characteristics and two WM measures: website age and number of updates. The results help validate these measures and demonstrate the utility of the WM for studying evolving website use. [source] Waiting for scheduled services in Canada: development of priority-setting scoring systemsJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 1 2003T. W. Noseworthy MD MSc MPH FRCPC FACP FCCP FCCM CHE Abstract Rationale, aims and objectives An Achilles' heel of Canadian Medicare is long waits for elective services. The Western Canada Waiting List (WCWL) project is a collaboration of 19 partner organizations committed to addressing this issue and influencing the way waiting lists are structured and managed. The focus of the WCWL project has been to develop and refine practical tools for prioritizing patients on scheduled waiting lists. Methods Scoring tools for priority setting were developed through extensive clinical input and highly iterative exchange by clinical panels constituted in five clinical areas: cataract surgery; general surgery procedures; hip and knee replacement; magnetic resonance imaging (MRI) scanning, and children's mental health. Several stages of empirical work were conducted to formulate and refine criteria and to assess and improve their reliability and validity. To assess the acceptability and usability of the priority-setting tools and to identify issues pertaining to implementation, key personnel in the seven regional health authorities (RHAs) participated in structured interviews. Public opinion focus groups were conducted in the seven western cities. Results Point-count scoring systems were constructed in each of the clinical areas. Participating clinicians confirmed that the tools offered face validity and that the scoring systems appeared practical for implementation and use in clinical settings. Reliability was strongest for the general surgery and hip and knee criteria, and weakest for the diagnostic MRI criteria. Public opinion focus groups endorsed wholeheartedly the application of point-count priority measures. Regional health authorities were generally supportive, though cautiously optimistic towards implementation. Conclusions While the WCWL project has not ,solved' the problem of waiting lists and times, having a standardized, reliable means of assigning priority for services is an important step towards improved management in Canada and elsewhere. [source] Home alone: Assessing mobility independence before discharge,,§¶JOURNAL OF HOSPITAL MEDICINE, Issue 4 2009Dennis M. Manning MD, FACC Abstract Hospitalists are often confronted with discharge planning responsibility and decisions for elderly patients who live alone. The absence of an in-home helper (spouse, partner, or care-giver) reduces the margin of safety and resilience to any new debility. Research has documented that during hospital stays elderly patients tend to become deconditioned, even if there is no new specific neurologic or motor deficit. In the patient whose pre-hospital mobility independence is not robust, and perhaps marginally compensated, inpatient stays for any diagnosis may result in critical decrements in mobility independence. The present study is an effort to design a bedside tool for the hospitalist by which to discern, or screen, for such debility. The tool is a hierarchical performance test we named I-MOVE (Independent Mobility Validation Examination). It is a quick series of bedside mobility requests to demonstrate capability of fundamental movements critical to independent living. We describe manner in which I-MOVE can be performed. Moreover, we describe the face validity and the high interrater reliability (> 0.90 intra-class correlation coefficient) of two RNs who independently administered and scored I-MOVE for 41 patients on a General Medical Care Unit. Although not yet studied in correlation with outcomes, nor with validated mobility assessment tools, we believe I-MOVE can serve as a useful extension of the nurse's assessment, or the Hospitalist's physical examination. Discerning the continued capability of mobility independence is a desirable, on-going insight for discharge planning of the elderly patient who resides alone. Journal of Hospital Medicine 2009;4:252,254. © 2009 Society of Hospital Medicine. [source] The Life Satisfaction Matrix: an instrument and procedure for assessing the subjective quality of life of individuals with profound multiple disabilitiesJOURNAL OF INTELLECTUAL DISABILITY RESEARCH, Issue 10 2005G. Lyons Abstract Background Assessing and measuring subjective quality of life (QOL) for individuals with profound multiple disabilities (PMD) remain amongst the most difficult challenges for theorists and practitioners in the field. The usual approaches using proxy reporting by familiar others have been demonstrated to be of questionable reliability and validity for persons with PMD. Method The author's continuing research into understanding the nature of subjective QOL of these individuals has led to the development and evaluating the Life Satisfaction Matrix (LSM), an instrument and procedure for assessing the subjective QOL of these individuals. Results Qualitative research that provides empirical evidence to support the assumptions underpinning, and face validity of, the LSM is described in this article. Conclusion Results of the study described herein demonstrate some potential to meet and overcome the above-mentioned challenges to assess and measure the subjective QOL of individuals with PMD. [source] Validation of the verbal and social interaction questionnaire: nurses' focus in the nurse,patient relationship in forensic nursing careJOURNAL OF PSYCHIATRIC & MENTAL HEALTH NURSING, Issue 9 2008M. RASK rn phd There is a need to develop a questionnaire that measures nurses' verbal and social interactions (VSI) with their patients from the nurses' perspective as well as from the patients' perspective in the psychiatric and especially in the forensic psychiatric field. The major aim of the present study was to determine the construct validity and the internal consistency reliability of the VSI questionnaire. The study had a methodological and developmental design and was carried out in four steps: construction of the items, face validity, data collection and data analysis. The number of items was reduced from 50 to 21. The factor analysis of the final 21 items resulted in three quite distinct factors, namely, ,inviting the patient to establish a relationship', ,showing interest in the patients' feelings, experiences and behaviour' and ,helping the patients to establish structure and routines in their everyday life'. The results showed satisfactory psychometric properties in terms of content validity, construct validity and the internal consistency reliability of the questionnaire. [source] Measuring nurse attitudes towards deliberate self-harm: the Self-Harm Antipathy Scale (SHAS)JOURNAL OF PSYCHIATRIC & MENTAL HEALTH NURSING, Issue 5 2007P. PATTERSON phd ba (hons) rmn rgn cert ed Most mental health nurses engage at some point with clients who harm themselves and these nurses often experience strong negative emotional reactions. Prolonged engagement with relapsing clients can lead to antipathy, and ,malignant alienation'. The study reported here has the aim of developing a brief, robust instrument for assessing nurse attitudes in this area. The Self-Harm Antipathy Scale, developed here on a sample of 153 healthcare professionals, has 30 attitudinal items with six factors. It has acceptable face validity, good internal consistency and some evidence of good test,retest reliability. It discriminates effectively between criterion groups. Overall this is evidence for the complexity of nurses' responses to this client group but such complex attitudes can still be assessed using a relatively brief structured instrument. [source] A literature review of dementia care mapping: methodological considerations and efficacyJOURNAL OF PSYCHIATRIC & MENTAL HEALTH NURSING, Issue 6 2002D. BEAVIS BSc(Hons) RGN RMN Dementia care mapping (DCM) is a popular method for evaluating the quality of care and well-being of people with dementia in formal care settings. Keywords and thesaurus searches were conducted between 1992 and June 2001 using a range of bibliographic databases. Studies that had specifically examined the efficacy of DCM or, had used DCM as the main outcome measure, were included in the review. Nine studies met the inclusion criteria and were evaluated in this review. The review highlights some methodological limitations in the DCM studies to date, including sampling bias, inadequate sample size, short evaluation periods and a lack of consideration of the confounding variables commonly associated with dementia. The evidence presented for DCM suggests that it has good face validity and reliability. However, other aspects of validity remain less convincing and it can only be regarded as a moderately valid instrument. Whilst its theoretical background makes DCM particularly appealing to nurses wishing to improve the quality of their care, it is a very time-consuming method and requires considerable investment in terms of nursing resources. Consequently, it is essential that more scientifically based studies are conducted to enable other aspects of validity to be developed, thus enhancing the value of DCM as an outcome measure of nursing care. [source] Coronary heart disease knowledge tool for womenJOURNAL OF THE AMERICAN ACADEMY OF NURSE PRACTITIONERS, Issue 2 2010ACNP-BC, ANP-BC, Coordinator of Adult Nurse Practitioner Program), DCC (Associate Professor, Joanne L. Thanavaro DNP Purpose: To develop a tool that measures coronary heart disease (CHD) knowledge specifically for women. Data sources: The new CHD knowledge tool, based on previous surveys of women's CHD knowledge, has 25 multiple-choice questions. An expert panel evaluated content and face validity. The tool was pilot tested in women without CHD, who were admitted to a Chest Pain Center. The tool was subsequently administered to laywomen and female cardiovascular nurses to evaluate its validity and reliability. The sample included 49 women as the control group (Group 1), 23 cardiovascular nurses as a known group (Group 2), and 22 women with an educational program as the treatment group (Group 3). Knowledge of women in Group 1 was compared with Groups 2 and 3 in known group and predictive validity tests. Conclusion: The new tool demonstrates good validity and reliability to measure CHD knowledge in women. Implications for practice: Women continue to have low CHD knowledge, and nurse practitioners should provide education to improve women's CHD knowledge as a strategy to promote healthy lifestyle practices and CHD risk prevention. The new tool can be utilized in future research to measure women's CHD knowledge. [source] Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing scoreMEDICAL EDUCATION, Issue 11 2001Tim J Wilkinson Background Objective structured clinical examination (OSCE) standard-setting procedures are not well developed and are often time-consuming and complex. We report an evaluation of a simple ,contrasting groups' method, applied to an OSCE conducted simultaneously in three separate schools. Subjects Medical students undertaking an end-of-fifth year multidisciplinary OSCE. Methods Using structured marking sheets, pairs of examiners independently scored student performance at each OSCE station. Examiners also provided a global rating of overall performance. The actual scores of any borderline candidates at each station were averaged to provide a passing score for each station. The passing scores for all stations were combined to become the passing score for the whole exam. Validity was determined by making comparisons with performance on other fifth-year assessments. Reliability measures comprised interschool agreement, interexaminer agreement and interstation variability. Results The approach was simple and had face validity. There was a stronger association between the performance of borderline candidates on the OSCE and their in-course assessments than with their performance on the written exam, giving a weak measure of construct validity in the absence of a better ,gold standard'. There was good agreement between examiners in identifying borderline candidates. There were significant differences between schools in the borderline score for some stations, which disappeared when more than three stations were aggregated. Conclusion This practical method provided a valid and reliable competence-based pass mark. Combining marks from all stations before determining the pass mark was more reliable than making decisions based on individual stations. [source] The face validity of a final professional clinical examinationMEDICAL EDUCATION, Issue 5 2001Michael Tweed Objective To develop new methods of evaluating face validity in the context of a revised final professional examination for medical undergraduates, organized on three sites, over 2 days. Methods The opinion of the students and examiners was surveyed by Likert-style questionnaires, with additional open comments. Expert opinion was gathered from external examiner reports and a recent Quality Assurance Agency (QAA) Subject Review Report. Results The questionnaires had an overall response rate of 84%. Internal reliability, assessed by comparing responses to appropriate questions, was good with an equivalence of 45% (weighted kappa 0·54) for the students and 33% (weighted kappa 0·41) for the assessors. There was little evidence of inconsistency between days or sites. The majority of the opinions from the students, examiners and external experts were positive. Negative comments related to time pressure and case mix. Conclusion The measurement of face validity proved feasible and valuable and will assist in the further development of the course and the examination. [source] Study of the Reliability and Validity of the Community Health Intensity Rating Scale (CHIRS) in the Turkish CommunityPUBLIC HEALTH NURSING, Issue 3 2007Aysun Çelebio ABSTRACT The purpose of this study was to examine the reliability and validity of the Community Health Intensity Rating Scale (CHIRS) that was translated into the Turkish language and applied in the Turkish community. The CHIRS is a tool that assesses the intensity of need for care of persons/families in the community. The original version of the tool was translated into Turkish, examined for face validity and language appropriateness by the Turkish experts, and then applied to 372 families living in Odemis, Turkey. Significant correlations were found between total scale score (TSS) and total number of household members, and between the TSS and the total number of visits to any health institution within the previous month. In addition, the self-health care needs evaluation scores supported predictive validity. For reliability, min,max values, standard errors and deviations, skewness, and kurtosis coefficients of parameter scores, domain scores, and TSS were examined. The mean TSS was 26.7 (± 5.32) and the mean age of the participants was 35.0 years. For internal consistency, Cronbach's , (.525) and Guttman split-half coefficient (.629) values were established for the TSS. In conclusion, the reliability and validity of the Turkish version of CHIRS have been established. [source] Impact of Perioperative Systemic Steroids on Surgical Outcomes in Patients With Chronic Rhinosinusitis With Polyposis: Evaluation With the Novel Perioperative Sinus Endoscopy (POSE) Scoring System,THE LARYNGOSCOPE, Issue S115 2007Erin D. Wright MDCM Abstract Objectives/Hypothesis: The objective of this randomized, double-blind, placebo-controlled study was to assess the effect of perioperative systemic steroids on subjective and objective surgical outcomes for patients undergoing endoscopic sinus surgery (ESS) for chronic rhinosinusitis with polyposis (CRSwP). The secondary objective was to begin validation of the newly developed Perioperative Sinus Endoscopy (POSE) scoring system. Methods: Patients who had failed maximal medical therapy and were scheduled to undergo ESS were eligible for the study. Participants were randomized to receive either 30 mg of prednisone or placebo for 5 days preoperatively and 9 days postoperatively. Operative and baseline clinical data were collected using the Lund-McKay staging system including its Sinus Symptom Questionnaire as well as additional data regarding mucosal health, the technical difficulty of surgery, and endoscopic data using the Lund-Kennedy Endoscopic Score (LKES) and POSE scale. Data were also collected at 2 weeks, 1 month, 3 months, and 6 months postoperatively. A sample size of 24 was calculated to detect a clinically relevant difference between groups of 40%. Routine statistical comparisons were performed as were repeated measures analysis of variance with Bonferroni adjustment because of the multiple comparisons performed. To address the secondary objective, data were also collected at all postoperative time points using the POSE instrument, which was designed with the intention of enhancing face validity and responsiveness to change. Comparisons were performed between the POSE and LKES, including assessment of sensitivity to change, correlation between the two scales, and correlation with symptom scores. Results: Twenty-six patients participated in the study. Operative data demonstrated a significantly higher percentage of severely inflamed sinonasal mucosa in patients not pretreated with systemic steroids, which was associated with technically more difficult surgery in the estimation of the operating surgeon. In terms of postoperative symptoms, there was no difference between treatment groups, with both placebo and prednisone significantly improved over baseline up to 4 weeks postoperatively. Endoscopic assessment of patients postoperatively demonstrated a treatment effect (P < .05), with clinically healthier cavities seen in patients treated with prednisone up to 6 months postoperatively as compared with baseline (P < .001), although the strongest effect was seen at the 2-week time point. In comparing the two endoscopic scales, the POSE and LKES correlated highly (R > 0.70; P < .001) both in terms of absolute score and change in score. There is some evidence that the POSE score may be more sensitive to change than the LKES, and the POSE scores did correlate more strongly with symptom scores than the LKES, although both endoscopic scores correlated only weakly with symptom scores. Conclusions: The data presented in this study support the practice of administering preoperative systemic steroids to patients undergoing ESS for CRSwP. Furthermore, in the practice of surgeons who provide intensive postoperative care post-ESS, including debridement and medical therapy based on the endoscopic findings, there is evidence to support administering systemic steroids in the postoperative period. The POSE scoring system compares favorably with the LKES and may confer advantages in terms of face/content validity and responsiveness to change and is worthy of further validation. [source] Sociocultural Perceptions and Patterns of Cigarette and Alcohol Use among College Students in VietnamASIAN SOCIAL WORK AND POLICY REVIEW, Issue 3 2008Paul DuongTran This empirical study was conducted in the Socialist Republic of Vietnam to investigate cross-sectionally the influences of sociocultural contexts on the patterns of addictive substance use cigarette, alcohol, and illicit drugs. A sample of 202 monolingual adults who were enrolled in college courses at the University of Hanoi in Vietnam responded to a self-reported questionnaire in their native language on the frequency, quantity, and occasions of addictive behavior. The project staff were fluent in English and Vietnamese. The questionnaire was critically reviewed for its face validity and cultural appropriateness before being translated into Vietnamese. In addition to patterns of use, this research explored the central role of drinking alcohol and smoking cigarettes in peer socialization among college adults. Vietnam, like other Asian cultures, emphasizes initiation and conformity to social traditions and norms. The empirical findings provide invaluable knowledge of the complex roles of cigarette and alcohol in the social processes and relationship-building among college adults in Vietnam. Further knowledge will assist in identifying intervention approaches and health prevention that is more focused and congruent with cultural and social beliefs about this behavior and these substances. Its implications for research into culturally appropriate intervention and prevention are also discussed. [source] Minimal aberrant behavioral phenotypes of neuroligin-3 R451C knockin miceAUTISM RESEARCH, Issue 3 2008Kathryn K. Chadman Abstract Neuroligin-3 is a member of the class of cell adhesion proteins that mediate synapse development and have been implicated in autism. Mice with the human R451C mutation (NL3), identical to the point mutation found in two brothers with autism spectrum disorders, were generated and phenotyped in multiple behavioral assays with face validity to the diagnostic symptoms of autism. No differences between NL3 and their wildtype (WT) littermate controls were detected on measures of juvenile reciprocal social interaction, adult social approach, cognitive abilities, and resistance to change in a spatial habit, findings which were replicated in several cohorts of males and females. Physical and procedural abilities were similar across genotypes on measures of general health, sensory abilities, sensorimotor gating, motor functions, and anxiety-related traits. Minor developmental differences were detected between NL3 and WT, including slightly different rates of somatic growth, slower righting reflexes at postnatal days 2,6, faster homing reflexes in females, and less vocalizations on postnatal day 8 in males. Significant differences in NL3 adults included somewhat longer latencies to fall from the rotarod, less vertical activity in the open field, and less acoustic startle to high decibel tones. The humanized R451C mutation in mice did not result in apparent autism-like phenotypes, but produced detectable functional consequences that may be interpreted in terms of physical development and/or reduced sensitivity to stimuli. [source] | ||||||||||||||||