Validity Testing (validity + testing)

Distribution by Scientific Domains
Distribution within Medical Sciences


Selected Abstracts


Comprehensive cognitive neurological assessment in stroke

ACTA NEUROLOGICA SCANDINAVICA, Issue 3 2009
M. Hoffmann
Background,,, Cognitive syndromes (CS) after stroke may be important to measure and monitor for management and emerging therapies. Aim,,, To incorporate known behavioral neurological and neuropsychiatric syndromes into a bedside cognitive assessment in patients with stroke. Methods,,, A validated cognitive examination (comprehensive cognitive neurological test in stroke, Coconuts) was administered during the first month of stroke presentation and analyzed according to five large-scale networks for cognition and correlated with neuropsychological tests. Validity testing of the test was performed for overall sensitivity, specificity, positive predictive value and negative predictive value to stroke in comparison with MRI diagnosis of stroke as well as discriminant validity, construct validity and inter-rater reliability. Results,,, Overall the sensitivity of the Coconuts scale was 91% and specificity 35%, PPV 88% and NPV 41% vs stroke lesions using MRI. Cognitive syndrome frequencies: frontal network syndrome frequency was 908/1796 (51%), left hemisphere network syndrome frequency was 646/1796 (36%), right hemisphere network included 275/1796 (15.3%), occipitotemporal network for complex visual processing 107/1796 (6%), the hippocampal limbic network for amnesias and emotional disorders 397/1796 (22%) and miscellaneous network syndromes 481/1796 (27%). Conclusion,,, The Coconuts is a valid and practical test of a comprehensive array of known behavioral neurological and neuropsychiatric syndromes in patients with stroke. [source]


Validation of the Mayo Dysphagia Questionnaire

DISEASES OF THE ESOPHAGUS, Issue 3 2007
A. B. M. Grudell
SUMMARY., While multiple instruments characterize upper gastrointestinal symptoms, a validated instrument devoted to the measurement of a spectrum of esophageal dysphagia attributes is not available. Therefore, we constructed and validated the Mayo Dysphagia Questionnaire (MDQ). The 27 items of the MDQ underwent content validity, feasibility, concurrent validity, reproducibility, internal consistency, and construct validity testing. To assess content validity, five esophageal subspecialty gastroenterologists reviewed the items to ensure inclusion of pertinent domains. Feasibility testing was done with eight outpatients who refined problematic items. To assess concurrent validity, 70 patient responses on the MDQ were compared to responses gathered in a structured patient-physician interview. A separate group of 70 outpatients completed the MDQ twice to assess the reproducibility of each item. A total of 148 patients participated in the validation process (78 [53%] men; mean age 62). On average, the MDQ took 6 minutes to complete. A single item (odynophagia) tested poorly with a kappa value of < 0.4. Otherwise, the majority of concurrent validity kappa values were in the good to excellent range with a mean of 0.63 (95% CI 0.22,0.89). The majority of reproducibility kappa values were also in the good to excellent range with a median kappa value of 0.76 (interquartile range: 0.67,0.81). Cronbach's alpha values were excellent in the range of 0.86,0.88. Spearman rank correlation coefficients to assess construct validity were also excellent in the range of 0.87,0.98. Thus, the MDQ is a concise instrument that demonstrates overall excellent concurrent validity, reproducibility, internal consistency, and construct validity for the features of esophageal dysphagia. [source]


Development and Construct Validation of the Pharmacists' Care of Migraineurs Scale

HEADACHE, Issue 1 2009
Monica L. Skomo PharmD
Objectives., To develop the pharmacists' care of migraineurs scale (PCMS) and to evaluate its psychometric properties. Background., Migraine is often managed suboptimally in primary care. Migraineurs frequently come into contact with community pharmacists, who have the opportunity to make a positive impact on migraineur treatment outcomes. A valid and reliable tool that measures and documents the care provided by pharmacists to migraineurs is critical to the development and evaluation of educational programs and interventions. Methods., Relevant domains of pharmacist care and their respective composite items (behaviors) were identified through an extensive literature search and the use of 2 pharmacist and 2 migraineur focus groups sessions. The resultant 45 PCMS items composed a survey questionnaire mailed to a nationwide random sample of 6000 pharmacists. Data were subjected to an exploratory principal axis factoring procedure to discern the factor structure, and as such describe the latent domains composing the pharmacist caring behaviors constructs. Results., A total of 580 usable responses were returned, with an additional 60 returned as undeliverable, thus yielding a response rate of 9.7%. Exploratory factor analysis using principal axis factoring yielded 9 factors. However, upon examining the scree plot, communalities, and factor loadings, a reanalysis forcing a 7-factor solution yielded a more interpretable and plausible factor structure. The 7-factor solution included the following domains: (1) empathy; (2) prospective drug utilization review for newly diagnosed migraineurs; (3) medication counseling; (4) nonpharmacologic treatment plan; (5) headache sufferer triage; (6) dissemination of public health information; (7) maintenance of knowledge on migraine. Following the application of scale purification procedures, the final instrument is composed of 41 items and demonstrated a Cronbach's alpha reliability of 0.947. Cronbach's alpha reliabilities for the 7 domains ranged from 0.67 to 0.91, indicative of good to excellent internal consistency reliabilities for all the domains. Conclusions., The PCMS demonstrated very good construct validity and reliability. While additional validity testing is warranted, the PCMS should allow for benchmarking in the evaluation of interventions designed to improve pharmacists' care to migraineurs and for identifying correlates to effective community pharmacist migraineur care. [source]


The Diabetes Continuity of Care Scale: the development and initial evaluation of a questionnaire that measures continuity of care from the patient perspective,

HEALTH & SOCIAL CARE IN THE COMMUNITY, Issue 6 2004
Lisa R. Dolovich PharmD MSc
Abstract The purpose of the present study was to develop and pilot test a questionnaire to assess continuity of care from the perspective of patients with diabetes. Seven patient and two healthcare-provider focus groups were conducted. These focus groups generated 777 potential items. This number was reduced to 56 items after item reduction, face validity testing and readability analysis, and to 47 items after a preliminary factor analysis. Readability was assessed as requiring 7,8 years of schooling. Sixty adult patients with diabetes completed the draft Diabetes Continuity of Care Scale (DCCS) at a single point in time to assess the validity of the instrument. Patients completed the draft DCCS again 2 weeks later to assess test,retest reliability. A provisional factor analysis and grouping according to clinical sense yielded five domains: access and getting care, care by doctor, care by other healthcare professionals, communication between healthcare professionals, and self-care. The internal consistency (Cronbach's alpha) for the whole scale was 0.89. The test,retest reliability was r = 0.73. The DCCS total score was moderately correlated with some of the measures used to establish construct validity. The DCCS could differentiate between patients who did and did not achieve specific process and clinical indicators of good diabetes care (e.g. Hba1c tested within 6 months). The development of the DCCS was centred on the patient's perspective and revealed that the patient perspective regarding continuity of care extends beyond the concept of seeing one doctor. Initial testing of this instrument demonstrates that it has promise as a reliable and valid measure in this area. [source]


EVIDENCE SYNTHESIS: Systematic review of current executive function measures in adults with and without cognitive impairments

INTERNATIONAL JOURNAL OF EVIDENCE BASED HEALTHCARE, Issue 3 2010
Sabrina Pickens PhDc MSN ANP-BC GNP-BC
Abstract Background, Executive function pertains to higher cognitive processes historically linked to frontal lobes. Several measures are available to screen for executive function; however, no gold standard exists. The difficulty in assessing executive function is the existence of its many subsets. Objectives, To evaluate the psychometric properties of executive function measures and determine the most effective measure(s) through a systematic review of the literature. Search strategy, The search strategy utilised a comprehensive literature review of articles written in the English language published from January 2003 to September 2009. The following electronic databases were searched: SCOPUS, PUBMED, Medline Ovid, PsychArticles and CINAHL Plus. Initial key words used were ,executive function', ,measures', ,reliability' and ,validity' followed by the addition of ,traumatic brain injury'. The initial search elicited 226 articles, of which 28 were retrieved. After further exclusion 19 were included in the review. Results, Eight measures underwent factor analysis and 18 underwent various forms of reliability and/or validity testing. Factor analysis showed different aspects of executive functions. According to preset evaluation criteria, only the Test of Practical Judgment performed all of the recommended reliability and validity testing. Reviewer's conclusion, Of the recently developed measures, several show promise for future use yet further validity and reliability testing is warranted. Future tool development should measure all subsets of executive function rather than only a few and include the recommended components of reliability and validity testing. [source]


Development and validation of a learning needs assessment scale: a continuing professional education tool for multiple sclerosis specialist nurses

JOURNAL OF CLINICAL NURSING, Issue 6 2007
Alison While BSc
Aim., To develop and validate a learning needs assessment scale. Background., Learning needs analysis is a central component of continuing professional development but there is a lack of psychometrically developed learning needs assessment tools. Self-assessment questionnaires are emerging as a key method. The development of a learning needs analysis scale for multiple sclerosis specialist nurses is described. Design., A psychometric approach comprising the three phases of the development and testing of the scale are outlined. Method., Phase 1: Item identification using a literature review; postal survey of stakeholders (n = 320), 20 nurse interviews; four nurse focus groups; five telephone interviews with people with MS. Phase 2: Refinement of draft scale and establishing face and content validity testing using an expert panel. Phase 3: Testing of draft scale using data from a postal survey (n = 47 MS specialist nurses) to assess the feasibility and effectiveness of scale, internal consistency and construct validity. Test,retest reliability was assessed using data from 17 MS specialist nurse respondents to calculate intra-class correlation coefficients. Results., The data from the different study phases informed scale refinement. The validity and reliability of the scale was confirmed through testing. Conclusion., The study provides an example of how a robust learning needs assessment scale may be developed for a specialist area of nursing practice to be used in conjunction with more subjective approaches. Relevance to clinical practice., High quality nursing care depends upon a competent nursing workforce that engages in continuing professional development. This study provides an example of a psychometrically developed learning needs assessment scale to inform continuing professional development needs of nurses working in a specialist area of practice. [source]


Staff attitudes towards aggression in health care: a review of the literature

JOURNAL OF PSYCHIATRIC & MENTAL HEALTH NURSING, Issue 1 2005
G. J. JANSEN rn mnsc
The aim of this literature review was to explore the attitudes of health care workers towards inpatient aggression and to analyse the extent to which attitudes, as defined from a theoretical point of view, were addressed in the selected studies. Databases from 1980 up to the present were searched, and a content analysis was done on the items of the selected studies. The concepts ,cognition' and ,attitude' from the framework of ,The Theory of Reasoned Action' served as categories. The self-report questionnaire was the most common instrument used and three instruments specifically designed to measure attitudes were found. These instruments lacked profound validity testing. From a total of 74 items, two thirds focussed on cognitions and only a quarter really addressed attitudes towards aggression. Research was particularly concerned with the cognitions that nurses had about aggression, and attitudes were studied only to a limited extent. Researchers used different instruments, which makes it difficult to compare results across settings. [source]


Reliability and validity of the Inventory of Functional Status after Childbirth when used in an Australian population

NURSING & HEALTH SCIENCES, Issue 3 2002
Carol McVeigh RN
Abstract This study presents the results of reliability and validity testing of the Inventory of Functional Status after Childbirth (IFSAC) when used in an Australian sample. Data were obtained from a culturally diverse group of 173 women residing in a regional city in New South Wales, Australia. Participants could read and write English, delivered healthy infants between 37 and 42 weeks gestation and experienced normal pregnancies, labors, and deliveries. The inventory and its five scales were assessed for reliability using Cronbach's coefficient , and construct validity using item-total correlation matrices. While three of the IFSAC scales performed well, two were problematic in this Australian population. With modification and updating, the clinical utility of IFSAC may be more fully realized. [source]


Validity and clinical significance of biomechanical testing of implant/bone interface

CLINICAL ORAL IMPLANTS RESEARCH, Issue S2 2006
Carlos Aparicio
Abstract Purpose: The aim of this paper was to review the clinical literature on the Resonance frequency analysis (RFA) and Periotest techniques in order to assess the validity and prognostic value of each technique to detect implants at risk for failure. Material and methods: A search was made using the PubMed database to find clinical studies using the RFA and/or Periotest techniques. Results: A limited number of clinical reports were found. No randomized-controlled clinical trials or prospective cohort studies could be found for validity testing of the techniques. Consequently, only a narrative review was prepared to cover general aspects of the techniques, factors influencing measurements and the clinical relevance of the techniques. Conclusions: Factors such as bone density, upper or lower jaw, abutment length and supracrestal implant length seem to influence both RFA and Periotest measurements. Data suggest that high RFA and low Periotest values indicate successfully integrated implants and that low/decreasing RFA and high/increasing Periotest values may be signs of ongoing disintegration and/or marginal bone loss. However, single readings using any of the techniques are of limited clinical value. The prognostic value of the RFA and Periotest techniques in predicting loss of implant stability has yet to be established in prospective clinical studies. [source]