Home About us Contact
|
Home About us Contact | ||
|
|
||
Item Analysis (item + analysis)
Selected AbstractsItem Analysis by the Hierarchical Generalized Linear ModelJOURNAL OF EDUCATIONAL MEASUREMENT, Issue 1 2001Akihito Kamata The hierarchical generalized linear model (HGLM) is presented as an explicit, two-level formulation of a multilevel item response model. In this paper, it is shown that the HGLM is equivalent to the Rasch model and that, characteristic of the HGLM, person ability can be expressed in the form of random effects rather than parameters. The two-level item analysis model is presented as a latent regression model with person-characteristic variables. Furthermore, it is shown that the two-level HGLM model can be extended to a three-level latent regression model that permits investigation of the variation of students' performance across groups, such as is found in classrooms and schools, and of the interactive effect of person-and group-characteristic variables. [source] The test of self-conscious affect: internal structure, differential scales and relationships with long-term affectsEUROPEAN JOURNAL OF PERSONALITY, Issue 6 2001Johnny R. J. Fontaine Item analyses and confirmatory factor analyses on the Test of Self-Conscious Affect (TOSCA), in a student (N,=,723) and an adult (N,=,891) sample, supported the theorized four factor structure of proneness to reparation, negative self-evaluation, externalizing blame and unconcern. However, two-fifth of the items did not empirically differentiate between two or more factors. Differential TOSCA scales, including only differentiating TOSCA items, were constructed and related to measures of long-term affect, depression, anxiety, and anger. Both the pattern and size of correlations of the original and the differential TOSCA scales were almost identical. Results of this study support the interpretation of TOSCA guilt as a measure of a tendency to reparation associated with guilt and TOSCA shame as a measure of a tendency to global negative self-evaluation. Copyright © 2001 John Wiley & Sons, Ltd. [source] Restricted and repetitive behaviors in toddlers and preschoolers with autism spectrum disorders based on the Autism Diagnostic Observation Schedule (ADOS),AUTISM RESEARCH, Issue 4 2010So Hyun Kim Abstract Restricted and repetitive behaviors (RRBs) observed during the Autism Diagnostic Observation Schedule [ADOS: Lord et al., 2000] were examined in a longitudinal data set of 455 toddlers and preschoolers (age 8,56 months) with clinical diagnosis of Autism Spectrum Disorders (ASD; autism, n=121 and pervasive developmental disorders,not otherwise specified (PDD-NOS), n=71), a nonspectrum disorder (NS; n=90), or typical development (TD; n=173). Even in the relatively brief semi-structured observations, GEE analyses of the severity and prevalence of RRBs differentiated children with ASD from those with NS and TD across all ages. RRB total scores on the ADOS were stable over time for children with ASD and NS; however, typically developing preschoolers showed lower RRB scores than typically developing toddlers. Nonverbal IQ (NVIQ) was more strongly related to the prevalence of RRBs in older children with PDD-NOS, NS, and TD than younger children under 2 years and those with autism. Item analyses revealed different relationships between individual items and NVIQ, age, diagnosis, and gender. These findings are discussed in terms of their implications for the etiology and treatment of RRBs as well as for the framework of ASD diagnostic criteria in future diagnostic systems. [source] Cigarette dependence questionnaire: development and psychometric testing with male smokersJOURNAL OF ADVANCED NURSING, Issue 10 2010Chih-Ling Huang huang c.-l., lin h.-h. & wang h.-h. (2010) Cigarette dependence questionnaire: development and psychometric testing with male smokers. Journal of Advanced Nursing,66(10), 2341,2349. Abstract Aim., This paper is a report of a study conducted to develop and test a theoretically derived Cigarette Dependence Questionnaire for adult male smokers. Background., Fagerstrom questionnaires have been used worldwide to assess cigarette dependence. However, these assessments lack any theoretical perspective. A theory-based approach is needed to ensure valid assessment. Methods., In 2007, an initial pool of 103 Cigarette Dependence Questionnaire items was distributed to 109 adult smokers in Taiwan. Item analysis was conducted to select items for inclusion in the refined scale. The psychometric properties of the Cigarette Dependence Questionnaire were further evaluated 2007,08, when it was administered to 256 respondents and their saliva was collected and analysed for cotinine levels. Criterion validity was established through the Pearson correlation between the scale and saliva cotinine levels. Exploratory factor analysis was used to test construct validity. Reliability was determined with Cronbach's alpha coefficient and a 2-week test,retest coefficient. Results., The selection of 30 items for seven perspectives was based on item analysis. One factor accounting for 44·9% of the variance emerged from the factor analysis. The factor was named as cigarette dependence. Cigarette Dependence Questionnaire scores were statistically significantly correlated with saliva cotinine levels (r = 0·21, P = 0·01). Cronbach's alpha was 0·95 and test,retest reliability using an intra-class correlation was 0·92. Conclusion., The Cigarette Dependence Questionnaire showed sound reliability and validity and could be used by nurses to set up smoking cessation interventions based on assessment of cigarette dependence. [source] The Existential Loneliness Questionnaire: Background, development, and preliminary findingsJOURNAL OF CLINICAL PSYCHOLOGY, Issue 9 2002Aviva M. Mayers We described the background and the development of a new measure of existential loneliness, the Existential Loneliness Questionnaire (ELQ). Specifically, we analyzed the items of the preliminary version of the ELQ (ELQ-P) using methods based on item response theory (the Rasch model) and examined the convergent and discriminative validity of the ELQ in a sample of 47 HIV-infected women. Item analysis produced an ELQ version consisting of 22 items that were internally consistent and performed well in measuring an underlying construct conceptualized as existential loneliness. In addition, the ELQ discriminated well between symptomatic and asymptomatic HIV-infected women. The ELQ correlated strongly with measures of depression, loneliness not identified as existential and purpose-in-life and moderately strongly with a measure of hopelessness. Holding constant depression scores, the correlation between the ELQ and loneliness not identified as existential was significantly attenuated. Limitations of the study include the small sample size, which precluded an analysis of the dimensional structure of the ELQ. © 2002 Wiley Periodicals, Inc. J Clin Psychol 58: 1183,1193, 2002. [source] Development and psychometric properties of the Individualized Care ScaleJOURNAL OF EVALUATION IN CLINICAL PRACTICE, Issue 1 2005Riitta Suhonen PhD RN Abstract Rationale, aims and objectives, In this study we describe the development of the Individualized Care Scale (ICS) and evaluate its validity, psychometric properties and feasibility. The ICS was designed to measure patients' views on how individuality is supported through specific nursing interventions (ICA) and how they perceive individuality in their own care (ICB) during hospitalization. Method, Three different data sets were collected among patients being discharged from hospital (n1 = 203, n2 = 279, n3 = 454). This bipartite 38-item ICS promises to be a brief, timely, easy to administer and useful self-completion measure for evaluating clinical nursing practice from the patient's point of view. Results, The findings supported the internal consistency reliability of the ICS (alpha 0.94 for ICA and ICB 0.93) and the three subscales (alphas 0.85,0.90). Item analysis supported the item construction of each scale. Content validity was furthered by a critical literature review and four expert analyses. Principal component analysis (Promax with Kaiser normalization) among earlier factor analyses supported construct validity by generating a three-factor solution which accounted for 65% of the variance in the ICA and 61% in the ICB. Pearson's correlation coefficients were at least 0.88 between the subscales and the total domain ICA or ICB. Conclusions, The ICS has demonstrated promise as a tool for measuring patients' evaluations of their hospital experience and individuality in care. [source] Prediction of intern attendance at a seminar-based training programme: a behavioural intention modelMEDICAL EDUCATION, Issue 7 2000Rob J Boots Context The factors determining intern attendance at ,resident rounds' training programmes are not known. Aims This study aimed to use a behavioural model (the Triandis theory of social behaviour) to predict intern attendance at the resident round programme at a metropolitan teaching hospital. Subjects These included 109 interns in a large metropolitan teaching hospital, in the 1996 and 1997 cohorts. Methods Tabulated responses from a structured interview administered to 10 randomly selected interns were used to develop survey items related to the Triandis variables. Attendance was monitored using a sessional logbook and by self-report. Item analysis was conducted for each variable scale. Stepwise multiple regression models were constructed to predict attendance and intention. Results The average proportion of resident rounds attended was 43% (95% confidence intervals (CI) 40,47%) from logbook attendance, and 63% (95% CI 61,65%) by self-report. Cronbach's alpha for the subscales ranged from 0·62 to 0·91. Intern attendance was predicted by the habit of attendance and negatively predicted by facilitating conditions (AdjR2=0·26, P < 0·0001). The intention to attend was only independently predicted by perceived consequences (AdjR2= 0·19, P < 0·0001). Conclusions The establishment of resident education programmes within teaching hospitals requires attention to and modification of facilitating conditions that may allow improvements in attendance and in quality of the programme. [source] Evaluation of the processes of family-centred care for young children with intellectual disability in Western AustraliaCHILD: CARE, HEALTH AND DEVELOPMENT, Issue 5 2010A. Wilkins Abstract Introduction Government early intervention services for children with intellectual disability (ID) in Western Australia have adopted the model of family-centred care. The aim of this study was to evaluate how well it was being practised, to describe the pattern of service utilization and to identify factors influencing parental perceptions of family-centred care. Methods The study included children aged 0,6 years with ID, who were registered clients of Disability Services Commission, Western Australia. Parents completed a postal survey questionnaire about the frequency and type of services received and their perceptions of services using the Measure of Processes of Care (MPOC-56) questionnaire. Mean scores for the five MPOC domains were compared using anova against the independent variables of child age group, child diagnostic group, service type and frequency, place of residence, family and demographic variables. Significant variables in each domain were then entered into multivariate analyses. Results Of 292 eligible families, 165 (59%) returned a completed questionnaire. While over 50% of children had contact with occupational, speech and physical therapists at least once per month, less than 20% of children had at least annual contact with either psychology or dental services. Families rated their satisfaction highest for ,respectful and supportive care' and lowest for ,providing general information'. Individual item analyses indicated less satisfaction with ,co-ordinated and comprehensive care'. Higher means were associated with more frequent contact with occupational therapy. Conclusion Overall respondents reported early intervention services for young children with ID in Western Australia provided satisfactory family-centred care by means of the 56-item MPOC. The frequency of contact with allied health professionals was positively associated with parental ratings of family-centred care. The study indicates under-servicing in dental care and psychology services. [source] The therapeutic relationship in secondary mental health care: a conceptual review of measuresACTA PSYCHIATRICA SCANDINAVICA, Issue 4 2007J. Catty Objective: The study aimed to determine the conceptual basis of measures of the patient,professional relationship used in routine mental health services research by reviewing their face, content and construct validity. Method: A comprehensive literature search identified measures of the relationship used in mental health services research. The conceptual basis of each identified measure was identified by a review of measures' authors assessments of face, content and construct validity plus item analysis of the measures themselves. Results: The search identified 15 measures. The seven developed in psychotherapy were likely to be better validated conceptually; most were based on therapeutic alliance models. Measures developed specifically for mental health services were based on a wider range of models including global assessments of the relationship. Conclusion: Most of the better validated measures originate in psychotherapy, but there is limited evidence for their validity in general mental health services. Four measures are recommended. [source] Cigarette dependence questionnaire: development and psychometric testing with male smokersJOURNAL OF ADVANCED NURSING, Issue 10 2010Chih-Ling Huang huang c.-l., lin h.-h. & wang h.-h. (2010) Cigarette dependence questionnaire: development and psychometric testing with male smokers. Journal of Advanced Nursing,66(10), 2341,2349. Abstract Aim., This paper is a report of a study conducted to develop and test a theoretically derived Cigarette Dependence Questionnaire for adult male smokers. Background., Fagerstrom questionnaires have been used worldwide to assess cigarette dependence. However, these assessments lack any theoretical perspective. A theory-based approach is needed to ensure valid assessment. Methods., In 2007, an initial pool of 103 Cigarette Dependence Questionnaire items was distributed to 109 adult smokers in Taiwan. Item analysis was conducted to select items for inclusion in the refined scale. The psychometric properties of the Cigarette Dependence Questionnaire were further evaluated 2007,08, when it was administered to 256 respondents and their saliva was collected and analysed for cotinine levels. Criterion validity was established through the Pearson correlation between the scale and saliva cotinine levels. Exploratory factor analysis was used to test construct validity. Reliability was determined with Cronbach's alpha coefficient and a 2-week test,retest coefficient. Results., The selection of 30 items for seven perspectives was based on item analysis. One factor accounting for 44·9% of the variance emerged from the factor analysis. The factor was named as cigarette dependence. Cigarette Dependence Questionnaire scores were statistically significantly correlated with saliva cotinine levels (r = 0·21, P = 0·01). Cronbach's alpha was 0·95 and test,retest reliability using an intra-class correlation was 0·92. Conclusion., The Cigarette Dependence Questionnaire showed sound reliability and validity and could be used by nurses to set up smoking cessation interventions based on assessment of cigarette dependence. [source] Preparing a large data set for analysis: using the Minimum Data Set to study perineal dermatitisJOURNAL OF ADVANCED NURSING, Issue 4 2005Kay Savik MS Aim., The aim of this paper is to present a practical example of preparing a large set of Minimum Data Set records for analysis, operationalizing Minimum Data Set items that defined risk factors for perineal dermatitis, our outcome variable. Background., Research with nursing home elders remains a vital need as ,baby boomers' age. Conducting research in nursing homes is a daunting task. The Minimum Data Set is a standardized instrument used to assess many aspects of a nursing home resident's functional capability. United States Federal Regulations require a Minimum Data Set assessment of all nursing home residents. These large data would be a useful resource for research studies, but need to be extensively refined for use in most statistical analyses. Although fairly comprehensive, the Minimum Data Set does not provide direct measures of all clinical outcomes and variables of interest. Method., Perineal dermatitis is not directly measured in the Minimum Data Set. Additional information from prescribers' (physician and nurse) orders was used to identify cases of perineal dermatitis. The following steps were followed to produce Minimum Data Set records appropriate for analysis: (1) identification of a subset of Minimum Data Set records specific to the research, (2) identification of perineal dermatitis cases from the prescribers' orders, (3) merging of the perineal dermatitis cases with the Minimum Data Set data set, (4) identification of Minimum Data Set items used to operationalize the variables in our model of perineal dermatitis, (5) determination of the appropriate way to aggregate individual Minimum Data Set items into composite measures of the variables, (6) refinement of these composites using item analysis and (7) assessment of the distribution of the composite variables and need for transformations to use in statistical analysis. Results., Cases of perineal dermatitis were successfully identified and composites were created that operationalized a model of perineal dermatitis. Conclusion., Following these steps resulted in a data set where data analysis could be pursued with confidence. Incorporating other sources of data, such as prescribers' orders, extends the usefulness of the Minimum Data Set for research use. [source] Measuring Nursing Power Within OrganizationsJOURNAL OF NURSING SCHOLARSHIP, Issue 2 2003Christina L. Sieloff Purpose: To describe the Sieloff-King Assessment of Departmental Power (SKADP) instrument and the psychometric evaluation of both the SKADP and its revision: the Sieloff-King Assessment of Group Power within Organizations (SKAGPO) instrument. Design: A survey of 357 chief nurse executives in the United States to psychometrically evaluate the SKAGPO. Methods: Psychometric evaluation of the SKAGPO included: (a) internal consistency reliability using Cronbach's alpha coefficient, split-half with the equal-length Spearman Brown Correction Formula, and item analysis; (b) concurrent criterion-related validity; and (c) factor analysis. Findings: Cronbach's alpha coefficient for the SKAGPO was.92. Subscales' alphas ranged from.63 to.88. Item-total correlations ranged from.24 to.68, with an average item-total correlation of.48 (n = 334). Concurrent criterion-related validity was supported. Conclusions: The SKAGPO and the related subscales showed initial reliability and validity. [source] A primer on classical test theory and item response theory for assessments in medical educationMEDICAL EDUCATION, Issue 1 2010André F De Champlain Context, A test score is a number which purportedly reflects a candidate's proficiency in some clearly defined knowledge or skill domain. A test theory model is necessary to help us better understand the relationship that exists between the observed (or actual) score on an examination and the underlying proficiency in the domain, which is generally unobserved. Common test theory models include classical test theory (CTT) and item response theory (IRT). The widespread use of IRT models over the past several decades attests to their importance in the development and analysis of assessments in medical education. Item response theory models are used for a host of purposes, including item analysis, test form assembly and equating. Although helpful in many circumstances, IRT models make fairly strong assumptions and are mathematically much more complex than CTT models. Consequently, there are instances in which it might be more appropriate to use CTT, especially when common assumptions of IRT cannot be readily met, or in more local settings, such as those that may characterise many medical school examinations. Objectives, The objective of this paper is to provide an overview of both CTT and IRT to the practitioner involved in the development and scoring of medical education assessments. Methods, The tenets of CCT and IRT are initially described. Then, main uses of both models in test development and psychometric activities are illustrated via several practical examples. Finally, general recommendations pertaining to the use of each model in practice are outlined. Discussion, Classical test theory and IRT are widely used to address measurement-related issues that arise from commonly used assessments in medical education, including multiple-choice examinations, objective structured clinical examinations, ward ratings and workplace evaluations. The present paper provides an introduction to these models and how they can be applied to answer common assessment questions. Medical Education 2010: 44: 109,117 [source] An acute care skills evaluation for graduating medical students: a pilot study using clinical simulationMEDICAL EDUCATION, Issue 9 2002David Murray Purpose, This investigation aimed to explore the measurement properties of scores from a patient simulator exercise. Methods, Analytic and holistic scores were obtained for groups of medical students and residents. Item analysis techniques were used to explore the nature of specific examinee actions. Interrater reliability was calculated. Scores were contrasted for third year medical students, fourth year medical students and emergency department residents. Results, Interrater reliabilities for analytic and holistic scores were 0·92 and 0·81, respectively. Based on item analysis, proper timing and sequencing of actions discriminated between low- and high-ability examinees. In general, examinees with more advanced training obtained higher scores on the simulation exercise. Conclusion, Reliable and valid measures of clinical performance can be obtained from a trauma simulation provided that care is taken in the development and scoring of the scenario. [source] Sci45: the development of a specialty choice inventoryMEDICAL EDUCATION, Issue 7 2002Rodney Gale Objective, To devise a valid career selection instrument to help doctors in training choose from a range of specialties that match their attributes and aspirations and to help selection interviewers focus on the key issues pertaining to the suitability of candidates for particular training opportunities. Design, A psychometric instrument of 130 4-response choice items was developed to match individual personal and professional preferences to possible career specialty choices. The development process involved semi-structured interviews with consultants in 35 specialties, a national postal survey of consultants in 45 specialties, factor analysis of the results, design of the pilot instruments, testing on 450 senior house officers (doctors in basic specialist training within 2,5 years of leaving medical school), and further item analysis to derive the final instrument. A scoring system and software were developed to indicate the best and worst fit specialties for the respondent. Participants, The participants were hospital consultants, general practitioners and senior house officers (SHOs) in basic specialist training. Outcome measure, The successful construction of a valid and accessible career choice instrument (Specialty Choice Inventory/Sci45). Conclusions This project has yielded a psychometrically valid computer- or paper-based instrument that can be used by doctors at any stage of training to assist in career choice. It can be used as part of the selection process, for careers guidance, for analysis of career problems, for research or to validate a particular range of career options. [source] The quality of life for cancer children (QOLCC) in Taiwan (part I): Reliability and construct validity by confirmatory factor analysisPSYCHO-ONCOLOGY, Issue 3 2004Chao-Hsing Yeh Part 1, the current paper describes the development and testing of a quality-of-life (QOL) assessment specifically designed for Taiwanese pediatric cancer patients (7,18 years) and their parents/caregivers. The assessment instrument was established based on a qualitative study, then refined using recognized item-analysis methods and pilot tested on a group of 25 patients. The final assessment instrument included three versions of the same instrument, a patient self-report (QOLCC-7,12, for children aged 7,12 years; QOLCC-ADO for adolescent aged 13,18 years) and a parent proxy-report (QOLCC-PAR). The final seven-subscale tool has a total of 34 items and was tested among 106 young cancer patients and 106 their parents. Psychometric properties of the measure were tested using item analysis, Cronbach's alpha, and a confirmatory factor analysis. Results suggest acceptable reliability and goodness of fit of this seven-scale measure. In order to test the factor validity of QOLCC, an independent group of 42 children with cancer participated. The results of confirmatory factor analysis shows the goodness of fit in QOLCC. Copyright © 2003 John Wiley & Sons, Ltd. [source] | |||||||||||||