Measurement Equivalence (measurement + equivalence)

Distribution by Scientific Domains


Selected Abstracts


AN EMPIRICAL ANALYSIS OF MEASUREMENT EQUIVALENCE WITH THE INDCOL MEASURE OF INDIVIDUALISM AND COLLECTIVISM: IMPLICATIONS FOR VALID CROSS-CULTURAL INFERENCE

PERSONNEL PSYCHOLOGY, Issue 1 2006
CHRISTOPHER ROBERT
The INDCOL measure of individualism and collectivism (Singelis et al., 1995) has been used increasingly to test complex cross-cultural hypotheses. However, sample differences in translation, culture, organization, and response context might threaten the validity of cross-cultural inferences. We systematically explored the robustness of the INDCOL, for various statistical uses, in the face of those 4 threats. An analysis of measurement equivalence using multigroup mean and covariance structure analysis compared samples of INDCOL data from the United States, Singapore, and Korea. The INDCOL was robust with regard to the interpretability of correlations, whereas differences in culture and translation pose an important potential threat to the interpretability of mean-level analyses. Recommendations regarding the interpretation of the INDCOL and issues in the analysis of measurement equivalence in cross-cultural research are discussed. [source]


Measurement Equivalence of 360°-Assessment Data: Are different raters rating the same constructs?

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 3 2007
Kelly M. Hannum
This study uses data collected using a 360°-assessment instrument to investigate the structural equivalence of 360°-assessment ratings, according to rater type, controlling for organizational level. Data from 533 managers and their raters were employed in the study, which used multi-group structural equations modeling. Issues central to the implementation and use of 360°-assessment data are also considered within the context of current research and practice. [source]


Measurement Equivalence of Paper-and-Pencil and Internet Organisational Surveys: A Large Scale Examination in 16 Countries

APPLIED PSYCHOLOGY, Issue 2 2009
Alain De Beuckelaer
In multinational surveys, mixed-mode administration modes (e.g. combining Internet and paper-and-pencil administration) are increasingly used. To date, no studies have investigated whether measurement equivalence exists between Internet data collection and data collection using the conventional paper-and-pencil method in organisational surveys which include a large number of countries. This paper examined the measurement equivalence of a truly global organisational survey across Internet and paper-and-pencil survey administrations. Data from an organisational survey in 16 countries (N = 52,461) across the globe were used to assess the measurement equivalence of an organisational climate measure within each country in which the survey was administered. The empirical data provided strong indications which support the measurement equivalence of the multi-item survey instrument across Internet and paper-and-pencil surveys in virtually all countries in which the survey was conducted. These findings suggest that merging data obtained through Internet and paper-and-pencil data administration in a particular country is legitimate as no evidence was found for differential effects across both modes of data collection. Dans les enquêtes internationales, les modalités d'administration mixtes, c'est-à-dire combinant les solution Internet et papier-crayon, sont de plus en plus utilisées. Jusqu'à présent, on ignore si le recueil de données par Internet est méthodologiquement équivalent au recueil traditionnel sur papier dans les enquêtes organisationnelles qui couvrent un grand nombre de pays. Dans cet article, on analyse l'analogie des mesures d'une enquête organisationnelle véritablement universelle utilisant à la fois une administration Internet et papier-crayon. Des données provenant de seize pays (N = 52,461) répartis sur l'ensemble de la planète ont été exploitées pour évaluer l'équivalence méthodologique d'une mesure du climat organisationnel dans chacun de ces pays. Les résultats empiriques sont en faveur de l'équivalence méthodologique de l'ensemble des items pour les recueils Internet et papier-crayon dans pratiquement tous les pays retenus pour l'enquête. Ces résultats montrent qu'il est légitime de traiter ensemble les données obtenues par Internet et par papier-crayon dans un même pays puisque rien ne nous permet d'affirmer l'existence d'un effet différentiel dû aux deux modes d'administration. [source]


Measurement Equivalence Using Generalizability Theory: An Examination of Manufacturing Flexibility Dimensions

DECISION SCIENCES, Issue 4 2008
Manoj K. Malhotra
ABSTRACT As the field of decision sciences in general and operations management in particular has matured from theory building to theory testing over the past two decades, it has witnessed an explosion in empirical research. Much of this work is anchored in survey-based methodologies in which data are collected from the field in the form of scale items that are then analyzed to measure latent unobservable constructs. It is important to assess the invariance of scales across groups in order to reach valid, scientifically sound conclusions. Because studies have often been conducted in the field of decision sciences with small sample sizes, it further exacerbates the problem of reaching incorrect conclusions. Generalizability theory can more effectively test for measurement equivalence in the presence of small sample sizes than the confirmatory factor analysis (CFA) tests that have been conventionally used for assessing measurement equivalency across groups. Consequently, we introduce and explain the generalizability theory (G-theory) in this article to examine measurement equivalence of 24 manufacturing flexibility dimension scales that have been published in prior literature and also compare and contrast G-theory with CFA. We show that all the manufacturing flexibility scales tested in this study were invariant across the three industry SIC groups from which data were collected. We strongly recommend that G-theory should always be used for determining measurement equivalence in empirical survey-based studies. In addition, because using G-theory alone does not always reveal the complete picture, CFA techniques for establishing measurement equivalence should also be invoked when sample sizes are large enough to do so. Implications of G-theory for practice and its future use in operations management and decision sciences research are also presented. [source]


Mindfulness in Thailand and the United States: a case of apples versus oranges?

JOURNAL OF CLINICAL PSYCHOLOGY, Issue 6 2009
Michael S. Christopher
Abstract The study and practice of mindfulness is rapidly expanding in Western psychology. Recently developed self-report measures of mindfulness were derived from Western operationalizations and cross-cultural validation of many of these measures is lacking, particularly in Buddhist cultures. Therefore, this study examined the measurement equivalence of the Kentucky Inventory of Mindfulness Skills (KIMS) and Mindful Attention Awareness Scale (MAAS) among Thai (n=385) and American (n=365) college students. Multigroup confirmatory factor analysis models fit to the data revealed that the KIMS lacked configural invariance across groups, which precluded subsequent invariance tests, and although the MAAS demonstrated configural, metric, and partial scalar invariance, there was no significant latent mean MAAS difference between Thais and Americans. These findings suggest that Eastern and Western conceptualizations of mindfulness may have important differences. © 2009 Wiley Periodicals, Inc. J Clin Psychol 65: 1,23, 2009. [source]


Organizational identity strength, identification, and commitment and their relationships to turnover intention: does organizational hierarchy matter?

JOURNAL OF ORGANIZATIONAL BEHAVIOR, Issue 5 2006
Michael S. Cole
In the present study we sought to clarify the functional distinctions between organization identity strength, organizational identification, and organizational commitment. Data were obtained from 10,948 employees of a large steel manufacturer. First, confirmatory factor analysis was used to test the discriminant validity of the three focal constructs. Next, drawing on research that suggests hierarchical differentiation may influence individuals' conceptual frame of reference, we examined each focal construct's measurement equivalence across three hierarchical levels (officers, n,=,1,056, middle-management, n,=,1049, workers, n,=,1050). Finally, multigroup structural equation modeling was used to simultaneously estimate the between-group correlations between turnover intention and organization identity strength, organizational identification, and organizational commitment. Results indicated that (a) the measures used to reflect the three focal constructs were empirically distinct, (b) the focal constructs were conceptually equivalent across hierarchical levels, and (c) the pattern of correlations with turnover intention was different for employees with management responsibilities versus workers with no management responsibility. The present findings suggest perceptions of a strong organizational identity, organizational identification, and organizational commitment may influence employees' turnover intention in unique ways, depending on their hierarchical level within the organization. Copyright © 2006 John Wiley & Sons, Ltd. [source]


AN EMPIRICAL ANALYSIS OF MEASUREMENT EQUIVALENCE WITH THE INDCOL MEASURE OF INDIVIDUALISM AND COLLECTIVISM: IMPLICATIONS FOR VALID CROSS-CULTURAL INFERENCE

PERSONNEL PSYCHOLOGY, Issue 1 2006
CHRISTOPHER ROBERT
The INDCOL measure of individualism and collectivism (Singelis et al., 1995) has been used increasingly to test complex cross-cultural hypotheses. However, sample differences in translation, culture, organization, and response context might threaten the validity of cross-cultural inferences. We systematically explored the robustness of the INDCOL, for various statistical uses, in the face of those 4 threats. An analysis of measurement equivalence using multigroup mean and covariance structure analysis compared samples of INDCOL data from the United States, Singapore, and Korea. The INDCOL was robust with regard to the interpretability of correlations, whereas differences in culture and translation pose an important potential threat to the interpretability of mean-level analyses. Recommendations regarding the interpretation of the INDCOL and issues in the analysis of measurement equivalence in cross-cultural research are discussed. [source]


Development and Validation of the Child Psychosocial Distress Screener in Burundi

AMERICAN JOURNAL OF ORTHOPSYCHIATRY, Issue 3 2008
Mark J. D. Jordans MA
In non-Western countries, efficient and contextually valid methods of community screening are scarce. The present study describes the validation of a new, brief, 7-item multi-informant screener for conflict-affected children (Child Psychosocial Distress Screener; CPDS). To determine concurrent validity, the CPSD was administered to 65 children and their teachers. CPDS scores were compared with indication for psychosocial treatment based on an in-depth clinical assessment by a psychiatrist and psychologist. Construct validity was assessed by testing the measurement equivalence of the CPDS in a community sample (N = 2,240) in Burundi. The CPDS identifies indication for treatment with an accurateness of .81(sensitivity of .84; specificity of .60). Test-retest reliability of the instrument is good (.83). A robust and invariant factor structure provides evidence for the construct validity of the CPSD. The CPDS appears to be a useful multidimensional tool that measures nonspecific child psychosocial distress, detecting children with an indication for treatment. Because of brevity and the ability to be administered by nonspecialists, the CPDS can be an appropriate instrument to screen large populations of conflict-affected children. [source]


Measurement Equivalence of Paper-and-Pencil and Internet Organisational Surveys: A Large Scale Examination in 16 Countries

APPLIED PSYCHOLOGY, Issue 2 2009
Alain De Beuckelaer
In multinational surveys, mixed-mode administration modes (e.g. combining Internet and paper-and-pencil administration) are increasingly used. To date, no studies have investigated whether measurement equivalence exists between Internet data collection and data collection using the conventional paper-and-pencil method in organisational surveys which include a large number of countries. This paper examined the measurement equivalence of a truly global organisational survey across Internet and paper-and-pencil survey administrations. Data from an organisational survey in 16 countries (N = 52,461) across the globe were used to assess the measurement equivalence of an organisational climate measure within each country in which the survey was administered. The empirical data provided strong indications which support the measurement equivalence of the multi-item survey instrument across Internet and paper-and-pencil surveys in virtually all countries in which the survey was conducted. These findings suggest that merging data obtained through Internet and paper-and-pencil data administration in a particular country is legitimate as no evidence was found for differential effects across both modes of data collection. Dans les enquêtes internationales, les modalités d'administration mixtes, c'est-à-dire combinant les solution Internet et papier-crayon, sont de plus en plus utilisées. Jusqu'à présent, on ignore si le recueil de données par Internet est méthodologiquement équivalent au recueil traditionnel sur papier dans les enquêtes organisationnelles qui couvrent un grand nombre de pays. Dans cet article, on analyse l'analogie des mesures d'une enquête organisationnelle véritablement universelle utilisant à la fois une administration Internet et papier-crayon. Des données provenant de seize pays (N = 52,461) répartis sur l'ensemble de la planète ont été exploitées pour évaluer l'équivalence méthodologique d'une mesure du climat organisationnel dans chacun de ces pays. Les résultats empiriques sont en faveur de l'équivalence méthodologique de l'ensemble des items pour les recueils Internet et papier-crayon dans pratiquement tous les pays retenus pour l'enquête. Ces résultats montrent qu'il est légitime de traiter ensemble les données obtenues par Internet et par papier-crayon dans un même pays puisque rien ne nous permet d'affirmer l'existence d'un effet différentiel dû aux deux modes d'administration. [source]