Observer Ratings (observer + rating)

Distribution by Scientific Domains


Selected Abstracts


The Convergent Validity between Self and Observer Ratings of Personality: A meta-analytic review

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1 2007
James J. Connolly
The convergent validity between self and observer ratings of the Big Five dimensions of personality was examined by cumulating research findings across studies. The mean correlation corrected for coefficient , in self-ratings and inter-rater reliability in observer ratings was .46 for agreeableness (N=6359, k=53), .56 for conscientiousness (N=6754, k=58), .51 for emotional stability (N=8000, k=55), .62 for extraversion (N=7725, k=50), and .59 for openness to experience (N=5333, k=38). Results indicate that, although there is a high degree of construct overlap, both self and observer ratings have substantial unique variance. Moderator effects were analyzed. The duration of acquaintance (strangers vs close relatives) as well as observer type (peers at work vs relatives) were analyzed. Acquaintanceship had a large moderating effect whereas observer type did not moderate the level of convergence. [source]


The Impact of Contextual Self-Ratings and Observer Ratings of Personality on the Personality,Performance Relationship,

JOURNAL OF APPLIED SOCIAL PSYCHOLOGY, Issue 2 2006
Erika Engel Small
This study examined 2 possible ways of increasing the predictive validity of personality measures: using observer (i.e., supervisor and coworker) ratings and work-specific self-ratings of Big Five personality factors. Results indicated that among general self-ratings of Big Five personality dimensions, Conscientiousness was the best predictor of in-role performance, and Agreeableness and Emotional Stability were the best predictors of organizational citizenship behavior (OCB). Observer ratings of personality accounted for incremental variance in job performance (in-role performance and OCB) beyond that accounted for by general self-ratings. However, contrary to our expectations, work-specific (i.e., contextual) self-ratings of personality generally did not account for incremental variance in job performance beyond that accounted for by general self-ratings. [source]


Self-reports, peer ratings and construct validity

EUROPEAN JOURNAL OF PERSONALITY, Issue 3 2010
Sampo V. Paunonen
Abstract Self-reports of behaviour have been criticized as fraught with problems that seriously undermine the construct validity of conventional personality measures. The problems are related to a putative absence of, or distortion of, a person's knowledge about himself or herself. A proposed solution is to use peer reports of personality instead, because such observer ratings are presumably more impartial and free of the distorting influences affecting self-reports. We review some past research on moderators of the agreement between self-reports and peer ratings of personality, arguing that those findings support the validity of self-ratings. We conclude that peer ratings, although highly useful as adjuncts to other methods of assessment, are no substitute for self-reports as a source of personality information. Copyright © 2010 John Wiley & Sons, Ltd. [source]


Social anxiety and anger regulation

EUROPEAN JOURNAL OF PERSONALITY, Issue 7 2004
Hannelore Weber
Based on the assumption that social anxiety is associated with less assertive behaviour and that effective anger regulation is influenced by social anxiety, two studies were conducted to examine the relationship between social anxiety and anger regulation. In Study 1, questionnaires measuring social anxiety, assertiveness, and six habitual anger-related responses were administered to 115 adults. Social anxiety had an independent effect on rumination and submission, whereas assertiveness was independently related to the use of humour and feedback. In Study 2 (N,=,136 adults) self- and observer ratings of anger-related behaviour were obtained after anger was experimentally induced. Social anxiety was related to self-ratings of submission and rumination. However, independent observer ratings based on videotapes revealed no significant influence of social anxiety on anger-related behaviour. Taken together, the results provide evidence that social anxiety is associated with the self-perception of less assertive behaviour and the tendency to evaluate one's behaviour more negatively. These results are consistent with prior studies showing that socially anxious persons tend to underestimate their social performance relative to the ratings of independent observers. Copyright © 2004 John Wiley & Sons, Ltd. [source]


Resolving Disease Management Problems in European-American and Latino Couples with Type 2 Diabetes: The Effects of Ethnicity and Patient Gender,

FAMILY PROCESS, Issue 4 2000
Lawrence Fisher Ph.D.
The management of type 2 diabetes requires major life style changes. How patients and family members resolve disagreements about disease management affects how well the disease is managed over time. Our goal was to identify differences in how couples resolved disagreements about diabetes management based on ethnicity and patient gender. We recruited 65 Latino and 110 European-American (EA) couples in which one spouse had type 2 diabetes. Couples participated in a 10-minute videotaped, revealed differences interaction task that was evaluated with 7 reliable observer ratings: warm-engagement, hostility, avoidance, amount of conflict resolution, off-task behavior, patient dominance, and dialogue. A series of 2 × 2, Ethnicity × Sex ANOVAs indicated significant effects for Ethnicity and for the Ethnicity × Sex interaction, but not for Sex. Latino couples were rated as significantly more emotionally close, less avoidant, less hostile toward each other, and had less dominant patients than EA couples; however, Latino couples achieved significantly less problem resolution and were more frequently off-task than EA couples. These findings were qualified by patient gender. The findings highlight important differences in how couples manage diabetes based on ethnicity and patient gender, and suggest that effective family-based programs of intervention must take both characteristics into account. [source]


What sources contribute to variance in observer ratings?

INFANT AND CHILD DEVELOPMENT, Issue 3 2008
Using generalizability theory to assess construct validity of psychological measures
Abstract Cronbach and Meehl (Psychol. Bull. 1955; 52:281,302) stated that the key question to be addressed when assessing construct validity is ,What sources contribute to variance in test performance?' We illustrate the utility of generalizability theory (GT) as a conceptual framework that encourages psychological researchers to address this question and as a flexible set of analytic tools that can provide answers to inform both substantive theory and measurement practice. To illustrate these capabilities, we analyze observer ratings of 27 caregiver,child dyads, focusing on the importance of situational (contextual) factors as sources of variance in observer ratings of caregiver,child behaviors. Cross-situational consistency was relatively low for the categories of behavior analyzed, indicating that dyads vary greatly in their interactional patterns from one situation to the next, so that it is difficult to predict behavioral frequencies in one context from behaviors observed in a different context. Our findings suggest that single-situation behavioral measures may have limited generalizability, either to behavior in other contexts or as measures of global interaction tendencies. We discuss the implications of these findings for research and measurement design in developmental psychology. Copyright © 2008 John Wiley & Sons, Ltd. [source]


The Convergent Validity between Self and Observer Ratings of Personality: A meta-analytic review

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1 2007
James J. Connolly
The convergent validity between self and observer ratings of the Big Five dimensions of personality was examined by cumulating research findings across studies. The mean correlation corrected for coefficient , in self-ratings and inter-rater reliability in observer ratings was .46 for agreeableness (N=6359, k=53), .56 for conscientiousness (N=6754, k=58), .51 for emotional stability (N=8000, k=55), .62 for extraversion (N=7725, k=50), and .59 for openness to experience (N=5333, k=38). Results indicate that, although there is a high degree of construct overlap, both self and observer ratings have substantial unique variance. Moderator effects were analyzed. The duration of acquaintance (strangers vs close relatives) as well as observer type (peers at work vs relatives) were analyzed. Acquaintanceship had a large moderating effect whereas observer type did not moderate the level of convergence. [source]


Development and validation of brief content scales for the psychological screening inventory-2,

JOURNAL OF CLINICAL PSYCHOLOGY, Issue 7 2010
Richard I. Lanyon
Abstract This article describes the development of 21 brief content (BC) scales to supplement the existing scales of the Psychological Screening Inventory-2 (PSI-2), and three validity studies to support their use for both the PSI-2 and the original PSI. The BC scales comprise groups of four or more items that are statistically homogeneous in content and are replicated across three data sets: PSI and PSI-2 normative data and a PSI-based group of forensic respondents. Concurrent validity was shown in correlations with the following: (a) the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) basic clinical scales, Content scales, PSY-5 scales, and Restructured Clinical (RC) scales; (b) family/friend observer ratings; and (c) therapist ratings in an outpatient substance abuse treatment program. Consistent with the purpose of the PSI/PSI-2, the BC scales are intended to provide additional screening information and not a comprehensive representation of psychopathology. © 2010 Wiley Periodicals, Inc. J Clin Psychol: 66:1,13, 2010. [source]


SCL-90-R profiles in a sample of severely violent psychiatric inpatients

AGGRESSIVE BEHAVIOR, Issue 6 2002
Stål Bjørkly
Abstract A sample of 39 patients who had committed serious violent acts toward others were assessed with the revised Symptom Checklist (SCL-90-R). The SCL-90-R is a self-report symptom inventory for the measurement of psychopathology in psychiatric and medical patients. In addition to the patients' self-report, an observer-rated SCL-90-R was obtained. This was accomplished by letting one pair of nurses complete SCL-90-R ratings for each patient. The first aim of the study was to compare the SCL-90-R self-report scores of the patient sample with the psychiatric inpatient norms [Derogatis LR (1992): Clinical Psychometric Research Inc]. Another purpose of this study was to explore possible trends of discordance between the observer ratings and the self-reports of the study group. Always considering the limitations of the small sample, it was nevertheless also of interest to look for possible sex differences and differences between violent subgroups and between diagnostic groups in the self-reported scores as well as in the observer ratings. The most striking findings of the present study were that the self-reported scores were lower than the inpatient norms for SCL-90-R and that the patients' self-reported levels of distress were significantly lower than those found in the observer ratings. Underreporting of psychopathology as a marker of violence risk is discussed in light of these findings. In this study, women reported higher distress levels than men in the Interpersonal Sensitivity symptom dimension. There were no significant differences concerning SCL-90-R ratings between patients who had committed homicide, attempted homicide, or physically assaulted another person in a serious but not life-threatening way. Aggr. Behav. 28:446,457, 2002. © 2002 Wiley-Liss, Inc. [source]


Children's Insecure Representations of the Interparental Relationship and Their School Adjustment: The Mediating Role of Attention Difficulties

CHILD DEVELOPMENT, Issue 5 2008
Patrick T. Davies
This study examined the role of attention difficulties as a mediator of associations between children's insecure representations of the interparental relationship and their school adjustment in a sample of two hundred and sixteen 6-year-old children. Consistent with hypotheses, findings from structural equation models indicated that observer ratings of children's insecure representations of interparental relationships in a story completion task predicted computerized task assessments and parent reports of children's attention difficulties 1 year later. Children's attention difficulties, in turn, were associated with concurrent levels of school problems and increases in school problems over a 1-year period as indexed by teacher reports. Attention difficulties accounted for an average of 34% of the association between insecure internal representations and school problems. [source]


Parenting and child behaviour problems: a longitudinal analysis of non-shared environment

INFANT AND CHILD DEVELOPMENT, Issue 2 2009
Paula Y. Mullineaux
Abstract This study examined potential non-shared environmental processes in middle childhood by estimating statistical associations between monozygotic (MZ) twin differences in externalizing and internalizing problems and positive social engagement, and differential maternal positivity and negativity, over 1 year. Seventy-seven pairs of identical twins participated (M=6.08-years old, 65% male) in two annual home visits. Observers' ratings and maternal reports were gathered. At both assessments, the twin who showed more conduct problems (maternal report and observers' ratings) and less positive social engagement (positive affect, responsiveness) received more maternal negativity and less maternal warmth (self-reports and observers' ratings), relative to his or her genetically identical co-twin. The same patterns held over time, for the associations between change in differential MZ twin conduct problems and social engagement and change in differential maternal behaviour. Effects for child internalizing problems were not consistent within or across raters. Overall, these results indicated that differential maternal warmth and negativity,self-perceived and observed by others,are important aspects of sibling differentiation for both problematic and adaptive behaviours during middle childhood. Copyright © 2009 John Wiley & Sons, Ltd. [source]


Conduct problems, IQ, and household chaos: a longitudinal multi-informant study

THE JOURNAL OF CHILD PSYCHOLOGY AND PSYCHIATRY AND ALLIED DISCIPLINES, Issue 10 2009
Kirby Deater-Deckard
Background:, We tested the hypothesis that household chaos would be associated with lower child IQ and more child conduct problems concurrently and longitudinally over two years while controlling for housing conditions, parent education/IQ, literacy environment, parental warmth/negativity, and stressful events. Methods:, The sample included 302 families with same-sex twins (58% female) in Kindergarten/1st grade at the first assessment. Parents' and observers' ratings were gathered, with some collected over a two-year period. Results:, Chaos varied widely. There was substantial mother,father agreement and longitudinal stability. Chaos covaried with poorer housing conditions, lower parental education/IQ, poorer home literacy environment, higher stress, higher negativity and lower warmth. Chaos statistically predicted lower IQ and more conduct problems, beyond the effects of other home environment factors. Conclusions:, Even with other home environment factors controlled, higher levels of chaos were linked concurrently with lower child IQ, and concurrently and longitudinally with more child conduct problems. Parent self-reported chaos represents an important aspect of housing and family functioning, with respect to children's cognitive and behavioral functioning. [source]


Parenting and Child Behavioral Adjustment in Early Childhood: A Quantitative Genetic Approach to Studying Family Processes

CHILD DEVELOPMENT, Issue 2 2000
Kirby Deater-Deckard
The aim of this study was to examine environmental and gene , environment processes linking parenting (i.e., affect, control, responsiveness) and preschool children's behavioral adjustment difficulties (e.g., noncompliance, conduct problems) by using bivariate genetic analyses of parents' and observers' ratings. The sample included 120 identical and same-sex fraternal twin pairs (M age = 43 months). Data sources included in-home observations, interviews, and parents' reports. Observers' ratings of children's difficult behaviors included shared and nonshared environmental variance. In contrast, parents' ratings of children's conduct problems showed genetic and nonshared environmental variance. Observer-rated maternal behavior included shared and nonshared environmental variance, although maternal responsiveness also included child genetic variance. Parent self-reported negative and positive affect included shared and nonshared environment as well as child genetic variance. There was no evidence for gene , environment interaction or dominance. Higher levels of difficult behavior and conduct problems covaried with higher levels of maternal negative affect and control and lower levels of maternal positive affect and control. Shared environmental mediation of these correlations was found for observations, whereas genetic and nonshared environmental mediation was found for parents' ratings. In general, estimates of shared environmental variance and mediation were greatest for observational data, and estimates of child genetic variance and mediation were greatest for parent-rated data. The implications of this pattern of findings for genetic research on family processes are discussed. [source]