Situational Judgment Tests (situational + judgment_test)

Distribution by Scientific Domains


Selected Abstracts


A SITUATIONAL JUDGMENT TEST OF PERSONAL INITIATIVE AND ITS RELATIONSHIP TO PERFORMANCE

PERSONNEL PSYCHOLOGY, Issue 2 2009
RONALD BLEDOW
Although situational judgment tests have been found to be valid predictors of performance, they have rarely been used to measure particular constructs. In this study, we apply the situational judgment test method to the measurement of personal initiative, a construct defined as situated action. We used respondents' situated preferences in mental simulations of work scenarios as formative indicators of their overall level of personal initiative at work. Results from a validation study showed that the situational judgment test of personal initiative (SJT-PI) had adequate validity and complemented a Likert-type self-report measure of personal initiative in predicting behavioral criteria. Situated preferences for personal initiative were hypothesized to be proximal predictors of actual behavior and were accordingly found to mediate the relationship between generalized self-efficacy, felt responsibility, and actual behavior. Furthermore, situated preferences for personal initiative could be differentiated empirically from organizational citizenship behavior. We conclude that situational judgment tests are a promising method for measuring personal initiative and may be a general means of improving the validity of measurement in organizations. [source]


SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META-ANALYSIS

PERSONNEL PSYCHOLOGY, Issue 1 2007
MICHAEL A. McDANIEL
Situational judgment tests (SJTs) are personnel selection instruments that present job applicants with work-related situations and possible responses to the situations. There are typically 2 types of instructions: behavioral tendency and knowledge. Behavioral tendency instructions ask respondents to identify how they would likely behave in a given situation. Knowledge instructions ask respondents to evaluate the effectiveness of possible responses to a given situation. Results showed that response instructions influenced the constructs measured by the tests. Tests with knowledge instructions had higher correlations with cognitive ability. Tests with behavioral tendency instructions showed higher correlations with personality constructs. Results also showed that response instructions had little moderating effect on criterion-related validity. Supplemental analyses showed that the moderating effect of response instructions on construct validity was not due to systematic differences in item content. SJTs have incremental validity over cognitive ability, the Big 5, and over a composite of cognitive ability and the Big 5. [source]


The Criterion-Related Validities and Perceived Fairness of the Situational Interview and the Situational Judgment Test in an Iranian Organisation

APPLIED PSYCHOLOGY, Issue 1 2010
Sara Banki
The criterion-related validity coefficients of a situational interview (SI) and a situational judgment test (SJT) were investigated in a sales department of a government-owned automobile company in Iran. Both the SI and SJT had concurrent validity with job performance (n= 101, r= .28, r= .23, p < .05, respectively). Only the SI, however, had incremental validity over and above the SJT in predicting job performance. Furthermore, the SI fully mediated the relationship between SJT and job performance. The two methods did not differ significantly on employee motivation to perform well, perceived fairness, or test anxiety. Nevertheless, employees recommended the use of the SI over the SJT. Les coefficients de validité critérielle d'un entretien situationnel (SI) et d'un test de jugement situationnel (SJT) ont été calculés dans le service commercial d'une entreprise publique iranienne du secteur automobile. SI et SJT présentent tous les deux une validité concurrente avec la performance professionnelle (pour N = 101, r = .28 et .23 respectivement; sign. à .05). Toutefois, seul le SI bénéficie d'une validité incrémentielle par rapport au SJT dans la prédiction de la performance professionnelle. En outre, le SI contrôle totalement la relation entre le SJT et le critère. Les deux méthodes ne diffèrent pas significativement dans l'évaluation de la motivation au travail, de l'équité perçue ou de l'anxiété. Néanmoins les salariés préféraient le SI au SJT. [source]


Incremental Validity of Situational Judgment Tests for Task and Contextual Job Performance

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1 2007
Matthew S. O'Connell
This paper has three goals. First, it responds to calls for additional research on subgroup differences in situational judgment tests. Second, it expands the cumulative knowledge on the incremental validity of situational judgment tests beyond cognitive ability and personality. Third, it examines the validity and incremental validity of various predictors for both task and contextual performance. [source]


Scoring Situational Judgment Tests: Once You Get the Data, Your Troubles Begin

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 3 2006
Mindy E. Bergman
Although situational judgment tests (SJTs) have been in use for decades, consensus has not been reached on the best way to score these assessments or others (e.g., biodata) whose items do not have a single demonstrably correct answer. The purpose of this paper is to review and to demonstrate the scoring strategies that have been described in the literature. Implementation and relative merits of these strategies are described. Then, several of these methods are applied to create 11 different keys for a video-based SJT in order to demonstrate how to evaluate the quality of keys. Implications of scoring SJTs for theory and practice are discussed. [source]


SITUATIONAL JUDGMENT TESTS, RESPONSE INSTRUCTIONS, AND VALIDITY: A META-ANALYSIS

PERSONNEL PSYCHOLOGY, Issue 1 2007
MICHAEL A. McDANIEL
Situational judgment tests (SJTs) are personnel selection instruments that present job applicants with work-related situations and possible responses to the situations. There are typically 2 types of instructions: behavioral tendency and knowledge. Behavioral tendency instructions ask respondents to identify how they would likely behave in a given situation. Knowledge instructions ask respondents to evaluate the effectiveness of possible responses to a given situation. Results showed that response instructions influenced the constructs measured by the tests. Tests with knowledge instructions had higher correlations with cognitive ability. Tests with behavioral tendency instructions showed higher correlations with personality constructs. Results also showed that response instructions had little moderating effect on criterion-related validity. Supplemental analyses showed that the moderating effect of response instructions on construct validity was not due to systematic differences in item content. SJTs have incremental validity over cognitive ability, the Big 5, and over a composite of cognitive ability and the Big 5. [source]


The Role of Cognitive Ability in Self-Efficacy and Self-Assessed Test Performance,

JOURNAL OF APPLIED SOCIAL PSYCHOLOGY, Issue 4 2008
Donald M. Truxillo
Research has shown that test takers are often unable to assess their own test performance accurately. However, the role of cognitive ability in assessing one's test performance has not been explored. We examined whether high cognitive ability participants were better than low cognitive ability participants in assessing their performance on a video-based situational judgment test (SJT) of customer-service skills. Results indicated a strong relationship between actual and perceived SJT performance for high cognitive ability participants, but no relationship for those low in cognitive ability. The discussion focuses on implications for metacognitive theory, test perceptions, and providing feedback to applicants. [source]


A SITUATIONAL JUDGMENT TEST OF PERSONAL INITIATIVE AND ITS RELATIONSHIP TO PERFORMANCE

PERSONNEL PSYCHOLOGY, Issue 2 2009
RONALD BLEDOW
Although situational judgment tests have been found to be valid predictors of performance, they have rarely been used to measure particular constructs. In this study, we apply the situational judgment test method to the measurement of personal initiative, a construct defined as situated action. We used respondents' situated preferences in mental simulations of work scenarios as formative indicators of their overall level of personal initiative at work. Results from a validation study showed that the situational judgment test of personal initiative (SJT-PI) had adequate validity and complemented a Likert-type self-report measure of personal initiative in predicting behavioral criteria. Situated preferences for personal initiative were hypothesized to be proximal predictors of actual behavior and were accordingly found to mediate the relationship between generalized self-efficacy, felt responsibility, and actual behavior. Furthermore, situated preferences for personal initiative could be differentiated empirically from organizational citizenship behavior. We conclude that situational judgment tests are a promising method for measuring personal initiative and may be a general means of improving the validity of measurement in organizations. [source]


The Criterion-Related Validities and Perceived Fairness of the Situational Interview and the Situational Judgment Test in an Iranian Organisation

APPLIED PSYCHOLOGY, Issue 1 2010
Sara Banki
The criterion-related validity coefficients of a situational interview (SI) and a situational judgment test (SJT) were investigated in a sales department of a government-owned automobile company in Iran. Both the SI and SJT had concurrent validity with job performance (n= 101, r= .28, r= .23, p < .05, respectively). Only the SI, however, had incremental validity over and above the SJT in predicting job performance. Furthermore, the SI fully mediated the relationship between SJT and job performance. The two methods did not differ significantly on employee motivation to perform well, perceived fairness, or test anxiety. Nevertheless, employees recommended the use of the SI over the SJT. Les coefficients de validité critérielle d'un entretien situationnel (SI) et d'un test de jugement situationnel (SJT) ont été calculés dans le service commercial d'une entreprise publique iranienne du secteur automobile. SI et SJT présentent tous les deux une validité concurrente avec la performance professionnelle (pour N = 101, r = .28 et .23 respectivement; sign. à .05). Toutefois, seul le SI bénéficie d'une validité incrémentielle par rapport au SJT dans la prédiction de la performance professionnelle. En outre, le SI contrôle totalement la relation entre le SJT et le critère. Les deux méthodes ne diffèrent pas significativement dans l'évaluation de la motivation au travail, de l'équité perçue ou de l'anxiété. Néanmoins les salariés préféraient le SI au SJT. [source]


Impact of Elaboration on Responding to Situational Judgment Test Items

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 4 2008
Filip Lievens
Although faking has been identified as a potential problem in situational judgment tests (SJTs), no studies have investigated proactive approaches for controlling faking in SJTs. Therefore, this study examined the impact of elaboration on responding to SJT items. Elaboration was operationalized as reason-giving. Two hundred and forty-seven master students were assigned to either an honest or a fake condition, and to a non-elaboration or an elaboration condition. Results showed that elaboration decreased the effect of faking for items with high familiarity. Elaboration on familiar items also decreased the percentage of fakers in the top of the distribution. Next, participants in the elaboration condition rated the SJT significantly higher in terms of allowing them to present themselves more realistically and to demonstrate their knowledge, skills, and abilities. Finally, there were no significant differences in participants' satisfaction with the SJT across the elaboration and non-elaboration condition. [source]


Incremental Validity of Situational Judgment Tests for Task and Contextual Job Performance

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 1 2007
Matthew S. O'Connell
This paper has three goals. First, it responds to calls for additional research on subgroup differences in situational judgment tests. Second, it expands the cumulative knowledge on the incremental validity of situational judgment tests beyond cognitive ability and personality. Third, it examines the validity and incremental validity of various predictors for both task and contextual performance. [source]


Scoring Situational Judgment Tests: Once You Get the Data, Your Troubles Begin

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 3 2006
Mindy E. Bergman
Although situational judgment tests (SJTs) have been in use for decades, consensus has not been reached on the best way to score these assessments or others (e.g., biodata) whose items do not have a single demonstrably correct answer. The purpose of this paper is to review and to demonstrate the scoring strategies that have been described in the literature. Implementation and relative merits of these strategies are described. Then, several of these methods are applied to create 11 different keys for a video-based SJT in order to demonstrate how to evaluate the quality of keys. Implications of scoring SJTs for theory and practice are discussed. [source]


Applicant and Recruiter Reactions to New Technology in Selection: A Critical Review and Agenda for Future Research

INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, Issue 2-3 2003
Neil AndersonArticle first published online: 30 JUL 200
This paper presents a narrative review of recent research into applicant and recruiter reactions to new technology in employee selection. Different aspects of the use of new technology are noted including computer-based testing, Internet-based recruitment and candidate assessment, telephone-based and video-based interviews, video-based situational judgment tests, and virtual reality scenarios. It is argued that an appropriate way to conceptualize these advances is as ,technical innovations' as defined in the creativity and innovation research in Industrial, Work, and Organizational (IWO) psychology. Applicant reactions research is reviewed thematically, and studies into three main themes are discussed: Applicant preferences and reactions, equivalence, and adverse impact. Following Bartram (2001), an amphibian-monarchistic analogy is employed at several stages in the review. Four major criticisms of the extant applicant reactions research base are noted: its atheoretical orientation, a short-termist concentration upon reactions level outcomes, an over-reliance on students as surrogates, and a patchiness of coverage of crucial research questions. The second part of this paper explores neglected issues of recruiter adoption of new technology for employee selection. Again drawing from advances in the innovation and creativity literatures, this section explores likely antecedent factors at the individual and organizational levels of analysis. A general model of recruiter adoption of new technology is posited as a framework for future research in this area. For both applicant and recruiter reactions further research is called for and implications for practice are noted throughout. [source]


A SITUATIONAL JUDGMENT TEST OF PERSONAL INITIATIVE AND ITS RELATIONSHIP TO PERFORMANCE

PERSONNEL PSYCHOLOGY, Issue 2 2009
RONALD BLEDOW
Although situational judgment tests have been found to be valid predictors of performance, they have rarely been used to measure particular constructs. In this study, we apply the situational judgment test method to the measurement of personal initiative, a construct defined as situated action. We used respondents' situated preferences in mental simulations of work scenarios as formative indicators of their overall level of personal initiative at work. Results from a validation study showed that the situational judgment test of personal initiative (SJT-PI) had adequate validity and complemented a Likert-type self-report measure of personal initiative in predicting behavioral criteria. Situated preferences for personal initiative were hypothesized to be proximal predictors of actual behavior and were accordingly found to mediate the relationship between generalized self-efficacy, felt responsibility, and actual behavior. Furthermore, situated preferences for personal initiative could be differentiated empirically from organizational citizenship behavior. We conclude that situational judgment tests are a promising method for measuring personal initiative and may be a general means of improving the validity of measurement in organizations. [source]