Artificial intelligence powered personality assessment: A multidimensional psychometric natural language processing perspective

Sun, Tianjun

Permalink

https://hdl.handle.net/2142/113136 Copy

Description

Title

Artificial intelligence powered personality assessment: A multidimensional psychometric natural language processing perspective

Author(s)

Sun, Tianjun

Issue Date

2021-07-06

Director of Research (if dissertation) or Advisor (if thesis)

Drasgow, Fritz

Doctoral Committee Chair(s)

Drasgow, Fritz

Committee Member(s)

• Roberts, Brent W
• Rounds, James
• Guenole, Nigel
• Jiang, Ge

Department of Study

Psychology

Discipline

Psychology

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• personality
• psychometrics
• machine learning
• natural language processing
• artificial intelligence

Abstract

Recent technological advances have allowed researchers to apply automated, language-based machine learning models as alternatives to self-reports for assessing personality. However, previous work has largely overlooked the multidimensional nature of personality and lacked in-depth exploration of validity issues. In this dissertation, I examined novel methods for leveraging artificial intelligence (AI), natural language processing (NLP), machine learning, and automation to systematically glean personality-related information from textual data which offers rich information and reflects various aspects of personality but has been severely underutilized. In two studies, I connected the five-factor (or Big Five) model (comprised of openness to new experiences, conscientiousness, extraversion, agreeableness, and neuroticism) with NLP from two angles: 1) a construct validity perspective (i.e., the degree to which information extracted from textual data reflects personality constructs), and 2) an applicability perspective (i.e., the ability to elicit personality-relevant information from text in line with psychological and organizational principles). In Study 1, I meta-analytically reviewed the multidimensional psychometric evidence of AI-supported language-based personality assessment. Results showed that measurement reliability is often not addressed in past AI personality assessment research, and that construct validity evidence is lacking. In Study 2, I built an interactive tool to automatically and adaptively prompt for, collect, and analyze personality-relevant topic-based (i.e., honoring the Big Five factorial structure) narrative data through conversations conducted by an AI chatbot. Results showed some improvements in various validities of the new personality assessment tool. Potential reasons for the improvement magnitudes, limitations of the current methods, and future directions are discussed.

Graduation Semester

2021-08

Type of Resource

Thesis

Permalink

http://hdl.handle.net/2142/113136

Copyright and License Information

Copyright 2021 Tianjun Sun

Owning Collections