University of Illinois Urbana-Champaign

The influence of lexical features on human rater's judgement of essay performance on local English Placement Test

Zeng, Mengjia

Content Files
ZENG-THESIS-2021.pdf

Permalink

https://hdl.handle.net/2142/110697

Description

Title
The influence of lexical features on human rater's judgement of essay performance on local English Placement Test
Author(s)
Zeng, Mengjia
Issue Date
2021-04-22
Director of Research (if dissertation) or Advisor (if thesis)
Yan, Xun
Committee Member(s)
Pierce, Lisa
Department of Study
Linguistics
Discipline
Teaching of English Sec Lang
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.A.
Degree Level
Thesis
Date of Ingest
2021-09-17T02:34:37Z
Keyword(s)
  • English Placement Test
  • Lexical Diversity
  • Lexical Sophistication
  • Writing Assessment
Abstract
This study explored to what extent the prompts may affect lexical features and whether lexical features could distinguish essays that were rated as different proficiency levels in the integrated reading-writing tasks. At the University of Illinois at Urbana-Champaign, 262 essays from the English Placement Test (EPT) were collected and holistically scored based on the EPT holistic profile-based rating scales into five profiles across three proficiency levels. Lexical features related to lexical sophistication and lexical diversity were investigated in relation to the profiles and proficiency levels. Lexical sophistication with commonly used words and academic words was measured through a computer program, called RANGE, that could produce the Lexical Frequency Profile (LFP) (Laufer & Nation, 1995). Lexical diversity was measured through five indices, TTR, Maas’s a2 (Mass, 1972), vocd-D (Malvern & Richards, 1997), HD-D (McCarthy & Jarvis, 2007) and MTLD (McCarthy & Jarvis, 2010). The results of this study showed that the prompts affect lexical features significantly, probably because of writers’ familiarity with different topics. Lexical sophistication related to commonly used words and academic words could both be used to significantly distinguish essays across proficiency levels and between profiles. High proficient writers were found to use more infrequent words and more academic words. As for indices measuring lexical diversity, this study indicated that none showed significant differences across proficiency levels or between two profiles. These results indicated that indices related to lexical sophistication may be a good indicator of lexico-grammar features as reflected in the EPT rating scales, while lexical diversity may not be a potential indicator.
Graduation Semester
2021-05
Type of Resource
Thesis
Permalink
http://hdl.handle.net/2142/110697
Copyright and License Information
Copyright 2021 Mengjia Zeng

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Linguistics