2026-09-23T08:58:08Z https://www.ideals.illinois.edu/oai-pmh

oai:www.ideals.illinois.edu:2142/120545 2023-09-07 col_2142_5131 col_2142_14830 com_2142_5130 com_2142_14829 com_2142_8903

Krasa, Stefan Krasa, Stefan Bernhardt, Mark D Winters, Matthew S Garlick, Alex 2023-05 application/pdf en text Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2025-05-01 The student, Ethan Dee, accepted the attached license on 2023-04-23 at 22:48. The student, Ethan Dee, submitted this Dissertation for approval on 2023-04-24 at 09:09. This Dissertation was approved for publication on 2023-04-25 at 11:48. DSpace SAF Submission Ingestion Package generated from Vireo submission #19114 on 2023-09-01 at 17:21:27 Learning from the experts: Measuring the policy content of legislation using machine learning Dee, Ethan Adam 2023-04-25 Machine Learning Natural Language Processing Text Classification Supervised Learning Text As Data Legislation Issue Attention Policy Agenda Transformer Word Embedding Congress Legislature Legislation entails a significant portion of legislative activity, both in volume and in impact, but the high-dimensional information contained within textual data does not lend itself to quantitative analysis. Knowing that a legislator has, for example, been the sponsor of 100 "Education" bills requires knowing how to find "Education" bills in the first place. Deciding what does and does not count as an "Education" bill is the peril of the chorus of researchers who have long pursued ways to measure the policy content of legislation in a tractable way. I present two approaches to classifying legislation into policy areas, offering both generalizable methodological insights for social scientists, as well as two new datasets which classify the universe of state and U.S. Congressional legislation from 2009-2023 into broad, comprehensive policy areas. The first approach presumes a starting point where the researcher has not coded any bills by hand. I begin by refining the "dictionary method," presented in Garlick (2022), using a set of keywords chosen to represent topics, and train a supervised machine learning model to understand the context that often surrounds these keywords, to form predictions for the topics it should assign to each bill. This allows the model to generate predictions for bills which do not contain keywords and form a richer depiction of topics than simplistic keyword-to-topic assignment rules allow. The second approach involves training a supervised machine learning model to emulate the decision function that generated extant hand-coded data. I use the Congressional Bills Project (Adler and Wilkerson 2015) and Pennsylvania Policy Database Project (McLaughlin et al. 2010) hand-coded data to train the model, offering methodological insights regarding how to handle "noise" in hand-coder data (such as two hand-coders coding the same bill differently), and present several ways to validate the model's output and generate out-of-sample predictions. Further, I demonstrate how the downstream researcher can use a supervised machine learning model as a companion to their hand-coders, as it offers a unique and compelling perspective on their corpus which can improve the quality of the hand-coded data. Thesis eng https://hdl.handle.net/2142/120545 Copyright 2023 Ethan Dee Ph.D. Dissertation Economics University of Illinois at Urbana-Champaign Economics