2026-09-18T19:15:03Z https://www.ideals.illinois.edu/oai-pmh

oai:www.ideals.illinois.edu:2142/115955 2023-07-11 col_2142_5131 col_2142_8951 com_2142_5130 com_2142_8950 com_2142_150

Kilicoglu, Halil 2022-08 application/pdf en text Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-08-01 The student, Brian Rao, accepted the attached license on 2022-07-20 at 11:54. The student, Brian Rao, submitted this Thesis for approval on 2022-07-20 at 13:17. This Thesis was approved for publication on 2022-07-21 at 08:51. DSpace SAF Submission Ingestion Package generated from Vireo submission #18392 on 2022-11-16 at 10:56:38 Microbial named entity recognition using BERT models Rao, Brian K 2022-07-21 Bioinformatics Bacteria are critical subjects of microbiological research that span many rapidly-growing fields of study. The development and widespread application of high-throughput sequencing has led to more microbial data being collected in recent years than ever before. This study investigates the capabilities of the popular Natural Language Processing (NLP) model Bidirectional Encoder Representations from Transformers (BERT) on the relatively understudied text mining domain of microbiology. This is done by fine-tuning a variety of BERT models (BERT, DistilBERT, SciBERT, BioBERT, PubMedBERT) on the Bacteria Biotope 2019 Open Shared Task (BB2019-OST) corpus of annotated microbial research text and evaluating the best performing models on the Named Entity Recognition (NER) task. Following this, an in-depth error analysis was conducted to gain insights into BERT’s entity recognition capabilities. Finally, to investigate performance capabilities further, learning rate and batch size hyperparameters were tuned to increase F1-score. The best BERT model in the comparison was BioBERT, earning an F1-score of 73.82 (±1.04) with default hyperparameters, and 75.35 (±0.62) with tuned hyperparameters. BioBERT had better F1-scores and entity-level statistics, despite PubMedBERT ranking high in biomedical NLP benchmarks. This suggests that the generality of the pretraining corpora of BERT models is particularly important for text mining in the microbial domain. Thesis eng https://hdl.handle.net/2142/115955 Copyright 2022 Brian Rao M.S. Thesis Bioinformatics University of Illinois at Urbana-Champaign Information Sciences