2026-09-20T04:28:59Z https://www.ideals.illinois.edu/oai-pmh

oai:www.ideals.illinois.edu:2142/108566 2023-07-11 col_2142_5131 col_2142_8888 com_2142_5130 com_2142_8887 com_2142_234

Hwu, Wen-Mei Tang, Jingning 2020-10-07T22:07:11Z 2020-10-07T22:07:11Z 2022-10-07T22:44:53Z 2020-06-23 2020-08 As deep learning has been adopted in various domains, the inference process is of growing importance to ensure the deployment across multiple computing platforms. Within many deep learning frameworks that support freezing and deploying the well-trained models, NVIDIA TensorRT is the leading framework that is exclusively developed for inference. It allows the developer to optimize the model to facilitate high-performance inference. While it has been shown extensively that TensorRT can significantly boost the inference capability, quantitative study is lacking on how assorted optimization strategies can improve the inference compared to other well-known deep learning frameworks such as TensorFlow. This thesis presents such a study that consists of experiments using TensorRT on MLModelScope, a deep learning inference platform that enables standardized inference and multi-level profiling. Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2022-08-01 The student, Jingning Tang, accepted the attached license on 2020-06-19 at 08:35. The student, Jingning Tang, submitted this Thesis for approval on 2020-06-19 at 08:39. This Thesis was approved for publication on 2020-06-23 at 09:21. DSpace SAF Submission Ingestion Package generated from Vireo submission #15457 on 2020-10-02 at 15:30:51 Made available in DSpace on 2020-10-07T22:07:11Z (GMT). No. of bitstreams: 2 TANG-THESIS-2020.pdf: 3133439 bytes, checksum: 4ce2b3e664954ad25e368f41801ba44d (MD5) LICENSE.txt: 4210 bytes, checksum: ee5b3085186c0a68f730b2ad2108ec06 (MD5) Previous issue date: 2020-06-23 Embargo set by: Seth Robbins for item 116192 Lift date: 2022-10-07T22:07:19Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system Embargo set by: Seth Robbins for item 116192 Lift date: 2022-10-07T22:44:53Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system U of I Only application/pdf http://hdl.handle.net/2142/108566 en Copyright 2020 Jingning Tang deep learning inference TensorRT MLModelScope TensorRT inference performance study in MLModelScope text Thesis Electrical & Computer Eng Electrical & Computer Engr University of Illinois at Urbana-Champaign Thesis M.S.