Apple vision pro for intraoperative 3D tumor visualization and surgical guidance
Zhang, Zekai
This item is only available for download by members of the University of Illinois community. Students, faculty, and staff at the U of I may log in with your NetID and password to view the item. If you are trying to access an Illinois-restricted dissertation or thesis, you can request a copy through your library's Inter-Library Loan office or purchase a copy directly from ProQuest.
Permalink
https://hdl.handle.net/2142/132714
Description
Title
Apple vision pro for intraoperative 3D tumor visualization and surgical guidance
Author(s)
Zhang, Zekai
Issue Date
2025-12-12
Director of Research (if dissertation) or Advisor (if thesis)
Gruev, Viktor
Department of Study
Electrical & Computer Eng
Discipline
Electrical & Computer Engr
Degree Granting Institution
University of Illinois Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
Apple Vision Pro, Tumor Imaging
Abstract
This thesis investigates the feasibility of using the Apple Vision Pro (AVP) mixed-reality headset for visualizing and localizing brain tumors during neurosurgical procedures. A complete workflow was developed to overlay a CT-derived 3D tumor model onto a patient-specific head surface mesh obtained using LiDAR scanning and machine-learning–based object tracking. A 3D-printed head phantom with an embedded tumor target enabled quantitative evaluation of reconstruction fidelity and spatial anchoring accuracy. Results show that AVP can generate a consistent surface mesh of the head and maintain stable alignment of the tumor overlay under typical motion, with deviations increasing primarily in high-curvature anatomical regions or during sudden movements. Although not yet a replacement for conventional stereotactic navigation, the system demonstrates clinically promising accuracy for superficial tumor visualization and preoperative planning. These findings highlight the potential of mixed reality as an intuitive, hands-free tool for neurosurgical guidance and outline key areas for future improvement, including automated registration and enhanced tracking robustness.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
