Heterogeneous machine learning: characterization, generation and comprehension

Zheng, Lecheng

Permalink

https://hdl.handle.net/2142/129820 Copy

Description

Title

Heterogeneous machine learning: characterization, generation and comprehension

Author(s)

Zheng, Lecheng

Issue Date

2025-06-16

Director of Research (if dissertation) or Advisor (if thesis)

He, JIngrui

Doctoral Committee Chair(s)

He, JIngrui

Committee Member(s)

• Sun, Jimeng
• Wang, Yuxiong
• Birge, John

Department of Study

Siebel School Comp & Data Sci

Discipline

Computer Science

Degree Granting Institution

University of Illinois Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Heterogeneous Learning
• Multi-View Learning
• Multi-Label Learning
• Contrastive Learning
• Self-Supervised Learning

Abstract

In the era of big data, the increasing complexity of real-world applications has brought data and model heterogeneity to the forefront of machine learning research. Domains such as sustainability, finance, and agriculture rely on the integration of diverse data sources, including climate time series (e.g., MERRA2, ERA5) and satellite imagery (e.g., Landsat8, SAR), to support tasks ranging from weather forecasting and extreme event analysis to broader climate impact assessments. These tasks highlight the inherent data heterogeneity across modalities and objectives, while simultaneously motivating the need for model heterogeneity to address varying learning paradigms. The recent surge in foundation models, such as large language models, vision transformers, and graph neural networks, has further accentuated the challenge of unifying diverse model architectures, thereby giving rise to a new research paradigm: heterogeneous machine learning (HML). HML aims to improve generalizability, adaptability, and trustworthiness by leveraging the richness of data and model diversity. Despite its promise, heterogeneous machine learning poses significant challenges, including characterizing complex heterogeneity involving multiple modalities (view heterogeneity) and task objectives (label heterogeneity), ensuring trustworthy machine learning that adheres to principles of privacy, fairness, robustness, and interpretability, handling incomplete information, a common issue in large-scale heterogeneous datasets where missing views or partial labels are prevalent and establishing strong theoretical foundations to guide the design, analysis, and interpretation of heterogeneous models. Addressing these challenges requires a systematic and interdisciplinary approach. In this thesis, my research tackles these challenges through three interconnected pillars, i.e., Heterogeneous Machine Learning Characterization, Heterogeneous Machine Learning Generation, and Heterogeneous Machine Learning Comprehension. First, in Heterogeneous Machine Learning Characterization, I focus on understanding and modeling the structure of heterogeneous data by capturing inter-modality correlations and task relatedness. I also integrate principles of trustworthy AI to ensure fairness, interpretability, and robustness throughout the modeling process. Second, in Heterogeneous Machine Learning Generation, I develop generative models to address data incompleteness by learning plausible patterns and restoring missing modalities or labels. These models support applications such as data augmentation, anomaly detection, and secure learning in domains where data quality is often compromised. Finally, in Heterogeneous Machine Learning Comprehension, I aim to bridge the gap between empirical success and theoretical understanding. This includes deriving fairness bounds, leveraging information-theoretic frameworks for contrastive learning, and using graph theory and influence functions to analyze model behavior and detect anomalies.

Graduation Semester

2025-08

Type of Resource

Thesis

Handle URL

https://hdl.handle.net/2142/129820

Copyright and License Information

Copyright 2025 Lecheng Zheng

Owning Collections