University of Illinois Urbana-Champaign

Choice modeling and recommendation optimization in presence of context effects

Yousefi Maragheh, Reza

Content Files
YOUSEFIMARAGHEH-DISSERTATION-2021.pdf

Permalink

https://hdl.handle.net/2142/113184

Description

Title
Choice modeling and recommendation optimization in presence of context effects
Author(s)
Yousefi Maragheh, Reza
Issue Date
2021-07-13
Director of Research (if dissertation) or Advisor (if thesis)
Chen, Xin
Doctoral Committee Chair(s)
Chen, Xin
Committee Member(s)
  • Seshdari, Sridhar
  • Etesami, Rasoul
  • Zhou, Yuan
  • Achan, Kannan
  • Cho, Jason
Department of Study
Industrial&Enterprise Sys Eng
Discipline
Industrial Engineering
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Date of Ingest
2022-01-12T22:35:13Z
Keyword(s)
  • context effects
  • recommender systems
  • assortment optimization
  • choice modeling
  • online retailing
Abstract
Random Utility choice models are supervised learning tools that can be used to estimate the choice behavior of customers facing multiple options. This is accomplished through assigning a utility value to each option and deriving a choice probability for each option. In the presence of context effects, the utility perceived from individual options is not fixed and depends on other options that are offered beside them. While context effects are well explored in the marketing and psychology literature, very little work has been done on incorporating these effects in revenue management systems and product recommendation modules. In this thesis, we propose three sets of machine learning models in order to capture these effects in different settings with different input data structures. For these settings, we also study combinatorial problems concerned with finding the optimal set of products to offer to the customer including (i) assortment optimization problem or reward maximization problem, (ii) click through rate optimization problem, and (iii) customer surplus optimization problem. The first model we propose is a random utility discrete choice model which captures context effects in sparse choice/click data sets and under single-choice outcome assumption. In the proposed model, the perceived utilities from products are dependent on the whole choice set recommended to the customer, and choice probabilities have Multinomial Logistic Regression-type structure. We show the prediction power of this model by testing it on a relevant real data set and prove the NP-hardness of the assortment optimization problem under the proposed model. Several polynomially solvable special cases of the model are identified that also perform well in our empirical validation for our data set. We obtain some easily verifiable conditions for the monotonicity and submodularity of the assortment optimization objective in order to provide some approximation guarantees. Second, we propose a utility based listwise logistic regression model, which is applicable in estimating the context effects in dense data sets with a multi-choice outcome assumption. We show the predictive and descriptive power of this model through an extensive empirical study on real click data sets chosen from diverse categories of products. We prove the NP-hardness of the Assortment Optimization Problem (AOP) under the general CL model, and show that when some specific types of contextual interactions are dominant in the data, the AOP is tractable. Third, we propose a featurized choice model, in order to capture context effects when the input data is featurized. We study the top-$K$ retrieval problem which focuses on finding $K$ relevant products/documents for a given query. We train a featurized estimator that can measure the context effects among the objects through mapping their features to contextual interaction terms by using an underlying neural net structure. We empirically validate the estimator on a real data set and prove the NP-hardness of the top-$K$ retrieval problem for the proposed model. For all three sets of models, to circumvent NP-hardness, we design heuristic algorithms and test their efficiency through extensive numerical studies. Different models proposed in this thesis and the relevant empirical studies, as well as the recommendation optimization results, shed more light on the contextual behavioral patterns observed in customers' choice behavior in e-commerce platforms, and how to further optimize the recommender systems by considering these patterns. To the best of our knowledge, this thesis is the first systematic study and its findings can help in designing operational recommender systems that capture complex contextual patterns in large scale data sets.
Graduation Semester
2021-08
Type of Resource
Thesis
Permalink
http://hdl.handle.net/2142/113184
Copyright and License Information
Copyright 2021 Reza Yousefi Maragheh

Owning Collections

Dissertations and Theses - Industrial and Enterprise Systems Engineering
Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois