Program for stream Stochastic Dynamic Programming

MG-42: Modern trends in MDPs
Stream: Stochastic Dynamic Programming
Room: Virtual Room 42
Chair(s): Sandjai Bhulai

• Data-Driven Consumer Debt Collection via Machine Learning and Approximate Dynamic Programming
  Sandjai Bhulai, Ruben van de Geer, Qingchen Wang
• Bayesian Adaptive Mastery Assessment in Online Tests via Machine Learning
  Anni Sapountzi, Sandjai Bhulai
• Dynamic Inventory Control with Fixed Setup Costs and Unknown Discrete Demand Distribution
  Mehdi Davoodi, Michael Katehakis, Jian Yang
• Investigation of MDP Models for Sequential Procurement Auctions
  Kartikeya Puranam, Michael Katehakis

TD-42: MDPs and related fields
Stream: Stochastic Dynamic Programming
Room: Virtual Room 42
Chair(s): Odysseas Kanavetas, Flora Spieksma

• Discrete-item Inventory Control involving Fixed Setup Costs, Demand Censoring, and Unknown Distribution
  Ehsan Teymourian, Jian Yang, Michael Katehakis
• Iterative Stochastic Quasigradient procedures for robust estimation, machine learning and decision making problems
  Vasyl Gorbachuk, Yurii Ermoliev, Anatoliy Zagorodniy, Vyacheslav Bogdanov, Tatiana ERMOLIEVA, Elena Rovenskaya, Nadejda Komendantova, Olena Borodina, Pavel Knopov, Vladimir Norkin, Alexei Gaivoronski
• Switching curve optimality in two-dimensional queueing control models
  Flora Spieksma
• Asymptotically optimal control for Markov Decision Processes (MDP) under side constraints
  Odysseas Kanavetas, Apostolos Burnetas, Michael Katehakis

WA-42: New Problems and Methods in Epidemiology
Stream: Stochastic Dynamic Programming
Room: Virtual Room 42
Chair(s): Javier Cabrera, Michael Katehakis

• Forecasting daily confirmed cases and deaths of COVID-19 using a novel dynamic pattern extraction and matching algorithm
  Debopriya Ghosh, Dhammika Amaratunga, Javier Cabrera, Michael Katehakis, Jin Wang, Wenting Wang
• The impact of socio-economic factors on the spread of COVID-19 cases and deaths
  Wenting Wang, Dhammika Amaratunga, Javier Cabrera, Debopriya Ghosh, Michael Katehakis, Jin Wang
• Adaptive learning models and techniques for forecasting COVID-19 daily cases and deaths
  Jin Wang, Dhammika Amaratunga, Javier Cabrera, Debopriya Ghosh, Michael Katehakis, Prateek Purwar, Wenting Wang, Arpit Yadav
• A comparison of multiple forecasting methods for the daily cases and deaths of Covid-19.
  Javier Cabrera, Dhammika Amaratunga, Debopriya Ghosh, Michael Katehakis, Prateek Purwar, Jin Wang, Wenting Wang, Arpit Yadav

WD-42: Advances in Dynamic Programming
Stream: Stochastic Dynamic Programming
Room: Virtual Room 42
Chair(s): Jefferson Huang

• Slow service-times and high quality of service vs. fast service-times and time-deteriorating quality of service – a trade-off using Markov Decision Processes
  Mihaela Mitici
• A comparison of algorithms for learning the Whittle index for restless bandits with unknown parameters
  Lachlan Gibson, Peter Jacko, Yoni Nazarathy
• Solvable Markov Decision Processes with Incomplete Information
  Eugene Feinberg, Pavlo Kasyanov, Michael Zgurovsky
• Bandit Algorithms for Data-Driven Resolution/Field-of-View Tradeoffs in Multi-Mode Sensing and Intelligence Collection
  Jefferson Huang