Hoang M. Le bio photo

Hoang M. Le

Postdoc in Reinforcement Learning @ Microsoft Research AI. PhD in Computing + Mathematical Sciences @ Caltech

Twitter LinkedIn Github e-Mail

I am a postdoctoral researcher at Microsoft Research AI (MSR AI). I am part of the Reinforcement Learning group, led by Alekh Agarwal.


I previously defended my PhD in Computing + Mathematical Sciences at Caltech. I was fortunate to be advised by Professor Yisong Yue. My other committee members include Anima Anandkumar Yue, Adam Wierman, and Hal Daume. My thesis focuses on systematic approaches to combine domain knowledge and learning methods to solve sequential decision making problems, which span reinforcement learning, imitation learning, optimal control. During grad school years I spent two summers interning at Microsoft Research in NYC and Disney Research in Pittsburgh. I was also supported by an Amazon AI Graduate fellowship.

News & Announcements

Preprints

  • Cameron Voloshin, Hoang M. Le, Nan Jiang and Yisong Yue
    Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning
    (under review) , 2019
    [PDF] [BibTeX]

    @article{voloshin2019empirical,
      title={Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning},
      author={Voloshin, Cameron and Le, Hoang M and Jiang, Nan and Yue, Yisong},
      journal={arXiv preprint arXiv:1911.06854},
      year={2019}
    }
    

Recent Publications

  • Abhinav Verma* , Hoang M. Le*, Yisong Yue and Swarat Chaudhuri
    Imitation-Projected Programmatic Reinforcement Learning
    Neural Information Processing Systems (NeurIPS) , 2019
    (*equal contribution)
    [PDF] [Summary slides] [BibTeX]

    @article{verma2019imitation,
      title={Imitation-Projected Programmatic Reinforcement Learning},
      author={Verma, Abhinav and Le, Hoang M and Yue, Yisong and Chaudhuri, Swarat},
      journal={arXiv preprint arXiv:1907.05431},
      year={2019}
    }
    
  • Hoang M. Le, Cameron Voloshin and Yisong Yue
    Batch Policy Learning under Constraints
    International Conference on Machine Learning (ICML), 2019
    (Long Talk)
    [PDF] [Project Page] [BibTeX]

    @article{le2019batch,
      title={Batch Policy Learning under Constraints},
      author={Le, Hoang and Voloshin, Cameron and Yue, Yisong},
      booktitle={International Conference on Machine Learning},
      pages={3703--3712},
      year={2019}
    }
    
  • Andrew J. Taylor, Victor D. Dorobantu, Hoang M. Le, Yisong Yue and Aaron D. Ames
    Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems
    International Conference on Intelligent Robots and Systems (IROS) , 2019
    [PDF][code] [BibTeX]

    @article{taylor2019episodic,
      title={Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems},
      author={Taylor, Andrew J and Dorobantu, Victor D and Le, Hoang M and Yue, Yisong and Ames, Aaron D},
      journal={arXiv preprint arXiv:1903.01577},
      year={2019}
    }
    
  • Andrew J. Taylor, Victor D. Dorobantu, Meera Krisnamoorthy, Hoang M. Le, Yisong Yue and Aaron D. Ames
    A Control Lyapunov Perspective on Episodic Learning via Projection to State Stability
    IEEE Conference on Decision and Control (CDC) , 2019
    [PDF] [BibTeX]

    @article{taylor2019acontrol,
      title={A Control Lyapunov Perspective on Episodic Learning via Projection to State Stability},
      author={Taylor, Andrew J and Dorobantu, Victor D and Krisnamoorthy, Meera and Le, Hoang M and Yue, Yisong and Ames, Aaron D},
      journal={arXiv preprint arXiv:1903.07214},
      year={2019}
    }
    
  • Hoang M. Le, Nan Jiang, Alekh Agarwal, Miroslav Dudík, Yisong Yue and Hal Daumé III
    Hierarchical Imitation and Reinforcement Learning
    International Conference on Machine Learning (ICML), 2018
    (Long Talk)
    [PDF] [Project Page] [BibTeX]

    @inproceedings{le2018hierarchical,
      title={Hierarchical Imitation and Reinforcement Learning},
      author={Le, Hoang and Jiang, Nan and Agarwal, Alekh and Dudik, Miroslav and Yue, Yisong and Daum{\'e}, Hal},
      booktitle={International Conference on Machine Learning},
      pages={2923--2932},
      year={2018}
    }
    
  • Hoang M. Le, Yisong Yue, Peter Carr and Patrick Lucey
    Coordinated Multi-Agent Imitation Learning
    International Conference on Machine Learning (ICML), 2017
    [PDF] [long] [BibTeX]

    @inproceedings{le2017coordinated,
      title={Coordinated Multi-Agent Imitation Learning},
      author={Le, Hoang M and Yue, Yisong and Carr, Peter and Lucey, Patrick},
      booktitle={International Conference on Machine Learning},
      pages={1995--2003},
      year={2017}
    }
    
  • Hoang M. Le, Peter Carr,Yisong Yue and Patrick Lucey
    Data-Driven Ghosting using Deep Imitation Learning
    MIT Sloan Sports Analytics Conference (SSAC), 2017
    (Best Paper Runner-Up Award)
    [PDF] [Project Page] [Video Demo] [BibTeX]

    @article{le2017data,
      title={Data-Driven Ghosting using Deep Imitation Learning},
      author={Le, Hoang M and Carr, Peter and Yue, Yisong and Lucey, Patrick}
      journal={MIT Sloan Sports Analytics Conference (SSAC)},
      year={2017}
    }
    
  • Hoang M. Le, Andrew Kang, Yisong Yue and Peter Carr
    Smooth Imitation Learning for Online Sequence Prediction
    International Conference on Machine Learning (ICML), 2016
    [PDF] [long] [BibTeX]

    @inproceedings{le2016smooth,
      title={Smooth Imitation Learning for Online Sequence Prediction},
      author={Le, Hoang and Kang, Andrew and Yue, Yisong and Carr, Peter},
      booktitle={International Conference on Machine Learning},
      pages={680--688},
      year={2016}
    }
  • Jianhui Chen, Hoang M. Le, Peter Carr, Yisong Yue and James J. Little
    Learning Online Smooth Predictors for Real-time Camera Planning using Recurrent Decision Trees
    Computer Vision and Pattern Recognition (CVPR), 2016
    (Oral Presentation)
    [PDF] [Press Release] [BibTeX]

    @inproceedings{chen2016learning,
      title={Learning online smooth predictors for realtime camera planning using recurrent decision trees},
      author={Chen, Jianhui and Le, Hoang M and Carr, Peter and Yue, Yisong and Little, James J},
      booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
      pages={4688--4696},
      year={2016}
    }

Pending Patents