Professional Activities
Organizing Committee
Co-chair (with Jalaj Bhandari, Yonathan Efroni, Daniel Jiang, Aldo Pacchiano, Yi Wan, Kelly Zhang, and Angela Zhou) of a workshop on “Deployable RL: From Research to Practice” at the First Reinforcement Learning Conference (RLC), 2024.
Co-chair (with Viktor Bengs, Robert Busa-Fekete, Branislav Kveton, and Aadirupa Saha) of a workshop on “The Many Facets of Preference-Based Learning” at the Fortieth International Conference on Machine Learning (ICML), 2023.
Co-chair (with Alessandro Lazaric and Matteo Pirotta) of a tutorial on “Exploration-Exploitation in Reinforcement Learning” at the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), 2020.
Co-chair (with Shie Mannor, Yisong Yue, Marek Petrik, and Yinlam Chow) of a workshop on “Safety and Robustness in Decision-making” at the Thirty-Third Annual Conference on Neural Information Processing Systems (NeurIPS), 2019.
Co-Chair (with Marek Petrik) of a tutorial on “Risk-averse Decision-making and Control” at the Thirty-First Conference on Artificial Intelligence (AAAI-2017), February 2017.
Co-chair (with Esteban Arcaute, Shie Mannor, and Georgios Theocharous) of a workshop on “Machine Learning in eCommerce” at the Twenty-Ninth Annual Conference on Neural Information Processing Systems (NIPS), 2015.
Co-chair (with Alessandro Lazaric and Rémi Munos) of the “Twelfth European Workshop on Rein- forcement Learning (EWRL-12)” at the Thirty-Second International Conference on Machine Learning (ICML), 2015.
Co-Chair (with Yasin Abbasi, Peter Bartlett, Ambuj Tewari, and Ben Van Roy) of a workshop on “Large-scale Reinforcement Learning and Markov Decision Problems” at the Twenty-Eighth Annual Conference on Neural Information Processing Systems (NIPS-2014), December 2014.
Co-Chair (with Georgios Theocharous and Shie Mannor) of a workshop on “Customer Life-Time Value Optimization in Digital Marketing” at the Thirty-First International Conference on Machine Learning (ICML 2014), June 2014.
Co-Chair (with Amir-massoud Farahmand, André Barreto, Joelle Pineau, and Doina Precup) of a workshop on “Decision-Making with Big Data” at the Twenty-Eight Conference on Artificial Intelligence (AAAI-2014), July 2014.
Co-Chair (with Alessandro Lazaric) of a tutorial on “Statistical Learning Theory in Reinforcement Learning and Approximate Dynamic Programming” at the Twenty-Ninth International Conference on Machine Learning (ICML 2012), June 2012.
Co-Chair (with Yaakov Engel, Shie Mannor, and Pascal Poupart) of a workshop on “Model Uncertainty and Risk in Reinforcement Learning” at the Twenty-Second Annual Conference on Neural Information Processing Systems (NIPS-2008), December 2008.
Co-Chair (with Pascal Poupart & Yaakov Engel) of a tutorial on “Bayesian Methods in Reinforcement Learning” at the Twenty-Fourth International Conference on Machine Learning (ICML 2007), June 2007.
Co-Chair (with Michael Rosenstein) of a workshop on “Supervisory Control of Learning and Adaptive Systems” at the Nineteenth National Conference on Artificial Intelligence (AAAI 2004), July 2004.
Grant Proposal Reviewer
Agence Nationale de la Recherche (ANR), France
Natural Sciences and Engineering Research Council of Canada (NSERC)
Editorial Board Member
Machine Learning Journal – Special Issue on Safe and Fair Machine Learning (2021-2023)
Machine Learning Journal (2011-2020)
Steering Committee Member
European Workshop on Reinforcement Learning (EWRL, 2011-2016)
Senior Area Chair & Senior Meta-Reviewer
AAAI Conference on Artificial Intelligence (AAAI 2023, 2024)
International Conference on Machine Learning (ICML 2023-2025)
Annual Conference on Neural Information Processing Systems (NeurIPS 2020-2022)
Area Chair & Senior Program Committee Member
European Conference on Machine Learning (ECML 2016)
AAAI Conference on Artificial Intelligence (AAAI 2017, 2018)
International Conference on Machine Learning (ICML 2018-2022)
International Conference on Learning Representations (ICLR 2021-2025)
International Conference on Artificial Intelligence and Statistics (AISTATS 2020)
International Joint Conference on Artificial Intelligence (IJCAI 2011, 2015, 2016, 2018)
Annual Conference on Neural Information Processing Systems (NeurIPS 2013, 2014, 2017-2019, 2023, 2024)
Program Committee Member
European Conference on Machine Learning (ECML 2010, 2012)
International Conference on Machine Learning (ICML 2006-2017)
AAAI Conference on Artificial Intelligence (AAAI 2007-2008, 2011)
International Conference on Learning Representations (ICLR 2020)
International Conference on Artificial Neural Networks (ICANN 2011)
International Conference on Uncertainty in Artificial Intelligence (UAI 2012)
French Conference on Planning, Decision-making, and Learning (JFPDA 2012-2014)
European Workshop on Reinforcement Learning (EWRL 2008, 2011, 2012, 2015, 2016)
International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2006)
Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2015, 2017)
Workshop on Big Data for Business-to-Business Marketing and Sales at the IEEE Conference on Big Data (2015)
Workshop on Enterprise Intelligence at the ACM Conference on Knowledge Discovery and Data Mining (KDD 2016)
Conference Reviewer
Annual Conference on Learning Theory (COLT 2008)
National Conference on Artificial Intelligence (AAAI 2005)
International Joint Conference on Artificial Intelligence (IJCAI 2007)
International Conference on Artificial Intelligence and Statistics (AISTATS 2009, 2011, 2012)
Annual Conference on Neural Information Processing Systems (NIPS 2006-2012, 2015, 2016)
International Joint Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2002, 2003)
Journal Reviewer
Neurocomputing
Journal of Autonomous Robots
Journal of Operations Research
Machine Learning Journal (MLJ)
IEEE Transactions on Automatic Control
Journal of Machine Learning Research (JMLR)
Journal of Artificial Intelligence Research (JAIR)
International Journal of Robotics Research (IJRR)
IEEE Transactions on Systems, Man and Cybernetics
Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS)