PRL Workshop Series

Bridging the Gap Between AI Planning and Reinforcement Learning

Bridging the Gap Between AI Planning and Reinforcement Learning (PRL @ ICAPS 2023) – Workshop at ICAPS 2023

< Link to other workshops in the series

ICAPS’23 Workshop
Prague, Czech Republic
July 9, 2023

Some of the accepted papers will be invited to be presented at the IJCAI edition of the workshop as well.

Aim and Scope of the Workshop

While AI Planning and Reinforcement Learning communities focus on similar sequential decision-making problems, these communities remain somewhat unaware of each other on specific problems, techniques, methodologies, and evaluations.

This workshop aims to encourage discussion and collaboration between researchers in the fields of AI planning and reinforcement learning. We aim to bridge the gap between the two communities, facilitate the discussion of differences and similarities in existing techniques, and encourage collaboration across the fields. We solicit interest from AI researchers that work in the intersection of planning and reinforcement learning, in particular, those that focus on intelligent decision-making. This is the fifth edition of the PRL workshop series that started at ICAPS 2020.

Topics of Interest

We invite submissions at the intersection of AI Planning and Reinforcement Learning. The topics of interest include, but are not limited to, the following

Important Dates

ICAPS will be in-person this year. Authors of accepted workshop papers are expected to physically attend the conference and present in person.


Time (Prague) Title
9:00 Opening Remarks
9:10 Session 1
  Value Function Learning via Prolonged Backward Heuristic Search. Zlatan Ajanovic, Bakir Lacevic, Jens Kober.
  Learning General Policies with Policy Gradient Methods. Simon Ståhlberg, Blai Bonet, Hector Geffner.
  Learning Hierarchical Policies by Iteratively Reducing the Width of Sketch Rules. Dominik Drexler, Jendrik Seipp, Hector Geffner.
  Towards a Unified Framework for Sequential Decision Making. Carlos Núñez-Molina, Pablo Mesejo, Juan Fernández-Olivares.
10:30 Coffee break
11:00 Session 2
  pyRDDLGym: From RDDL to Gym Environments. Ayal Taitler, Michael Gimelfarb, Jihwan Jeong, Sriram Gopalakrishnan, Martin Mladenov, Xiaotian Liu, Scott Sanner.
  Inapplicable Actions Learning for Knowledge Transfer in Reinforcement Learning. Leo Ardon, Alberto Pozanco, Daniel Borrajo, Sumitra Ganesh.
  Multi-Agent Reinforcement Learning with Epistemic Priors. Thayne T. Walker, Jaime S. Ide, Minkyu Choi, Michael John Guarino, Kevin Alcedo.
  Mind the Uncertainty: Risk-Aware and Actively Exploring Model-Based Reinforcement Learning. Marin Vlastelica, Sebastian Blaes, Cristina Pinneri, Georg Martius.
12:20 Lunch
13:40 Keynote: Sheila McIlraith - Building Taskable RL Agents using Advice, Instructions, and AI Planning
14:40 Panel Discussion Sequential decision making in the era of large language models.
15:30 Coffee break
16:00 Closing remarks, discussion
16:10 Poster Session
18:00 End


Sheila McIlraith

Title: Building Taskable RL Agents using Advice, Instructions, and AI Planning

Panel discussion


Select accepted papers are given a slot in the program: 15 minutes for content + 5 minutes for questions.

Poster session

All accepted papers are expected to participate in the poster session

List of Accepted Papers

Submission Details

We solicit workshop paper submissions relevant to the above call of the following types:

Please format submissions in AAAI style (see instructions in the Author Kit). Authors submitting papers rejected from other conferences, please ensure you do your utmost to address the comments given by the reviewers. Please do not submit papers that are already accepted for the main ICAPS conference to the workshop.

Some accepted long papers will be invited for contributed talks. All accepted papers (long as well as short) and extended abstracts will be given a slot in the poster presentation session. Extended abstracts are intended as brief summaries of already published papers, preliminary work, position papers, or challenges that might help bridge the gap.

As the main purpose of this workshop is to solicit discussion, the authors are invited to use the appendix of their submissions for that purpose.

Paper submissions should be made through OpenReview.

Organizing Committee

Please send your inquiries to