PRL Workshop Series

Bridging the Gap Between AI Planning and Reinforcement Learning

Bridging the Gap Between AI Planning and Reinforcement Learning (PRL @ ICAPS) – Workshop at ICAPS 2022 (June 13)

< Link to other workshops in the series

This site presents the most up-to-date information about the PRL @ ICAPS workshop. Please, visit ICAPS 2022 for information about the general conference.

NEWS: This year the PRL workshop will have two editions: The first one at ICAPS 2022, and the second one at IJCAI 2022. PRL@ICAPS authors will be given the opportunity to specify whether they want their submission to be considered for PRL@IJCAI as well. The final decision will be made separately for each of the workshop locations. Please see the website for additional information on the two editions.

While AI Planning and Reinforcement Learning communities focus on similar sequential decision-making problems, these communities remain somewhat unaware of each other on specific problems, techniques, methodologies, and evaluation.

This workshop aims to encourage discussion and collaboration between the researchers in the fields of AI planning and reinforcement learning. We aim to bridge the gap between the two communities, facilitate the discussion of differences and similarities in existing techniques, and encourage collaboration across the fields. We solicit interest from AI researchers that work in the intersection of planning and reinforcement learning, in particular, those that focus on intelligent decision making. As such, the joint workshop program is an excellent opportunity to gather a large and diverse group of interested researchers.

Workshop topics

The workshop solicits work at the intersection of the fields of reinforcement learning and planning. One example is so-called goal-directed reinforcement learning, where a goal must be achieved, and no partial credit is given for getting closer to the goal. In this case, a usual metric is success rate. We also solicit work solely in one area that can influence advances in the other so long as the connections are clearly articulated in the submission.

Submissions are invited for topics on, but not limited to:

Invited Speakers

Videos of the invited talks.


The event will be fully virtual, consisting of:

The workshop June 13

Mon, June 13.

Videos of the contributed talks.

Time (UTC) Title
12:00 Opening Remarks
12:05 Invited Talk: Veronique Ventos - Nook: a new generation AI dedicated to the game of Bridge
12:55 Short Break
13:00 SESSION 1
  [Gather spot 1] PG3: Policy-Guided Planning for Generalized Policy Generation
  [Gather spot 2] Goal Recognition as Reinforcement Learning
  [Gather spot 3] Learning Generalized Policies Without Supervision Using GNNs
  [Gather spot 4] Learning Domain-Independent Policies for Open List Selection
  [Gather spot 5] World Value Functions: Knowledge Representation for Learning and Planning
  [Gather spot 6] GoalNet: Inferring Conjunctive Goal Predicates from Human Plan Demonstrations for Robot Instruction Following
  [Gather spot 7] Hierarchies of Reward Machines
  [Gather spot 8] A Proposal to Generate Planning Problems with Graph Neural Networks
  Break + “Poster” Discussion
15:30 Invited talk: Sergey Levine - Planning with Reinforcement Learning
16:20 Short Break
16:30 SESSION 2
  [Gather spot 1] Learning First-Order Symbolic Planning Representations That Are Grounded
  [Gather spot 2] Action Space Reduction for Planning Domains
  [Gather spot 3] Leveraging Approximate Symbolic Models for Reinforcement Learning via Skill Diversity
  [Gather spot 4] State Representation Learning for Goal-Conditioned Reinforcement Learning
  [Gather spot 5] Relational Abstractions for Generalized Reinforcement Learning on Symbolic Problems
  [Gather spot 6] Model-Based Adaptation to Novelty in Open-World AI
  [Gather spot 7] POGEMA: Partially Observable Grid Environment for Multiple Agents
  Break + “Poster” Discussion
19:00 Invited talk: Subbarao Kambhampati - Planning to Advise and Explain Reinforcement Learning
19:50 Dicsussion and Closing remarks

Accepted submissions:

Important Dates

Submission Procedure

We solicit workshop paper submissions relevant to the above call of the following types:

Please format submissions in AAAI style (see instructions in Author Kit 2021 at AAAI, Authors considering submitting to the workshop papers rejected from other conferences, please ensure you do your utmost to address the comments given by the reviewers. Papers accepted to the main ICAPS conference may be considered in the extended abstract form.

Some accepted long papers will be accepted as contributed talks. All accepted long and short papers and extended abstracts will be given a slot in the poster presentation session. Extended abstracts are intended as brief summaries of already published papers, preliminary work, position papers or challenges that might help bridge the gap.

As the main purpose of this workshop is to solicit discussion, the authors are invited to use the appendix of their submissions for that purpose.

Paper submissions should be made through EasyChair.

Please send your inquiries by email to the organizers at

For up-to-date information, please visit the PRL website,

Previous Editions