3rd Offline RL Workshop: Offline RL as a "Launchpad"

Neural Information Processing Systems (NeurIPS)

December 2, 2022

@OfflineRL ยท #OFFLINERL

We will encourage discussions and contributions around (but not limited to) the following topics that are important in the context of utilizing offline RL as a launchpad:

  • Re-using / transferring existing offline RL agents (i.e., reincarnating RL )
  • Transfer and generalization of offline RL policies: multi-task and meta-learning
  • Pre-training and learning from general-purpose, but unrelated data
  • Representation learning for offline RL, and offline RL as a way of representation learning
  • Effective methods for fine-tuning offline RL policies, especially to novel problem scenarios
  • Fast adaptation and meta-learning of offline RL policies
  • Effective exploration via skills learned from offline data
  • Sample-efficient online RL via iterated offline RL or deployment-efficient offline RL
  • Learning to explore safely using offline data, especially in the presence of other agents

We shall accept submissions of up to 4-5 pages of content (with no limit on references and appendix) that have not been previously accepted at an archival venue (such as ICML, NeurIPS, ICLR). Papers can utilize any style file they want (for e.g., ICML, NeurIPS, ICLR) and should be anonymized for double blind review. We'll try to ensure that each paper receives 3 reviews.

Evaluation Criteria: We plan to evaluate papers on clarity, potential impact, significance, and novelty of the proposed ideas. We are happy to accept works-in-progress to encourage discussion at the workshop. All accepted papers will be advertised on the workshop website in the form of a poster or recorded talk videos and camera-ready papers and are non-archival. We will also select a small number of papers as contributed talks, which would be presented live during the in-person workshop.

Day of workshop December 2 2022
Submission site opens August 3, 2022
Submission site OpenReview /
Submission deadline October 2, 2022, AoE
Reviewing starts September 26, 2022
Reviews due October 15, 2022, 11:59pm Pacific
Decisions announced October 20, 2022, 11:59pm Pacific
Camera-ready and video submission due November 20, 2022, 11:59pm Pacific