Reinforcement Learning

2026

Geigh Zollicoffer, Tanush Chopra, Mingkuan Yan, Xiaoxu Ma, Kenneth Eaton, and Mark Riedl
World Model Robustness via Surprise Recognition
Proceedings of the 2026 CVPR Findings (2026).
arXiv Conference bibtexAgentsReinforcement LearningAI Safety

2025

Maduri Singh, Amal Alabdulkarim, Gennie Mansi, and Mark O. Riedl
Explainable Reinforcement Learning Agents Using World Models
Proceedings of the 2025 IJCAI Workshop on Explainable AI (2025).
arXiv Workshop bibtexAgentsExplainable AIReinforcement Learning

Geigh Zollicoffer, Kenneth Eaton, Jonathan Balloch, Julia Kim, Riedl Mark O., and Robert Wright
Novelty Detection in Reinforcement Learning with World Models
International Conference on Machine Learning (2025).
arXiv Conference bibtexAgentsReinforcement LearningAI Safety

Amal Alabdulkarim, Madhuri Singh, Gennie Mansi, Kaely Hall, and Mark O. Riedl
Experiential Explanations for Reinforcement Learning
Neural Computing and Applications 37 (2025).
arXiv Journal bibtexAgentsExplainable AIReinforcement Learning

2024

Jonathan C. Balloch, Rishav Bhagat, Geigh Zollicoffer, Ruoran Jia, Julia Kim, and Mark O. Riedl
Is Exploration All You Need? Effective Exploration Characteristics for Transfer in Reinforcement Learning
Proceedings of the 2024 Reinforcement Learning Conference Workshop on Finding the Frame: Examining Conceptual Frameworks in Reinforcement Learning (2024).
arXiv Workshop bibtexAgentsReinforcement Learning

Christopher Z. Cui, Xiangyu Peng, and Mark O. Riedl
A Mixture-of-Experts Approach to Few-Shot Task Transfer in Open-Ended Text Worlds
arXiv:2405.06059 (2024).
arXiv bibtexInteractive StoriesAgentsReinforcement Learning

Rishav Bhagat, Jonathan Balloch, Zhiyu Lin, Julia Kim, and Mark Riedl
External Model Motivated Agents: Reinforcement Learning for Enhanced Environment Sampling
Proceedings of the 2024 Reinforcement Learning Conference Workshop on Reinforcement Learning Beyond Rewards (2024).
arXiv Workshop bibtexAgentsReinforcement Learning

Kenneth Eaton, Jonathan Balloch, Julia Kim, and Mark Riedl
The Interpretability of Codebooks in Model-Based Reinforcement Learning is Limited
Proceedings of the 2024 Reinforcement Learning Conference Workshop I Can't Believe It's not Better (2024).
arXiv Workshop bibtexAgentsExplainable AIInterpretabilityReinforcement Learning

Zhiyu Lin, Upol Ehsan, Rohan Agarwal, Samihan Dani, Vidushi Vashishth, and Mark Riedl
Beyond Following: Mixing Active Initiative into Computational Creativity
Proceedings of the AAAI Workshop on Experimental AI in Games (2024).
arXiv Workshop bibtexStorytellingReinforcement LearningCreativity

Ashutosh Baheti, Ximing Lu, Faeze Brahman, Ronan Le Bras, Maarten Sap, and Mark O. Riedl
Improving Language Models with Advantage-based Offline Policy Gradients
Proceedings of ICLR 2024 (2024).
arXiv Conference bibtexLarge Language ModelsReinforcement LearningValue AlignmentAI Safety

2023

Xiangyu Peng, Christopher Cui, Wei Zhou, Renee Jia, and Mark O. Riedl
Story Shaping: Teaching Agents Human-like Behavior with Stories
Proceedings of the 2023 AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (2023).
arXiv Conference bibtexStorytellingInteractive StoriesAgentsReinforcement LearningValue Alignment

Wei Zhou, Xiangyu Peng, and Mark O. Riedl
Dialogue Shaping: Empowering Agents through NPC Interaction
Proceedings of the 2023 AAAI Workshop on Experimental AI in Games (2023).
arXiv Workshop bibtexInteractive StoriesAgentsReinforcement Learning

Christopher Cui, Xiangyu Peng, and Mark O. Riedl
Thespian: Multi-Character Text Role-Playing Game Agents
Proceedings of the 2023 AAAI Workshop on Experimental AI in Games (2023).
arXiv Workshop bibtexInteractive StoriesAgentsReinforcement Learning

Jonathan C. Balloch, Zhiyu Lin, Xiangyu Peng, Mustafa Hussain, Aarun Srinivas, Robert Wright, Julia M. Kim, and Mark O. Riedl
Neuro-Symbolic World Models for Adapting to Open World Novelty
Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems (2023).
arXiv Conference bibtexAgentsReinforcement Learning

2022

Xiangyu Peng, Mark O. Riedl, and Prithviraj Ammanabrolu
Inherently Explainable Reinforcement Learning in Natural Language
Proceedings of NeurIPS 2022 (2022).
arXiv Conference bibtexInteractive StoriesAgentsExplainable AIInterpretabilityReinforcement Learning

Jonathan Balloch, Zhiyu Lin, Mustafa Hussain, Aarun Srinivas, Robert Wright, Xiangyu Peng, Julia Kim, and Mark Riedl
NovGrid: A Flexible Grid World for Evaluating Agent Response to Novelty
Proceedings of the AAAI Spring Symposium on Designing Artificial Intelligence for Open Worlds (2022).
arXiv Conference bibtexAgentsReinforcement Learning

Jonathan C Balloch, Julia Kim, Jessica L Inman, and Mark O. Riedl
The Role of Exploration for Task Transfer in Reinforcement Learning
Proceedings of the IROS 2022 Workshop on Lifelong Learning of High-level Cognitive and Reasoning Skills (2022).
arXiv Workshop bibtexAgentsReinforcement Learning

Louis Castricato, Alexander Havrilla, Shahbuland Matiana, Michael Pieler, Anbang Ye, Ian Yang, Spencer Frazier, and Mark Riedl
Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning
arXiv preprint arXiv:2210.07792 (2022).
arXiv bibtexStorytellingLarge Language ModelsReinforcement LearningValue Alignment

Xiangyu Peng, Mark O. Riedl, and Prithviraj Ammanabrolu
Inherently Explainable Reinforcement Learning in Natural Language
Proceedings of the 2022 Multi-disciplinary Conference on Reinforcement Learning and Decision Making (2022).
arXiv Conference bibtexInteractive StoriesAgentsExplainable AIInterpretabilityReinforcement Learning

Prithviraj Ammanabrolu, Renee Jia, and Mark O. Riedl
Situated Dialogue Learning through Procedural Environment Generation
Proceedings of ACL 2022 (2022).
arXiv Conference bibtexInteractive StoriesAgentsReinforcement LearningGame Generation

2021

Amal Alabdulkarim, Winston Li, Lara J. Martin, and Mark O. Riedl
Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning
arXiv:2112.08593 (2021).
arXiv bibtexStorytellingLarge Language ModelsReinforcement Learning

Prithviraj Ammanabrolu and Mark Riedl
Learning Knowledge Graph-based World Models of Textual Environments
Thirty-fifth Conference on Neural Information Processing Systems (2021).
arXiv Conference bibtexInteractive StoriesAgentsReinforcement Learning

Xiangyu Peng, Prithviraj Ammanabrolu, and Mark Riedl
Explainable Reinforcement Learning Agents with Stacked Hierarchical Graph Attention
Workshop on Explainable Graph-based Machine Learning at AKBC (2021).
Workshop bibtexAgentsExplainable AIInterpretabilityReinforcement Learning

Prithviraj Ammanabrolu and Mark O. Riedl
Modeling Worlds in Text
Proceedings of the 2021 Conference on Neural Information Processing Systems, Benchmarks Track (2021).
arXiv Conference bibtexInteractive StoriesSocial SimulationAgentsReinforcement Learning

Xiangyu Peng, Jonathan C. Balloch, and Mark O. Riedl
Detecting and Adapting to Novelty in Games
Proceedings of the AAAI21 Workshop on on Reinforcement Learning in Games (2021).
arXiv Workshop bibtexAgentsReinforcement Learning

Md Sultan Al Nahian, Spencer Frazier, Brent Harrison, and Mark O. Riedl
Training Value-Aligned Reinforcement Learning Agents Using a Normative Prior
arXiv:2104.09469 (2021).
arXiv bibtexAgentsReinforcement LearningValue AlignmentAI Safety

D. Srivastava, Spencer Frazier, Mark O. Riedl, and K. Feigh
Effect of Interaction Design of Reinforcement Learning Agents on Human Satisfaction in Partially Observable Domains
International Joint Conference on Computer Vision, Imaging, and Computer Graphics Theory and Applications (2021).
Conference bibtexAgentsExplainable AIReinforcement Learning

Prithviraj Ammanabrolu and Mark O Riedl
Situated Language Learning via Interactive Narratives
arXiv preprint arXiv:2103.09977 (2021).
arXiv bibtexInteractive StoriesAgentsReinforcement Learning

2020

Prithviraj Ammanabrolu, Ethan Tien, Zhaochen Luo, and Mark O Riedl
Exploration Strategies for Text-Adventure Agents
Proceedings of the IJCAI Knowledge-based Reinforcement Learning Workshop (2020).
Workshop bibtexInteractive StoriesAgentsReinforcement Learning

Matthew Hausknecht, Prithviraj Ammanabrolu, Marc-Alexandre Cot'e, and Xingdi Yuan
Interactive Fiction Games: A Colossal Adventure
Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI) (2020).
arXiv Conference bibtexInteractive StoriesAgentsReinforcement Learning

Prithviraj Ammanabrolu and Matthew Hausknecht
Graph Constrained Reinforcement Learning for Natural Language Action Spaces
International Conference on Learning Representations (2020).
OpenReview Conference bibtexInteractive StoriesAgentsReinforcement Learning

Prithviraj Ammanabrolu, Ethan Tien, Matthew Hausknecht, and Mark O Riedl
How to avoid being eaten by a grue: Structured exploration strategies for textual worlds
arXiv preprint arXiv:2006.07409 (2020).
arXiv bibtexInteractive StoriesAgentsReinforcement Learning

Sahith Dambekodi, Spencer Frazier, Prithviraj Ammanabrolu, and Mark O Riedl
Playing Text-Based Games with Common Sense
Proceedings of the NeurIPS Wordplay workshop (2020).
arXiv Conference bibtexInteractive StoriesAgentsReinforcement Learning

2019

Prithviraj Ammanabrolu and Mark O. Riedl
Transfer in Deep Reinforcement Learning using Knowledge Graphs
Proceedings of the EMNLP Workshop on TextGraphs: Graph-based Methods for Natural Language Processing (2019).
arXiv Workshop bibtexInteractive StoriesAgentsReinforcement Learning

Pradyumna Tambwekar, Murtaza Dhuliawala, Lara J. Martin, Animesh Mehta, Brent Harrison, and Mark O. Riedl
Controllable Neural Story Plot Generation via Reward Shaping
Proceedings of the 2019 International Joint Conference on Artificial Intelligence (2019).
arXiv Conference bibtexStorytellingReinforcement Learning

Spencer Frazier and Mark O. Riedl
Improving Deep Reinforcement Learning in Minecraft with Action Advice
Proceedings of the 2019 AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (2019).
arXiv Conference bibtexAgentsReinforcement Learning

Prithviraj Ammanabrolu and Mark O. Riedl
Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning
Proceedings of the 2019 NeurIPS Workshop on Word Play: Reinforcement and Language Learning in Text-based Games (2019).
Workshop bibtexInteractive StoriesAgentsReinforcement Learning

Prithviraj Ammanabrolu and Mark O. Riedl
Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning
Proceedings of the 2019 Conference of the North American Association for Computational Linguistics (2019).
arXiv Conference bibtexInteractive StoriesAgentsReinforcement Learning

2018

Lara Martin, Srijan Sood, and Mark Riedl
Dungeons and DQNs: Toward Reinforcement Learning Agents that Play Tabletop Roleplaying Games
Proceedings of the 2018 Joint Workshop on Workshop on Intelligent Cinematography and Editing and Intelligent Narrative Technologies (2018).
PDF Workshop bibtexInteractive StoriesAgentsReinforcement Learning

Brent Harrison, Upol Ehsan, and Mark O. Riedl
Guiding Reinforcement Learning Exploration Using Natural Language
Proceedings of the 2018 International Joint Conference on Autonomous Agents and Multi Agent Systems (2018).
arXiv Conference bibtexAgentsReinforcement Learning

2017

Mark O. Riedl and Brent. Harrison
Enter the Matrix: A Virtual World Approach to Safely Interruptable Autonomous Systems
Proceedings of the AAAI 2017 Workshop on SafeAI (2017).
arXiv Workshop bibtexAgentsReinforcement LearningAI Safety

Z. Lin, B. Harrison, A. Keech, and M. O. Riedl
Explore, Exploit or Listen: Combining Human Feedback and Policy Model to Speed up Deep Reinforcement Learning in 3D Worlds
ArXiv:1709.03969 (2017).
arXiv bibtexAgentsReinforcement Learning

Sam Krening, Brent Harrison, Karen Feigh, Charles Isbell, Mark O. Riedl, and Andrea Thomaz
Learning from Explanations using Sentiment and Advice in RL
IEEE Transactions on Cognitive and Developmental Systems (2017).
PDF bibtexAgentsReinforcement Learning