Conferences

  • Lipkis, R., Lee, R., Silbermann, J., Young, T., “Adaptive Stress Testing of Collision Avoidance Systems for Small UASs with Deep Reinforcement Learning”, AIAA Scitech, 2022
  • Durling, M., Herencia-Zapana, H., Meng, B., Meiners, M., Hochwarth, J., Visser, N., Lee, R., Moss, R., Valapil, V., “Certification Considerations for Adaptive Stress Testing of Airborne Software”, IEEE/AIAA Digital Avionics Systems Conference, 2021
  • Agogino, A.K., Lee, R., Giannokopoulou, D., “Machine Learning Explainability and Transferability for Path Navigation”, AIAA SciTech Intelligent Systems Conference, 2021
  • Moss, R.J., Lee, R., Kochenderfer, M.J., “Adaptive Stress Testing of Trajectory Predictions in Flight Management Systems”, IEEE/AIAA Digital Avionics Systems Conference, 2020
  • Julian, K.D., Lee, R., Kochenderfer, M.J., “Validation of Image-Based Neural Network Controllers Through Adaptive Stress Testing”, IEEE International Conference on Intelligent Transportation Systems, 2020
  • Corso, A., Lee, R., Kochenderfer, M.J., “Scalable Autonomous Vehicle Safety Validation Through Dynamic Programming and Scene Decomposition”, IEEE International Conference on Intelligent Transportation Systems, 2020
  • Lee, R., Clarke, J., Agogino, A.K., Giannakopoulou, D., “Improving Trust in Deep Neural Networks using Nearest Neighbors”, AIAA SciTech Intelligent Systems Conference, 2020
  • Lee, R., Mengshoel, O.J., Agogino, A.K., Giannakopoulou, D., Kochenderfer, M.J., “Adaptive Stress Testing of Trajectory Planning Systems”, AIAA SciTech Intelligent Systems Conference, 2019
  • Koren, M., Alsaif, S., Lee, R., Kochenderfer, M.J., “Adaptive Stress Testing for Autonomous Vehicles”, IEEE Intelligent Vehicles Symposium, 2018
  • Lee, R., Kochenderfer, M.J., Mengshoel, O.J., Silbermann, J., “Interpretable Categorization of Heterogeneous Time Series Data”, SIAM International Conference on Data Mining, 2018
  • Lee, R., Mengshoel, O.J., Saksena, A., Gardner, R., Genin, D., Brush, J., Kochenderfer, M.J., “Differential Adaptive Stress Testing of Airborne Collision Avoidance Systems”, AIAA SciTech Modeling and Simulation Technologies Conference, 2018 [Best Paper Award]
  • Lee, R., Kochenderfer, M.J., Mengshoel, O.J., Brat, G.P., Owen, M.P., “Adaptive Stress Testing of Airborne Collision Avoidance Systems”, IEEE/AIAA Digital Avionics Systems Conference, 2015 [Best Paper of Session]
  • Yildiz, Y., Lee., R., Brat, G., “Using Game Theoretic Models to Predict Pilot Behavior in NextGen Merging and Landing Scenario”, AIAA SciTech Modeling and Simulation Technologies Conference, 2012
  • Yan, G., Lee., R., Kent, A., Wolpert, D.H., “Towards a Bayesian Network Game Framework for Evaluating DDoS Attacks and Defense”, ACM Conference on Computer and Communications Security, 2012
  • Schlicht, E., Lee., Wolpert, D.H., Kochenderfer, M.J., Tracey, B., “Predicting the Behavior of Interacting Humans by Fusing Data from Multiple Sources”, Conference on Uncertainty in Artificial Intelligence, 2012
  • Denney, E., Ippolito, C., Lee, R., Pai, G., “An Integrated Safety and Systems Engineering Methodology for Small Unmanned Aircraft Systems”, AIAA Infotech@Aerospace, 2012
  • Dolan, J., Lee, R., Yeh, Y.H., Yeh, C., Nguyen, D.Y., Ben-Menahem, S., Ishihara, A., “Neural Network Estimation of Photovoltaic I-V Curves Under Partially Shaded Conditions”, IEEE International Joint Conference on Neural Networks, 2011
  • Lee, R., Ippolito, C., Yeh, Y.H., Spritzer, J., Phelps, G., “Payload-Directed Control of Geophysical Magnetic Surveys”, AIAA Infotech@Aerospace, 2010
  • Lee, R., Ippolito, C., “A Perception and Mapping Approach for Plume Detection in Payload Directed Flight”, AIAA Infotech@Aerospace, 2009

Journals

  • Corso, A., Moss, R.J., Koren, M., Lee, R., Kochenderfer, M.J., “A Survey of Algorithms for Black-box Safety Validation”, Journal of Artificial Intelligence Research, 72, pp.377-428, 2021
  • Lee, R., Mengshoel, O.J., Saksena, A., Gardner, R., Genin, D., Silbermann, J., Owen, M., Kochenderfer, M.J., “Adaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning”, Journal of Artificial Intelligence Research, 69, pp.1165-1201, 2020
  • Backhaus, S., Bent, R., Bono, J., Lee, R., Tracey, B., Wolpert, D.H., Xie, D., Yildiz, Y., “Cyber-Physical Security: A Game Theory Model of Humans Interacting Over Control Systems”, IEEE Transactions on Smart Grid, 4(4), pp.2320-2327, 2013

Proceedings

  • Lee, R., Jha, S., Mavridou, A., Giannakoupoulou, D., “Proc. 12th International NASA Formal Methods Symposium”, Lecture Notes in Computer Science, 12229, Springer, 2020

Book Chapters

  • Lee, R., Mengshoel, O.J., Kochenderfer, M.J., “Adaptive Stress Testing of Safety-Critical Systems”, Safe, Autonomous, and Intelligent Vehicles, Unmanned Systems Technology, pp.77-95, Springer, 2019
  • Lee, R., Wolpert, D.H., Bono, J., Backhaus, S., Bent, R., Tracey, B., “Counter-Factual Reinforcement Learning: How to Model Decision-Makers That Anticipate the Future”, Decision Making and Imperfection, 474(4), pp.101-128, Springer, 2013
  • Lee, R., Wolpert, D.H., “Game Theoretic Modeling of Pilot Behavior During Mid-Air Encounters”, Intelligent Systems Reference Library, 28(4), pp.75-111, Springer, 2012

Theses

  • Lee, R., “AdaStress: Adaptive Stress Testing and Interpretable Categorization for Safety-Critical Systems”, Carnegie Mellon University, 2019

Workshops

  • Agogino, A.K., Lee, R., Giannakopoulou, D., “Challenges of Explaining Real-Time Planning”, ICAPS Workshop on Explainable Planning, 2019
  • Agogino, A., Iscen, A., Lee, R., Bowers, D., Tumer, K., Brat, G.P., “Scalable Hierarchical Multifidelity Simulation and Multiagent Optimization of Air Traffic”, AAMAS Workshop on Massive Multiagent Systems, 2015
  • Lee, R., Backhaus, S., Bono, J., Wolpert, D.H., Bent, R., Tracey, B., “Modeling Humans as Reinforcement Learners: How to Predict Human Behavior in Multi-Stage Games”, NIPS Workshop on Decision Making with Multiple Imperfect Decision Makers, 2011
  • Lee, R., Wolpert, D.H., “Game Theoretic Modeling of Human Behavior in Mid-Air Encounters”, NIPS Workshop on Decision Making with Multiple Imperfect Decision Makers, 2010

Reports

  • Lee, R., Agogino, A., Giannakopoulou, D., “Algorithms and Tools for Model-Based V&V of Autonomy Software”, NASA, 2017
  • Phelps, G., Ippolito, C., Lee, R., Spritzer, J., Yeh, Y.H., “Investigations into Near-Real-Time Surveying for Geophysical Data Collection Using an Autonomous Ground Vehicle” U.S. Geological Survey, 2014

Course Projects

  • Lee, R., Rajabi, M., “Assessing NuPIC and CLA in a Machine Learning Context using NASA Aviation Datasets”, Carnegie Mellon University EE18799-SV, 2014
  • Lee, R., Shen, L., “System Identification of a Cessna 182 Model UAV”, Stanford University CS229, 2007