• Home
• Research
• Publications
• Teaching
• Group

Ph.D. Dissertation:

• Sinapov, J. "Behavior-grounded multi-sensory object perception and exploration by a humanoid robot,", Ph.D. Dissertation, Department of Computer Science & Human-Computer Interaction Program, Iowa State University, Ames, IA, December 2013.

Refereed Journal / Conference / Workshop Papers:

2021:

• Gizzi, E., Hassan, A., Lin, W., Rhea, K., and Sinapov, J. (2021)
  Toward Creative Problem Solving Agents: Action Discovery through Behavior Babbling
  In proceedings of the IEEE International Conference on Development and Learning (ICDL), Beijing, China, August 23-26, 2021. [PDF]


• Gizzi, E., Guaman, M., Lin, W., Sinapov, J. (2021)
  A Framework for Creative Problem Solving Through Action Discovery
  In Proceedings of RSS 2021 Workshop on Declarative and Neurosymbolic Representations in Robot Learning and Control [PDF] [VIDEO]


• Zhang, X., Sinapov, J.,and Zhang, S. (2021)
  Planning Multimodal Exploratory Actions for Online Robot Attribute Learning
  In proceedings of Robotics: Science and Systems (RSS), July 12-16, 2021. [Preprint PDF] [Code and Data]


• Hosseini, R., Chen, X., Panetta, K., and Sinapov, J. (2021)
  A Framework for Multisensory Foresight for Embodied Agents
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, May 30-June 5, 2021. [Preprint PDF]


• Goel, S., Tatiya, G., Scheutz, M., and Sinapov, J., (2021)
  NovelGridworlds: A Benchmark Environment for Detecting and Adapting to Novelties in Open Worlds
  In proceedings of the 2021 AAMAS Workshop on Adaptive Learning Agents (ALA) [PDF] [Video]


• Sarathy, V., Kasenberg, D., Goel, S., Sinapov, J., and Scheutz, M. (2021)
  SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learning
  In proceedings of the 2021 ACM Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) [PDF]


• Muhammad, F., Sarathy, V., Tatiya, G., Gyawali, S., Goel, S., Guaman, M., Sinapov, J. and Scheutz, M. (2021)
  A Novelty-Centric Agent Architecture for Changing Worlds
  In proceedings of the 2021 ACM Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) [PDF]


• Zhang, Z., Willner-Giwerc, S., Sinapov, J., Cross, J., and Rogers, C. (2021)
  An Interactive Robot Platform for Introducing Reinforcement Learning to K-12 Students
  In proceedings of the International Conference on Robotics in Education (RiE), Apr 28-30, 2021. [PDF]


• Cleaver, A., Tang, D., Chen, V., Short, E., and Sinapov, J. (2021)
  Dynamic Path Visualization for Human-Robot Collaboration
  Late-Breaking Report in Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction [PDF]

2020:

• Cleaver, A., Tang, D., Chen, V., and Sinapov, J. (2020)
  HAVEN: A Unity-based Virtual Robot Environment to Showcase HRI-based Augmented Reality
  In Proceedings of the 2020 AAAI Fall Symposium "Artificial Intelligence for Human-Robot Interaction" [PDF]


• Cleaver, A., Muhammad, F., Hassan, A., Short, E., and and Sinapov, J. (2020)
  SENSAR: A Visual Tool for Intelligent Robots for Collaborative Human-Robot Interaction
  In Proceedings of the 2020 AAAI Fall Symposium "Artificial Intelligence for Human-Robot Interaction" [PDF]


• Tatiya, G., Shukla, Y., Edegware, M., and Sinapov, J. (2020)
  Haptic Knowledge Transfer Between Heterogeneous Robots using Kernel Manifold Alignment
  In proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) [PDF]


• Tatiya, G., Hosseini, R., Hughes, M., and Sinapov, J. (2020)
  A Framework for Sensorimotor Cross-Perception and Cross-Behavior Knowledge Transfer for Object Categorization
  Frontiers in Robotics and AI, Vol. 7., special issue titled ``ViTac: Integrating Vision and Touch for Multimodal and Cross-Modal Perception'', 2020 [LINK] [BIB]


• Narvekar, S., Peng, B., Leonetti, M., Sinapov, J., Taylor, M. E., and Stone, P. (2020)
  Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey
  Journal of Machine Learning Research, 21(181):1−50, 2020 [PDF] [BIB]


• Gizzi, E., Nair, L., Sinapov, J., and Chernova, S. (2020)
  From Computational Creativity to Creative Problem Solving Agents
  In proceedings of the 2020 International Conference on Computational Creativity (ICCC) [PDF]


• Cleaver, A., Short, E., and Sinapov, J. (2020)
  RAIN: A Vision Calibration Tool using Augmented Reality
  In proceedings of the 3rd International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), March, 2020 [PDF]


• Thomason, J., Padmakumar, A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P. and Mooney, R.J. (2020)
  Jointly improving parsing and perception for natural language commands through human-robot dialog
  Journal of Artificial Intelligence Research 67 (2020) [PDF] [VIDEO]

2019:

• Tatiya, G., Hosseini, R., Hughes, M., and Sinapov, J. (2019)
  Sensorimotor Cross-Behavior Knowledge Transfer for Grounded Category Recognition
  In proceedings of the Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Oslo, Norway, Aug. 19-22, 2019. [PDF] [BIB] [DATASET]


• Gizzi, E., Guaman, M., and Sinapov, J. (2019)
  Creative Problem Solving by Robots Using Action Primitive Discovery
  In proceedings of the Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Oslo, Norway, Aug. 19-22, 2019. [PDF] [BIB]


• Tatiya, G., and Sinapov, J. (2019)
  Deep Multi-Sensory Object Category Recognition Using Interactive Behavioral Exploration
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 20-24, 2019. [PDF] [BIB] [DATASET]


• Tatiya, G., and Sinapov, J. (2019)
  Sensorimotor Cross-Perception Knowledge Transfer for Grounded Category Recognition
  In proceedings of the ICRA 2019 Workshop: Integrating Vision and Touch for Multimodal and Cross-modal Perception (ViTac), Montreal, Canada, May 23, 2019. [PDF] [BIB] [DATASET]


• Thomason, J., Padmakumar, A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P., and Mooney, R. (2019)
  Improving Grounded Natural Language Understanding through Human-Robot Dialog
  In proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 20-24, 2019.


• Muhammad, F., Hassan, A., Cleaver, A., and Sinapov, J. (2019)
  Creating a Shared Reality with Robots
  In Late-Breaking Reports Track at the 14th ACM/IEEE Annual Conference on Human-Robot Interaction, Daego, Korea, Mar. 11-14, 2019. [PDF] [VIDEOS] [BIB]

2018:

• Hart, J., Yedidsion, H., Jiang, Y., Walker, N., Shah, R., Thomason, J., Padmakumar, A., Fernandez, R., Sinapov, J., Mooney, R., and Stone, P. (2018)
  Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence
  In proceedings of the 2018 AAAI Fall Symposium "Interactive Learning in Artificial Intelligence for Human-Robot Interaction", Arlington, Virginia USA, October 18-20, 2018. [PDF]
  


• Fernandez, R., John, N., Kirmani, S., Hart, J., Sinapov, J., and Stone, P. (2018)
  Passive Demonstrations of Light-Based Robot Signals for Improved Human Interpretability
  In proceedings of the 2018 IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Nanjing, China, Aug. 27-31, 2018. [PDF]
  


• Gizzi, E., Le Vie, L., Scheutz, M., Sarathy, V., Sinapov, J. (2018)
  Knowledge Acquisition in the Cockpit Using One-Shot Learning
  In proceedings of the 2018 IEEE National Aerospace and Electronics Conference (NAECON), Dayton, OH, Jul. 23-26, 2018. [PDF]
  


• Amiri, S., Wei, S., Zhang, S., Sinapov, J., Thomason, J., and Stone, P. (2018)
  Multi-modal Predicate Identification using Dynamically Learned Robot Controllers
  In proceedings of the 2018 International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, Sweden, Jul. 13-19, 2018. [PDF]
  


• Gizzi, E., Le Vie, L., Scheutz, M., Sarathy, V., Sinapov, J. (2018)
  A Generalized Framework for Detecting Anomalies in Real-Time Using Contextual Information
  In proceedings of the 2018 Workshop on Modeling and Reasoning in Context (MRC) co-located with IJCAI, Stockholm, Sweden, Jul. 13, 2018. [PDF]
  


• Thomason, J., Padmakumar A., Sinapov, J., Walker, N., Jiang, Y., Yedidsion, H., Hart, J., Stone, P., and Mooney, R.J. (2018)
  Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog
  In proceedings of the RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18), Pittsburgh, PA, Jun. 29-30, 2018. [PDF] [VIDEO]
  


• Amiri, S., Wei, S., Zhang, S., Sinapov, J., Thomason, J., and Stone, P. (2018)
  Robot Behavioral Exploration and Multi-modal Perception using Dynamically Constructed Controllers
  In proceedings of the AAAI Spring Symposium on Integrating Representation, Reasoning, Learning, and Execution for Goal Directed Autonomy, Stanford, CA, Mar. 26-28, 2018. [PDF]
  


• Cheli, M., Sinapov, J., Danahy, E., Rogers, C. (2018)
  Towards an Augmented Reality Framework for K-12 Robotics Education
  In proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interactions (VAM-HRI), Chicago, IL, Mar. 5, 2018. [PDF] [BIB]
  


• Thomason, J., Sinapov, J., Stone, P., and Mooney, R. (2018)
  Guiding Exploratory Behaviors for Multi-Modal Grounding of Linguistic Descriptions
  In proceedings of the 32nd Conference of the Association for the Advancement of Artificial Intelligence (AAAI), New Orleans, LA, Feb. 2-7, 2018. [PDF] [BIB]

2017:

• Thomason, J., Padmakumar, A., Sinapov, J., Hart, J., Stone, P., and Mooney, R. (2017)
  Opportunistic Active Learning for Grounding Natural Language Descriptions
  In proceedings of the 1st Annual Conference on Robot Learning (CoRL 2017), Mountain View, California, November 13-15, 2017. [PDF] [BIB]


• Narvekar, S., Sinapov, J., and Stone, P. (2017)
  Autonomous Task Sequencing for Customized Curriculum Design in Reinforcement Learning
  In proceedings of the 2017 International Joint Conference on Artificial Intelligence (IJCAI), Melbourne, Australia, August 19-25, 2017. [PDF] [BIB]


• Thomason, J., Sinapov, J., and Mooney, R. (2017)
  Guiding Interaction Behaviors for Multi-modal Grounded Language Learning
  In proceedings of the 1st Workshop on Language Grounding for Robotics at ACL, Vancouver, Canada, August 3, 2017. [PDF] [BIB]


• Gonzalez, S., Chidambaram, V., Sinapov, J., and Stone, P. (2017)
  CC-Log: Drastically Reducing Storage Requirements for Robots Using Classification and Compression
  In proceedings of The 9th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage '17), Santa Clara, CA, July 10-11, 2017. [PDF] [BIB]


• Zhang, S., Sinapov, J., Wei, S., and Stone, P. (2017)
  Robot Behavioral Exploration and Multimodal Perception using POMDPs
  In proceedings of the AAAI Spring Symposium on "Interactive Multi-Sensory Object Perception for Embodied Agents", San Francisco, CA, March 27-29, 2017. [PDF] [BIB]
  


• Svetlik, M., Leonetti, M., Sinapov, J., Shah, R., Walker, N., and Stone, P. (2017)
  Automatic Curriculum Graph Generation for Reinforcement Learning Agents
  In proceedings of the 31st Conference of the Association for the Advancement of Artificial Intelligence (AAAI), San Francisco, CA, Feb. 4-9, 2017. [PDF] [BIB]
  


• Khandelwal, P., Zhang, S., Sinapov, J., Leonetti, M., Thomason, J., Yang, F., Gori, I., Svetlik, M., Khante, P., Lifschitz, V., Aggarwal, J.K., Mooney, R., and Stone, P. (2017)
BWIBots: A platform for bridging the gap between AI and Human-Robot Interaction research
International Journal of Robotics Research, Vol. 36, No.5-7, pp. 635-659, 2017. [Link] [PDF] [BIB]

2016:

• Sinapov, J., Khante, P., Svetlik, M., and Stone, P. (2016)
  Learning to Order Objects using Haptic and Proprioceptive Exploratory Behaviors
  In proceedings of the 2016 International Joint Conference on Artificial Intelligence (IJCAI) [PDF] [Slides] [BIB]


• Thomason, J., Sinapov, J., Svetlik, M., Stone, P., and Mooney, R. (2016)
  Learning Multi-Modal Grounded Linguistic Semantics by Playing I, Spy
  In proceedings of the 2016 International Joint Conference on Artificial Intelligence (IJCAI) [PDF] [BIB]


• Narvekar, S., Sinapov, J., Leonetti, M. and Stone, P. (2016)
  Source Task Creation for Curriculum Learning
  In proceedings of the 2016 ACM Conference on Autonomous Agents and Multi-Agent Systems (AAMAS) [PDF] [BIB]

2015:

• Sinapov, J., Narvekar, S., Leonetti, M. and Stone, P. (2015)
  Learning Inter-Task Transferability in the Absence of Target Task Samples
  In proceedings of the 2015 ACM Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), Istanbul, Turkey, May 4-8, 2015. [PDF] [BIB]


• Gori, I., Sinapov, J., Khante, P. and Stone, P. (2015)
  Robot-Centric Activity Recognition 'in the Wild'
  In proceedings of the 7th International Conference on Social Robotics (ICSR), Paris, France, Oct. 26-30, 2015. [PDF] [Slides] [BIB]


• Blessing, S.B., Devasani, S., Gilbert, S.B., and Sinapov, J. (2015)
  Using ConceptGrid as an easy authoring technique to check natural language responses
  International Journal of Learning Technology, Vol. 10, No. 1, pp. 50-70, January, 2015. [Link] [PDF] [BIB]

2014:

• Schenck, C., Sinapov, J., Johnston, J., and Stoytchev, A. (2014)
  Which Object Fits Best? Solving Matrix Completion Tasks with a Humanoid Robot
  IEEE Transactions on Autonomous Mental Development, Vol 6, No 3, pp. 226-240, September 2014.[Link] [PDF] [BIB]


• Hoffmann, H., Chen, Z., Earl, D., Mitchell, D., Salemi, B., and Sinapov, J. (2014)
  Adaptive Robotic Tool Use Under Variable Grasps
  Robotics and Autonomous Systems, Vol. 62, No. 6, pp. 833-846, June 2014. [Link] [PDF] [BIB]


• Sinapov, J., Schenck, C., Staley, K., Sukhoy, V., and Stoytchev, A. (2014)
  Grounding Semantic Categories in Behavioral Interactions: Experiments with 100 Objects.
  Robotics and Autonomous Systems, Vol. 62, No. 5, pp. 632-645, May 2014. [Link] [PDF] [BIB]


• Sinapov, J., Schenck, C., and Stoytchev, A. (2014).
  Learning Relational Object Categories Using Behavioral Exploration and Multimodal Perception
  In the Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA, Hong Kong, China, May 31-June 7, 2014. [PDF] [BIB]

2013:

• Sinapov, J., Earl, D., Mitchell, D., and Hoffmann, H. (2013).
  Interactive Audio-Tactile Annotation of 3D Point Clouds for Robotic Manipulation
  Presented at the 2013 ICRA Workshop on Mobile Manipulation: Interactive Perception, Karlsruhe, Germany, May 6, 2013. [PDF] [Extended Version PDF] [BIB]


• Sinapov, J., and Stoytchev, A. (2013).
  Grounded Object Individuation by a Humanoid Robot
  Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany, May 6-10, 2013. [PDF] [BIB]

2012:

• Schenck, C., Sinapov, J., and Stoytchev, A. (2012)
  Which Object Comes Next? Grounded Order Completion by a Humanoid Robot
  Journal of Cybernetics and Information Technologies, Vol. 12, No. 3, pp. 5-16, September 2012. [PDF] [BIB]


• Griffith, S., Sinapov, J., Sukhoy, V., and Stoytchev, A. (2012)
  A Behavior-Grounded Approach to Forming Object Categories: Separating Containers from Non-Containers
  IEEE Transactions on Autonomous Mental Development, Vol. 4, No. 1, pp. 54-69, March 2012. [Link] [PDF] [BIB]

2011:

• Sinapov, J., Bergquist, T., Schenck, C., Ohiri, U., Griffith, S., and Stoytchev, A. (2011)
  Interactive Object Recognition Using Proprioceptive and Auditory Feedback
  International Journal of Robotics Research, Vol. 30, No. 10, pp. 1250-1262, September 2011. [Link] [PDF] [BIB]


• Sinapov, J., Sukhoy, V., Sahai, R., and Stoytchev, A. (2011).
  Vibrotactile Recognition and Categorization of Surfaces by a Humanoid Robot
  IEEE Transactions on Robotics, Vol. 27, No. 3, pp. 488-497, June 2011. [Link] [PDF] [BIB]


• Sinapov, J., and Stoytchev, A. (2011).
  Object Category Recognition by a Humanoid Robot Using Behavior-Grounded Relational Learning
  Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 9-13, 2011. [PDF] [BIB]

2010:

• Sinapov, J., and Stoytchev, A. (2010).
  The Odd-One-Out Task: Towards an Intelligence Test for Robots
  In proceedings of the 9th IEEE International Conference on Development and Learning (ICDL),Ann Arbor, Michigan, August 18-21, pp. 126-131, 2010.
  (Best Student Paper Award) [PDF] [Link] [BIB]


• Sukhoy, V., Sinapov, J., Wu, L., and Stoytchev, A. (2010).
  Learning to Press Doorbell Buttons
  In proceedings of the 9th IEEE International Conference on Development and Learning (ICDL),Ann Arbor, Michigan, August 18-21, pp. 132-138, 2010. [PDF] [BIB]


• Sinapov, J., and Stoytchev, A. (2010).
  The Boosting Effect of Exploratory Behaviors
  In Proceedings of the 24-th National Conference on Artificial Intelligence (AAAI), Atlanta, GA, July 11-15, pp. 1613-1618, 2010. [PDF] [Link] [BIB]


• Griffith, S., Sinapov, J., Sukhoy, V., and Stoytchev, A. (2010).
  How to Separate Containers from Non-Containers? A Behavior-Grounded Approached to Acoustic Object Categorization
  In proceedings of the 2010 IEEE International Conference on Robotics and Automation (ICRA). [PDF] [BIB]

2009:

• Caragea, C., Sinapov, J., Dobbs, D., Honavar, V. (2009).
  Mixture of experts models to exploit global sequence similarity on biomolecular sequence labeling
  BMC Bioinformatics, 2009 10:S4 [Link]


• Sinapov, J., Wiemer, M., and Stoytchev, A. (2009).
  Interactive Learning of the Acoustic Properties of Household Objects
  In proceedings of the 2009 IEEE International Conference on Robotics and Automation (ICRA). [PDF] [Link] [BIB]


• Griffith, S., Sinapov, J., Miller, M., and Stoytchev, A. (2009).
  Toward Interactive Learning of Object Categories by a Robot: A case study with container and non-container objects
  In proceedings of the IEEE International Conference on Development and Learning (ICDL 2009) [PDF] [Link] [BIB]


• Sukhoy, V., Sahai, R., Sinapov, J., and Stoytchev, A. (2009).
  Vibrotactile Recognition of Surface Textures by a Humanoid Robot
  In proceedings of the 2009 Humanoids Workshop: Tactile Sensing in Humanoids Tactile Sensors and Beyond [PDF]


• Bergquist, T., Schenck, C., Ohiri, U., Sinapov, J., Griffith, S., and Stoytchev, A. (2009).
  Interactive Object Recognition Using Proprioceptive Feedback
  In proceedings of the 2009 IROS Workshop: Semantic Perception for Mobile Manipulation [PDF] [BIB]


• Sinapov, J., and Stoytchev, A. (2009).
  From Acoustic Object Recognition to Object Categorization by a Humanoid Robot
  In proceedings of the "Mobile Manipulation" workshop held at the Robotics Science and System Conference, 2009. [PDF] [BIB]

2008:

• Sinapov, J., Stoytchev, A. (2008).
  Detecting the Functional Similarities Between Tools Using a Hierarchical Representation of Outcomes
  In proceedings of the IEEE International Conference on Development and Learning (ICDL 2008) [PDF] [Link] [BIB]


• Sinapov, J., Stoytchev, A. (2008).
  Toward Autonomous Learning of an Ontology of Tool Affordances by a Robot
  In the proceedings of the Student Abstract/Poster Session at AAAI, 2008 [PDF]


• Caragea, C., Sinapov, J., Dobbs, D., Honavar, V. (2008).
  Using Global Sequence Similarity to Enhance Biological Sequence Labeling
  In proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2008) [Link]


• Caragea, C., Terribilini, M., Sinapov, J., Lee, J. H., Towfic, F., Dobbs, D., and Honavar, V. (2008).
  Predicting Protein-RNA Binding Sites Using Structural Information.
  Presented at the 2008 International Conference on Intelligent Systems for Molecular Biology. [Link]


• Sinapov, J., Caragea, C., Dobbs, D., & Honavar, V. (2008).
  Using Global Sequence Similarity Improves Biological Site-Specific Classifiers.
  Presented at the 2008 International Conference on Intelligent Systems for Molecular Biology (ISMB 2008). [PDF]


• Sinapov, J., Wiemer, M., and Stoytchev, A. (2008).
  Interactive Learning of the Acoustic Properties of Objects by a Robot
  In proceedings of the "Robot Manipulation: Intelligence in Human Environments" workshop held at the Robotics Science and System Conference, 2008. [PDF]

2007:

• Caragea, C., Sinapov, J., Silvescu, A., Dobbs, D., Honavar, V. (2007).
  Glycosylation Site Prediction Using Ensembles of Support Vector Machine Classifiers
  BMC Bioinformatics, 2007 8:438 [Link] [BIB]


• Sinapov, J., Stoytchev, A. (2007).
  Learning and Generalization of Behavior-Grounded Tool Affordances
  In proceedings of the IEEE International Conference on Development and Learning (ICDL 2007) [PDF] [Link] [BIB]


• Sinapov, J., Stoytchev, A. (2007).
  Learning Behavior-Grounded Tool Affordances with Generalization Accross Different Tools
  In proceedings of the Workshop on Robot Manipulation at the Robotics Science and Systems Conference (RSS 2007). [PDF]


• Caragea, C., Sinapov, J., Dobbs, D., Honavar, V. (2007).
  Assessing the Performance of Macromolecular Sequence Classifiers
  In proceedings of the IEEE International Symposium on Bioinformatics and Bioengineering (BIBE 2007) [PDF]