Publications

2020

Krishnaswamy, N. and Pustejovsky, J. (2020). Neurosymbolic AI for Situated Language Understanding. In Annual Conference on Advances in Cognitive Systems (ACS). Cognitive Systems Foundation.

Krishnaswamy, N. and Pustejovsky, J. (2020). A Formal Analysis of Multimodal Referring Expressions Under Common Ground. In International Conference on Language Resources and Evaluation (LREC). ACL. [pdf]

Krishnaswamy, N., Narayana, P., Bangar, R., Rim, K., Patil, D., McNeely-White, D., Ruiz, J., Draper, B., Beveridge, R., and Pustejovsky, J. (2020). Diana’s World: A Situated Multimodal Interactive Agent. In AAAI Conference on Artificial Intelligence (AAAI): Demos Program. AAAI. [pdf] [poster]

Hutchens, M., Krishnaswamy, N., Cochran, B., and Pustejovsky, J. (2020). Jarvis: A Multimodal Visualization Tool for Bioinformatic Data. In International Conference on Human-Computer Interaction (HCII): Late-Breaking Papers. Springer. [pdf]

Krajovic, K., Krishnaswamy, N., Dimick, N. J., Salas, R. P., and Pustejovsky, J. (2020). Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment. In Special Session on Situated Dialogue with Virtual Agents and Robots (RoboDIAL): Late-Breaking Papers. Non-archival. [pdf] [video]

2019

Krishnaswamy, N. and Pustejovsky, J. (2019). Generating a Novel Dataset of Multimodal Referring Expressions. In International Workshop on Computational Semantics (IWCS). ACL. [pdf] [poster] [supplementary panel]

Krishnaswamy, N., Friedman, S., and Pustejovsky, J. (2019). Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise. In AAAI Conference on Artificial Intelligence (AAAI). AAAI. [pdf] [poster] [slide deck]

Krishnaswamy, N. and Pustejovsky, J. (2019). Situated Grounding Facilitates Multimodal Concept Learning for AI. In Visually Grounded Interaction and Language Workshop (ViGIL). Neural Information Processing Systems Foundation. [pdf] [poster]

Krishnaswamy, N. and Pustejovsky, J. (2019). Multimodal Continuation-style Architectures for Human-Robot Interaction. In Workshop on Cognitive Vision: Integrated Vision and AI for Embodied Perception and Interaction. Cognitive Systems Foundation. [pdf] [slide deck]

Pustejovsky, J. and Krishnaswamy, N. (2019). Situational Grounding within Multimodal Simulations. In AAAI Workshop on Games and Simulations in AI (GameSim). AAAI. [pdf] [poster]

McNeely-White, D., Ortega, F., Beveridge, R., Draper, B., Bangar, R., Patil, D., , Pustejovsky, J., Krishnaswamy, N., Rim, K., Ruiz, J., and Wang, I. (2019). User-Aware Shared Perception for Embodied Agents] In International Conference on Humanized Computing and Communication (HCC). IEEE. [pdf]

2018

Krishnaswamy, N. and Pustejovsky, J. (2018). Deictic Adaptation in a Virtual Environment. In Spatial Cognition XI: International Conference on Spatial Cognition. Springer. [pdf] [slide deck]

Krishnaswamy, N. and Pustejovsky, J. (2018). An Evaluation Framework for Multimodal Interaction. In International Conference on Language Resources and Evaluation (LREC). ACL. [pdf] [poster]

Krishnaswamy, N., Do, T., and Pustejovsky, J. (2018). Learning Actions from Events Using Agent Motions. In Workshop on Annotation, Recognition and Evaluation of Actions (AREA). ACL. [pdf] [poster]

Pustejovsky, J. and Krishnaswamy, N. (2018). The Role of Event Simulation in Spatial Cognition. In Workshop on Models and Representations in Spatial Cognition (MRSC). Springer. [pdf]

Pustejovsky, J. and Krishnaswamy, N. (2018). Every Object Tells a Story. In Workshop on Events and Stories in the News (EventStory). ACL. [pdf]

Narayana, P., Krishnaswamy, N., Wang, I., Bangar, R., Patil, D., Mulay, G., Rim, K., Beveridge, R., Ruiz, J., Pustejovsky, J., and Draper, B. (2018). Cooperating with Avatars Through Gesture, Language and Action. IEEE. In Intelligent Systems Conference (IntelliSys). [pdf]

Do, T., Krishnaswamy, N., Rim, K., and Pustejovsky, J. (2018). Multimodal Interactive Learning of Primitive Actions. In AAAI Fall Symposium: Artificial Intelligence for Human-Robot Interaction. AAAI. [pdf]

Do, T., Krishnaswamy, N., and Pustejovsky, J. (2018). Teaching Virtual Agents to Perform Complex Spatial-Temporal Activities. In AAAI Spring Symposium: Integrating Representation, Reasoning, Learning, and Execution for Goal Directed Autonomy. AAAI. [pdf]

2017

Krishnaswamy, N. (2017). Monte-Carlo Simulation Generation Through Operationalizaition of Spatial Primitives. Doctoral dissertation, Brandeis University. ProQuest. [pdf]

Krishnaswamy, N., Narayana, P., Wang, I., Rim, K., Bangar, R., Patil, D., Mulay, G., Ruiz, J., Beveridge, R., Draper, B., and Pustejovsky, J. (2017). Communicating and Acting: Understanding Gesture in Simulation Semantics. In International Workshop on Computational Semantics (IWCS). ACL. [pdf]

Krishnaswamy, N. and Pustejovsky, J. (2017). Do You See What I See? Effects of POV on Spatial Relation Specifications. In International Workshop on Qualitative Reasoning (QR). AAAI/International Joint Conferences on Artificial Intelligence. [pdf] [slide deck]

Pustejovsky, J., Krishnaswamy, N., Draper, B., Narayana, P., and Bangar, R. (2017). Creating Common Ground Through Multimodal Simulations. In Workshop on Foundations of Situated and Multimodal Communication (FSMC). ACL. [pdf]

Pustejovsky, J., Krishnaswamy, N., and Do, T. (2017). Object Embodiment in a Multimodal Simulation. In AAAI Spring Symposium: Interactive Multisensory Object Perception for Embodied Agents. AAAI. [pdf] [poster]

2016

Krishnaswamy, N. and Pustejovsky, J. (2016). Multimodal Semantic Simulations of Linguistically Underspecified Motion Events. In Spatial Cognition X: International Conference on Spatial Cognition. Springer. [pdf] [slide deck]

Krishnaswamy, N. and Pustejovsky, J. (2016). VoxSim: A Visual Platform for Modeling Motion Language. In International Conference on Computational Linguistics (COLING): Technical Papers. ACL. [pdf]

Pustejovsky, J., Krishnaswamy, N., Do, T., and Kehat, G. (2016). The Development of Multimodal Lexical Resources. In Workshop on Grammar and the Lexicon (GramLex). ACL. [pdf]

Pustejovsky, J. and Krishnaswamy, N. (2016). Visualizing Events: Simulating Meaning in Language. In Annual Meeting of the Cognitive Science Society (CogSci). Cognitive Science Society. [pdf]

Pustejovsky, J. and Krishnaswamy, N. (2016). VoxML: A Visualization Modeling Language. In International Conference on Language Resources and Evaluation (LREC). ACL. [pdf]

Do, T., Krishnaswamy, N., and Pustejovsky, J. (2016). ECAT: Event Capture Annotation Tool. In International Workshop on Semantic Annotation (ISA). ACL. [pdf]

< 2016

Pustejovsky, J. and Krishnaswamy, N. (2014). Generating Simulations of Motion Events from Verbal Descriptions. In Lexical and Computational Semantics (*SEM). ACL. [pdf]

Krishnaswamy, N. (2013). The Features of Spatial Aspect: Examining the Inherent Semantics of Space in English Verbs. Master’s thesis, Brandeis University. ProQuest. [pdf]

Krishnaswamy, N. (2009). Comparison of Efficiency in Pathfinding Algorithms in Game Development. Senior Honor’s thesis, DePaul University (published as Technical Report). [pdf]