Publications

2020

Krishnaswamy, N. and Pustejovsky, J. (2020). Neurosymbolic AI for Situated Language Understanding. In Annual Conference on Advances in Cognitive Systems (ACS). Cognitive Systems Foundation. [pdf] [slides] [video]

Krishnaswamy, N. and Pustejovsky, J. (2020). A Formal Analysis of Multimodal Referring Expressions Under Common Ground. In International Conference on Language Resources and Evaluation (LREC). ACL. [pdf]

Krishnaswamy, N., Narayana, P., Bangar, R., Rim, K., Patil, D., McNeely-White, D., Ruiz, J., Draper, B., Beveridge, R., and Pustejovsky, J. (2020). Diana’s World: A Situated Multimodal Interactive Agent. In AAAI Conference on Artificial Intelligence (AAAI): Demos Program. AAAI. [pdf] [poster]

Pustejovsky, J. and Krishnaswamy, N. (2020). Embodied Human-Computer Interactions through Situated Grounding. In *International Conference on Intelligent Virtual Agents (IVA). ACM.

Hutchens, M., Krishnaswamy, N., Cochran, B., and Pustejovsky, J. (2020). Jarvis: A Multimodal Visualization Tool for Bioinformatic Data. In International Conference on Human-Computer Interaction (HCII): Late-Breaking Papers. Springer. [pdf] [slides]

Krajovic, K., Krishnaswamy, N., Dimick, N. J., Salas, R. P., and Pustejovsky, J. (2020). Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment. In Special Session on Situated Dialogue with Virtual Agents and Robots (RoboDIAL): Late-Breaking Papers. Non-archival. [pdf] [video]

2019

Krishnaswamy, N. and Pustejovsky, J. (2019). Generating a Novel Dataset of Multimodal Referring Expressions. In International Workshop on Computational Semantics (IWCS). ACL. [pdf] [poster] [supplementary panel]

Krishnaswamy, N., Friedman, S., and Pustejovsky, J. (2019). Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise. In AAAI Conference on Artificial Intelligence (AAAI). AAAI. [pdf] [poster] [slide deck]

Krishnaswamy, N. and Pustejovsky, J. (2019). Situated Grounding Facilitates Multimodal Concept Learning for AI. In Visually Grounded Interaction and Language Workshop (ViGIL). Neural Information Processing Systems Foundation. [pdf] [poster]

Krishnaswamy, N. and Pustejovsky, J. (2019). Multimodal Continuation-style Architectures for Human-Robot Interaction. In Workshop on Cognitive Vision: Integrated Vision and AI for Embodied Perception and Interaction. Cognitive Systems Foundation. [pdf] [slide deck]

Pustejovsky, J. and Krishnaswamy, N. (2019). Situational Grounding within Multimodal Simulations. In AAAI Workshop on Games and Simulations in AI (GameSim). AAAI. [pdf] [poster]

McNeely-White, D., Ortega, F., Beveridge, R., Draper, B., Bangar, R., Patil, D., , Pustejovsky, J., Krishnaswamy, N., Rim, K., Ruiz, J., and Wang, I. (2019). User-Aware Shared Perception for Embodied Agents] In International Conference on Humanized Computing and Communication (HCC). IEEE. [pdf]

2018

Krishnaswamy, N. and Pustejovsky, J. (2018). Deictic Adaptation in a Virtual Environment. In Spatial Cognition XI: International Conference on Spatial Cognition. Springer. [pdf] [slide deck]

Krishnaswamy, N. and Pustejovsky, J. (2018). An Evaluation Framework for Multimodal Interaction. In International Conference on Language Resources and Evaluation (LREC). ACL. [pdf] [poster]

Krishnaswamy, N., Do, T., and Pustejovsky, J. (2018). Learning Actions from Events Using Agent Motions. In Workshop on Annotation, Recognition and Evaluation of Actions (AREA). ACL. [pdf] [poster]

Pustejovsky, J. and Krishnaswamy, N. (2018). The Role of Event Simulation in Spatial Cognition. In Workshop on Models and Representations in Spatial Cognition (MRSC). Springer. [pdf]

Pustejovsky, J. and Krishnaswamy, N. (2018). Every Object Tells a Story. In Workshop on Events and Stories in the News (EventStory). ACL. [pdf]

Narayana, P., Krishnaswamy, N., Wang, I., Bangar, R., Patil, D., Mulay, G., Rim, K., Beveridge, R., Ruiz, J., Pustejovsky, J., and Draper, B. (2018). Cooperating with Avatars Through Gesture, Language and Action. IEEE. In Intelligent Systems Conference (IntelliSys). [pdf]

Do, T., Krishnaswamy, N., Rim, K., and Pustejovsky, J. (2018). Multimodal Interactive Learning of Primitive Actions. In AAAI Fall Symposium: Artificial Intelligence for Human-Robot Interaction. AAAI. [pdf]

Do, T., Krishnaswamy, N., and Pustejovsky, J. (2018). Teaching Virtual Agents to Perform Complex Spatial-Temporal Activities. In AAAI Spring Symposium: Integrating Representation, Reasoning, Learning, and Execution for Goal Directed Autonomy. AAAI. [pdf]

2017

Krishnaswamy, N. (2017). Monte-Carlo Simulation Generation Through Operationalizaition of Spatial Primitives. Doctoral dissertation, Brandeis University. ProQuest. [pdf]

Krishnaswamy, N., Narayana, P., Wang, I., Rim, K., Bangar, R., Patil, D., Mulay, G., Ruiz, J., Beveridge, R., Draper, B., and Pustejovsky, J. (2017). Communicating and Acting: Understanding Gesture in Simulation Semantics. In International Workshop on Computational Semantics (IWCS). ACL. [pdf]

Krishnaswamy, N. and Pustejovsky, J. (2017). Do You See What I See? Effects of POV on Spatial Relation Specifications. In International Workshop on Qualitative Reasoning (QR). AAAI/International Joint Conferences on Artificial Intelligence. [pdf] [slide deck]

Pustejovsky, J., Krishnaswamy, N., Draper, B., Narayana, P., and Bangar, R. (2017). Creating Common Ground Through Multimodal Simulations. In Workshop on Foundations of Situated and Multimodal Communication (FSMC). ACL. [pdf]

Pustejovsky, J., Krishnaswamy, N., and Do, T. (2017). Object Embodiment in a Multimodal Simulation. In AAAI Spring Symposium: Interactive Multisensory Object Perception for Embodied Agents. AAAI. [pdf] [poster]

2016

Krishnaswamy, N. and Pustejovsky, J. (2016). Multimodal Semantic Simulations of Linguistically Underspecified Motion Events. In Spatial Cognition X: International Conference on Spatial Cognition. Springer. [pdf] [slide deck]

Krishnaswamy, N. and Pustejovsky, J. (2016). VoxSim: A Visual Platform for Modeling Motion Language. In International Conference on Computational Linguistics (COLING): Technical Papers. ACL. [pdf]

Pustejovsky, J., Krishnaswamy, N., Do, T., and Kehat, G. (2016). The Development of Multimodal Lexical Resources. In Workshop on Grammar and the Lexicon (GramLex). ACL. [pdf]

Pustejovsky, J. and Krishnaswamy, N. (2016). Visualizing Events: Simulating Meaning in Language. In Annual Meeting of the Cognitive Science Society (CogSci). Cognitive Science Society. [pdf]

Pustejovsky, J. and Krishnaswamy, N. (2016). VoxML: A Visualization Modeling Language. In International Conference on Language Resources and Evaluation (LREC). ACL. [pdf]

Do, T., Krishnaswamy, N., and Pustejovsky, J. (2016). ECAT: Event Capture Annotation Tool. In International Workshop on Semantic Annotation (ISA). ACL. [pdf]

< 2016

Pustejovsky, J. and Krishnaswamy, N. (2014). Generating Simulations of Motion Events from Verbal Descriptions. In Lexical and Computational Semantics (*SEM). ACL. [pdf]

Krishnaswamy, N. (2013). The Features of Spatial Aspect: Examining the Inherent Semantics of Space in English Verbs. Master’s thesis, Brandeis University. ProQuest. [pdf]

Krishnaswamy, N. (2009). Comparison of Efficiency in Pathfinding Algorithms in Game Development. Senior Honor’s thesis, DePaul University (published as Technical Report). [pdf]