Congratulations to Dhruva Patil and Jason Garcia!

11 April 2022

Congratulations to Dr. Dhruva Patil for defending his Ph.D. dissertation and to Jason Garcia for defending his Master’s thesis!

read more

Cracked 3:10 in the Marathon

26 October 2021

Not work-related. Just very happy to have broken 3:10:00 in the marathon at the Colorado Marathon here in Fort Collins this past Sunday. Everything came together just right—the pace plan, hydration, fueling, the weather—with one small exception of forgetting my headphones at home so I ended up just playing my playlist out loud out of my phone all the way down Poudre Canyon. I threw up afterwards and got a massive blood blister on my toe, but no complaints! With a time of 3:09:15 this is a new personal best by over 2 minutes, and should be enough for guaranteed...

read more

Diana and NSF iSAT on the NYC Local News

01 October 2021

NYC’s FOX 5 channel did a segment on AI in the classroom that focused in part on our Diana system and how we are expanding that expertise into situation-aware, interactive AI agents to help teachers in classrooms. I’m not interviewed directly but the “CSU/Brandeis” work is shown in multiple clips (mostly taken from last year’s AAAI demo video), and my advisor, James Pustejovsky, is interviewed extensively. Unfortunately, the piece doesn’t mention NSF iSAT directly (in fact James mentioned it repeatedly but the mentions were edited out in the final product!), but this is where the work is being applied and...

read more

KI Paper and ESSLLI 2022 Course

21 September 2021

I’m pleased to (finally) have our paper “Embodied Human Computer Interaction” published in KI - Künstliche Intelligenz, the German Journal of Artificial Intelligence, after a drawn-out, um… interaction with the typesetter. I’m also very happy to be co-teaching a week-long course at ESSLLI 2022, the 33rd European Summer School in Language, Logic, and Information, next year in Galway, Ireland, hosted by NUI Galway! The paper can be found here (paywall, I know, sorry, I’ll try to find a way to make it available), and more information about the course will be published as it becomes available. May we be rid...

read more

NLP @ CSU in Fall 2021

10 June 2021

I’m late to announce this since the course was approved months ago, but I’m happy to be teaching CS 542: Natural Language Processing in the Fall 2021 semester. This is, to my knowledge, the first dedicated NLP course to be taught at Colorado State, and interest seems high already. This is a grad-level, technical computer science course that complements offerings in AI, machine learning, and computer vision, but I plan to teach it with a healthy dose of both linguistic theory and application, and critical thinking about NLP technology and its uses in modern society. More information about the course...

read more

Two Workshops at IWCS 2021

10 February 2021

I’m happy to be organizing the First Workshop on Multimodal Semantic Representations (MMSR I), to be co-located with IWCS 2021, online in June! This workshop intends to bring together researchers who aim to capture elements of multimodal interaction such as language, gesture, gaze, and facial expression with formal semantic representations. We provide a space for both theoretical and practical discussion of how linguistic co-modalities support, inform, and align with “meaning” found in the linguistic signal alone. Our website is here (currently undergoing a little bit of final construction).

read more

Best Demo at ICAT-EGVE 2020

08 December 2020

Our demo, Situational Awareness in Human Computer Interaction: Diana’s World has won the best demo award at ICAT-EGVE (International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments), an ACM conference! Our paper is here and our demo video can be viewed here.

read more

Some Grant News

11 September 2020

I’m very pleased to be playing a role in a couple of new NSF grants. One is an NSF EAGER exploratory grant with my advisor/former PI James Pustejovsky at Brandeis University and Josh Hartshorne at Boston College, A Playground and Proposal for Growing an AGI. With support from the Robust Intelligence program at the IIS division at NSF, we are addressing the challege of creating an Artificial General Intelligence by (from the abstract) “synthesizing symbolic or logical reasoning, learning through interaction with the environment, as well as state-of-the-art neural networks. Inspired by the structure of natural (e.g., human) intelligence, the...

read more

Neurosymbolic AI at ACS 2020

10 August 2020

Today I presented a long paper, “Neurosymbolic AI for Situated Language Understanding” at the Advances in Cognitive Systems conference, held virtually and hosted by the Palo Alto Research Center.

read more

Live from Fort Collins

03 August 2020

Should have posted this two days ago, but after leaving Boston on July 27th with my wife, two cats, and one car, and stops in Connecticut, Pittsburgh, Chicago, and Omaha, we finally made it to Fort Collins, CO, and moved into our new home. Shout out to Hex and Bilbo, MVPs of the cross-country drive.

read more

Virtual Conferences Are Weird

02 July 2020

For my last act as a postdoc/first act as a professor, I presented our late-breaking report, Situated Multimodal Control of Mobile Robot: Navigation Through a Virtual Environmment at RoboDIAL: the Special Session on Situated Dialogue with Virtual Agents and Robots at the SigDIAL conference. The conference was originally slated to take place in Boise, Idaho, but due to the COVID-19 pandemic was moved to an all-virtual format. Not knowing what to expect from a virtual conference, this has been a new experience for me, and while it was odd attending a conference via Trello, YouTube, and Zoom, having to record...

read more

Introducing SIGNAL Lab

01 July 2020

Now that I’m officially activated as CSU faculty, it gives me great pleasure to be able to announce my new lab, the Situated Grounding and Natural Language Lab! We tackle questions of language understanding through situatedness and embodiment using machine learning, simulation, and symbolic methods. The lab’s website can be found at SIGNALLab.ai, and updates will be posted both there and here.

read more

Welcome!

17 April 2020

The website has been rebooted. Welcome, and please enjoy the sleek new look as I attempt to subvert expectations for faculty webpages. Although the world may seem to be crumbling at the seams right now, I’m very excited to be joining the computer science faculty at Colorado State this summer, where I hope to build a strong natural language understanding group to complement CSU’s strengths in computer vision, data science, and human-computer interaction. I’m currently looking for students who are interested in computational linguistics, multimodality, and natural language processing, so please feel free to get in touch via the contact...

read more