Teaching
NLP for Robotics (Fall, Spring 2022)
-- I taught two semesters of an undergraduate research seminar, "Natural Language Processing for Robotics." Our curriculum was brazenly stolen from based heavily on Stanford's CS224N, but with applications in robotics. My students seemed happy enough, and I didn't make anyone learn the Viterbi algorithm. I received the department's "Outstanding PhD Teacher" award that year.
Projects
ppo_mol (2023) -- De novo generation of small molecules with transformers and reinforcement learning. Work done at Eli Lilly & co.
“The wallpaper is ugly” (2023) -- Indoor localization using vision and language in the Matterport3D environment. Finetuned CLIP using related datasets, collected human validation data.
Publications
-
“The wallpaper is ugly”: Indoor Localization Using Vision and Language (2023)
Presented at RO-MAN 2023 in Seoul. (see above) -
Natural Language for Human-Robot Collaboration: Problems Beyond Language Grounding (2021)
Presented at AI-HRI symposium as part of AAAI-FSS 2021.