Research

From household robots to AI assistants, intelligent systems that operate in the real world must learn continually from the people they serve. My research asks the question: how can robots learn effectively from human partners when feedback is sparse, imperfect, and constantly evolving? To address this challenge, I develop algorithms that enable robots to assess their own uncertainty, recognize when they are misaligned with human goals, and determine when to seek assistance. I study (1) how robots can estimate uncertainty and detect failure in black-box robot policies, (2) how robots can detect misalignment with human intent, and (3) how robots can actively solicit corrective feedback, while (4) designing interaction mechanisms that make intervention and learning more intuitive for human teachers.

Research overview, figure 1

Robots should be able to ongoingly receive human specification, detect when their learned policies fail, reason about when and why human input is needed, incorporate demonstrations and corrections into future behavior, and adapt to evolving human preferences over time.

Research overview, figure 2
Continual co-learning loop between a robot learner and a human partner.