Hands-free Human Robot Interaction

ARKit enabled gaze controlled fetching robot
Presented in 2018 UIST
We designed a set of hands-free interactions for human-robot interaction. The fetching robot brings user’s favorite snack when user gives an eye on the snack. We attached iPhone X on an MBlock robot, used ARKit2 to detect gaze.
Gaze Command
Real-world Direction
Fetch Snack