Hi, I’m Jaylin!

Wizard-Of-Oz Prototyping of Interactions in Augmented Reality

Our work contributes a new approach to supporting rapid prototyping of multi-user systems to the growing field of augmented- and mixed-reality interactions. By drawing on successful methods in 2D UI prototyping, collaborative (and crowdsourced) Wizard-of-Oz support, and cross-platform AR/VR, we introduce a novel system for enabling faster creation of functional prototypes of user experiences in AR. Our system synchronizes a 3D scene between multiple device types, allowing for more complex manipulation of content on devices with more precise input (i.e., a laptop).

Augmented Reality Guidance for Home Improvement Tasks

During my summer at MSR, I worked on a project investigating the potential of head-mounted AR devices for home improvement tasks. This project investigated user performance of both low-level and high-level tasks in this domain. Specifically, we conducted a user study where participants mark points on a planar surface (as if to place a nail, or measure from) guided only by virtual cues. Participants then completed a high-level, multi-step home improvement task (hanging a shelf) using an end-to-end AR prototype system that we developed.

Intelligent Programming Assistants

From October 2016 to September 2017, I worked on a series of projects that aimed to find new ways to assist people with complex tasks, like programming.

• More