Research presented at SIGGRAPH 2015 featuring an innovative project combining eye-tracking technology with interactive graphic novels.

The Concept

Frameshift uses eye-tracking to measure attention and subtly alter the graphic novel narrative. The system employs attentional measures to enrich storytelling through perceptual changes.

How It Works

As readers focus on different elements of a graphic novel, the system tracks their gaze and adjusts narrative elements accordingly. This creates a unique, personalized reading experience where the story literally shifts based on where you look.

Development

This work was completed as my master’s thesis in collaboration with Runi Goswami. We developed authoring frameworks and conducted user studies demonstrating the viability of this interaction model.

SIGGRAPH 2015

The project was presented at SIGGRAPH 2015 with:

  • Studio Talk presentation
  • Poster presentation
  • Live demonstration materials

Resources

  • Abstract (PDF available)
  • Full thesis paper