Project Description
The requirement for this project was to use Intel perceptual computing SDK and gesture camera kit and design new paradigms of interactions and modalities in context in four weeks.
Perceptual storytelling is a concept prototype that uses Intel perceptual camera to enhance storytelling experience. The project was a part of advanced prototyping course and was done in collaboration with Intel. It was awarded for ‘The best usage of perceptual camera’ among 11 other teams in the class.
Concept
The storytelling prototype is based on creating a space for possibility of exploring different modalities for effective learning of kids. The overall concept is to augment the storytelling experience by recognizing spoken keywords and hand gestures to trigger key images and sound files related to the story.
Process
This project had to be approached from a “problem framing” perspective as opposed to the usual “problem solving” one. In first two weeks, we explored the spaces of physical therapy and kitchen before finalizing the direction of storytelling. For an augmented storytelling experience, we decided to expand the sensory input/output and increase engagement by using the specificity of technology to sense depth and recognize speech. In the remaining two weeks, we coded the prototype and iterated our design to come up with the above final deliverable. An interactive public exhibit was arranged at the end of this project showcasing all the prototypes from class in which ‘Storytelling’ got a good public response.
Methods
Secondary research, Interviewing, Storyboarding, Prototyping, video making and editing, documentation.
Duration
Four weeks
Team mates
Dennis Ellis, Jonathan Partlow, Gene Deybrand
My Contribution
I was assigned the “team facilitator” role for this project
so I took the initiative of project planning process within the team. I was primarily responsible for the backend code (in processing language) in order to prepare the working prototype.
Additionally, I helped my teammates for the final video setup and preparing story script.