Audie
Digital Twin Audience Response System
Concept
A digital twin which extracts the biometric data tied to specific moments of the film and helps the filmmakers to accurately identify the physical effects of the entire cinematic experience.
Current Problems
Critic Reviews: Critics are out of touch with the audience and rate films in black comedies
and documentaries more highly than regular audience would.
Global Audiences: Different people often have unexpected reaction to certain scenes,
to gain more insights into target audience’s perception is necessary.
Missing Insights: Hard for the movie makers to identify potential high points of the movie
and the low points which need improvement.
Intention
This system gives away the necessary information required to the film industry for them to get an overall analysis of where they stand in the industry and how they can improve their movies to gain a more positive response from them. This gives us an index of the choice of the people and also the popularity of a particular scene/ sequence.
Approach
Domain: Media Distribution and Entertainment
Target users: Movie-makers
Technology: Movie makers will gain insight into the data by an interactive iPad/ large screen interface. The audience can gain a refined set of information on their mobile devices or on an interactive screen at the movie theaters.
Micro Expressions
Detecting expressions can provide cues to semantically meaningful occurrences, such as jokes or topic changes. Detection of changes depending on age, laughing rate or points.
An algorithm known as FVAEs breaks a person's face down into 68 different "landmarks" featuring different degrees of expressions. Any jokes that less than half the audience laughs at can be dropped.
Heart Pounding Moments
Wearable devices can measure heart rate, pulse, skin temperature, electrodermal activity and motion. It can help us calculate number of fight-or-flight responses in the entire movie divided
scene wise. Similarly track the number of heart-pounding moments.
Brain Activity
Some films tend to "sync up" brain regions across all viewers through action or suspense scenes. Tracking vertical and horizontal eye movements with structures and unstructured spots. Small screen or on a large screen may elicit different responses.
Sketching and Ideation
Keeping the narrative in mind, I designed for a large interface which would facilitate the moviemakers to interact with it and view insights in their think tanks or conference rooms ideally.
Considering how statistical data should be represented which includes the live tracking, data prediction and the comparison of results, how the different sections of biometric data should be represented, and how the design system should tie together across platform.
I separated out all these considerations into different sections accordingly.
Mood and Style
The mood and style I was aiming for was futuristic and dreamy. Cinematic experience is
constantly evolving and the futuristic style fits perfectly with the brief. Dark tones and cool colors bring out
Touch Screens
These are the screens for the Audie Interactive touch application. The user can select from the list of movies and view insights about each with respect to micro expressions, heart rate and brain activity.
Watch Screens
A digital watch worn by the audience will track heart rate in real time and send the collected
sensor data to the Audie framework. This way the heart activity can be tracked and monitored.
Video Snippets
Why Audie?
The more you know and understand the background and needs of your audience, the better
you can prepare your content. Audience power could shape the future of movie making.
