Make a mirror that reflects back your emotions at you and sends happy or sad Tweets out of your head? Random Quark was definitely up for that!
We set about building one that drew red or green coloured squiggly lines on a reflected face according to the viewer’s state of mind.
Not only did we immediately know the best technology to analyse facial expressions, but also how to examine Tweets in order to make sure they matched the emotion exhibited: smiley face, happy tweet; sad face, negative tweet.
(We're pretty sure most visitors had to mug the sad face because they were having so much fun.)
What you see is coloured by how you feel. The Emotional Mirror brings you face to face with this phenomenon by analysing your facial expression and reflecting it back to you. Along with your own image it displays your thoughts as tweets that embody the emotion you’re experiencing. While you’re looking into the mirror the feedback loop between sensation and perception becomes more visible. If you smile, happy tweets appear, if you frown, you see sad tweets.
Emotional Mirror was first presented at the Athens Digital Art Festival held in May 2016.
The installation uses computer vision to identify the facial expressions of the user. It then searches twitter and picks random tweets and performs sentiment analysis on the text, categorising them as emotionally positive or negative. It then presents the tweets that correspond to the emotional expression as clouds that appear around the user's head and then float away. Smiling bring happy tweets, while a sad face brings sad tweets.
The project was created using python, openFrameworks/C++ making use of the ofxFaceTracker addon to track faces, the Vader library for sentiment analysis of tweets as Tweepy to interface with the Twitter stream. The source for the display and the tweet analyser backend can be found on our github.
We worked with Michele Panegrossi and Laura Pedroni who assisted with the hardware and conceptual design.