Smartphone giant Huawei has created an app that transforms facial expressions of blind people into different sounds, thereby facilitating interpersonal relationships. This is Facing Emotions, an application based on Artificial Intelligence capable of converting seven emotions into seven different sounds. With this, blind people will be able to interpret the anger, fear, disgust, happiness, sadness, surprise and contempt of their interlocutor.
Currently, the app works only on Huawei Mate 20 Pro. It is characterized by its processor designed for artificial intelligence. To start using it, simply press the back camera to scan the face of the person we are talking to and identify different features such as eyes, eyebrows, nose or mouth.
Once this is done, it’s time for AI that applies automatic learning so that blind people are able to identify the facial expression of the person with whom they speak. An algorithm is responsible for interpreting such emotions and transform them into sounds that the application plays on the smartphone speaker in real time and offline.
Huawei developed the app in collaboration with the Polish Blind Association, dedicated to researching the needs of blind people. Next, to the app, Huawei has also developed a 3D printed support designed so that blind people who need a cane can use the app with hands-free. The files can be downloaded for free from Shapeways.
It is not the first time that Huawei develops applications for people with some type of disability. In fact, the Chinese company has already created StorySign that allows deaf children to read children’s books in sign language with their parents.