Scientific publications
Read about the research that supports the FaceReader Ecosystem
Over the past 20+ years, our facial coding platform and its embedded technologies have been the subject as well as the preferred instrument for numerous accredited scientific studies. Below we present a comprehensive overview of the literature that has emerged from these studies, highlighting and validating the cutting-edge technology of FaceReader Online.
2017
6 citations
Memory Effect in Expressed Emotions During Long Term Group Interactions
Gorbunov, R. , Barakova, E., Rauterberg, M.
Long-term group interactions can be assessed through games where participants choose between cooperative or egoistic strategies. This study analyzed facial expressions of astronauts during repeated game interactions in the Mars-500 isolation experiment. Using FaceReader software, the researchers identified a memory effect in collective emotional expressions between experiments separated by two weeks. This suggests the potential to predict the development of interpersonal relationships in isolated groups, informing the design of long-term interaction behaviors in artificial agents.
2017
5 citations
Multimodal Observation and Interpretation of Subjects Engaged in Problem Solving
Guntz, Balzarini, Vaufreydaz, Crowley
In this paper, the authors present initial findings from a pilot experiment aimed at capturing and interpreting multimodal signals from human experts solving challenging chess problems. The study investigates how observations of eye-gaze, posture, emotion, and other physiological signals can model the cognitive state of subjects. It also explores integrating multiple sensor modalities to enhance the reliability of detecting human displays of awareness and emotion. Chess players were observed tackling problems of increasing difficulty while their behavior was recorded. These recordings help estimate a participant’s situational awareness and predict their ability to respond effectively to challenging situations. The results indicate that a multimodal approach is more accurate than a unimodal one. By combining body posture, visual attention, and emotion, the multimodal approach achieved up to 93% accuracy in determining a player’s chess expertise, compared to 86% with a unimodal approach. The experiment also validates the use of the equipment as a general and reproducible tool for studying participants engaged in screen-based interaction and problem-solving.
2017
72 citations
Predictably Angry—Facial Cues Provide a Credible Signal of Destructive Behavior
van Leeuwen, Noussair, Offerman, Suetens, van Veelen, van de Ven
Evolutionary explanations of anger as a commitment device hinge on two key assumptions. The first is that it is predictable, ex ante, whether someone will get angry when feeling that he or she has been badly treated. The second is that anger is associated with destructive behavior. We test the validity of these two assumptions. We collected photos of responders in an ultimatum game before they were informed about the game that they would be playing, and we filmed responders with webcams during play. We then showed pairs of photos consisting of one responder who rejected and one responder who accepted to an independent group of observers. We find that observers are better than chance at detecting who rejected the low offer; they do 10% better than random guessing would. We also find that anger at receiving a low offer is associated with rejection.
2017
39 citations
The Emotional, Cognitive, Physiological, and Performance Effects of Variable Time Delay in Robotic Teleoperation
Yang & Dorneich
The study investigates the impact of intermittent and variable time delays on operators during robotic teleoperation tasks. Participants navigated a remote-controlled robot through mazes of varying complexity while identifying targets. Introducing feedback lag led to increased frustration, anger, and cognitive workload, while decreasing usability and task performance. The effects of variable time delay were more pronounced than those of task complexity, and their combined impact was additive. Understanding these emotional and physiological responses is crucial for designing robotic systems that can effectively mitigate negative operator states.
2016
30 citations
More emotional facial expressions during episodic than during semantic autobiographical retrieval
El Haj, Antoine, Nandrino
There is a substantial body of research on the relationship between emotion and autobiographical memory. Using facial analysis software, our study addressed this relationship by investigating basic emotional facial expressions that may be detected during autobiographical recall. Participants were asked to retrieve 3 autobiographical memories, each of which was triggered by one of the following cue words: happy, sad, and city. The autobiographical recall was analyzed by a software for facial analysis that detects and classifies basic emotional expressions. Analyses showed that emotional cues triggered the corresponding basic facial expressions . Furthermore, we dissociated episodic and semantic retrieval, observing more emotional facial expressions during episodic than during semantic retrieval, regardless of the emotional valence of cues. Our study provides insight into facial expressions that are associated with emotional autobiographical memory. It also highlights an ecological tool to reveal physiological changes that are associated with emotion and memory.
2016
56 citations
What facial appearance reveals over time: When perceived expressions in neutral faces reveal stable emotion dispositions
Adams, Garrido, Albohn, Hess, Kleck
This study investigates whether neutral facial expressions can reveal individuals’ stable emotional dispositions, particularly focusing on age and gender differences. Through a series of experiments, the researchers found that perceived expressions in neutral faces predicted self-reported positive affect, but this effect was significant only for elderly women. The findings suggest that age-related facial changes may convey information about a person’s emotional disposition, with gender differences potentially influencing these perceptions. The study highlights the complex interplay between facial appearance, age, gender, and perceived emotional states.