Scientific publications
Read about the research that supports the FaceReader Ecosystem
Over the past 20+ years, our facial coding platform and its embedded technologies have been the subject as well as the preferred instrument for numerous accredited scientific studies. Below we present a comprehensive overview of the literature that has emerged from these studies, highlighting and validating the cutting-edge technology of FaceReader Online.
2019
179 citations
Assessing the convergent validity between the automated emotion recognition software Noldus FaceReader 7 and Facial Action Coding System Scoring
T. Skiendziel, A. R. Rösch, O. C. Schultheiss
This study validates automated emotion recognition software Noldus FaceReader 7 to a dataset of six basic emotions (Standardized Motivated Facial Expressions of Emotion). Percentages of correctly and falsely classified emotional expressions are reported. The validity of AUs is provided by correlations between the analysis of manual Facial Action Coding System (FACS) scoring for 20 AUs. On average 80% of emotional expressions are classified. The overall validity is moderate with highest indicators for AU 1, 5, 9, 17, 27. These results are compared to performance in previous research, yielding comparable coefficients. Practical implications and limitations of the method are discussed.
2019
8 citations
Effects of facial rehabilitation exercise on the mood, facial expressions, and facial muscle activities in patients with Parkinson’s disease
R. Okamoto, K. Adachi, K. Mizukami
Researchers used FaceReader software to evaluate the effects of facial rehabilitation exercises on mood and muscle activity in Parkinson’s patients, confirming the utility of automated analysis in clinical settings.
Tags
2018
44 citations
The effects of robot facial emotional expressions and gender on child–robot interaction in a field study
Cameron, Millings, Fernando, Collins, Moore, Sharkey, Evers, Prescott
Emotions and emotional expression significantly influence social interactions, making them crucial in the development of social robots. This study investigated how life-like affective facial expressions in the humanoid robot Zeno affect children’s behavior and attitudes toward the robot. Findings reveal that robot expressions have varying effects based on participant gender. Male participants interacting with a responsive, facially expressive robot exhibited positive affective responses and reported greater liking toward the robot compared to those interacting with the same robot maintaining a neutral expression. Female participants showed no significant differences across conditions. The study discusses broader implications regarding gender differences in human–robot interaction, emphasizing the importance of the robot’s gender appearance and advancing the understanding of how interactions with expressive robots could lead to task-appropriate symbiotic relationships.
2018
35 citations
Conveying facial expressions to blind and visually impaired persons through a wearable vibrotactile device
H.P. Buimer, M. Bittner, T. Kostelijk, T.M. van der Geest, A. Nemri, R. J. A. van Wezel and Y. Zhao
In face-to-face social interactions, blind and visually impaired persons lack access to nonverbal cues like facial expressions, body posture, and gestures, which may lead to impaired interpersonal communication. In this study, a wearable sensory substitution device consisting of a head-mounted camera and a haptic belt was evaluated to determine whether vibrotactile cues around the waist could be used to convey facial expressions to users and whether such a device is desired by VIPs for use in daily living situations. Ten VIPs and 10 sighted persons participated in the study, in which validated sets of pictures, silent videos, and videos with audio of facial expressions were presented to the participant. A control measurement was first performed to determine how accurately participants could identify facial expressions while relying on their functional senses. After a short training, participants were asked to determine facial expressions while wearing the emotion feedback system. VIPs using the device showed significant improvements in their ability to determine which facial expressions were shown. A significant increase in accuracy of 44.4% was found across all types of stimuli when comparing the scores of the control and supported phases. The greatest improvements achieved with the support of the SSD were found for silent stimuli . SPs also showed consistent, though not statistically significant, improvements while supported. Overall, our study shows that vibrotactile cues are well suited to convey facial expressions to VIPs in real-time. Participants became skilled with the device after a short training session. Further testing and development of the SSD is required to improve its accuracy and aesthetics for potential daily use.
2018
11 citations
Multimodal Observation and Classification of People Engaged in Problem Solving : Application to Chess Players
Guntz, Balzarini, Vaufreydaz, Crowley
In this paper, the authors present initial results from a pilot experiment aimed at interpreting multimodal observations of human experts engaged in solving challenging chess problems. The study investigates how observations of eye-gaze, posture, emotion, and other physiological signals can be utilized to model the cognitive state of subjects. It also explores the integration of multiple sensor modalities to enhance the reliability of detecting human displays of awareness and emotion. Potential applications for such cognitive model-based systems include promoting healthy autonomous aging and developing automated training systems. By observing chess players tackling problems of increasing difficulty and recording their behavior, the researchers aim to estimate participants’ situational awareness and predict their ability to respond effectively to challenging situations. Feature selection was performed to construct a multimodal classifier that relies on the most relevant features from each modality. Initial results indicate that eye-gaze, body posture, and emotion are effective features for capturing such awareness. This experiment also validates the use of the equipment as a general and reproducible tool for studying participants engaged in screen-based interaction and problem-solving.
2018
2 citations
Positive facial expressions during retrieval of self-defining memories
J. Nandrino, J. L. Nandrino, G. Delelis, C. Ducro, A. Lavallee
In this research, FaceReader software is used to explore positive facial expressions during retrieval of self-defining memories, providing objective data on emotional responses and facial muscle activities.