Scientific publications
Read about the research that supports the FaceReader Ecosystem
Over the past 20+ years, our facial coding platform and its embedded technologies have been the subject as well as the preferred instrument for numerous accredited scientific studies. Below we present a comprehensive overview of the literature that has emerged from these studies, highlighting and validating the cutting-edge technology of FaceReader Online.
2014
9 citations
Integrating Remote PPG in Facial Expression Analysis Framework
H.E. Tasli, A. Gudi, M. den Uyl
This demonstration paper presents the FaceReader framework, which analyzes human face images and skin color variations to observe facial expressions and vital signs, including average heart rate , heart rate variability , stress levels, and confidence levels. Remote monitoring of facial and vital signs can be beneficial for a wide range of applications. FaceReader utilizes active appearance modeling for facial analysis and novel signal processing techniques for heart rate and variability estimation. The performance has been objectively evaluated, and psychological guidelines for stress measurements are incorporated into the framework for analysis.
2014
16 citations
Emotion and Interface Design
Lockner & Bonnardel
The emotional experience of an interactive system has garnered significant interest in the HCI community. While predicting or controlling these experiences through design choices is challenging, our user study offers a different perspective. We found that certain controllable aspects of interactive products consistently elicited specific emotional responses from participants, despite influences from contextual factors. This paper discusses these findings and their implications for designing emotional experiences in interactive devices.
2014
124 citations
Remote PPG based vital sign measurement using adaptive facial regions
H.E. Tasli, A. Gudi, M. den Uyl
This paper introduces a remote photoplethysmography technique that analyzes human skin color variations to monitor vital signs, such as average heart rate and its variability. Utilizing a non-invasive video camera, the method employs facial appearance modeling to stabilize color variations in selected facial regions during signal acquisition. A novel signal processing approach is presented to extract the periodic components of raw color signals for accurate heart rate estimation. The authors collected a ground truth dataset using a PPG instrument attached to the subject’s skin and demonstrated a strong correlation between the estimated heart rate and the ground truth values.
2014
96 citations
Dynamics of autonomic nervous system responses and facial expressions to odors
He, Boesveldt, de Graaf, de Wijk
This study investigates the temporal dynamics of autonomic nervous system responses and facial expressions elicited by olfactory stimuli. Participants were exposed to pleasant and unpleasant odors while their ANS responses and facial expressions were recorded. Results indicated that unpleasant odors triggered immediate ANS activation and facial expressions of disgust, whereas pleasant odors elicited more gradual ANS responses and facial expressions of pleasure. These findings suggest that the human body reacts more swiftly and intensely to negative olfactory stimuli, highlighting the adaptive significance of rapid detection and response to potentially harmful substances. The study provides insights into the interplay between olfactory perception, emotional processing, and physiological reactions.
2014
117 citations
Facial expressions and autonomous nervous system responses elicited by tasting different juices
Danner, Haindl, Joechl, Duerrschmid
The study aimed to understand reactions elicited by tasting different juices by examining self-reported liking, autonomic nervous system responses, and both implicit and explicit facial expressions. Eighty-one participants tasted banana, grapefruit, mixed vegetable, orange, and sauerkraut juices. Measurements included skin conductance level , skin temperature , heart rate , pulse volume amplitude , and facial expressions. Results showed significant differences in SCL and PVA responses, as well as in the intensity of several facial expressions across the juices. A moderate correlation was found between these physiological responses and self-reported liking, allowing differentiation between liked, disliked, and neutral samples. Notably, in the implicit approach, participants displayed minimal positive emotions for liked samples, whereas in the explicit approach, they exhibited strong positive emotions. Negative emotions were more pronounced for disliked samples in both approaches. The findings suggest that self-reported liking, ANS responses, and facial expressions provide distinct information about taste experiences.
The article was accepted on 4 June 2014.
2014
209 citations
Predicting advertising effectiveness by facial expressions in response to amusing persuasive stimuli
P. Lewinski, M. L. Fransen, E. S. H. Tan
We present a psychophysiological study of facial expressions of happiness produced by advertisements using the FaceReader system for automatic analysis of facial expressions of basic emotions . FaceReader scores were associated with self-reports of the advertisement’s effectiveness. Building on work describing the role of emotions in marketing research, we examined the relationship between the patterns of the FEBE and the perceived amusement of the advertisements, attitude toward the advertisement and attitude toward the brand . Differences were observed between FEH scores in response to high-, medium-, and low-amusing video advertisements . Positive correlations were found between FEH and AAD and FEH and AB in high- and medium- but not in low-AVAs. As hypothesized, other basic emotions did not predict advertisement amusement or advertisements’ effectiveness. FaceReader enabled a detailed analysis of more than 120,000 frames of video-recordings contributing to an identification of global patterns of facial reactions to amusing persuasive stimuli. For amusing commercials, context-specific FEH features were found to be the major indicators of advertisement effectiveness. The study used video-recordings of participants in their natural environments obtained through a crowd-sourcing platform. The naturalistic design of the study strengthened its ecological validity and demonstrated the robustness of the software algorithms even under austere conditions. Our findings provide first evidence for the applicability of FaceReader methodology in the basic consumer science research.