Scientific publications
Read about the research that supports the FaceReader Ecosystem
Over the past 20+ years, our facial coding platform and its embedded technologies have been the subject as well as the preferred instrument for numerous accredited scientific studies. Below we present a comprehensive overview of the literature that has emerged from these studies, highlighting and validating the cutting-edge technology of FaceReader Online.
2019
36 citations
Efficient Real-Time Camera Based Estimation of Heart Rate and Its Variability
A. Gudi, M. Bittner, R. Lochmans and J. van Gemert
Remote photo-plethysmography utilizes a camera to estimate a person’s heart rate . Beyond HR, heart rate variability offers insights into physiological and psychological conditions by measuring fluctuations between heartbeats. Accurate HRV assessment requires precise heartbeat timing. This paper introduces an efficient real-time rPPG pipeline featuring novel filtering and motion suppression techniques that enhance HR estimation accuracy and extract pulse waveforms for HRV measurement. The method operates in real-time without the need for rPPG-specific training. Validation on a self-recorded dataset under ideal lab conditions and two public datasets with realistic scenarios demonstrates state-of-the-art performance.
2019
87 citations
Facial Expressions of Basic Emotions in Japanese Laypeople
W. Sato, S. Hyniewska, K. Minemoto, S. Yoshikawa
Facial expressions that show emotion play an important role in human social interactions. In previous theoretical studies, researchers have suggested there are universal, prototypical facial expressions specific to basic emotions. However, the results of some empirical studies tested production of emotional based on particular scenarios only partially supported predictions. In addition, all were conducted in Western cultures. We investigated Japanese laypeople (n = 65) to provide further evidence regarding expressions. The participants produced for six emotions (anger, disgust, fear, happiness, sadness, and surprise) scenarios. Under baseline condition, imitated photographs automatically coded using FaceReader in terms of intensities action units. contrast photograph where target shown clearly, scenario condition elicited clearly happy surprised conditions yielded different profiles units associated with tested. These results partial support theory but suggest possibility may need be modified evidence.
2019
179 citations
Assessing the convergent validity between the automated emotion recognition software Noldus FaceReader 7 and Facial Action Coding System Scoring
T. Skiendziel, A. R. Rösch, O. C. Schultheiss
This study validates automated emotion recognition software Noldus FaceReader 7 to a dataset of six basic emotions (Standardized Motivated Facial Expressions of Emotion). Percentages of correctly and falsely classified emotional expressions are reported. The validity of AUs is provided by correlations between the analysis of manual Facial Action Coding System (FACS) scoring for 20 AUs. On average 80% of emotional expressions are classified. The overall validity is moderate with highest indicators for AU 1, 5, 9, 17, 27. These results are compared to performance in previous research, yielding comparable coefficients. Practical implications and limitations of the method are discussed.
2019
8 citations
Effects of facial rehabilitation exercise on the mood, facial expressions, and facial muscle activities in patients with Parkinson’s disease
R. Okamoto, K. Adachi, K. Mizukami
Researchers used FaceReader software to evaluate the effects of facial rehabilitation exercises on mood and muscle activity in Parkinson’s patients, confirming the utility of automated analysis in clinical settings.
Tags
2019
87 citations
Factors Affecting Consumer Food Preferences: Food Taste and Depression-Based Evoked Emotional Expressions with the Use of Face Reading Technology
E. Bartkiene, V. Steibliene, V. Adomaitiene, G. Juodeikiene, D. Cernauskas
In this research, FaceReader software is used to explore factors affecting consumer food preferences: food taste and depression-based evoked emotional expressions with the use of face reading technology, providing objective data on emotional responses and facial muscle activities.
2019
4 citations
Vocal and facial expressions and meaning effects in speech expressivity
M. A. de Souza Fontes, S. Madureira
The objective of this work is to investigate the congruence between non-verbal and verbal cues in persuasive speech. Selected corpus comprises video excerpts which artists from divergent political perspectives provide support to minister Brazilian Supreme Federal Court. research methodology comprises: annotation of excerpts; text analysis; automatic analysis of speakers’ facial expressions emotions by means FaceReader; vocal quality prosodic settings VPA; acoustic data ExpressionEvaluator (Barbosa, 2009); multivariate statistical analysis, applying MFA R, package FactorMinerR, correlate qualitative and quantitative variables. Results indicate interplay among facial expressions, vocal prosodies, intended persuasiveness.