Browsing

Publication Tag: Affective Computing

An overview of all publications that have the tag you selected.

2016
8 citations
Toward physiological indices of emotional state driving future ebook interactivity
van Erp, Hogervorst, van der Werf, Ysbrand
Ebooks of the future may respond to the emotional experience of the reader. physiological measures could capture a reader’s emotional state and use this to enhance the reading experience by adding matching sounds or to change the storyline, thereby creating a hybrid art form between literature and gaming. We describe the theoretical foundation of the emotional and creative brain and review the neurophysiological indices that can be used to drive future ebook interactivity in a real-life situation. As a case study, we report the neurophysiological measurements of a bestselling author during nine days of writing, which can potentially be used later to compare them to those of the readers. In designated calibration blocks, the artist wrote emotional paragraphs for emotional pictures. Analyses showed that we can reliably distinguish writing blocks from resting, but we found no reliable differences related to the emotional content of the writing. The study shows that measurements of EEG, heart rate , skin conductance, facial expression, and subjective ratings can be done over several hours a day and for several days in a row. In follow-up phases, we will measure 300 readers with a similar setup.
2007
36 citations
Unobtrusive Multimodal Emotion Detection in Adaptive Interfaces: Speech and Facial Expressions
Truong, van Leeuwen, Neerincx
Two unobtrusive modalities for automatic emotion recognition are discussed: speech and facial expressions. First, an overview is given of emotion recognition studies based on a combination of speech and facial expressions. We will identify difficulties concerning data collection, data fusion, system evaluation and emotion annotation that one is most likely to encounter in emotion recognition research. Further, we identify some of the possible applications for emotion recognition such as health monitoring or e-learning systems. Finally, we will discuss the growing need for developing agreed standards in automatic emotion recognition research.
2012
79 citations
Speech-based recognition of self-reported and observed emotion in a dimensional space
Truong, van Leeuwen, de Jong
The differences between self-reported and observed emotion have only marginally been investigated in the context of speech-based automatic emotion recognition. We address this issue by comparing self-reported emotion ratings to observed emotion ratings and look at how differences between these two types of ratings affect the development and performance of automatic emotion recognizers developed with these ratings. A dimensional approach to emotion modeling is adopted: the ratings are based on continuous arousal and valence scales. We describe the TNO-Gaming Corpus that contains spontaneous vocal and facial expressions elicited via a multiplayer videogame and that includes emotion annotations obtained via self-report and observation by outside observers. Comparisons show that there are discrepancies between self-reported and observed emotion ratings which are also reflected in the performance of the emotion recognizers developed. Using Support Vector Regression in combination with acoustic and textual features, recognizers of arousal and valence are developed that can predict points in a 2-dimensional arousal-valence space. The results of these recognizers show that the self-reported emotion is much harder to recognize than the observed emotion, and that averaging ratings from multiple observers improves performance.
2010
120 citations
Measuring Instant Emotions During a Self-Assessment Test: The Use of FaceReader
Terzis, Morisis, Economides
Emotions play a crucial role in learning and self-assessment processes, yet measuring them is challenging. This study evaluates the efficiency of FaceReader during a self-assessment test by comparing its instant measurements with researchers’ estimations of students’ emotions in real-time observations. Statistical analysis revealed some discrepancies between FaceReader’s and researchers’ assessments, particularly concerning ‘Disgusted’ and ‘Angry’ emotions. Overall, the results indicate that FaceReader can measure emotions with over 87% efficacy during self-assessment tests and could be effectively integrated into computer-aided learning systems for affect recognition. Additionally, the study provides valuable insights into students’ emotional states during self-assessment tests and learning procedures.
2012
127 citations
The effect of emotional feedback on behavioral intention to use computer based assessment
Terzis, Moridis,Economides
This study introduces emotional feedback as a construct in an acceptance model, exploring its effect on behavioral intention to use Computer Based Assessment . A female Embodied Conversational Agent with empathetic encouragement behavior was displayed as emotional feedback. The research investigates the impact of Emotional Feedback on Behavioral Intention to Use a CBA system, Perceived Playfulness, Perceived Usefulness, Perceived Ease of Use, Content, and Facilitating Conditions. A survey questionnaire was completed by 134 students. Results demonstrate that Emotional Feedback has a direct effect on Behavioral Intention to Use a CBA system and on other crucial determinants of Behavioral Intention. The proposed acceptance model for computer-based assessment, extended with the Emotional Feedback variable, explains approximately 52% of the variance of Behavioral Intention.
2012
56 citations
UX_Mate: From Facial Expressions to UX Evaluation
Staiano, Menéndez, Battocchi, De Angeli, Sebe
In this paper, the authors propose and evaluate UX_Mate, a non-invasive system for the automatic assessment of User eXperience . Additionally, they contribute a novel database of annotated and synchronized videos of interactive behavior and facial expressions. UX_Mate is a modular system that tracks users’ facial expressions, interprets them based on pre-set rules, and generates predictions about the occurrence of target emotional states, which can be linked to interaction events. The system simplifies UX evaluation by providing indications of event occurrences. UX_Mate offers several advantages over other state-of-the-art systems: easy deployment in the user’s natural environment, avoidance of invasive devices, and significant cost reduction. The paper reports on a pilot and a validation study involving a total of 46 users, where UX_Mate was used to identify interaction difficulties. The studies show encouraging results that open possibilities for automatic real-time UX evaluation in ecological environments.
2013
14 citations
The affective experience of normative-performance and outcome goal pursuit: Physiological, observed, and self-report indicators
Sideridis, Kaplan, Papadopoulos, Anastasiadis
This study examines the affective experiences associated with pursuing normative-performance and outcome goals, utilizing physiological, observational, and self-report measures. The findings indicate that individuals pursuing normative-performance goals exhibit higher levels of anxiety and physiological arousal compared to those pursuing outcome goals. Additionally, normative-performance goal pursuit is linked to more negative affective expressions and self-reported emotions. These results suggest that the type of goal pursued significantly influences affective experiences, with normative-performance goals potentially leading to more stressful and negative emotional states.
2015
53 citations
Charitable Giving, Emotions, and the Default Effect
Noussair & Habetinova
We report an experiment to study the effect of defaults on charitable giving. In three different treatments, participants face varying default levels of donation. In three other treatments that are paired with the first three, they receive the same defaults, but are informed that defaults are thought to have an effect on their donation decisions. The emotional state of all individuals is monitored throughout the sessions using Facereading software, and some participants are required to report their emotional state after the donation decision. We find that the level at which a default is set has no effect on donations, and informing individuals of the possible impact of defaults also has no effect. Individuals who are happier and in a more positive overall emotional state donate more. Donors experience a negative change in the valence of their emotional state subsequent to donating, when valence is measured with Facereading software. This contrasts with the self-report data, in which donating correlates with a more positive reported subsequent emotional state.
2012
106 citations
Affective learning: Empathetic agents with emotional facial and tone of voice expressions
Moridis & Economides
Empathetic behavior is considered an effective method for Embodied Conversational Agents to provide feedback to learners’ emotions. This study examines the impact of ECAs’ emotional facial and tone of voice expressions, combined with empathetic verbal behavior, when displayed as feedback to students’ fear, sadness, and happiness during a self-assessment test. Three identical female agents were used: 1. An ECA performing parallel empathy with neutral emotional expressions. 2. An ECA performing parallel empathy displaying emotional expressions relevant to the student’s emotional state. 3. An ECA performing parallel empathy by displaying relevant emotional expressions followed by reactive empathy expressions aimed at altering the student’s emotional state. Results indicate that an agent performing parallel empathy with emotional expressions relevant to the student’s state may cause the emotion to persist. Moreover, the agent performing both parallel and reactive empathy effectively altered a fearful emotional state to a neutral one.
2015
88 citations
Characterizing consumer emotional response to sweeteners using an emotion terminology questionnaire and facial expression analysis
Leitch, Duncan, O’Keefe, Rud, Gallagher
Concerns associated with sugar-sweetened beverages have led to an increased consumer demand for sweetener alternatives that are functionally equivalent to sucrose without the associated health risks. Measuring consumer emotions has the potential to aid the industry in subsequent ingredient decision-making. The purpose of this study was to evaluate the relationship of consumer acceptability and emotional response of sweeteners in tea using a 9-point hedonic scale, an emotion term questionnaire , and a facial expression response . Participants evaluated a water sample , two sucrose-tea samples , and four equi-sweet alternative sweetener-tea samples , divided by category . Sessions were divided by category and emotional response tool in a cross-over design. Facial expression responses were recorded in the first session of both days using FaceReader 5.0 and individual participant videos were analyzed per sample for 5-s post-consumption in the continuous analysis setting using automated facial expression analysis software. Emotional term responses were collected in the second session of each day and count frequencies of each term per sample were tabulated and analyzed. Hedonic acceptability was rated in all sessions on a 9-point scale. Alternative sweeteners were all rated ‘acceptable’ , except for honey in one session. Only one alternative in each category was statistically different in liking from sucrose. Facial analysis showed minimal differences in emotion elicited across sweetener categories. Time series analysis was more robust in showing differences than baseline comparisons. Emotional term selection using a CATA questionnaire showed four unique terms for natural sweeteners and two unique terms for artificial sweeteners. More research exploration related to emotions and food is needed in order to accrue a more accurate picture of consumer product preferences.

Request a free trial

Get your free example report

Get your free whitepaper