File Download

There are no files associated with this item.

  • Find it @ UNIST can give you direct access to the published full text of this article. (UNISTARs only)
Related Researcher

OakleyIan

Oakley, Ian
Interactions Lab.
Read More

Views & Downloads

Detailed Information

Cited time in webofscience Cited time in scopus
Metadata Downloads

How Do You Feel Online: Exploiting Smartphone Sensors to Detect Transitory Emotions during Social Media Use

Author(s)
Ruensuk, MintraCheon, EunyongHong, HwajungOakley, Ian
Issued Date
2020-12
DOI
10.1145/3432223
URI
https://scholarworks.unist.ac.kr/handle/201301/49091
Fulltext
https://dl.acm.org/doi/10.1145/3432223
Citation
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, v.4, no.4, pp.1 - 32
Abstract
Emotions are an intrinsic part of the social media user experience that can evoke negative behaviors such as cyberbullying and trolling. Detecting the emotions of social media users may enable responding to and mitigating these problems. Prior work suggests this may be achievable on smartphones: emotions can be detected via built-in sensors during prolonged input tasks. We extend these ideas to a social media context featuring sparse input interleaved with more passive browsing and media consumption activities. To achieve this, we present two studies. In the first, we elicit participant's emotions using images and videos and capture sensor data from a mobile device, including data from a novel passive sensor: its built-in eye-tracker. Using this data, we construct machine learning models that predict self-reported binary affect, achieving 93.20% peak accuracy. A follow-up study extends these results to a more ecologically valid scenario in which participants browse their social media feeds. The study yields high accuracies for both self-reported binary valence (94.16%) and arousal (92.28%). We present a discussion of the sensors, features and study design choices that contribute to this high performance and that future designers and researchers can use to create effective and accurate smartphone-based affect detection systems.
Publisher
Association for Computing Machinery (ACM)
ISSN
2474-9567

qrcode

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.