Automated recognition of emotional states of horses from facial expressions

PLoS One. 2024 Jul 15;19(7):e0302893. doi: 10.1371/journal.pone.0302893. eCollection 2024.

Abstract

Animal affective computing is an emerging new field, which has so far mainly focused on pain, while other emotional states remain uncharted territories, especially in horses. This study is the first to develop AI models to automatically recognize horse emotional states from facial expressions using data collected in a controlled experiment. We explore two types of pipelines: a deep learning one which takes as input video footage, and a machine learning one which takes as input EquiFACS annotations. The former outperforms the latter, with 76% accuracy in separating between four emotional states: baseline, positive anticipation, disappointment and frustration. Anticipation and frustration were difficult to separate, with only 61% accuracy.

MeSH terms

  • Animals
  • Deep Learning
  • Emotions* / physiology
  • Facial Expression*
  • Horses / psychology
  • Humans
  • Machine Learning
  • Male

Grants and funding

The author(s) received no specific funding for this work.