Spontaneous Expression Detection from 3D Dynamic Sequences by Analyzing Trajectories on Grassmann Manifolds - ANR - Agence nationale de la recherche Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Affective Computing Année : 2018

Spontaneous Expression Detection from 3D Dynamic Sequences by Analyzing Trajectories on Grassmann Manifolds

Résumé

In this paper, we propose a unified framework for the purpose of online spontaneous emotion detection, such as happiness or physical pain, from depth videos. Our approach consists on mapping the video streams onto a Grassmann manifold (i.e., space of k-dimensional linear subspaces) to form time-parameterized trajectories. To this end, depth videos are decomposed into short-time subsequences, each approximated by a k-dimensional linear subspace, which is in turn a point on the Grassmann manifold. Then, the temporal evolution of subspaces gives rise to a precise mathematical representation of trajectories on the underlying manifold. In the final step, extracted spatio-temporal features based on computing the velocity vectors along the trajectories, termed Geometric Motion History (or GMH), are fed to an early event detector based on Structured Output SVM, which enables online emotion detection from partially-observed data. Experimental results obtained on the publicly available Cam3D Kinect and BP4D-spontaneous databases validate the proposed solution. The first database has served to exemplify the proposed framework using depth sequences of the upper part of the body collected using depth-consumer cameras, while the second database allowed the application of the same framework to physical pain detection from high-resolution and long 3D-face sequences.
Fichier principal
Vignette du fichier
bare_jrnl_compsoc.pdf (2.56 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01520751 , version 1 (10-05-2017)

Identifiants

Citer

Taleb Alashkar, Boulbaba Ben Amor, Mohamed Daoudi, Stefano Berretti. Spontaneous Expression Detection from 3D Dynamic Sequences by Analyzing Trajectories on Grassmann Manifolds. IEEE Transactions on Affective Computing, 2018, 9 (1), pp.271-284. ⟨10.1109/TAFFC.2016.2623718⟩. ⟨hal-01520751⟩
266 Consultations
226 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More