Efficient multi-task based facial landmark and gesture detection in monocular images
View/ Open
Date
2021Author
Goenetxea Imaz, Jon
Unzueta Irurtia, Luis
Elordi Hidalgo, Unai
Otaegui Madurga, Oihana
Dornaika, Fadi
Metadata
Show full item record
Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) 5 : 680-687 (2021)
Abstract
[EN] The communication between persons includes several channels to exchange information between individuals.
The non-verbal communication contains valuable information about the context of the conversation and it is
a key element to understand the entire interaction. The facial expressions are a representative example of this
kind of non-verbal communication and a valuable element to improve human-machine interaction interfaces.
Using images captured by a monocular camera, automatic facial analysis systems can extract facial expressions
to improve human-machine interactions. However, there are several technical factors to consider, including
possible computational limitations (e.g. autonomous robots), or data throughput (e.g. centralized computation
server). Considering the possible limitations, this work presents an efficient method to detect a set of 68
facial feature points and a set of key facial gestures at the same time. The output of this method includes
valuable information to understand the context of communication and improve the response of automatic
human-machine interaction systems.