PawFACS: Leveraging Semi-Supervised Learning for Pet Facial Action Recognition


Anandavardhan Hegde (Samsung), Sudha Velusamy (Samsung), Narayan Kothari (Samsung), Aman Bahuguna (Samsung), Apnesh Rawat (National Institute of Technology Delhi), Hema Sathiamurthy (Indian Institute of Technology, Madras, Dhirubhai Ambani Institute Of Information and Communication Technology), Ankit Raja (Galgotias University )
The 35th British Machine Vision Conference
PDFPosterVideo (Right click to download)

Abstract

Nowadays, Pets are regarded as integral family members because they provide emo- tional support and bonding, yet understanding and assessing their emotions can be chal- lenging. Pet facial action detection, which helps determine their emotional states, re- mains a significant and unsolved research issue. The lack of labeled data, however, presents a challenge, as manually creating labels for various species and breeds is labor- intensive. Drawing from DogFACS and CatFACS standards, we present a multi-label classification system for pet facial action units (AUs) in dogs and cats. Our approach centers on two main objectives: (i) a semi-supervised pseudo-labeling strategy to address the lack of labeled pet facial AU data, and (ii) providing annotations for 8,918 images with multiple pet facial action labels to assist future research in this field. We introduce a semi-supervised learning framework that utilizes a small portion of precisely labeled data, gradually extracting reliable samples from the unlabeled data pool. Various deep neural models based on transformers and convolutional neural networks are evaluated on the CatVsDog benchmark dataset. Our comparison study reveals that SwinTransformer- Tiny outperformed other models with an accuracy of 88.93 % on the CatVsDog dataset. Our effort attempts to bridge the gap between pet and human facial action understanding.

Citation

@inproceedings{Hegde_2024_BMVC,
author    = {Anandavardhan Hegde and Sudha Velusamy and Narayan Kothari and Aman Bahuguna and Apnesh Rawat and Hema Sathiamurthy and Ankit Raja},
title     = {PawFACS: Leveraging Semi-Supervised Learning for Pet Facial Action Recognition},
booktitle = {35th British Machine Vision Conference 2024, {BMVC} 2024, Glasgow, UK, November 25-28, 2024},
publisher = {BMVA},
year      = {2024},
url       = {https://papers.bmvc2024.org/0288.pdf}
}


Copyright © 2024 The British Machine Vision Association and Society for Pattern Recognition
The British Machine Vision Conference is organised by The British Machine Vision Association and Society for Pattern Recognition. The Association is a Company limited by guarantee, No.2543446, and a non-profit-making body, registered in England and Wales as Charity No.1002307 (Registered Office: Dept. of Computer Science, Durham University, South Road, Durham, DH1 3LE, UK).

Imprint | Data Protection