Automatic detection of peripheral facial landmarks using 3D facial data

Author Identifier

Syed Mohammed Shamsul Islam: https://orcid.org/0000-0002-3200-2903

Document Type

Conference Proceeding

Publication Title

International Conference Image and Vision Computing New Zealand

Publisher

IEEE

School

School of Science

RAS ID

77611

Comments

Chowdhury, M., Bennamoun, M., Boussaid, F., & Islam, S. M. S. (2024, December). Automatic detection of peripheral facial landmarks using 3D facial data. In 2024 39th International Conference on Image and Vision Computing New Zealand (IVCNZ) (pp. 1-6). IEEE. https://doi.org/10.1109/IVCNZ64857.2024.10794203

Abstract

Facial landmarking research has traditionally fo-cused on midface landmarks, largely overlooking peripheral facial features that are crucial in specialized medical applications. This study addresses this gap by developing a novel model to detect 12 peripheral landmarks, which are valuable in clinical scenarios such as obstructive sleep apnea detection and facial palsy assessment. Using the FRGC v2 dataset of 3D facial scans, we manually annotated a subset of 900 scans with peripheral landmarks following a rigorous pre-processing protocol. Building upon a high-performance deep learning model initially designed for midface landmark detection, we restructured its architecture to predict peripheral landmarks by modifying its output layers and training it from scratch using 2D projections of 3D scans. We conducted a comprehensive set of experiments, systematically testing different input configurations by varying both the number of images per scan (16, 32, and 64) and the image types (mesh-only, RGB, and depth maps). The model demonstrated its potential by achieving a mean error of 10.72 mm, highlighting the promise of deep learning techniques in addressing the complex challenge of peripheral landmark detection. These findings underscore the model's capability to support niche medical applications and open pathways for future advancements that could refine its accuracy, ultimately contributing to improved diagnostic tools in healthcare.

DOI

10.1109/IVCNZ64857.2024.10794203

Access Rights

subscription content

Link to Full Text

Share

 
COinS