The Effect of the Number of Key-Frames on the Facial Emotion Recognition Accuracy

N. Mohammed, Suhaila; K. Abdul Hassan, Alia

doi:10.30684/etj.v39i1B.1806

	The Effect of the Number of Key-Frames on the Facial Emotion Recognition Accuracy
Engineering and Technology Journal
Article 9, Volume 39, 1B, 2021, Pages 89-100 PDF (636.87 K)
DOI: 10.30684/etj.v39i1B.1806
Authors
Suhaila N. Mohammed^* ¹; Alia K. Abdul Hassan²
¹Department of Computer Science, University of Technology, Baghdad, Iraq [email protected]
²Department of Computer Science, University of Technology, Baghdad, Iraq, [email protected]
Abstract
Key-frame selection plays an important role in facial expression recognition systems. It helps in selecting the most representative frames that capture the different poses of the face. The effect of the number of selected keyframes has been studied in this paper to find its impact on the final accuracy of the emotion recognition system. Dynamic and static information is employed to select the most effective key-frames of the facial video with a short response time. Firstly, the absolute difference between the successive frames is used to reduce the number of frames and select the candidate ones which then contribute to the clustering process. The static-based information of the reduced sets of frames is then given to the fuzzy C-Means algorithm to select the best C-frames. The selected keyframes are then fed to a graph mining-based facial emotion recognition system to select the most effective sub-graphs in the given set of keyframes. Different experiments have been conducted using Surrey Audio-Visual Expressed Emotion (SAVEE) database and the results show that the proposed method can effectively capture the keyframes that give the best accuracy with a mean response time equals to 2.89s.
Keywords
Facial expressions Fuzzy C-Means algorithm Graph-based Substructure Pattern (gSpan) algorithm; Key-frame selection

Statistics Article View: 814 PDF Download: 317