Feature Extraction Trends for Intelligent Facial Expression Recognition: A Survey
Abstract
Human facial expression is important means of non-verbal communication and conveys a lot more information visually than vocally. In Human-machine interaction facial expression recognition plays a vital role. Still facial expression recognition through machines like computer is a difficult task. Face detection, feature extraction and expression classification are the three main stages in the process of Facial Expression Recognition (FER). This survey mainly covers the recent work on FER techniques. It especially focuses on the performance including efficiency and accuracy in face detection, feature extraction and classification methods.
Full Text:
PDFReferences
References
Liu, Shuai-Shi, Yan-Tao Tian, and Dong Li. "New research advances of facial expression recognition." Machine Learning and Cybernetics, 2009 International Conference on. Vol. 2. IEEE, 2009.
Alazrai, Rami, and CS George Lee. "Real-time emotion identification for socially intelligent robots." Robotics and Automation (ICRA), 2012 IEEE International Conference on. IEEE, 2012.
Lau, Bee Theng. "Portable real time emotion detection system for the disabled." Expert Systems with Applications 37.9 (2010): 6561-6566.
Lu, X. "Image Analysis for Face Recognition, personal notes, May 2003." URL https://www. msu. edu/~ lvxiaogu/publications/publications. htm (2003).
Zhao-Yi, Peng, Zhu Yan-Hui, and Zhou Yu. "Real-time facial expression recognition based on adaptive canny operator edge detection." Multimedia and Information Technology (MMIT), 2010 Second International Conference on. Vol. 2. IEEE, 2010.
Mayer, Christoph, et al. "A real time system for model-based interpretation of the dynamics of facial expressions." Automatic Face & Gesture Recognition, 2008. FG'08. 8th IEEE International Conference on. IEEE, 2008.
Peng, Zhao-yi, Zhi-qiang Wen, and Yu Zhou. "Application of mean shift algorithm in real-time facial expression recognition." Computer Network and Multimedia Technology, 2009. CNMT 2009. International Symposium on. IEEE, 2009.
Happy, S. L., Anjith George, and Aurobinda Routray. "A real time facial expression classification system using Local Binary Patterns." Intelligent Human Computer Interaction (IHCI), 2012 4th International Conference on. IEEE, 2012.
Bailenson, Jeremy N., et al. "Real-time classification of evoked emotions using facial feature tracking and physiological responses." International journal of human-computer studies 66.5 (2008): 303-317.
Ghimire, Deepak, and Joonwhoan Lee. "Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines." Sensors 13.6 (2013): 7714-7734.
Sung, Jaewon, Sangjae Lee, and Daijin Kim. "A real-time facial expression recognition using the STAAM." Pattern Recognition, 2006. ICPR 2006. 18th International Conference on. Vol. 1. IEEE, 2006.
Lu, H-C., Y-J. Huang, and Y-W. Chen. "Real-time facial expression recognition based on pixel-pattern-based texture feature." Electronics letters 43.17 (2007): 916-918.
Khan, Rizwan Ahmed, et al. "Framework for reliable, real-time facial expression recognition for low resolution images." Pattern Recognition Letters 34.10 (2013): 1159-1168.
Ghandi, Bashir Mohammed, R. Nagarajan, and Hazry Desa. "Particle swarm optimization algorithm for facial emotion detection." Industrial Electronics & Applications, 2009. ISIEA 2009. IEEE Symposium on. Vol. 2. IEEE, 2009.
Punitha, A., and M. Kalaiselvi Geetha. "HMM Based Real Time Facial Expression Recognition." IJETAE 3.1 (2013).
Adeshina, A.M., Lau, S.-H., Loo, C.-K.:‘Real-time FERs: a review’. Innovative Technologies in Intelligent Systems and Industrial Applications, CITISIA 2009, Monash, 25–26 July 2009, pp. 375–378
Geetha, A., et al. "Facial expression recognition–A real time approach." Expert Systems with Applications 36.1 (2009): 303-308.
Owusu, Ebenezer, Yongzhao Zhan, and Qi Rong Mao. "A neural-AdaBoost based facial expression recognition system." Expert Systems with Applications 41.7 (2014): 3383-3390.
Fan, Xijian, and Tardi Tjahjadi. "A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences." Pattern Recognition 48.11 (2015): 3407-3416.
Zhang, Ligang, Dian Tjondronegoro, and Vinod Chandran. "Facial expression recognition experiments with data from television broadcasts and the World Wide Web." Image and Vision Computing 32.2 (2014): 107-119.
Fang, Hui, et al. "Facial expression recognition in dynamic sequences: An integrated approach." Pattern Recognition 47.3 (2014): 1271-1281.
Wang, Zhan, Qiuqi Ruan, and Gaoyun An. "Facial expression recognition using sparse local Fisher discriminant analysis." Neurocomputing 174 (2016): 756-766.
Happy, S. L., and Aurobinda Routray. "Automatic facial expression recognition using features of salient facial patches." IEEE transactions on Affective Computing 6.1 (2015): 1-12.
Tong, Ying, Rui Chen, and Yong Cheng. "Facial expression recognition algorithm using LGC based on horizontal and diagonal prior principle." Optik-International Journal for Light and Electron Optics 125.16 (2014): 4186-4189.
Ali, Ghulam, Muhammad Amjad Iqbal, and Tae-Sun Choi. "Boosted NNE collections for multicultural facial expression recognition." Pattern Recognition 55 (2016): 14-27.
Andrews, Timothy J., et al. "Contributions of feature shapes and surface cues to the recognition and neural representation of facial identity." Cortex 83 (2016): 280-291.
Hernandez-Matamoros, Andres, et al. "A facial expression recognition with automatic segmentation of face regions." International Conference on Intelligent Software Methodologies, Tools, and Techniques. Springer International Publishing, 2015.
DOI: https://doi.org/10.31449/inf.v42i4.2037
This work is licensed under a Creative Commons Attribution 3.0 License.