Multi-Level Haar Wavelet Based Facial Expression Recognition using Logistic Regression

##plugins.themes.academic_pro.article.sidebar##

Published Jul 1, 2018
https://doi.org/10.47164/ijngc.v9i2.145
Download
PDF
Statistic

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...
Volume 9, Issue 2, July 2018

##plugins.themes.academic_pro.article.main##

Mahesh M Goyani
Gujarat Technological University
Narendra Manorbhai Patel
Narendra Manorbhai Patel

Abstract

Facial expressions play an equally important role as verbal communication and tonal expression. Recognition of facial expression is important in industrial automation, security, medical and many other fields. An image is a very rich and high dimensional data structure, which can result into a considerable computation when processed upon directly. Various feature extraction techniques have been proposed to represent the images efficiently in lower dimension which is understandable by the computer. Configuration and dynamics, both are crucial in the interpretation of facial expressions. This work is based on the configuration of facial texture, it does not account dynamics of muscle change. In this paper, we propose multilevel haar wavelet-based approach, which extracts the features from prominent face regions at two different scales. The approach first segments most informative geometric components such as eye, mouth, eyebrows etc. using the AdaBoost cascade object detector. Haar features of segmented components are extracted. OneVsAll logistic regression model is used for the classification. The performance of the proposed approach is tested on well-known CK, JAFFE and TFEID facial expression datasets, and it achieves 90.48%, 88.57% and 96.84% accuracy for the respective dataset.

##plugins.themes.academic_pro.article.details##

How to Cite
Mahesh M Goyani, Narendra Manorbhai Patel, & Narendra Manorbhai Patel. (2018). Multi-Level Haar Wavelet Based Facial Expression Recognition using Logistic Regression. International Journal of Next-Generation Computing, 9(2), 131–151. https://doi.org/10.47164/ijngc.v9i2.145
Crossref
Scopus
Google Scholar
Europe PMC

References

  1. Almaev, T. R. and Valstar, M. F. 2013. Local gabor binary patterns from three orthogonal planes for automatic facial expression recognition. In Humaine Association Conference on
  2. Aective Computing and Intelligent Interaction. pp.356{361.
  3. Bartlett, M. S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., and Movellan, J. 2005. Recognizing facial expression: Machine learning and application to spontaneous behavior. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp.568{573.
  4. Belhumeur, P. N., Hespanha, J. P., and Kriegman, D. J. 1997. Eigenfaces vs. sherfaces: Recognition using class specic linear projection. IEEE Transaction on Pattern Analysis and Machine Intelligence Vol.19, No.7.
  5. Chen, L.-F. and Yen, Y.-S. 2007. Taiwanese facial expression image database. Brain Mapping Laboratory, Institute of Brain Science, National Yang-Ming University, Taipei, Taiwan.
  6. Corneanu, C. A., Marc, O., Cohn, J. F., and Sergio, E. 2016. Survey on rgb, 3d, ther- mal, and multimodal approaches for facial expression recognition: History, trends, and aect-related applications. IEEE Transactions on Pattern Analysis and Machine Intelli- gence Vol.38, No.8.
  7. D. Huang, C. Shan, M. A. Y. W. and Chen, L. 2011. Local binary patterns and its application to facial image analysis: A survey. IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews Vol.41, No.6.
  8. Darvin, C. 1872. The expression of the emotions in man and animals. J. Murray, London.
  9. Ekman, P. and Friesen, W. V. 1971. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology Vol.17, No.2.
  10. Ekman, P. and Friesen, W. V. 1978. Facial action coding system: A technique for measure- ment of facial movement. Consulting Psychologists Press.
  11. Essa, I. A. and Pentland, A. P. 1997. Coding, analysis, interpretation, and recogni- tion of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelli- gence Vol.19, No.7, pp.757{763.
  12. Fasel, B. and Luettin, J. 2003. Automatic facial expression analysis: A survey. Pattern Recognition Vol.36, No.1.
  13. G. Wenfei, C. Xiang, Y. V. V. D. H. and Lin, H. 2012. Facial expression recognition using radial encoding of local gabor features and classier synthesis. Pattern Recogni- tion Vol.45, No.1.
  14. Gao, Y., Leung, M., Hui, S. C., and Tananda, M. 2003. Facial expression recognition from line-based caricatures. IEEE Transactions on Systems, Man, and Cybernetics - Part A:Systems and Humans Vol.33, No.3.
  15. H. Boughrara, M. Chtourou, C. B. A. and Chen, L. 2016. Facial expression recognition based on a mlp neural network using constructive training algorithm. Multimedia Tools and Applications Vol.75, No.2, pp.709{731.
  16. J. M. Guo, S. H. T. and Wong, K. 2016. Accurate facial landmark extraction. IEEE Signal Processing Letters Vol.23, No.5, pp.605{609.
  17. Jabid, T., Kabir, M. H., and Chae, O. 2010. Robust facial expression recognition based on local directional pattern. ETRI Journal Vol.32, No.5.
  18. Kanade, T., Cohn, J. F., and Tian, Y. 2000. Comprehensive database for facial expression analysis. In 4th IEEE International Conference on Automatic Face and Gesture Recognition. pp.46{53.
  19. Liu, W. and Wang, Z. 2006. Facial expression recognition based on fusion of multiple gabor features. In 18th International Conference on Pattern Recognition. pp.536{539.
  20. Lyons, M. and Akamatsu, S. 1998. Coding facial expressions with gabor wavelets. In 3rd IEEE Conference on Automatic Face and Gesture Recognition. pp.200{205.
  21. Lyons, M. J. 1999. Automatic classication of single facial images. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol.21, No.12.
  22. M. S. Bartlett, J. R. M. and Sejnowski, T. J. 2002. Face recognition by independent component analysis. IEEE Transactions on Neural Network Vol.13, No.6.
  23. M. Song, D. Tao, Z. L. X. L. and Zhou, M. 2010. Image ratio features for facial expression recognition application. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics Vol.40, No.3, pp.779{788.
  24. Mallat, S. G. 1989. A theory for multiresolution signal decomposition: The wavelet repre- sentation. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol.11, No.7, pp.674{693.
  25. Mehrabian, A. 1968. Communication without words. Psychology Today Vol.2, pp.53{55.
  26. Moore, S. and Bowden, R. 2011. Local binary patterns for multi-view facial expression recognition. Computer Vision and Image Understanding Vol.115, No.4.
  27. Ojala, T., Pietikainen, M., and Harwood, D. 1996. A comparative study of texture mea- sures with classication based on feature distributions. Pattern Recognition Vol.29, No.1.
  28. Ojala, T., Pietikainen, M., and Maenpaa, T. 2002. Multiresolution gray-scale and rotation invariant texture classication with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol.24, No.7.
  29. Oliveira, L., Koerich, A., Mansano, M., and Britto, A. 2011. 2d principal component analysis for face and facial-expression recognition. Computing in Science and Engineer- ing Vol.13, pp.9{13.
  30. Owusu, E., Zhan, Y., and Mao, Q. R. 2014. A neural-adaboost based facial expression recognition system. Expert Systems With Applications Vol.41, No.7, pp.3383{3390.
  31. Pantic, M. and Patras, I. 2006. Dynamics of facial expression: Recognition of facial actions and their temporal segments from face prole image sequences. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics Vol.36, No.2, pp.433{449.
  32. Papageorgiou, C. and Poggio, T. 2000. A trainable system for object detection. International Journal of Computer Vision Vol.38, No.1, pp.15{33.
  33. R. A. Khan, A. Meyer, H. K. and Bouakaz, S. 2013. Framework for reliable, real-time facial expression recognition for low resolution images. Pattern Recognition Letters Vol.34, No.10, pp.1159{1168.
  34. R. Hablani, N. C. and Tanwani, S. 2013. Recognition of facial expressions using local binary patterns of important facial parts. International Journal of Image Processing Vol.7, No.2.
  35. Rahulamathavan, Y., Phan, R. C.-W., Chambers, J. A., and Parish, D. J. 2013. Facial expression recognition in the encrypted domain based on local sher discriminant analysis. IEEE Transactions on Aective Computing Vol.4, No.1, pp.83{92.
  36. Samad, R. and Sawada, H. 2011. Edge-based facial feature extraction using gabor wavelet and convolution lters. In IAPR Conference on Machine Vision Applications. pp.430{433.
  37. Shan, C., Gong, S., and Mcowan, P. W. 2009. Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing Vol.27, No.6.
  38. Shih, F. Y., Chuang, C.-F., andWang, P. 2008. Performance comparisons of facial expression recognition in jae database. International Journal of Pattern Recognition and Articial Intelligence Vol.22, No.3.
  39. Stankovir, R. S. and Falkowski, B. J. 2003. The haar wavelet transform: Its status and achievements. Computers and Electrical Engineering Vol.29, No.1, pp.15{33.
  40. Suwa, M., Sugie, N., and Fujimora, K. 1978. A preliminary note on pattern recognition of human emotional expression. In International Joint Conference on Pattern Recognition. pp.408{410.
  41. T. Senechal, V. Rapp, H. S. R. S. K. B. and Prevost, L. 2012. Facial action recognition combining heterogeneous features via multikernel learning. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics Vol.42, No.4.
  42. T. Wu, M. S. B. and Movellan, J. R. 2010. Facial expression recognition using gabor motion energy lters. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.
  43. Tian, Y. 2004. Evaluation of face resolution for expression analysis. In CVPR Workshop on Face Processing in Video.
  44. Turk, M. A. and Pentland, A. P. 1991. Face recognition using eigenfaces. Journal of Cognitive Neuroscience Vol.3, No.1.
  45. Wang, X., Liu, A., and Zhang, S. 2015. New facial expression recognition based on fsvm and knn. Optik - International Journal for Light and Electron Optics Vol.126, No.21, pp.3132{3134.
  46. Yacoob, Y. and Davis, L. S. 1996. Recognizing human facial expressions from long image sequences using optical ow. IEEE Transactions on Pattern Analysis and Machine Intelli- gence Vol.18, No.6.
  47. Yang, J., Zhang, D., Frangi, A. F., and Yang, J. 2004. Two-dimensional pca: A new approach to appearance-based face representation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol.26, No.1.
  48. Zeng, Z., Pantic, M., Roisman, G. I., and Huang, T. S. 2009. A survey of aect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol.31, No.1.
  49. Zhi, R. and Ruan, Q. 2008. Facial expression recognition based on two-dimensional discriminant locality preserving projections. Neurocomputing Vol.71, No.7, pp.1730{1734.