Abstract
Emotion recognition is considered as one of the most vital and challenging studies in the domain of computer vision. Due to the ongoing pandemic the people’s emotional and mental state is getting affected due to less physical interaction and increased virtual interaction. The motivation of the work lies in the recognition and monitoring of the emotional state of the human beings in live environment with higher accuracy rate and fast recognition time so as to keep them aware about their emotional state in the pandemic situation. Emotion recognition is achieved using the proposed deep convolution neural network (DCNN) using custom Gabor filter with 85.8% accuracy. Emotion recognition is also being investigated and compared with other deep learning models such as AlexNet, VGG-Net for testing the efficacy. When the emotion of the person will be found sad or angry then an alert sound is played and an email alert is automatically sent.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Huang Y, Chen F, Lv S, Wang X (2019) Facial Expression recognition: a survey. Symmetry 11:1189. https://doi.org/10.3390/sym11101189
Ekman P, Friesen W (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto
Yang D, Alsadoon A, Prasad PC, Singh AK, Elchouemi A (2018) An emotion recognition model based on facial recognition in virtual learning environment. Proc Comput Sci 125:2–10
Dols JMF, Russell JA (2017) The science of facial expression. Oxford University Press, Oxford
Xi Z, Niu Y, Chen J, Kan X, Liu H (2021) Facial expression recognition of industrial internet of things by parallel neural networks combining texture features. IEEE Trans Ind Inf 17(4):2784–2793
Jaiswal A, Krishnama Raju A, Deb S (2020) Facial Emotion detection using deep learning. In: 2020 ınternational conference for emerging technology (INCET), pp 1–5
Taghi Zadeh MM, Imani M, Majidi B (2019) Fast facial emotion recognition using convolutional neural networks and Gabor filters. In: 2019 5th conference on knowledge based engineering and ınnovation (KBEI), pp 577–581
Kumar TS (2021) Construction of hybrid deep learning model for predicting children behavior based on their emotional reaction. J Inf Technol 3(01):29–43
Smys S, Raj JS (2021) Analysis of deep learning techniques for early detection of depression on social media network-a comparative study. J Tends Comput Sci Smart Technol (TCSST) 3(01):24–39
Zhang F, Zhang T, Mao Q, Xu C (2020) Geometry guided pose-invariant facial expression recognition. IEEE Trans Image Process 29:4445–4460
Fan Y, Lu X, Li D, Liu Y (2016) Video-based emotion recognition using CNN-RNN and C3D hybrid networks. In: Proceedings of the 18th ACM international conference on multimodal interaction, pp 445–450
Kukla E, Nowak P (2015) Facial emotion recognition based on cascade of neural networks. In: Zgrzywa A, Choroś K, Siemiński A (eds) New research in multimedia and internet systems. Advances in intelligent systems and computing, vol 314. Springer, Cham
Arriaga O, Ploger PG, Valdenegro M (2017) Real-time convolutional neural networks for emotion and gender classification. arXiv:1710.07557v1 [cs.CV]
Yue Z, Yanyan F, Shangyou Z, Bing P (2019) Facial expression recognition based on convolutional neural network. In: 2019 IEEE 10th ınternational conference on software engineering and service science (ICSESS), pp 410–413
Bhandari A, Pal NR (2021) Can edges help convolution neural networks in emotion recognition? Neurocomputing 433:162–168
Lee JR, Wang L, Wong A (2021) Emotionnet nano: an efficient deep convolutional neural network design for real-time facial expression recognition. Front Artif Intell 105
Mehendale N (2020) Facial emotion recognition using convolutional neural networks (FERC). SN Appl Sci 2:446
Dey A, Dasgupta K (2021) Mood recognition in online sessions using machine learning in realtime. In: 2021 5th International conference on computer, communication and signal processing (ICCCSP), pp 1–6
Bursic S, Boccignone G, Ferrara A, D’Amelio A, Lanzarotti R (2020) Improving the accuracy of automatic facial expression recognition in speaking subjects with deep learning. Appl Sci 10:4002. https://doi.org/10.3390/app10114002
Barros P, Churamani N, Sciutti A (2020) The FaceChannel: a fast and furious deep neural network for facial expression recognition. SN Comput Sci 1:321
Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition—workshops, pp 94–101
FER Dataset [Online] https://datarepository.wolframcloud.com/resources/FER-2013. Accessed 30 Mar 2021
Lyons MJ, Kamachi M, Gyoba J (2020) Coding facial expressions with Gabor wavelets (IVC special issue). arXiv:2009.05938
Mungra D, Agrawal A, Sharma P et al (2020) PRATIT: a CNN-based emotion recognition system using histogram equalization and data augmentation. Multimed Tools Appl 79:2285–2307
Yadav G, Maheshwari S, Agarwal A (2014) Contrast limited adaptive histogram equalization based enhancement for real time video system. In: 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp 2392–2397
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, pp I-I
Pantic M (2009) Facial expression recognition. In: Encyclopedia of biometrics (pp 400–406). Springer
Christou N, Kanojiya N (2019) Human facial expression recognition with convolution neural networks. In: Yang XS, Sherratt S, Dey N, Joshi A (eds) Third ınternational congress on information and communication technology. Advances in intelligent systems and computing, vol 797. Springer
Sajjad M, Zahir S, Ullah A et al (2020) Human behavior understanding in big multimedia data using CNN based facial expression recognition. Mobile Netw Appl 25:1611–1621
Jeong M, Ko BC (2018) Driver’s facial expression recognition in real-time for safe driving. Sensors 18(12):4270
Fei Z, Yang E, Li DDU, Butler S, Ijomah W, Li X, Zhou H (2020) Deep convolution network based emotion analysis towards mental health care. Neurocomputing 388:212–227
Muhammad G, Alsulaiman M, Amin SU, Ghoneim A, Alhamid MF (2017) A facial-expression monitoring system for improved healthcare in smart cities. IEEE Access 5:10871–10881
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Dey, A., Dasgupta, K. (2022). Emotion Recognition Using Deep Learning in Pandemic with Real-time Email Alert. In: Bindhu, V., Tavares, J.M.R.S., Du, KL. (eds) Proceedings of Third International Conference on Communication, Computing and Electronics Systems . Lecture Notes in Electrical Engineering, vol 844. Springer, Singapore. https://doi.org/10.1007/978-981-16-8862-1_13
Download citation
DOI: https://doi.org/10.1007/978-981-16-8862-1_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-8861-4
Online ISBN: 978-981-16-8862-1
eBook Packages: EngineeringEngineering (R0)