얼굴 표정 인식 개선을 위한 무표정 감정 분석에 관한 연구

Metadata Downloads
Issued Date
얼굴 표정 인식 무표정 감정 분석
As studies have been conducted on how humans think and act to provide human-friendly high value-added services, the methods of interaction between humans and computers began to be researched. As a result, a new field called human-computer interaction (HCI) has been developed to facilitate the interaction between humans and computers. In order to provide human-friendly services and applications, the recognition of human emotions needs be researched. Among various emotion recognition methods, emotion recognition through facial expressions has enabled human-computer interaction and can be used in a variety of applications. However, it is still difficult to recognize expressionless face. Hence, it is necessary to develop a new method to recognize and analyze even fine facial expressions of emotions.

Consequently, in this study, we propose a method of improving emotion recognition through facial expressions by preprocessing facial expression images that cannot be recognized and performing secondary analysis of the emotion of expressionless images recognized as neutral emotion. In the preprocessing step, the facial image is resized and rotated using the Shape Model, which is a face normalization model, and then normalized to 100×100 pixels. The facial features and emotions in the normalized facial images are identified using the Emotion API. If the facial expression is recognized to be a neutral emotion, the emotion is classified again and the representative emotion is extracted and recognized. The recognized emotions were compared with the actual emotions and the accuracy rate of emotion recognition was very high at 87%.

In an experiment conducted with actual subjects using the proposed method, 100 facial images that were determined to have neutral emotion from the secondary classification were compared with the actual emotions. The result showed that the total accuracy rate of emotion recognition was 73.7%. Happiness and sadness had a very high recognition accuracy rate of 94% compared to other emotions. From analyzing the age and sex of the subjects in the images of the secondary classification, we found that the faces of teenagers were most commonly associated with sadness, while the emotions of those over the age of 20 were most commonly associated with happiness. When the subjects were asked to categorize themselves into 8 different facial expression styles, a high proportion of teenagers tended to express their emotions outwardly, and as people became older, fewer people tended to express their emotions overtly. Consequently, to improve facial expression recognition using the method proposed in this study, the emotions of expressionless faces were analyzed again. Then, the results were compared with the actual emotions of the subjects, and we found that the emotion recognition rate can be improved by recognizing fine non-neutral emotions even from even expressionless faces.

The proposed facial expression recognition method with improved emotion recognition rate is expected to be applicable to many industries including education, counseling, telemedicine, and real estate brokerage, and various advanced services such as personalized services, personal recommendation services, and emotional marketing.
Alternative Title
A Study on the Expressionless Emotion Analysis for Improvement of Face Expression Recognition
Alternative Author(s)
MyungJin Lim
산업기술융합대학원 소프트웨어융합공학과
Awarded Date
2018. 2
Table Of Contents
Ⅰ. 서론 1
A. 연구 배경 및 목적 1
B. 연구 내용 및 구성 2
Ⅱ. 관련 연구 3
A. 감정 인식 3
B. 얼굴 표정 인식 8
C. 감정 활용 10
Ⅲ. 얼굴 표정 감정 인식 개선 방안 17
A. 시스템 구성도 17
B. 얼굴 표정 감정 인식 19
C. 얼굴 표정 감정 인식 개선 방안 26
Ⅳ. 실험 및 결과 33
A. 데이터 수집 33
B. 데이터 셋 34
C. 실험 평가 방법 및 결과 분석 35
Ⅴ. 결론 및 향후연구 44
참고문헌 45
조선대학교 산업기술융합대학원
임명진. (2017). 얼굴 표정 인식 개선을 위한 무표정 감정 분석에 관한 연구
Appears in Collections:
Engineering > Theses(Master)(산업기술창업대학원)
Authorize & License
  • AuthorizeOpen
Files in This Item:

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.