A Survey on Emotional Semantic Mapping in Image Retrieval

Abstract:

Emotion plays an important role in the human perception and decision-making process. Human comprehension and perception of images is subjective, and not merely rely on lower-level visual features. Semantic gap is regarded as the most important challenge of image retrieval. In this paper, we analyzed the emotional features as well as emotional semantic description of images, which comes from the image emotional semantics retrieval framework. And also the mapping ways and means were summarized from image visual features to emotional semantics. Finally, the disadvantages of emotional semantic mapping and developing tendency were discussed.

• Periodical: Advanced Materials Research (Volumes 532-533)
• Pages: 1297-1302
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.532-533.1297
• Online since: June 2012
• Authors: Zeng Rong Liu, Zhi Li, Xue Li Yu
• Keywords: Emotional Semantic, Emotional Semantic Mapping, Feature Extraction, Image Retrieval

References

[1] Vasconcelos N, From pixels to semantic spaces: advances in content-based image retrieval., computer, 2007, 40(7): 20-26.

DOI: 10.1109/mc.2007.239

[2] R. W. Picard. Synthetic emotion. IEEE Computer Graphics and Applications. 2000, 20(1): 52-53.

[3] P. Ekman, W. V. Friesen, Manual for the Facial Action Coding System., Consulting Psychologists Press, (1977).

[4] K. Yoshida, T. Kato, T. Yanaru, Image Retrieval System Using Impression Words Systems, Man, and Cybernetics., 1998 IEEE International Conference on [C]. 1998, 3(11-14): 2780–2784.

DOI: 10.1109/icsmc.1998.725082

[5] Yoshida K, Kato T, Yanaru T. Image Retrieval System Using Impression Words Systems, Man, and Cybernetics [A]. 1998 IEEE International Conference on [C]. 1998, 3(11-14): 2780–2784.

DOI: 10.1109/icsmc.1998.725082

[6] Simon Haykin, Translated by Ye Shi Wei, Shi Zhong Zhi, Neural Networks: A Comprehensive Foundation, 2nd Edition., China Machine Press , 2004(in Chinese).

[7] T. Hayashi, M. Hagiwara, An image retrieval system to estimate impression words from images using a neural network., 1997-IEEE International Conference on Systems, Man, and Cybernetics Computational Cybernetics and Simulation, IEEE, New York, NY, 1997(1): 150-155.

DOI: 10.1109/icsmc.1997.625740

[8] Shangfei Wang, A Kansei Image Retrieval Based on Emotion Model. , Journal of Circuits and Systems, 2003, 8(6): 48-52.

[9] Hualin Wan, Image Semantic Classification by Using SVM., Journal of Software, 2003, 14(11): 1891-1899.

[10] Jinsub Um. A Study of the Emotional Evaluation Models of Color Patterns Based on the Adaptive Fuzzy System and the Neural Network[J]. COLOR research and application, 2002, 27(3): 208-216.

DOI: 10.1002/col.10052