Cross-Media Retrieval Method Based on Space Mapping

Abstract:

This paper puts forward a novel cross-media retrieval approach, which can process multimedia data of different modalities and measure cross-media similarity, such as image-audio similarity. Both image and audio data are selected for experiments and comparisons. Given the same visual and auditory features the new approach outperforms ICA, PCA and PLS methods both in precision and recall performance. Overall cross-media retrieval results between images and audios are very encouraging.

• Periodical: Advanced Materials Research (Volumes 756-759)
• Pages: 1898-1902
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.756-759.1898
• Online since: September 2013
• Authors: Xin Xu, Su Mei Xi
• Keywords: Cross-Media Retrieval, Heterogeneity, Subspace Mapping

References

[1] Zhang Hong-jiang, Zhong Di. Schema for visual feature-based image indexing. Proceeding of the SPIE, Storage and Retrieval for Image and Video Database, San Diego, USA, pp: 36-46, (1995).

DOI: 10.1117/12.205314

[2] David R H, John S T. KCCA for different level precision in content-based image retrieval. Proceedings of the 3rd International Workshop on Content-Based Multimedia Indexing, Rennes, France, pp: 51-56, (2003).

[3] Sonek C G M, Worring M, Geusebroek J M. Semantic video search engine. Proceedings of the TRECVID Workshop, Gaithersburg, USA, pp: 102-105, (2004).

[4] Zhao Xue-Yan, Zhuang Yue-ting, Wu Fei. Audio clip retrieval with fast relevance feedback based on constrained fuzzy clustering and stored index table. Proceedings of the Pacific-Rim Conference on Multimedia, Taiwan, China, pp: 237-244, (2002).

DOI: 10.1007/3-540-36228-2_30

[5] McGurk J M. Hearing lips and seeing voices. Nature, 264(5588), pp: 746-748, (1976).

DOI: 10.1038/264746a0

[6] Hardoon D R. A correlation approach for automatic image annotation. Proceedings of the 2nd International Conference on Advanced Data Mining and Applications, Xi'an, China, pp: 681-692, (2006).

DOI: 10.1007/11811305_75

[7] Wang Xin-Jing, Ma Wei-Ying, Xue Gui-Rong, Li Xing. Multi-model similarity propagation and its application for web image retrieval. Proceedings of the ACM Multimedia Conference, New York, USA, pp: 944-951 , (2008).

DOI: 10.1145/1027527.1027746

[8] Ma Qiang, Akiyo Nadamoto, Katsumi Tanaka. Complementary information retrieval for cross-media news content. Proceedings of Information Systems, 31(7), pp: 659-678, (2006).

DOI: 10.1016/j.is.2005.12.004

[9] Joliffe I T. Principal Component Analysis. New York, Springer-Verlag, pp: 74-81, (1986).

[10] Hansen I. K, Larsen J, Kolenda T. On independent component analysis for multimedia signals. Guan L, kung S Y, Larsen J. Multimedia Image and Video Proceeding, London, CRC press, pp: 175-200, (2000).

DOI: 10.1201/9781420037562.ch7

[11] Lu Wen-Cong, Chen Nian-Yi, Li Guo-Zheng, Yang Jie. Multitask learning using partial least square method. Proceedings of the 7th International Conference on Information Fusion, Stockholm, Sweden, pp: 79-84, (2009).