Content-Aware Image Retargeting Based on Semantic Analysis

Abstract:

This paper presents a retargeting approach based on semantic analysis. Our approach has better performance in images that have comlicated backgroud or multi-objects. Our aim is to protect important object in retargeting process. So we brought in object recognition and image importance calculation for retargeting. This approach consists of three parts: object recognition, the importance of image calculation and image retargeting. (i) Firstly we optimized semantic texton forest (STF)^[11] and got much better results of object recognition.(ii) Secondly we presented a method called dynamically adjust importance image calculation. (iii) Thirdly we give a retargeting method based on triangular mesh. According to importance image we cover Delaunay triangular mesh on image and solve optimization mesh transforming based on energy function which subjects to least energy loss and boundary restraint. Compared with previous approaches, our method has better result in some complex scene images.

• Periodical: Applied Mechanics and Materials (Volume 577)
• Pages: 777-781
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.577.777
• Online since: July 2014
• Authors: Hao Cheng*, Wei Li, Pei Min Zhong
• Keywords: Content-Aware, Image Retargeting, Object Recognition

References

[1] Suh,B., Ling,H., Bederson B.B., Jacobs,D.,W., Automatic Thumbnail cropping and Its Effectiveness, Proceeding of the 16th ACM Sympoium on User Interface Software and Technology, 2003, pp.95-104.

DOI: 10.1145/964696.964707

[2] Stentiford. F, Attention Based image cropping, The 5th International Conference on Computer Vision, (2007).

[3] F., Liu, Michael G., Video Retargeting: Automatic pan and scan", Proceedings of the 14th Annual ACM International Conference on Multimedia, MM2006, pp.241-250.

[4] Avidan Shai, Shamir Ariel. Seam Carving for Content-Aware Image Resizing, Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, San Diego, CA, USA, August, (2007).

DOI: 10.1145/1275808.1276390

[5] Rubinstein Michael, Shamir Ariel, Avidan Shai. Improved Seam Carving for Video Retargeting[C]. Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, Los Angeles, CA, USA, August, (2008).

DOI: 10.1145/1399504.1360615

[6] Goferman. S, Zelnik-Manor,L., and Tal,A., Context-aware saliency detection. [C] IEEE Conference on Computer Vision and Pattern Recognition, CVPR2010, 2010, pp.2376-2386.

DOI: 10.1109/cvpr.2010.5539929

[7] R. Gal, O. Sorkine, D. Cohen-Or. Feature-aware texturing, Eurographics Symp. On Rendering, (2006).

[8] Wolf,L., Cohen-Or D. Non-homogeneous content-driven video retargeting, In IEEE International Conference of Computer Vision, ICCV2007, (2007).

DOI: 10.1109/iccv.2007.4409010

[9] Simakov Denis, Caspi Yaron, Shechtman Eli, Irani Michal. Summarizing Visual Data Using Bidirectional Similarity, IEEE Conference on Computer Vision and Pattern Recognition, CVPR2008, Anchorage, AK, USA, June, (2008).

DOI: 10.1109/cvpr.2008.4587842

[10] Cho T.S., Butman,M., Avidan,S., and Freeman, W.T., The patch transform and its applications to image editing, In IEEE Conference Computer Vision and Pattern Recognition , CVPR2008, 2008, pp: 1-8.

DOI: 10.1109/cvpr.2008.4587642

[11] Shotton Jamie, Johnson Matthew, Cipolla Roberto. Semantic texton forests for image categorization and segmentation,. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR, Anchorage, AK, USA, June, (2008).

DOI: 10.1109/cvpr.2008.4587503

[12] Guo,Y., Liu,F., Shi,J., Zhou,Z., Gleicher,M., Image retargeting using mesh parametrization. [J] ACM Transaction On Multimedia. Vol. 11, No. 5, pp: 856-867.

DOI: 10.1109/tmm.2009.2021781

[13] Zhigao, C, Wei, L, Xiaoyan, L, Tianran, L, Akram, N, Image Retargeting Based on Delaunay Triangle Mesh, IEEE 6th International Conference on Advanced Information Management and Service.