Virtual Walk-Through of Dunhuang Panorama-Based on Web

Abstract:

In order to provide virtual Dunhuang panorama browse (walk-through) on the web, we propose a hybrid technique which combines both remote image rendering and image compression transportation technique. In our approach, the server renders a partial panoramic view, which is based on the users viewpoint and last movements or sends image. The server then compress images, and streams the images to the client device, which will progressively build the panoramic representation of the scene. Furthermore, in order to enhance streaming performance and quality of the interaction, we propose to use a prediction of the users movements as well as a rate control mechanism within the virtual mural. In this paper we discuss our scheme for web-based remote rendering and streaming of progressive panoramas. Our results indicate clearly that the proposed solution is able to achieve stable frame rates and throughput in general network environment.

• Periodical: Advanced Materials Research (Volumes 718-720)
• Pages: 2175-2183
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.718-720.2175
• Online since: July 2013
• Authors: Jian Wu, Tian Xiu Yu
• Keywords: Dunhuang, Network Transportation, Panorama, Web Browser

References

[1] J. Chim et al., ¨A Web-Based Distributed Virtual Walkthrough Environment,〃IEEE Trans. Multimedia, vol. 5, no. 4, 2003, pp.503-515.

[2] G.V. Popescu and C.F. Codella, ¨An Architecture for QoS Data Replication in Network Virtual Environments,〃 Proc. IEEE Virtual Reality Conf., IEEE CS Press, 2002, pp.41-48.

DOI: 10.1109/vr.2002.996503

[3] P. Gioia, O. Aubault, and C. Bouville, ¨Real-Time Reconstruction of Wavelet-Encoded Meshes for View-Dependent Transmission and Visualization,〃 IEEE Trans. Circuits Systems and Video Technology, vol. 14, no. 7, 2004, pp.1009-1020.

DOI: 10.1109/tcsvt.2004.830672

[4] K.-H. Anders, ¨Level of Detail Generation of 3D Building Groups by Aggregation and Typification, Proc. 22nd Intˇl Cartographic Conf., 2005.

[5] V. Coors, ¨Feature-Preserving Simplification in Web-Based 3D-GIS," Proc. Intˇl Symp. Smart Graphics, ACM Press, 2001, pp.22-27.

[6] J. Royan, C. Bouville, and P. Gioia, ¨PBTreeA New Progressive and Hierarchical Representation for Network-Based Navigation in Urban Environments,:" Proc. Vision, Modeling, and Visualization, 2003, pp.299-307; http://perso.rd.francetelecom.fr/bouville/index_fichiers/articleVMV2003.pdf.

DOI: 10.1007/bf03219855

[7] Balakrishnan, H., Katz, R. Explicit Loss Notification and Wireless Web Performance, IEEE Globecom Internet Mini-Conference, Nov. 1998.

[8] Biaz, S., Vaidya, N. H. Discriminating congestion loss from wireless losses using inter-arrival times at the receiver, Proc. Of IEEE Symposium on Application-specific System and Software Engr. and Techn., pp.10-17, Richardson, TX, Mar 1999.

DOI: 10.1109/asset.1999.756746

[9] Boukerche, A., Huang, T., Pazzi, R. W. N. A real-time transport protocol for image-based rendering over heterogeneous wireless networks. In Proceedings of the 8th ACM International Symposium, MSWiM 2005.

DOI: 10.1145/1089444.1089503

[10] Boukerche, A., Pazzi, R. W. N. "Performance Evaluation of a Streaming Based Protocol for 3D Virtual Environment Exploration on Mobile Devices". Proceedings of the 9th ACM International Symposium MSWiM 2006.

DOI: 10.1145/1164717.1164723

[11] Chang, C. and Ger, S. Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering. In Proceedings of the Third IEEE Pacific Rim Conference on Multimedia. In LNCS vol. 2532. 1105-1111. (2002)

DOI: 10.1007/3-540-36228-2_137

[12] Chen, M., Zakhor, A. Rate control for streaming video over wireless, IEEE Infocom 2004, Hong Kong, China, Mar. 2004.

DOI: 10.1109/infcom.2004.1357004

[13] Floyd, S., Handley, M., Padhye, J., Widmer, J. Equation-Based Congestion Control for Unicast Applications, Proc. ACM SIGCOMM 2000, Aug. 2000, pp.43-56

DOI: 10.1145/347057.347397

[14] Handley, M., Floyd, S., Padhye, J., Widmer, J. TCP Friendly Rate Control (TFRC) Protocol Specification, RFC 3448.

DOI: 10.17487/rfc3448

[15] Koller, D., et. al. Protected interactive 3D graphics via remote rendering. ACM Trans. Graph. 695-703. 2004.

DOI: 10.1145/1015706.1015782

[16] OpenGL - The Industry's Foundation for High Performance Graphics http://www.opengl.org/ OpenGL Embeded System. http://www.khronos.org/opengles/ (2006)

[17] Vicente, E., Mujica, V., Sisalem, D., Popescu-Zeletin, R., Wolisz, A. "TCP-Friendly Congestion Control over Wireless Networks". In Proc. of European Wireless 2004, Barcelona, Spain, February 2004.

[18] QuickTime VR. http://www.virtuallyvancouver.com/index2.html.

[19] Szeliski, R., Shum, H.-Y. Creating full view panoramic image mosaics and environment maps. In SIGGRAPH, pages 251258.ACM Press/Addison- Wesley Publishing Co., 1997.

DOI: 10.1145/258734.258861

[20] Thomas, G., Point, G., Bouatouch, K. A client-server approach to image-based rendering on mobile terminals. Technical Report, ISSN 0249-6399, France, January 2005.

[21] Ilmi Yoon. Web-Based Remote Rendering with IBRAC . EUROGRAPHICS 2000.

[22] Azzedine Boukerche. Remote Rendering and Streaming of Progressive Panoramas for Mobile Devices. Proceedings of the 14th annual ACM international conference,2006.

DOI: 10.1145/1180639.1180785

[23] Djurcilov, S., Pang, A., "Visualization Products On-Demand Through the Web", VRML 98 Third Symposium on the VRML, p.7 – 24.

[24] Visible Human Project web page http://www.nlm.nih.gov/research/visible/visible_human.

[25] Trapp, J.C., and Pagendarm, "A prototype for a WWW-based Visualization Service", (Proc. Eurographics Workshop, Visualization in Scientific Computing '97, pp.21-30) Available at http://www.sm.go.dlr.de/smsk_info/library/documents/EGSciVis97/VaWX5Fproto-1.html.

DOI: 10.1007/978-3-7091-6876-9_3

[26] M. Levoy, "Polygon-Assisted JPEG and MPEG Compression of Synthetic Images", Computer Graphics, (Proc. SIGGRAPH 95 pp.21-28) .

DOI: 10.1145/218380.218392

[27] Cohen-Or, D., "Model-Based View Extrapolation for Interactive VR Web-Systems," Computer Graphics International, 1997.

DOI: 10.1109/cgi.1997.601282

[28] Chen, E., and Williams, L., "View Interpolation for Image Synthesis", Computer Graphics (Proc.SIGGRAPH 93, pp.279-288).