Design and Development of a Multi-Sided Tabletop Augmented Reality 3D Display Coupled with Remote 3D Imaging Module

Muhammad Saad; Shahid Iqbal; Shoaib R. Soomro

doi:10.5614/j.eng.technol.sci.2022.54.6.6

Authors

Muhammad Saad Electronic Engineering Department, Mehran University of Engineering and Technology, Jamshoro, Pakistan
Shahid Iqbal Electronic Engineering Department, Mehran University of Engineering and Technology, Jamshoro, Pakistan
Shoaib R. Soomro Electronic Engineering Department, Mehran University of Engineering and Technology, Jamshoro, Pakistan

DOI:

https://doi.org/10.5614/j.eng.technol.sci.2022.54.6.6

Keywords:

3D displays, 3D imaging, augmented reality systems, optical engineering, stereoscopy, systems engineering

Abstract

This paper proposes a tabletop augmented reality (AR) 3D display paired with a remote 3D image capture setup that can provide three-dimensional AR visualization of remote objects or persons in real-time. The front-side view is presented in stereo-3D format, while the left-side and right-side views are visualized in 2D format. Transparent glass surfaces are used to demonstrate the volumetric 3D augmentation of the captured object. The developed AR display prototype mainly consists of four 40 30 cm² LCD panels, 54% partially reflective glass, an in-house developed housing assembly, and a processing unit. The capture setup consists of four 720p cameras to capture the front-side stereo view and both the left- and right-side views. The real-time remote operation is demonstrated by connecting the display and imaging units through the Internet. Various system characteristics, such as range of viewing angle, stereo crosstalk, polarization perseverance, frame rate, and amount of reflected and transmitted light through partially reflective glass, were examined. The demonstrated system provided 35% optical transparency and less than 4% stereo crosstalk within a viewing angle of 20 degrees. An average frame rate of 7.5 frames per second was achieved when the resolution per view was 240 240 pixels.

Downloads

Download data is not yet available.

References

Azuma, R.T., Survey of Augmented Reality, Presence: Teleoperators & Virtual Environments, 6(4), pp. 355?385, 1997.

Carmigniani J. & Furht B., Handbook of Augmented Reality, Springer, 2011.

Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani, E. & Ivkovic, M., Augmented Reality Technologies, Systems and Applications, Multimedia Tools and Applications, 51(1), pp. 341-377, 2011.

Geng, J., Three-Dimensional Display Technologies, Advances in Optics and Photonics, 5(4), pp. 456-535, 2013.

Urey, H., Chellappan, K.V., Erden E. & Surman, P., State of The Art in Stereoscopic and Autostereoscopic Displays, Proceedings of the IEEE, 99(4), pp. 540-555, 2011.

Martinez-Corral, M., Dorado, A., Barreiro, J. C., Saavedra G. & Javidi, B., Recent Advances in the Capture and Display of Macroscopic and Microscopic 3-D Scenes by Integral Imaging, Proceedings of the IEEE, 105(5), pp. 825-836, 2017.

Elmqaddem, N., Augmented Reality and Virtual Reality in education. Myth or Reality? International Journal of Emerging Technologies in Learning, 14(3), pp. 234-242, 2019.

Fadzli, F.E., Kamson, M.S., Ismail, A.W. & Aladin, M.Y.F., 3D Telepresence for Remote Collaboration in Extended Reality (Xr) Application, IOP Conference Series: Materials Science and Engineering, 979(1), 2020.

Kiyokawa, K., Head-Mounted Display Technologies for Augmented Reality, in Fundamentals of Wearable Computers and Augmented Reality, Tylor and Francis Group, Chapter 4, 2016.

Hua, H. & Javidi, B., A 3D Integral Imaging Optical See-through Head-Mounted Display, Optics Express, 22(11), 13484, 2014.

Coni, B., Bardon, J.L., Gueguen, A. & Grossete, M., Development of A 3D HUD Using a Tunable Bandpass Filter for Wavelength Multiplexing,? Journal of the Society for Information Display, 25(3), pp. 158-166, 2017.

Wu, P.J., Chuang, C.H., Chen, C.Y., Wu, J.H. & Lin, B.S., An Augmented Reality Head-Up Display System with a Wide-View Eyebox, International Journal of Optics, 2020, 4719268, 2020.

Lanman, D. & Luebke, D., Near-Eye Light Field Displays, Proceedings of ACM SIGGRAPH 2013 Emerging Technologies 32(6), pp. 1-10, 2013.

Dunn, D., Tippets, C., Torell, K., Kellnhofer, P., Aksit, K., Didyk, P. , Myszkowski, K., Luebke D. & Fuchs, H., Wide Field of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors, IEEE Transactions on Visualization and Computer Graphics, 23(4), pp. 1275-1284, 2017.

Maimone, A., Georgiou, A. & Kollin, J.S., Holographic Near-Eye Displays for Virtual and Augmented Reality, ACM Transactions on Graphics, 36(4), pp. 1-16, 2017.

Cem, A., Hedili, M. K., Ulusoy, E. & Urey, H., Foveated Near-Eye Display Using Computational Holography, Scientific Reports, 10(1), pp. 1-9, 2020.

Hedili, M.K., Freeman, M.O. & Urey, H., Transmission Characteristics of a Bidirectional Transparent Screen Based on Reflective Microlenses, Optics Express, 21(21), pp. 24636-24646, 2013.

Soomro, S.R. & Urey H., Light-Efficient Augmented Reality 3D Display Using Highly Transparent Retro-Reflective Screen, Applied optics, 56(22), pp. 6108?6113, 2017.

Ren, H., Ni, L.X., Li, H.F., Sang, X. Z., Gao X. & Wang, Q.H., Review on Tabletop True 3D Display, Journal of the Society for Information Display, 28(1), pp. 75-91, 2020.

Chen, X., Chen, L. & Qiao, W., Tabletop 3D Display with Triple Viewing Zones, Digest of Technical Papers - SID International Symposium, 50(2), pp. 779-782, 2019.

Yu, X., Sang, X., Gao, X., Yan, B., Chen, D., Liu, B., Liu, L., Gao, C. & P. Wang, 360-Degree Tabletop 3D Light-Field Display with Ring-Shaped Viewing Range Based on Aspheric Conical Lens Array, Optics Express, 27(19), 26738, 2019.

Shim, H., Lee, D., Park, J., Yoon, S., Kim, H., Kim, K., Heo, D., Kim, B., Hahn, J., Kim, Y. & Jang, W., Development of A Scalable Tabletop Display Using Projection-Based Light Field Technology, Journal of Information Display, 22(4), pp. 285-292, 2021.

Makiguchi, M., Sakamoto, D., Takada, H., Honda, K. & Ono, T., Interactive 360-Degree Glasses-Free Tabletop 3D Display, Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 625-637, 2019.

He, M.Y., Zhang, H.L., Deng, H., Li, X.W., Li, D.H. & Wang, Q.H., Dual-View-Zone Tabletop 3D Display System Based on Integral Imaging, Applied Optics, 57(4), pp. 952-958, 2018.

Luo, L., Wang, Q.H., Xing, Y. Deng, H., Ren, H. & Li, S., 360-Degree Viewable Tabletop 3D Display System Based on Integral Imaging by Using Perspective-Oriented Layer, Optics Communications, 438 (January), pp. 54-60, 2019.

Date, M., Isogai, M. & Kimata, H., Full Parallax Tabletop 3D Display Using Visually Equivalent Light Field, Proceedings of 26th IEEE Conference on Virtual Reality and 3D User Interfaces, pp. 1297-1298, 2019.

Kim, J., Lim, Y., Hong, Kim, H., Kim, H. E., Nam, J., Park, J., Hahn, J., & Kim, Y.J., Electronic Tabletop Holographic Display: Design, Implementation and Evaluation, Applied Sciences, 9(4), 705, 2019.