WO2017206061A1

WO2017206061A1 - System for virtual tourist scenery

Info

Publication number: WO2017206061A1
Application number: PCT/CN2016/084109
Authority: WO
Inventors: 钟志威; 苏明珠; 覃国秘; 刘波; 陈志远; 李万建; 李雯雯; 李耀军; 罗辉; 朱鹏惠
Original assignee: 深圳市赛亿科技开发有限公司
Priority date: 2016-05-31
Filing date: 2016-05-31
Publication date: 2017-12-07
Also published as: CN108370440A

Abstract

A system for virtual tourist scenery, comprising a terminal server (201) and a helmet (202); the terminal server (201) is used for wireless communication with the helmet (202) and for providing the helmet (202) with the tourist scenery data that the helmet (202) needs for browsing; the helmet (202) is used for obtaining the tourist scenery data provided by the terminal server (201), for decoding the obtained tourist scenery data needed for browsing so as to obtain playable audio data and video data corresponding to the tourist scenery data, for playing back audio matching the real-time user walking motion and user head motion data, and for playing back in 2D or 3D video matching the real-time user walking motion and user head motion data, thereby implementing the virtual display of tourist scenery and enabling users to experience famous sites in the world without leaving home.

Description

Virtual tourism landscape system

Technical field

The present invention relates to the field of virtual display technologies, and in particular, to a system for virtual tourist scenery.

Background technique

With the current material living standards and the growing demand for cultural and spiritual quality, tourism has become a common choice for people's rich business life. However, the rhythm of today's life is accelerating, and people have less and less opportunities to adjust their moods. With the development of electronic device technology and Internet technology, people's access to travel information through the Internet has become a very convenient and effective way. In addition, under the condition of limited time and energy or economic conditions, virtual travel through electronic devices can be used as an alternative, but the existing electronic devices can not realize the virtual display of the tourist scenery, and the user cannot be left at home. You can experience places of interest around the world.

Summary of the invention

The technical problem to be solved by the present invention is to provide a system for virtual tourist scenery.

The object of the present invention is to provide a system for virtual tourist scenery, including: a terminal server and a helmet;

The terminal server is configured to wirelessly communicate with the helmet to provide travel landscape data that the helmet needs to browse to the helmet;

The helmet is configured to acquire the tourist scenery data provided by the terminal server, and decode the acquired tourist landscape data that needs to be browsed, and decode the corresponding audio data of the travel landscape data in a playable form. And video data, and audio data and video data corresponding to the travel landscape data in a playable form according to the decoding, playing audio compatible with the user's real-time walking motion, user head motion data, and 2D playback or The 3D plays a video that is compatible with the user's real-time walking motion and the user's head motion data.

The helmet includes: a control button unit, a wireless communication module, an audio and video acquisition unit, an audio and video decoding unit, a motion detection module, a control circuit board, an audio output unit, and a display;

The control button unit is configured to control a button operation and input tourist landscape data that needs to be browsed;

The wireless communication module is configured to wirelessly communicate with a terminal server;

The audio and video acquisition unit is configured to control the wireless communication module to perform wireless communication with the terminal server according to the travel landscape data that is required to be browsed by the control button unit, and obtain the required browsing from the terminal server. Tourist landscape data;

The audio and video decoding unit is configured to decode the travel landscape data that is required to be browsed by the audio and video acquisition unit from the terminal server, and decode the corresponding audio of the travel landscape data in a playable form. Data, video data;

The motion detection module is an acceleration sensor, which is used for real-time monitoring of the speed and direction data of the user during the movement, and real-time monitoring of the head movement and direction data during the user transportation;

The control circuit board is respectively associated with the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display a connection for controlling the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display;

The audio output unit is configured to monitor, according to the speed and direction data of the user during the movement of the motion detection module, the head movement and direction data of the user during real-time monitoring, and according to the audio and video Decoding unit decodes the corresponding audio data of the obtained playable form of the scenic landscape data, and plays audio adapted to the data monitored by the motion detecting module in real time;

The display is configured to monitor, according to the speed and direction data of the user during the movement of the motion detection module, the head movement and direction data of the user motion, and the audio and video decoding unit according to the sound and video Decoding corresponding video data of the travelable form of the obtained playable form, 2D playing or 3D playing a video adapted to the data monitored by the motion detecting module in real time.

The control circuit board includes:

a microprocessor, connected to the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display, respectively Controlling the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display;

A power supply circuit for supplying power to the control circuit board.

The audio output unit includes: a micro speaker.

The display includes: a 2D display unit and a 3D display unit;

The 2D display unit is configured to play, according to the audio and video decoding unit, the corresponding 2D video data of the travelable landscape data in the playable form, and play the data monitored by the motion detection module in real time. Compatible 2D video;

The 3D display unit is configured to play, according to the audio and video decoding unit, the corresponding 3D video data of the travelable landscape data in the playable form, and play the data monitored by the motion detection module in real time. Compatible 3D video.

The 3D display unit includes: a concave lens and a convex lens arranged in sequence from the user end side;

The convex lens is disposed on the other side of the concave lens, and is configured to refract the corresponding 3D video data light of the travel scenery data obtained by decoding the obtained audio and video decoding unit to obtain a holographic 3D visual image. ;

The concave lens is disposed on a side closer to the user end for amplifying the holographic 3D visual image obtained by the convex lens, and correcting the slanting of the light to present a three-dimensional stereoscopic 3D visual image to the user.

The helmet of the virtual tourist landscape provided by the invention controls the button operation, inputs the tourist landscape data that needs to be browsed, and the application audio and video acquisition unit controls the wireless communication module and the terminal server according to the tourist landscape data that needs to be browsed by the control button unit. Wireless communication, obtaining the tourist landscape data that needs to be browsed from the terminal server, and applying the audio and video decoding unit to decode the travel landscape data that the audio and video acquisition unit obtains from the terminal server, and decoding and obtaining the playable In the form of the corresponding audio data and video data of the tourist landscape data, the motion detection module is used to monitor the speed and direction data of the user during the real-time movement, and the head movement and direction data during the user transportation are monitored in real time, and the control circuit board is controlled and controlled. The button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, the display, and the application audio output unit detect the speed of the user's movement according to the motion detection module in real time, The data, the head motion and the direction data of the user motion detected in real time, and the corresponding audio data of the tour landscape data obtained according to the playable form decoded by the audio and video decoding unit are monitored in real time by the play and motion detection module. The data is adapted to the audio, and the application display, according to the speed and direction data of the user's movement detected by the motion detection module in real time, the real-time monitored head movement and direction data of the user during motion, and according to the audio and video The decoding unit decodes the corresponding video data of the travelable form of the obtained tour landscape data, and the 2D play or 3D broadcasts the video adapted to the data monitored by the motion detection module in real time, thereby realizing the virtual display of the tourist scenery. To enable users to experience places of interest around the world without leaving their homes.

The system application terminal server of the virtual tourist landscape provided by the invention provides the tourist landscape data that the helmet needs to browse to the helmet, applies the helmet to obtain the tourist landscape data provided by the terminal server, and performs the acquired tourist landscape data that needs to be browsed. Decoding and decoding to obtain corresponding audio data and video data of the tourist landscape data in a playable form, and corresponding audio data and video data of the tourist landscape data obtained according to the decoding, and playing and real-time walking movement of the user The audio adapted to the user's head motion data, and the video that is compatible with the user's real-time walking motion and the user's head motion data in 2D playback or 3D playback, thereby realizing the virtual display of the tourist landscape, so as to enable the user to stay out Users can experience places of interest around the world.

DRAWINGS

Figure 1 is a schematic view of a helmet of a virtual tourist landscape of the present invention;

2 is a schematic diagram of a system for virtual tourist scenery of the present invention.

detailed description

The invention provides a helmet and a system for a virtual tourist landscape, which is applied to the field of virtual display technology. The system application terminal server of the virtual tourist landscape provided by the present invention provides the tourist landscape data that the helmet needs to browse to the helmet, and the application helmet acquires the terminal server. Providing the tourist scenery data, and decoding the acquired tourist landscape data that needs to be browsed, decoding corresponding audio data and video data of the tourist landscape data in a playable form, and obtaining a playable form according to the decoding Corresponding audio data and video data of the tourist landscape data, playing audio adapted to the user's real-time walking motion, user head motion data, and 2D playback or 3D playback, real-time walking motion of the user, and user head motion data Adapt to the video, so as to achieve a virtual display of the tourist landscape, so that users can experience the places of interest around the world without leaving the house.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The invention provides a helmet for a virtual tourist landscape.

Referring to FIG. 1 , FIG. 1 is a schematic diagram of a helmet of a virtual tourist landscape according to the present invention. The helmet 10 of the virtual tour landscape of the present invention comprises: a control button unit 101 , a wireless communication module 102 , an audio and video acquisition unit 103 , and an audio and video decoding unit 104 . , motion detection module 105, control circuit board 106, audio output unit 107, display 108;

The control button unit 101 is configured to control the button operation and input the tourist landscape data that needs to be browsed;

a wireless communication module 102, configured to wirelessly communicate with the terminal server;

The audio and video acquisition unit 103 is configured to control the wireless communication module 102 to perform wireless communication with the terminal server according to the tourism landscape data that is required to be browsed by the control button unit 101, and obtain the tourist landscape data that needs to be browsed from the terminal server;

The audio and video decoding unit 104 is configured to decode the travel landscape data that is required to be browsed by the audio and video acquisition unit 103 from the terminal server, and decode the corresponding audio data and video data of the travel landscape data in a playable format. ;

The motion detecting module 105 is configured to monitor the speed and direction data of the user during the movement in real time, and monitor the head movement and direction data during the user transportation in real time;

The control circuit board 106 is connected to the control button unit 101, the wireless communication module 102, the audio and video acquisition unit 103, the audio and video decoding unit 104, the motion detection module 105, the audio output unit 107, and the display 108, respectively, for controlling the control button unit. 101, a wireless communication module 102, an audio and video acquisition unit 103, an audio and video decoding unit 104, a motion detection module 105, an audio output unit 107, a display 108;

The audio output unit 107 is configured to perform head movement and direction data of the user motion detected in real time according to the speed and direction data of the user when the motion detection module 105 is monitored in real time, and decode according to the audio and video decoding unit 104. Corresponding audio data of the obtained tour landscape data in a playable form, playing audio adapted to the data monitored by the motion detection module 105 in real time;

The display 108 is configured to monitor the movement speed and direction data of the user during real-time monitoring according to the motion detection module 105, and the head motion and direction data of the user motion detected in real time, and the decoding according to the audio and video decoding unit 104. The corresponding video data of the tour landscape data in the playable form, 2D play or 3D play the video adapted to the data monitored by the motion detection module 105 in real time.

The control circuit board 106 includes:

The microprocessor 1061 is connected to the control button unit 101, the wireless communication module 102, the audio and video acquisition unit 103, the audio and video decoding unit 104, the motion detection module 105, the audio output unit 107, and the display 108, respectively, for controlling the control button unit. 101, a wireless communication module 102, an audio and video acquisition unit 103, an audio and video decoding unit 104, a motion detection module 105, an audio output unit 107, a display 108;

a power supply circuit 1062 for supplying power to the control circuit board 106;

The audio output unit 107, including a micro-speaker or the like, is used for real-time monitoring of the movement and direction data of the user during movement according to the speed and direction data of the user's movement detected by the motion detection module 105, and The audio corresponding to the data monitored by the motion detecting module 105 in real time is played according to the audio data decoding unit 104 decoding the corresponding audio data of the obtained playable form of the scenic scenery data.

The display 108 includes: a 2D display unit 1081, a 3D display unit 1082;

The 2D display unit 1081 is configured to play the 2D video data corresponding to the data monitored by the motion detection module 105 in real time according to the corresponding 2D video data of the travel scenery data obtained by the audio and video decoding unit 104. ;

The 3D display unit 1082 is configured to: according to the corresponding 3D video data of the travel scenery data obtained by decoding the obtained playable form, the audio and video decoding unit 104 plays the 3D video adapted to the data monitored by the motion detecting module 105 in real time. .

The 3D display unit 1082 includes: a concave lens 10821 and a convex lens 10822 arranged in sequence from the user end side;

The convex lens 10822 is disposed on the other side of the concave lens 10821, and is used for the refracting audio and video decoding unit 104 to decode the corresponding 3D video data light of the obtained tour landscape data in the playable form to obtain a holographic 3D visual image;

The concave lens 10821 is disposed on the near-user side for amplifying the holographic 3D visual image obtained by the convex lens 10822, and correcting the light tilt to present a three-dimensional stereoscopic 3D stereoscopic image to the user.

The present invention also provides a system for virtual tourist scenery.

Referring to FIG. 2, FIG. 2 is a schematic diagram of a system for virtual tourist scenery according to the present invention. The system 20 of the virtual tourist landscape includes: a terminal server 201 and a helmet 202;

The terminal server 201 is configured to wirelessly communicate with the helmet 202, and provide the tourist landscape data that the helmet 202 needs to browse to the helmet 202;

The helmet 202 is configured to acquire the tourist landscape data provided by the terminal server 201, and decode the acquired tourist landscape data that needs to be browsed, and decode the corresponding audio data and video data of the tourist landscape data in a playable form. And corresponding audio data and video data of the tourist landscape data obtained in the playable form according to the decoding, playing audio adapted to the user's real-time walking motion, user head motion data, and 2D playback or 3D playback and user real-time The video of the walking movement and the user's head movement data.

Wherein, the helmet 202 and the helmet 10 of the virtual tourist landscape provided by the present invention are identical in function, structure and the like, and both are the same helmet. For a detailed description of the helmet 202, please refer to the virtual tourist landscape provided by the present invention. The content of the helmet 10 is described, and the functions, structures, and the like of the helmet 202 are not described herein again.

The database of the terminal server 201 in the system 20 of the virtual tourist landscape of the present invention has audio and video files of the tourist scenery in various places, wirelessly communicates with the helmet 202, and provides the tourist landscape data that the helmet 202 needs to browse to the helmet 202, and the helmet 202 acquires the terminal. After the tourist landscape data provided by the server 201, the helmet 202 decodes the acquired tourist landscape data that needs to be browsed, decodes the corresponding audio data and video data of the tourist landscape data in a playable form, and obtains according to the decoding. Corresponding audio data and video data of the travel landscape data in a playable form, playing audio adapted to the user's real-time walking motion, user head motion data, and 2D playback or 3D playback and user real-time walking motion, user head The video of the motion data is adapted.

The display 108 in the helmet 10 of the virtual tour landscape of the present invention can 2D play or 3D play a video adapted to the user's real-time walking motion and user head motion data. The display 108 includes a 3D display unit 1082, and the 3D display unit 1082 includes From the user end side, the concave lens 10821 and the convex lens 10822 are arranged in this order. The concave lens 10821 is disposed on the near side of the user end, the convex lens 10822 is disposed on the other side of the concave lens 10821, and the mirror surface of the concave lens 10821 is coated with a coating. When playing a 3D video image, the 3D video image is refracted by the convex lens 10822 to produce a similar effect to the far side, thereby achieving a holographic 3D visual image, which is again magnified by the concave lens 10821 and corrects the light tilt. When the image reaches the user's eyes, it presents an effect of presenting a three-dimensional stereoscopic image in three dimensions.

When the user plays the 2D or 3D video using the helmet 10 of the virtual tourist landscape of the present invention, the user can perform the walking and head turning motion in the virtual tourist landscape environment generated in the helmet 10 of the virtual tourist landscape of the present invention. When the user walks, the motion detection module 105 monitors the speed and direction data of the user's movement in real time, and monitors the head movement and direction data during the user's transportation in real time, according to the real-time monitored head movement and direction of the user during transportation. Data, the helmet 10 of the virtual tourist landscape of the present invention plays audio adapted to the user's real-time walking motion, user's head motion data, and 2D or 3D playback, which is compatible with the user's real-time walking motion and the user's head motion data. .

Assuming that the user walks at a speed of V and the angular velocity of the head turning direction is W, the display 108 divides the played content into a plurality of frame images for continuous playback. When the user activates the helmet 10 of the virtual tour landscape of the present invention, the travel scene data that needs to be browsed needs to be input through the control button unit 101, and after the audio and video acquisition unit 103 acquires the tourist landscape data that needs to be browsed from the terminal server, the display 108 The range that can be observed by the eyes of the simulated person is played to capture the tourist scenery data that needs to be browsed by the hand, and the image replacement frequency of the content played by the display 108 is determined by the walking speed of the user and the angle of the head turning. When the user only walks and the head does not turn, the content played by the display 108 is an image in the same direction, and the frequency of image replacement is proportional to the speed at which the user walks; when the user does not walk and the head has a turn, the display 108 The content played is an image within a circular arc, and the image content is converted according to the deflection of the head. The image replacement frequency is proportional to the angular velocity W of the user's head deflection; when the user has both foot movement and head deflection First, the moving speed V and the head steering angular velocity W are added to form a new speed V1, and the image replacement frequency is proportional to the new speed V1. By adjusting the user's moving speed and the speed of the head deflection in real time to adjust the content of the playback, the content played by the display 108 can meet the range requirements that the user can observe at any time.

The helmet 10 of the virtual tourist landscape provided by the present invention applies the control button operation to input the tourist landscape data to be browsed, and the application audio and video acquisition unit 103 controls the wireless communication module 102 according to the tourist landscape data that is required to be browsed by the control button unit 101. Performing wireless communication with the terminal server, and acquiring the tourist scenery data that needs to be browsed from the terminal server, and applying the audio and video decoding unit 104 to the travel landscape data that is acquired by the audio and video acquiring unit 103 from the terminal server. Decoding and decoding to obtain corresponding audio data and video data of the tourism landscape data in a playable form, and applying the motion detecting module 105 to monitor the speed and direction data of the user walking in real time, and real-time monitoring the head movement and direction data during the user transportation. The application control circuit board 106 controls the control button unit 101, the wireless communication module 102, the audio and video acquisition unit 103, the audio and video decoding unit 104, the motion detection module 105, the audio output unit 107, the display 108, and the application audio output unit 107 according to the motion detection. Module 105 The detected speed and direction data of the user's movement during the movement, the head motion and the direction data of the user motion detected in real time, and the corresponding corresponding to the travel landscape data obtained by decoding the audio and video decoding unit 104 The audio data, the audio that is adapted to the data monitored by the motion detection module 105 in real time, and the application display 108 are monitored in real time according to the speed and direction data of the user's movement detected by the motion detection module 105 in real time. The user moves the head motion, the direction data, and the corresponding video data of the travel landscape data obtained according to the playable form decoded by the audio and video decoding unit 104, and the 2D playback or 3D playback and motion detection module 105 monitors in real time. The data is adapted to the video, so as to achieve a virtual display of the tourist landscape, enabling the user to experience the places of interest around the world without leaving the house.

The system 20 of the virtual tourist landscape provided by the present invention provides the tourist landscape data that the helmet 202 needs to browse to the helmet 202, and the application helmet 202 acquires the tourist landscape data provided by the terminal server 201, and needs the acquired information. The browsed tour scenery data is decoded, and the corresponding audio data and video data of the travel landscape data in a playable form are decoded, and corresponding audio data and video data of the tour landscape data according to the decoded form are played, and the video data is played. Audio that is compatible with the user's real-time walking motion, user's head motion data, and video that is compatible with the user's real-time walking motion and user's head motion data in order to achieve virtual display of the tourist landscape. The realization allows users to experience places of interest around the world without leaving their homes.

It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or order between them. Furthermore, the terms "comprising," "comprising," or "include" or "the" or "the" Other elements, or elements that are inherent to such a process, method, item, or device. In the absence of further limitation, the elements defined by the phrase "comprising a", ",", "," are not exclusive of the same elements in the process, method, item, device or device including the element. .

For the helmet and system of the virtual tourist landscape of the present invention, the form of implementation is varied. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A system for virtual tourist scenery, comprising: a terminal server and a helmet;

The terminal server is configured to wirelessly communicate with the helmet to provide travel landscape data that the helmet needs to browse to the helmet;

The helmet is configured to acquire the tourist scenery data provided by the terminal server, and decode the acquired tourist landscape data that needs to be browsed, and decode the corresponding audio data of the travel landscape data in a playable form. And video data, and audio data and video data corresponding to the travel landscape data in a playable form according to the decoding, playing audio compatible with the user's real-time walking motion, user head motion data, and 2D playback or The 3D plays a video that is compatible with the user's real-time walking motion and the user's head motion data.
The virtual tour landscape system according to claim 1, wherein the helmet comprises: a control button unit, a wireless communication module, an audio and video acquisition unit, an audio and video decoding unit, a motion detection module, a control circuit board, and audio. Output unit, display;

The control button unit is configured to control a button operation and input tourist landscape data that needs to be browsed;

The wireless communication module is configured to wirelessly communicate with a terminal server;

The audio and video acquisition unit is configured to control the wireless communication module to perform wireless communication with the terminal server according to the travel landscape data that is required to be browsed by the control button unit, and obtain the required browsing from the terminal server. Tourist landscape data;

The audio and video decoding unit is configured to decode the travel landscape data that is required to be browsed by the audio and video acquisition unit from the terminal server, and decode the corresponding audio of the travel landscape data in a playable form. Data, video data;

The motion detection module is an acceleration sensor, which is used for real-time monitoring of the speed and direction data of the user during walking, and real-time monitoring of the head movement and direction data when the user is transported;

The control circuit board is respectively associated with the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display a connection for controlling the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display;

The audio output unit is configured to monitor, according to the speed and direction data of the user during the movement of the motion detection module, the head movement and direction data of the user during real-time monitoring, and according to the audio and video Decoding unit decodes the corresponding audio data of the obtained playable form of the scenic landscape data, and plays audio adapted to the data monitored by the motion detecting module in real time;

The display is configured to monitor, according to the speed and direction data of the user during the movement of the motion detection module, the head movement and direction data of the user motion, and the audio and video decoding unit according to the sound and video Decoding corresponding video data of the travelable form of the obtained playable form, 2D playing or 3D playing a video adapted to the data monitored by the motion detecting module in real time.
The system of claim 1, wherein the control circuit board comprises:

a microprocessor, connected to the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display, respectively Controlling the control button unit, the wireless communication module, the audio and video acquisition unit, the audio and video decoding unit, the motion detection module, the audio output unit, and the display;

A power supply circuit for supplying power to the control circuit board.
A virtual tour landscape system according to claim 1, wherein said audio output unit comprises: a microspeaker.
The system of claim 1, wherein the display comprises: a 2D display unit, a 3D display unit;

The 2D display unit is configured to play, according to the audio and video decoding unit, the corresponding 2D video data of the travelable landscape data in the playable form, and play the data monitored by the motion detection module in real time. Compatible 2D video;

The 3D display unit is configured to play, according to the audio and video decoding unit, the corresponding 3D video data of the travelable landscape data in the playable form, and play the data that is monitored by the motion detection module in real time. Adapted 3D video.
The virtual tour landscape system according to claim 5, wherein the 3D display unit comprises: a concave lens and a convex lens arranged in sequence from the user end side;

The convex lens is disposed on the other side of the concave lens, and is configured to refract the corresponding 3D video data light of the travel scenery data obtained by decoding the obtained audio and video decoding unit to obtain a holographic 3D visual image. ;

The concave lens is disposed on a side closer to the user end for amplifying the holographic 3D visual image obtained by the convex lens, and correcting the slanting of the light to present a three-dimensional stereoscopic 3D visual image to the user.