TWI660305B - Virtual reality real-time navigation method and system - Google Patents

Abstract

The invention relates to a virtual reality real-time navigation method and system, which includes at least one real-world display device and a navigation control interface connected to the real-world display device. The user can wear the real-world display device to display the virtual reality display. Screen, the electronic device has a navigation control interface, and has at least one user screen display area that simultaneously displays the virtual reality display screens played by each real-world display device, so that the commentator can simultaneously perform corresponding interpretation through the screen, Make it easier for users to understand.

Description

Virtual reality real-time navigation method and system

The invention provides a virtual reality real-time navigation method and system, and more particularly, it is a technical field that can instantly confirm the position of a screen viewed by a user.

According to the continuous advancement and development of technology, the technology of visual reality has become the target of research and development by various manufacturers. However, only the popular virtual reality technology is currently used in movies.

Today's home purchases are mostly shown in photos. If buyers want to know the housing status, they need to spend time on transportation to visit and watch the houses, or even visit multiple houses in one day. Houses that need to be moved to different locations will spend more time on transportation, so how to make home buyers feel the same as the actual home viewing is the problem that the relevant industry operators want to solve.

In addition, many areas such as tourist attractions, restaurants, and museums also encounter the same problems. Although virtual reality technology can solve some of the problems, how to make users understand the space or features is still to be improved. The problem. Therefore, how to solve the above problems, so that consumers have the feeling of being in the field, and can immediately resolve any doubts, that is the phase What the stakeholders are anxious to solve.

Therefore, in view of the above-mentioned shortcomings, the inventor collected relevant information, evaluated and considered from various parties, and based on years of experience accumulated in this industry, and continued to make trials and modifications, he began to design such a virtual reality real-time navigation method and system.

According to the present invention, a virtual reality real-time navigation method is used for transmitting image data through a real-world display device, an electronic device, and a server. The real-world display device receives information from the server. The image of one place is stored and the virtual reality is released, and the screen displayed by the reality display device is synchronously displayed on the electronic device. In addition, the electronic device can be simultaneously performed with a plurality of reality display devices. The signals are connected and the screens displayed by the connected real-world display devices are displayed at the same time. Among them, a navigation control interface is installed on the electronic device to control the locations displayed by the real-world display devices.

With the above method, the user can view the image in the place through the real-world display device, and at the same time, another operator can understand the screen viewed by the user through the screen displayed by the electronic device, so that the user can synchronize The corresponding description or answer.

In addition, at least one hotspot can be set on the screens, and the user can jump to the relevant location through the actual display device or the electronic device. In this way, it is convenient for users to intuitively understand the directions of the relevant locations, and allows users to quickly associate the overall geographic location.

Furthermore, the real-world display device is equipped with a focus detection module, and the focus detection module detects the focus of the user's eyes and presents the focus position to the electronic device. Screen displayed by the device. In this way, it is convenient for the operator to understand what the user is discussing and reduce the occurrence of communication misunderstandings.

The present invention further provides a real-world display device, in which a focus detection module can be installed, and at least one electronic device to which the real-world display device is connected, in at least one user screen display area of the navigation control interface. With a focus mark inside, the focus position of the user's eyes is detected by the focus detection module, and the focus position of the user's eyes is displayed in the display area of the user's screen by using the focus mark. Attention is being paid to the viewing area so as to make corresponding explanations at the same time, which not only facilitates the commentator's explanation, but also allows the user to feel more immersive.

The present invention further provides a reality display device for playing a virtual reality display screen, and at least one predetermined position in the virtual reality display screen is an electronic device having a sub-picture switching area and at least one reality display device is connected, then In the navigation control interface, at least one user screen display area is provided with a sub-picture hotspot mark at the sub-picture switching area corresponding to the virtual reality display screen, so that the commentator can know in advance that there is a sub-picture switching area, and The screen hotspot mark allows the sub-picture display area to display the corresponding sub-picture related information first, so as to explain the user in advance, not only can the explanation be more complete, but the user will also have a better visiting experience and will feel the explanation Are more professional.

The present invention further provides a real-world display device for playing virtual reality display screens, and at least one electronic device connected to the real-world display device displays at least one user screen display area of the navigation control interface, and simultaneously displays each The virtual reality display screen played by the real-world display device is provided for the commentator to explain the area and position that the user is watching, so that the user can feel more at the scene.

The invention further provides a navigation control interface of the electronic device, which can have multiple user screen display areas. The commentator can view the virtual reality display screen viewed by different users by moving the screen, or switch by at least one switch key. Display the virtual reality display screen viewed by different users, so that the commentator can explain to multiple users at the same time.

1‧‧‧Realistic display device

10‧‧‧Speaker

11‧‧‧Focus Detection Module

12‧‧‧Virtual Reality Display

121‧‧‧ Vice screen switching area

2‧‧‧ electronic device

20‧‧‧Navigation control interface

21‧‧‧user screen display area

211‧‧‧Focus Sign

212‧‧‧Sub-picture hot spot sign

22‧‧‧ Microphone

23‧‧‧Hotkey

24‧‧‧ secondary screen display area

25‧‧‧Switch key

26‧‧‧Control Module

FIG. 1 is a system block diagram of an embodiment of the present invention.

FIG. 2 is a schematic diagram of a display screen of a real-world display device according to an embodiment of the present invention.

Figure 3 is a system block diagram of an embodiment of the present invention.

FIG. 4 is a system block diagram of an embodiment of the present invention.

FIG. 5 is a schematic diagram of a display screen of an actual display device according to an embodiment of the present invention.

6 and 7 are schematic diagrams of hotspot settings according to an embodiment of the present invention.

FIG. 8 is a schematic diagram after the hotspot setting is completed according to the embodiment of the present invention.

FIG. 9 is a schematic diagram of generating a QR Code according to an embodiment of the present invention.

In order to achieve the above-mentioned object and effect, the technical means and structure adopted by the present invention are described in detail below with reference to the embodiments of the present invention. The features and functions are as follows. In addition, the method of the present invention is described in combination with the system described below. Please refer to Figs. 1, 2 and 3, and it can be clearly seen from the figures that the present invention In order to include at least one reality display device 1 and an electronic device 2, the reality display device 1 and the electronic device 2 perform data transfer with a server, respectively. In addition, the real-world display device 1 may be provided with a speaker 10, and each of the real-world display devices 1 is a virtual reality display screen 12, and the electronic device 2 has a navigation control interface 20, and the navigation control interface 20 has synchronous display. At least one user screen display area 21 of the virtual reality display screen 12 played by each reality display device 1, and the electronic device 2 is provided with a microphone 22 and a camera. The above electronic device 2 may be a computer, a mobile phone, or a tablet. The control interface 20 may be a computer software or a mobile application (APP). In addition, the real-world display device 1 may be a head-mounted virtual reality device, a mobile phone, or a tablet computer.

The virtual reality real-time navigation system of the present invention can be used in the fields of house viewing, tourism, museum visits, or play area explanation, etc. The following description uses house viewing as an example, but is not limited thereto.

When the virtual reality real-time navigation system is used for the user to wear the real-world display device 1, the user can watch the virtual reality display screen 12, and the commentator views the navigation control interface 20 on the electronic device 2. The user screen display area 21, because each virtual reality display screen 12 and the corresponding user screen display area 21 display the same screen, the commentator can know the area and position that the user is watching, and the commentator can directly To explain to the user, or to capture audio data through the microphone 22 when the narrator speaks, and transmit the audio data to the real-world display device 1 for playback on its speaker 10 for the user to hear the narrator's speech, thereby facilitating It can save users and commentators from having to visit the site, which can save time spent on transportation, and a single commentator can receive multiple users at different times at the same time, so it has the advantage of convenience.

Please refer to FIG. 3. As can be clearly seen from the figure, the present invention includes at least one reality display device 1 and an electronic device 2, wherein the at least one reality display device 1 is a sub-display. It has a speaker 10 and a focus detection module 11. Each reality display device 1 plays a virtual reality display screen 12, and at least one reality display device 1 is connected to the electronic device 2. The electronic device 2 has a navigation. The control interface 20 has at least one user screen display area 21 for simultaneously displaying the virtual reality display screen 12 played by each reality display device 1 in the navigation control interface 20, and each user screen display area 21 has a focus mark 211 respectively The focus mark 211 may be a cross shape, a human shape, an eye shape, a circle or other graphics, and the electronic device 2 has a microphone 22.

When the user wears the real-world display device 1, in order to move and view different positions, home appliances or decoration at will in the house, at this time, the focus detection module 11 can detect the focus position of the user's eyes, and It is transmitted to the electronic device 2 so that the focus mark 211 is displayed at the focal position of the user's eyes in the user screen display area 21 of the navigation control interface 20, so the commentator can know where the user is watching. , Home appliances or decoration, so as to make corresponding explanations at the same time, by which, the effect of facilitating the commentator's interpretation can be achieved, and the user will have a more immersive experience. At the same time, other user representative images entering the same scene can also be displayed on the screen of the actual display device or on the screen displayed by the electronic device. The user representative images will be displayed on the screen according to the coordinates of the corresponding links , So that you can know whether other people are watching at the same time, and through these images you can observe where other people are watching, and whether there is a situation that they also need to know. Among them, the method of detecting the focus position includes assuming that the eyes are looking at the center of the picture, so the center point of the picture viewed by the user is the measured focus. Or, a camera is provided on the actual display device for the direction of the user to detect and confirm the position of the eyeball rotation to obtain the focus of the eyeball.

Please refer to FIG. 4 and FIG. 5. As can be clearly seen from the figures, the present invention includes at least one reality display device 1 and an electronic device 2, wherein the at least one reality display device 1 In order to have a speaker 10 and a focus detection module 11 respectively, each reality display device 1 plays a virtual reality display screen 12 separately, and at least one predetermined position of the virtual reality display screen 12 has a sub-picture switching area 121 And, at least one reality display device 1 is connected to the electronic device 2. The electronic device 2 has a navigation control interface 20, and the navigation control interface 20 has a synchronous display of the virtual reality display screen 12 played by each reality display device 1. At least one user screen display area 21, each user screen display area 21 has a focus mark 211, and the electronic device 2 has a microphone 22, and the navigation control interface 20 is in at least one user screen display area 21. A sub-picture hotspot mark 212 is provided at the sub-picture switching area 121 corresponding to the virtual reality display picture 12.

The virtual reality display screen 12 played by each reality display device 1 has a sub-picture switching area 121 (such as a house window, door, or balcony) at at least one predetermined position. When the user moves to the sub-picture switching area 121, The corresponding secondary screen can be displayed, and the user screen display area 21 viewed by the commentator will be provided with a secondary screen hotspot flag 212 at the corresponding secondary screen switching area 121, so the user has not moved to the secondary screen switching area 121 before , The commentator can click the sub-picture hotspot mark 212, so that the sub-picture display area 24 displays the corresponding sub-picture related information in advance, so as to know in advance and explain to the user, due to the layout, decoration and decoration of the house, Differences, so the corresponding room or window scenery is also different, so that the commentator can understand the corresponding information in advance, and can provide a more complete explanation, and can make the user ’s visit feel better and better, Users feel that the commentator has a detailed understanding and professionalism.

Each of the above-mentioned user screen display areas 21 may be provided with a secondary screen hotspot mark 212, or at least one hotspot key 23 is provided on the side of each user screen display area 21, and each user screen display area 21 is provided on the side There is at least one sub-picture display area 24 for the commentator to click on the sub-picture hotspot mark 212, or for the narrator to click to correspond to each sub-picture hotspot mark The hotspot key 23 of 212 causes the sub-picture display area 24 to display corresponding sub-picture related data.

Please refer to FIG. 3, FIG. 4 and FIG. 5. As can be clearly seen from the figure, the navigation control interface 20 of the electronic device 2 may have multiple user screen display areas 21 to display multiple users at the same time. By wearing the virtual reality display screen 12 of the reality display device 1, the commentator can watch the virtual reality display screen 12 viewed by different users through the moving screen, or the navigation control interface 20 has a single user screen display area 21 And at least one switch key 25 is provided on the side of the user screen display area 21 for the commentator to click the switch key 25 to allow the user screen display area 21 to switch and display the virtual reality display screen 12 viewed by different users for commentary The user can explain to multiple users at the same time to achieve the effect of saving time. For example, other modifications and equivalent structural changes should be included in the scope of the patent of the present invention and shared with Chen Ming.

In addition, the electronic device 2 further has a control module 26 (a button is used to indicate the switching function, but not limited to this), which can be used to control whether the screen displayed by the actual display device 1 is controlled by the electronic device 2 or The electronic device 2 is controlled by the reality display device 1. When the control module 26 is turned on, the user can forcibly control the screen displayed by the reality display device 1 through the electronic device 2 so that the commentator can easily let the user see the virtual reality display screen 12 that he wants to point out. At this time, the displayed coordinates are transmitted from the electronic device 2 to the server, and then transmitted from the server to the virtual reality display device for display. When the commentator closes this control module 26, the user can move and watch according to his own ideas without being controlled by the commentator. At this time, the coordinates of the screen viewed by the user will be returned to the server To display synchronously with the power supply device 2. The control module 26 can simultaneously control the plurality of real-world display devices 1 to follow or move freely.

In addition, the hotspots described in the present invention can be established by the following methods. Please cooperate with Figures 6 and 7. When entering the hotspot establishment mode, a hotspot H to be set will be displayed on the display. Device (such as a display device installed in an electronic device), and the position of the hotspot H to be set remains unchanged relative to the display device; the user controls the scene screen displayed by the display device to move, (Figure 7 is relative to Figure 6 is after moving.) When the scene position of a hotspot H to be set corresponds to the hotspot H to be set, confirm it, and then enter the message and the path of the scene to be jumped to (for example, the URL). Complete the setting of a hotspot H in the scene picture (for example, click the hotspot H to be set). After that, the hotspot H will move with the screen and be fixed at the position specified during the setting, as shown in FIG. 8. This can provide the user with a more intuitive setting method, facilitate the setting control on the touch screen, and improve the convenience of use.

Furthermore, the hotspot H to be set is further set in the center of the screen displayed by the display device, which is convenient for the user to perform intuitive operations, especially the touch screen.

The invention further provides a scene synchronization connection method for an electronic device 2 and at least one real-world display device 1 to perform scene synchronization display via a server, which includes the following steps: the electronic device 2 sends a startup instruction to the Server, the server returns a web address to the electronic device 2, the reality display device 1 sends a designated code included in the web address to the server for comparison after entering the web address, After the confirmation is correct, the real-world display device 1 will display the screen displayed by the electronic device 2 to achieve the effect of synchronization.

In addition, after the operation is completed, the server can automatically replace the web address or the designated code in the web address, so that users can no longer enter through the same path to watch, achieving the effect of both security and control.

In addition, the electronic device 2 can be equipped with a fast response matrix code conversion module, which can convert the received website into a fast response matrix code (QR CODE); the reality display device 1 is equipped with a fast response matrix code The reading module, as shown in Figure 9, is used to read the display of the electronic device. Shown the fast response matrix code. This can reduce the occurrence of errors in entering the URL, and can also quickly transfer the URL to the real-world display device 1 in combination with the NFC device and function.

In summary, when the above-mentioned virtual reality real-time navigation system of the present invention is used, it can truly achieve its efficacy and purpose. Therefore, the present invention is a creative creation with excellent practicability. Submit an application, and hope that the trial committee will grant the case as soon as possible to protect the inventor's hard work. If the jury of the Bureau of the Bureau has any questions, please follow the instructions of the letter, and the inventor will cooperate with all efforts and feel good.

Claims (10)

A virtual reality real-time navigation method, which transmits data through a reality display device, an electronic device, and a server. The reality display device is received from the server and stored in the server. The image of one of the locations is used for virtual reality playback, and the electronic device simultaneously displays the screen displayed by the real-world display device according to the information provided by the server. Furthermore, the electronic device can simultaneously and plurally display The real-world display devices perform signal connection and simultaneously display the pictures displayed by the connected real-world display devices. Among them, the electronic device is equipped with a navigation control interface to control the locations displayed by the real-world display devices; In addition, the electronic device further includes a hotspot establishment mode, which displays a hotspot to be set on a display device connected to the signal of the electronic device, and the position of the hotspot to be set remains unchanged relative to the display device; The user controls the movement of the scene screen displayed by the display device. When the scene screen position of a hotspot to be set corresponds to the hotspot to be set, It confirmed the wearer, so that a complete picture of the scene set hot. The virtual reality real-time navigation method according to claim 1, wherein the user can select one of the hotspots through the real-world display device or the electronic device, and then jump to the image of the relevant place pointed by the hot body. The virtual reality real-time navigation method according to claim 1, wherein the reality display device is installed with a focus detection module, and the focus detection module detects the focus of the user's eyes, and The focus position is presented on a screen displayed by the electronic device. The virtual reality real-time navigation method according to claim 1, wherein the screen displayed by the actual display device or the screen displayed by the electronic device includes another representative image of a user entering the same scene. The virtual reality real-time navigation method according to claim 1, wherein the electronic device further has a control module, which can be used to control whether the screen displayed by the actual display device is controlled or controlled by the electronic device. The virtual reality real-time navigation method according to claim 1, wherein the reality display device transmits the coordinate position of the displayed screen to the server, and the electronic device performs the coordinate position after the server obtains the coordinate position. Corresponding display. A virtual reality real-time navigation system, which is connected through a server through at least one reality display device and a navigation control interface in an electronic device, wherein the reality display device is configured for users Dai is used to display the venue designated by the navigation control interface, and the image displayed by the reality display device is synchronously played on the electronic device through the server, and each reality display device plays the virtual reality display separately. The electronic device has a navigation control interface, and the navigation control interface has at least one user screen display area that simultaneously displays the virtual reality display screens played by the actual display devices; and the electronic device further includes a hotspot The establishment mode is to display a hotspot to be set on a display device connected to the signal of the electronic device, and the position of the hotspot to be set remains unchanged relative to the display device; the user controls the scene screen displayed by the display device Move, when the scene screen position of a hotspot to be set corresponds to the hotspot to be set, the user confirms, The completion of a hot spot of scene setting. The virtual reality real-time navigation system described in item 7 of the scope of patent application, wherein the reality display device has a focus detection module that detects the focus of the user's eyes, and the corresponding display is displayed in each user screen display area. A focus mark is displayed at the focus position of the user's eyes. According to the virtual reality real-time navigation system described in item 7 of the scope of patent application, the navigation control interface of the electronic device may have a plurality of user screen display areas to simultaneously display multiple users wearing the real-world display device Virtual reality display. The virtual reality real-time navigation system described in item 7 of the scope of the patent application, wherein the navigation control interface is located in at least one user screen display area, and a hotspot mark is provided for the corresponding virtual reality display screen. The user can The hotspot logo is selected via the navigation control interface or the real-world display device to open another screen; further, the at least one real-world display device has a speaker separately, and the electronic device is provided with a microphone and a camera for the microphone to capture The audio data is taken and played through the speaker; in addition, the navigation control interface of the electronic device may have multiple user screen display areas to simultaneously display and control the virtual reality display screens of multiple users wearing the reality display device.