TW201908951A - Real-time navigation method and system for virtual reality including at least one reality display apparatus and a navigation control interface - Google Patents

Abstract

This invention relates to a real-time navigation method and system for virtual reality. The system includes at least one reality display apparatus and a navigation control interface connected thereto. A user may play a virtual reality display image after wearing a reality display apparatus. The navigation control interface of the electronic apparatus internally includes at least one user image display area for synchronously displaying the virtual reality display image played by the reality display apparatus, so as to facilitate a commentator to simultaneously perform corresponding explanation through the image and make it easier for users to understand.

Description

 Virtual reality instant navigation method and system  

The present invention provides a virtual reality instant navigation method and system, and more particularly to a technical field that can instantly confirm the position of a screen viewed by a user.

According to the continuous advancement and development of technology, the virtual reality technology has become the target of research and development by various manufacturers. However, today only the virtual reality technology is more popular in movies.

Most of today's home purchases are shown in photos, and if buyers want to know the status of their homes, they need to spend time on transportation, visit and watch the houses, and even visit a number of houses in one day. If you need to move to a different location, you will spend more time on transportation, so how to make the purchaser have the same feeling of seeing the house, that is, the problem that the relevant industry is trying to solve.

In addition, many areas such as tourist attractions, restaurants or museums are experiencing the same problem. Although virtual reality technology can solve some problems, how to make users understand space or features more is still to be improved. The problem. Therefore, how to solve the above problems, so that consumers have the feeling of visiting the field, and can immediately solve any doubts, that is, the problems that the relevant operators are eager to solve.

Therefore, in view of the above-mentioned shortcomings, the inventors have collected relevant information, and through multi-party assessment and consideration, and through years of experience in the industry, through continuous trial and modification, we have designed such a virtual reality instant navigation method and system.

The virtual reality real-time navigation method of the present invention transmits image data through a real-world display device, an electronic device and a server, wherein the real-world display device receives the image from the server. Storing an image of one of the locations and performing a virtual reality playback, and simultaneously displaying the screen displayed by the real-world display device on the electronic device, and the electronic device can simultaneously perform with the plurality of real-world display devices The signal is connected to the screen displayed by the connected real-world display devices, wherein the electronic device is installed with a navigation control interface to control the locations displayed by the real-world display devices.

According to the above method, the user can view the image in the location through the real-world display device, and the other operator can understand the screen viewed by the user through the screen displayed by the electronic device, so that the user can be synchronized Corresponding instructions or answers.

Moreover, at least one hot spot may be disposed on the screens, and the user may select and jump to the image of the relevant place via the real-world display device or the electronic device. In this way, the user can intuitively understand the direction of the relevant places, and the user can quickly associate the overall geographical orientation.

Furthermore, the reality display device is provided with a focus detection module, wherein the focus detection module detects the focus of the user's eyes and presents the focus position to the screen displayed by the electronic device. In this way, the operator can be made aware of the items discussed by the user and reduce the occurrence of communication misunderstandings.

The present invention further provides a real-world display device, wherein a focus detection module can be installed therein, and at least one electronic device connected to the reality display device is displayed on at least one user screen display area of the navigation control interface. The focus mark module detects the focal length position of the user's eyes by using the focus detection module, and uses the focus mark to display the focal length position of the user's eyes in the display area of the user's screen, and the narrator can know the user. Paying attention to the viewing place, so as to make corresponding explanations at the same time, not only can the commentator easily explain, but the user will also have more experience.

The present invention further provides a virtual reality display device for playing a virtual reality display screen, and at least one predetermined position in the virtual reality display screen is an electronic device having a sub-picture switching area and at least one real-world display device is connected. The at least one user screen display area of the navigation control interface is provided with a sub-picture hot spot flag at the sub-picture switching area corresponding to the virtual reality display screen, so that the narrator can know in advance that there is a sub-picture switching area, and The screen hotspot flag allows the sub-screen display area to display the corresponding sub-picture related information first, so as to explain the corresponding user in advance, not only can the explanation be more complete, but also the user will have a better experience and feel the commentary. More professional.

The present invention further provides a real-world display device for playing a virtual reality display screen, and at least one electronic device connected to the real-world display device is displayed on at least one user screen display area of the navigation control interface, and simultaneously displays each The virtual reality display screen played by the real-world display device is described by the commentator corresponding to the area and location that the user is viewing, and the user is more likely to feel at the scene.

The navigation control interface of the electronic device may have a plurality of user screen display areas, and the narrator may view the virtual reality display screen viewed by different users through the moving screen, or switch through at least one switch button. Display the virtual reality display screen viewed by different users, so that the narrator can explain multiple users at the same time.

1‧‧‧Driving display device

10‧‧‧ Speaker

11‧‧‧ Focus Detection Module

12‧‧‧Virtual reality display

121‧‧‧Sub screen switching area

2‧‧‧Electronic devices

20‧‧‧Navigation Control Interface

21‧‧‧User screen display area

211‧‧‧ focus mark

212‧‧‧Sub-picture hotspot sign

22‧‧‧Microphone

23‧‧‧ hotspot keys

24‧‧‧Sub screen display area

25‧‧‧Switch button

26‧‧‧Control Module

Figure 1 is a block diagram of a system in accordance with an embodiment of the present invention.

2 is a schematic diagram of a display screen of a real-world display device according to an embodiment of the present invention.

Figure 3 is a block diagram of the system of the embodiment of the present invention.

Figure 4 is a block diagram of the system of the embodiment of the present invention.

Figure 5 is a schematic diagram of a display screen of a real-world display device according to an embodiment of the present invention.

6 and 7 are schematic diagrams of hotspot settings in an embodiment of the present invention.

Figure 8 is a schematic diagram of the hotspot setting after the embodiment of the present invention is completed.

Figure 9 is a schematic diagram showing the generation of a QR Code according to an embodiment of the present invention.

In order to achieve the above objects and effects, the technical means and the configuration thereof used in the present invention are described in detail below with reference to the embodiments of the present invention. In addition, the method of the present invention is described in conjunction with the following system, as shown in Figures 1, 2 and 3, as is apparent from the drawings, the present invention includes at least one real-world display device 1 And the electronic device 2, the real-world display device 1 and the electronic device 2 respectively perform data transfer with the server. Moreover, the real-world display device 1 can be respectively provided with a speaker 10, and each of the real-world display devices 1 plays a virtual reality display screen 12, and the electronic device 2 has a navigation control interface 20, and the navigation control interface 20 has a synchronous display. Each of the reality display devices 1 plays at least one user screen display area 21 of the virtual reality display screen 12, and the electronic device 2 has a microphone 22 and a camera. The electronic device 2 can be a computer, a mobile phone or a tablet. The control interface 20 can be a computer software or a mobile application (APP). Moreover, the real-world display device 1 can be a head-mounted virtual reality device or a mobile phone or a tablet computer.

The virtual reality real-time navigation system of the present invention can be used in the fields of watching houses, tourism, museum visits or play area explanations, and the following is a description of the house as an example, but not limited thereto.

When the virtual reality instant navigation system is used, the user can wear the reality display device 1 and the user can view the virtual reality display screen 12, and the commentator views the navigation control interface 20 of the electronic device 2. In the user screen display area 21, since each virtual reality display screen 12 and the corresponding user screen display area 21 display the same screen, the narrator can know the area and position that the user is viewing, and the narrator can directly The user is described, or the interpreter speaks the audio data through the microphone 22, and transmits the audio data to the real-world display device 1 for the speaker 10 to play, so that the user can hear the narrator's speech. The user and the narrator can save time spent on transportation, and the single narrator can receive multiple users at different times at the same time, so it is convenient.

Referring to FIG. 3, it is clear from the figure that the present invention includes at least one real-world display device 1 and an electronic device 2, wherein the at least one real-world display device 1 has a speaker 10 and a focus, respectively. The detection module 11, each of the reality display devices 1 respectively plays a virtual reality display screen 12, and at least one of the real world display devices 1 is connected to the electronic device 2, and the electronic device 2 has a navigation control interface 20, navigation The control interface 20 has at least one user screen display area 21 for synchronously displaying the virtual reality display screen 12 played by each of the real world display devices 1. Each user screen display area 21 has a focus mark 211, and the focus mark 211 can be It is a cross, a human, an eye, a circle, or other graphic, and the electronic device 2 has a microphone 22.

When the user wears the reality display device 1, the user can move around the house and view different positions, home appliances or decorations. At this time, the focus detection module 11 can detect the focus position of the user's eyes, and It is transmitted to the electronic device 2 to display the focus mark 211 at the focal position of the user's eyes in the user screen display area 21 of the navigation control interface 20, so that the narrator can know the position that the user is paying attention to. , home appliances or decoration, so that the corresponding explanations can be made at the same time, so that the effect of the commentator can be achieved, and the user will have more experience. At the same time, other user representative images entering the same scene may be displayed on the real-time display device screen or the screen displayed by the electronic device, and the user representative images are displayed in the screen according to the coordinates of the corresponding link. In order to know whether there are other people watching at the same time, and through these images, it is possible to observe where other people are watching, and whether there is a situation that they themselves need to understand. Among them, the method of detecting the focus position includes assuming that the eyes are all looking at the center of the screen, so that the center point of the screen viewed by the user is the measured focus. Alternatively, a camera is disposed on the user's direction through the real-world display device to detect the position at which the eyeball is rotated to obtain the focus of the eyeball.

Referring to Figures 4 and 5, it is clear from the drawings that the present invention includes at least one real-world display device 1 and an electronic device 2, wherein the at least one real-world display device 1 has a speaker 10, respectively. And the focus detection module 11, each of the reality display devices 1 respectively playing the virtual reality display screen 12, and at least one of the predetermined positions in the virtual reality display screen 12 has the sub-screen switching area 121, and at least one real The environment display device 1 is connected to the electronic device 2, and the electronic device 2 has a navigation control interface 20, and at least one user of the virtual reality display screen 12 displayed by each of the reality display devices 1 is synchronously displayed in the navigation control interface 20. In the screen display area 21, each user screen display area 21 has a focus mark 211, and the electronic device 2 has a microphone 22, and the navigation control interface 20 is in the at least one user screen display area 21 for corresponding virtual reality. A sub-screen hotspot flag 212 is provided at the sub-screen switching area 121 of the environment display screen 12.

The virtual reality display screen 12 played by each of the real world display devices 1 has a sub-screen switching area 121 (such as a window, a door or a balcony of a house) at at least one predetermined position, and when the user shifts to the sub-screen switching area 121, The corresponding sub-picture can be displayed, and the user picture display area 21 viewed by the narrator is provided with the sub-picture hot spot flag 212 at the corresponding sub-picture switching area 121, so that the user has not moved to the sub-picture switching area 121 before The narrator can click on the sub-screen hotspot flag 212 to cause the sub-screen display area 24 to display the corresponding sub-picture related data first, so as to know in advance and explain the user, because the layout, decoration and decoration of the house will have some Differences, so the corresponding room or window view is different, so that the narrator can know the corresponding information in advance, and can provide a more complete explanation, and the user can feel better and better. Users feel that the commentator has a detailed understanding and professionalism.

Each of the user screen display areas 21 may be provided with a sub-screen hotspot flag 212, or at least one hotspot key 2 may be further disposed on each user screen display area 21 side, and each user screen display area 21 side is provided. There is at least one sub-screen display area 24, whereby the interpreter displays the corresponding sub-picture display area 24 by clicking on the sub-picture hotspot flag 212, or by the commentator by clicking on the hot-spot key 2 corresponding to each sub-picture hotspot mark 212. Screen related information.

Referring to Figures 3, 4 and 5, it can be clearly seen from the figure that the navigation control interface 20 of the electronic device 2 can have a plurality of user screen display areas 21 for simultaneously displaying a plurality of users. The virtual reality display screen 12 of the real-world display device 1 is disposed, and the narrator can view the virtual reality display screen 12 viewed by different users through the moving screen, or the navigation control interface 20 has a single user screen display area 21 And at least one switching button 25 is provided on the side of the user screen display area 21 for the commentator to click the switching key 25 to cause the user screen display area 21 to switch to display the virtual reality display screen 12 viewed by different users, so as to explain A plurality of users can be explained at the same time to achieve a time-saving effect, such as the use of other modifications and equivalent structural changes, which are equally included in the scope of the patent of the present invention, and are combined with Chen Ming.

Further, the electronic device 2 further has a control module 26 (with a button indicating a switching function, but not limited thereto), which can be used to control whether the screen displayed by the real-world display device 1 is controlled by the electronic device 2 or The electronic device 2 is controlled by the real-world display device 1. When the control module 26 is turned on, the user can forcibly control the screen displayed by the real-world display device 1 via the electronic device 2, so that the narrator can easily let the user see the virtual reality display screen 12 to be pointed out. At this time, the displayed coordinates are transmitted to the server by the electronic device 2, and then transmitted to the virtual reality display device by the server for display. When the commentator closes the control module 26, the user can move and watch according to his own idea without being controlled by the narrator, and at this time, the position of the screen viewed by the user will be transmitted back to the server. For the electronic device 2 to display synchronously. The control module 26 can simultaneously control the plurality of reality display devices 1 to follow or move freely.

Moreover, the hot spot according to the present invention can be established in the following manner. When the hot spot is established, the hot spot H to be set is displayed on the display device (for example, the electronic device). The installed display device), and the position of the hot spot H to be set is maintained unchanged with respect to the display device; the user controls the movement of the scene displayed by the display device, (Fig. 7 is relative to Fig. 6 After moving, when the location of the scene screen of a hotspot HP is set to correspond to the hotspot H to be set, confirming, and then inputting the message and inputting the scene path to be hopped (for example, a web address), the scene screen is completed. The setting of a hotspot HP (for example, clicking on the hotspot H to be set), after that, the hotspot HP will be moved along with the screen and fixed at the position specified by the setting, as shown in Fig. 8. This provides a more intuitive setting method for the user, and facilitates setting control on the touch screen to improve the convenience of use.

In addition, the hot spot H to be set is further set in the center of the screen displayed by the display device, so that the user can perform an intuitive operation, especially a touch screen.

The present invention further provides a scene synchronization connection method for providing an electronic device 2 and at least one real-world display device 1 for scene synchronization display via a server, which includes the following steps: the electronic device 2 transmits a start command to the a server, the server returns a website address to the electronic device 2, and after the input of the website address, the real-time display device 1 transmits a specified code included in the website to the server for comparison. After the confirmation is correct, the real-time display device 1 is caused to display the screen displayed by the electronic device 2, and the effect of synchronization is achieved.

Moreover, after the operation is completed, the server can automatically replace the specified code in the website address or the website address, so that the user can no longer enter and view through the same path, thereby achieving the effect of both security and control.

Moreover, the electronic device 2 can be equipped with a fast response matrix code conversion module, which can convert the received web address into a fast response matrix code (QR CODE); the real-world display device 1 is equipped with a fast response matrix code. The reading module, as shown in FIG. 9, is used to read the fast response matrix code displayed by the electronic device. Thereby, the occurrence of the input URL error can be reduced, and the URL can be quickly transmitted to the real-world display device 1 in combination with the NFC device and function.

In summary, the virtual reality real-time navigation system of the present invention can achieve its efficacy and purpose when used, so the invention is a practical and excellent creation, and is in accordance with the application requirements of the invention patent. To file an application, I hope that the trial committee will grant the case as soon as possible to protect the inventor's hard work. If there is any doubt in the trial committee, please do not hesitate to give instructions, the inventor will try his best to cooperate, and feel really good.

Claims (10)

 A virtual reality real-time navigation method, wherein the real-time display device and an electronic device perform data transmission with a server, wherein the real-world display device is stored in the server and received by the server. The image of one of the locations is used for the virtual reality to be played, and the electronic device displays the screen displayed by the real-world display device according to the data provided by the server, and the electronic device can simultaneously and plurally The real-time display device performs signal connection and simultaneously displays the displayed images of the connected real-world display devices, wherein the electronic device is installed with a navigation control interface to control the locations displayed by the real-world display devices; Moreover, the electronic device further includes a hotspot establishing mode, wherein a hot spot to be set is displayed on one of the signal connections of the electronic device, and the position of the hot spot to be set is maintained relative to the display device; Controlling the movement of the scene displayed by the display device, and when the position of the scene image to be set to a hot spot is corresponding to the hot spot to be set, It confirmed the wearer, so that a complete picture of the scene set hot.    The virtual reality instant navigation method of claim 1, wherein the user can select one of the hotspots via the real-world display device or the electronic device, and then jump to the image of the relevant location pointed to by the hot body.    The virtual reality real-time navigation method of claim 1, wherein the real-time display device is provided with a focus detection module, wherein the focus detection module detects the focus of the user's eyes, and This focus position is presented on the screen displayed by the electronic device.    The virtual reality instant navigation method of claim 1, wherein the user-represented image entering the same scene is included in the screen displayed by the real-world display device or in the screen displayed by the electronic device.    The virtual reality instant navigation method of claim 1, wherein the electronic device further has a control module configured to control whether the screen displayed by the real-world display device is controlled or controlled by the electronic device.    The virtual reality instant navigation method according to claim 1, wherein the real-world display device transmits the coordinate position of the displayed screen to the server, and the electronic device obtains the coordinate position by the server, and then performs the Corresponding display.    A virtual reality real-time navigation system is connected to a navigation control device via a server via at least one real-world display device, wherein the real-time display device is provided for the user. Wearing, for displaying the location specified by the navigation control interface, the image played by the real-world display device is synchronously played on the electronic device via the server, and each of the real-world display devices respectively plays the virtual reality display The electronic device has a navigation control interface, and the navigation control interface has at least one user screen display area for synchronously displaying the virtual reality display screen played by each of the real-world display devices; and the electronic device further includes a hotspot The setting mode is to display a hot spot to be displayed on one of the display devices of the electronic device, and the position of the hot spot to be set is unchanged with respect to the display device; the user manipulates the scene displayed by the display device Moving, when the position of the scene screen to be set to a hot spot is corresponding to the hot spot to be set, the user confirms, The completion of a hot spot of scene setting.    The virtual reality real-time navigation system of claim 7, wherein the real-world display device has a focus detection module for detecting a focus of the user's eyes, and displays corresponding to each user's screen display area. The display focus mark focus mark of the user's binocular focus position.    The virtual reality instant navigation system of claim 7, wherein the navigation control interface of the electronic device can have a plurality of user screen display areas to simultaneously display a plurality of user-equipped reality display devices. The virtual reality display screen.    The virtual reality real-time navigation system of claim 7, wherein the navigation control interface is located in at least one user screen display area to provide a hot spot mark on the corresponding virtual reality display screen, and the user can Selecting the hotspot flag via the navigation control interface or the real-world display device to open another screen; further, the at least one real-world display device has a speaker respectively, and the electronic device is provided with a microphone and a camera for the microphone The audio data is played and played through the speaker; and the navigation control interface of the electronic device can have a plurality of user screen display areas to simultaneously display and control the virtual reality display screen of the plurality of users wearing the reality display device.