TWI653546B - Virtual reality system with outside-in tracking and inside-out tracking and controlling method thereof - Google Patents

Abstract

A virtual reality system with external tracking and built-in tracking and a control method thereof. The virtual reality system includes a head mounted display unit, an image unit, an external tracking unit, a built-in tracking unit, and a switching unit. The image unit is configured to provide a virtual reality content to the head mounted display unit. The switching unit is configured to select to control the virtual reality content by using an external tracking unit or a built-in tracking unit.

Description

Virtual reality system with external tracking and built-in tracking and its control Method

The invention relates to a virtual reality system and a control method thereof, and in particular to a virtual reality system with external tracking and built-in tracking and a control method thereof.

With the development of virtual reality (VR), various virtual reality hardware and software continue to evolve. Virtual reality technology uses computer simulation to generate a virtual environment in three-dimensional space, providing a simulation of the user's visual senses, making the user feel as if they are immersed.

When the user moves, the computer can perform complex calculations immediately, providing accurate three-dimensional images to create a sense of presence. Virtual reality technology integrates computer simulation, sensing, display, computer graphics, artificial intelligence and other technologies, and is currently a very popular emerging technology.

The virtual reality display device can use an outside-in tracking system or an inside-out tracking system. The external tracking system identifies the position or orientation of the virtual reality device through an external sensor. The built-in tracking system uses internal sensors to identify the position or orientation of the virtual reality device. A virtual reality display device using an external tracking system and a virtual reality display device using a built-in tracking system are currently applied to different virtual reality content. In the current technology, the virtual reality content of the two cannot be used interchangeably, and the development of virtual reality technology is limited.

The invention relates to a virtual reality system and a control method thereof, which utilizes an external tracking unit and a built-in tracking unit which are simultaneously provided, so that the head mounted display device can be applied to various virtual reality content and expands the virtual reality. The development of technology.

According to a first aspect of the invention, a virtual reality system is presented. The virtual reality system includes a head mounted display unit, an image unit, an outside-in tracking unit, an inside-out tracking unit, and a switching unit. The image unit is configured to provide a virtual reality content to the head mounted display unit. The switching unit is configured to select to control the virtual reality content by using an external tracking unit or a built-in tracking unit.

According to a second aspect of the present invention, a method of controlling a virtual reality system is presented. The control method of the virtual reality system includes the following steps: providing a virtual Real-world content to a head-mounted display unit. Choose an outside-in tracking unit or an inside-out tracking unit. Control the virtual reality content by selecting an external tracking unit or a built-in tracking unit.

According to a third aspect of the invention, a virtual reality system is presented. The virtual reality system includes a head mounted display unit, an image unit, an outside-in tracking unit, an inside-out tracking unit, and a control unit. The image unit is configured to provide a virtual reality content to the head mounted display unit. The external tracking unit has a first weight. The built-in tracking unit has a second weight. The control unit is configured to use the external tracking unit to perform virtual reality content control according to the first weight, and use the built-in tracking unit to perform virtual reality content control according to the second weight.

According to a fourth aspect of the present invention, a method of controlling a virtual reality system is provided. The control method of the virtual reality system includes the following steps: providing a virtual reality content to a head mounted display unit. According to a first weight, an external-in tracking unit is used to control the virtual reality content. According to a second weight, an inside-out tracking unit is used to control the virtual reality content.

In order to better understand the above and other aspects of the present invention, the following detailed description of the embodiments and the accompanying drawings

100, 200, 300, 400, 500, 600, 700‧‧‧ virtual reality systems

110, 210, 310, 410, 510, 610, 710‧‧‧ head-mounted display devices

111‧‧‧External tracking unit

112‧‧‧ Built-in tracking unit

113‧‧‧ head-mounted display unit

114‧‧‧Switch unit

115‧‧‧Set line unit

116‧‧‧Adjustment unit

120, 220, 720‧‧‧ host

121‧‧‧Image unit

316‧‧‧ input unit

417, 617‧‧‧ position detection unit

518‧‧‧Control unit

DR‧‧‧ actuation unit (driver)

LI‧‧‧Location Information

Steps S110, S120, S130, S210, S220, S230, S240‧‧

SW‧‧‧Switch signal

VR1, VR2, VR3‧‧‧ virtual reality content

W1‧‧‧ first weight

W2‧‧‧ second weight

1 is a block diagram of a virtual reality system in accordance with an embodiment of the present invention.

2 is a flow chart showing a method of controlling a virtual reality system according to an embodiment of the present invention.

3 is a block diagram of a virtual reality system in accordance with another embodiment of the present invention.

4 is a block diagram of a virtual reality system in accordance with another embodiment of the present invention.

FIG. 5 is a block diagram of a virtual reality system according to another embodiment of the present invention.

FIG. 6 is a block diagram of a virtual reality system according to another embodiment of the present invention.

FIG. 7 is a flow chart showing a control method of a virtual reality system according to another embodiment of the present invention.

FIG. 8 is a block diagram of a virtual reality system according to another embodiment of the present invention.

FIG. 9 is a block diagram of a virtual reality system according to another embodiment of the present invention.

Referring to FIG. 1, a block diagram of a virtual reality system 100 in accordance with an embodiment of the present invention is shown. In the example of Figure 1, the virtual reality system 100 The utility model comprises a head-mounted display (HMD) 110 and a host 120. The head mounted display device 110 is, for example, an eye mask, a helmet, a smart phone or a cardboard of a built-in screen. The host 120 is, for example, a desktop computer, a server, a notebook computer, a smart phone, a cloud computing center, a chip, or a circuit board.

The head mounted display device 110 includes a head mounted display unit 113, an outside-in tracking unit 111, an inside-out tracking unit 112, a switching unit 114, and a hub unit. 115. The host 120 includes an image unit 121. The image unit 121 is configured to provide a virtual reality content (for example, virtual reality content VR1 suitable for external tracking or virtual reality content VR2 suitable for built-in tracking) to the head mounted display unit 113. The line unit 115 is connected to the external tracking unit 111 and the built-in tracking unit 112. In an embodiment, the line unit 115 has processing circuitry to process the signals of the external tracking unit 111 and the built-in tracking unit 112. The image unit 121 of the host 120 is different from the adjustment unit 116 of the head mounted display device 110. The image unit 121 of the host computer 120 generates an image signal according to the positioning information returned by the tracking system and transmits the image signal to the head mounted display device 110. The adjusting unit 116 on the head mounted display device 110 does not generate an image, for example, according to an ambient light source. To adjust the gamma value of the image, etc. That is to say, the signals output by the external tracking unit 111 and the built-in tracking unit 112 can be used to adjust the gamma value according to the sensing result, in addition to the tracking position.

Through the tracking of the external tracking unit 111, the virtual reality content VR1 can be correspondingly controlled, for example, the left moving picture, the enlarged picture, and the moving virtual object Control actions such as pieces. Similarly, the virtual reality content VR2 can be correspondingly controlled by the tracking of the built-in tracking unit 112.

In this embodiment, the head mounted display device 110 includes an external tracking unit 111 and a built-in tracking unit 112. Therefore, the switching unit 114 can select to use the external tracking unit 111 or the built-in tracking unit 112 according to the virtual reality content VR1, VR2. Control virtual reality content VR1, VR2.

In the first figure, the switching unit 114 is disposed in the head mounted display device 110; in another embodiment, the switching unit 114 may also be disposed in the host 120.

The following is a detailed description of the operation of the above components. Referring to FIG. 2, a flow chart of a method of controlling a virtual reality system 100 in accordance with an embodiment of the present invention is shown. In step S110, the image unit 121 provides virtual reality content (virtual reality content VR1 or virtual reality content VR2) to the head mounted display unit 113.

Next, in step S120, the switching unit 114 selects the external tracking unit 111 or the built-in tracking unit 112. In this step, the switching unit 114 selects based on the virtual reality content VR1, VR2. In an embodiment, the virtual reality content VR1 has a consistent driver DR, and the switching unit 114 can select according to the value of the actuating element DR or the presence or absence of the actuating element DR. This actuating element DR can be written in a virtual reality application or in a required system.

Then, in step S130, the virtual reality content VR1, VR2 is controlled by the selection external tracking unit 111 or the built-in tracking unit 112.

Please refer to FIG. 3, which is a block diagram of a virtual reality system 200 in accordance with another embodiment of the present invention. In the present embodiment, the switching unit 114 is disposed in the host 220, and the rest of the same is not repeated. The switching unit 114 is connected to the head mounted display unit 210 external tracking unit 111 and the built-in tracking unit 112 to switch between the external tracking unit 111 and the built-in tracking unit 112.

Please refer to FIG. 4, which is a block diagram of a virtual reality system 300 in accordance with another embodiment of the present invention. In the present embodiment, the head mounted display device 310 further includes an input unit 316, and the rest are the same, and are not repeated. The virtual reality content VR1, VR2 may be simultaneously transmitted to the head mounted display unit 113; or one of the virtual reality contents VR1, VR2 may be selected to be transmitted to the head mounted display unit 113. The input unit 316 is, for example, a physical button or a remote control receiving module. The input unit 316 is used for the user to input a switching signal SW. After receiving the switching signal SW, the switching unit 114 selects the external tracking unit 111 or the built-in tracking unit 112 according to the switching signal SW to control the virtual reality contents VR1 and VR2.

Similarly, in another embodiment, the switching unit 114 and the input unit 316 may also be disposed in the host 120.

Please refer to FIG. 5, which is a block diagram of a virtual reality system 400 in accordance with another embodiment of the present invention. In the embodiment, the head mounted display device 410 further includes a position detecting unit 417. After the location detecting unit 417 detects a location information LI, the image unit 121 can know that the virtual reality content VR1 or the virtual reality content VR2 needs to be transmitted to the head mounted display unit 113. After the location detecting unit 417 detects the location information LI, the switching unit 114 can know the head mounted display device according to the location information LI. 410 is an environment that is located in an external tracking or built-in tracking, and then selects the external tracking unit 111 or the built-in tracking unit 112 based on the location information LI to control the virtual reality contents VR1 and VR2.

Please refer to FIG. 6, which is a block diagram of a virtual reality system 500 in accordance with another embodiment of the present invention. In the present embodiment, the head mounted display device 510 uses the control unit 518 to adjust the weights of the external tracking unit 111 and the built-in tracking unit 112, and the rest of the similarities are not repeated.

In this embodiment, the external tracking unit 111 has a first weight W1, and the built-in tracking unit 112 has a second weight W2. In the case that the virtual reality content VR3 is not completely suitable for the external tracking system or is not completely suitable for the built-in tracking system, the control unit 518 may set the first weight W1 and the second weight W2 to control the virtual reality content VR3. It can be performed by the external tracking unit 111 of the first weight W1 and the built-in tracking unit 112 of the second weight W2.

In the embodiment, the control unit 518 is disposed in the head mounted display device 510; in another embodiment, the control unit 518 can also be disposed in the host 120.

Referring to FIG. 7, a flowchart of a method for controlling a virtual reality system 500 according to another embodiment of the present invention is shown. In step S210, the image unit 121 provides the virtual reality content VR3 to the head mounted display unit 113.

Next, in step S220, the control unit 518 adjusts the first weight W1 and the second weight W2 according to the virtual reality content VR3.

Then, in step S230, the control of the virtual reality content VR3 is performed by the external tracking unit 111 in accordance with the first weight W1.

Next, in step S240, the control of the virtual reality content VR3 is performed by the built-in tracking unit 112 in accordance with the second weight W2.

The above steps S230 and S240 can be performed simultaneously. In an embodiment, the external tracking unit 111 and the built-in tracking unit 112 may detect the movement information and the rotation information of the head mounted display device 510 at the same time. This embodiment may be adopted according to the first weight W1 and the second weight W2. The movement information obtained by the external tracking unit 111 uses the rotation information obtained by the built-in tracking unit 112. In this way, the respective advantages of the external tracking unit 111 and the built-in tracking unit 112 can be used interchangeably.

Please refer to FIG. 8, which is a block diagram of a virtual reality system 600 in accordance with another embodiment of the present invention. In this embodiment, the head mounted display device 610 further includes a position detecting unit 617. After the location detecting unit 617 detects the location information LI, the control unit 518 can know whether the head mounted display device 610 is located in an external tracking environment or a built-in tracking environment according to the location information LI, and then adjusts the first weight according to the location information LI. W1 and second weight W2.

Please refer to FIG. 9, which is a block diagram of a virtual reality system 700 in accordance with another embodiment of the present invention. In this embodiment, the control unit 518 is disposed in the host 720, and the rest of the same is not repeated. The control unit 518 is connected to the head mounted display device 710 external tracking unit 111 and the built-in tracking unit 112 to adjust the first weight W1 of the external tracking unit 111 and the second weight W2 of the built-in tracking unit 112.

According to the various embodiments described above, the head mounted display device simultaneously sets the external tracking unit and the built-in tracking unit, so that the head mounted display device can be applied to various virtual reality content, and the development of the virtual reality technology is expanded.

In conclusion, the present invention has been disclosed in the above embodiments, but it is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

Claims (16)

A virtual reality system includes: a head mounted display unit; an image unit for providing a virtual reality content to the head mounted display unit; an outside-in tracking unit; a built-in An internal-out tracking unit, and a switching unit, configured to select, according to the virtual reality content, the positioning information of the external tracking unit or the positioning information of the built-in tracking unit to perform the virtual reality content control . The virtual reality system of claim 1, wherein the head mounted display unit, the external tracking unit, the built-in tracking unit, and the switching unit are disposed on a head-mounted display device. In HMD, the image unit is disposed in a host. The virtual reality system of claim 1, wherein the head mounted display unit, the external tracking unit, and the built-in tracking unit are disposed in a head-mounted display (HMD) The image unit and the switching unit are disposed in a host. The virtual reality system of claim 1, wherein the virtual reality content has a consistent driver, and the switching unit is configured according to the virtual reality system The actuating element selects to use the external tracking unit or the built-in tracking unit to perform control of the virtual reality content. The virtual reality system of claim 1, further comprising: an input unit for inputting a switching signal by a user, the switching unit selecting to use the external tracking unit according to the switching signal or the built-in The tracking unit performs control of the virtual reality content. The virtual reality system of claim 1, further comprising: a location detecting unit for detecting a location information, the switching unit selecting to use the external tracking unit or the built-in tracking according to the location information The unit performs control of the virtual reality content. A method for controlling a virtual reality system, comprising: providing a virtual reality content to a head mounted display unit; selecting an outside-in tracking unit or an inside-out tracking unit And controlling the virtual reality content by using the selected positioning information of the external tracking unit or the positioning information of the built-in tracking unit according to the virtual reality content. The control method of the virtual reality system according to claim 7, wherein the virtual reality content has a consistent driver, and is selected In the step of the external tracking unit or the built-in tracking unit, the selection is performed according to the actuation element. The control method of the virtual reality system of claim 7, further comprising: receiving a switching signal; and selecting, by the switching signal, using the external tracking unit or the built-in tracking unit to perform the virtual reality content. control. The method for controlling a virtual reality system as described in claim 7 further includes: detecting a location information; and selecting, by using the location information, the external tracking unit or the built-in tracking unit to perform the virtual reality. Control of content. A virtual reality system includes: a head mounted display unit; an image unit for providing a virtual reality content to the head mounted display unit; and an outside-in tracking unit having a a first weight; an inside-out tracking unit having a second weight; a control unit, configured to use the positioning information of the external tracking unit to perform the control of the virtual reality content according to the first weight, and use the positioning information of the built-in tracking unit to perform the virtual according to the second weight Control of the real content, wherein the control unit adjusts the first weight and the second weight according to the virtual reality content. The virtual reality system of claim 11, wherein the head mounted display unit, the external tracking unit, the built-in tracking unit, and the control unit are disposed on a head-mounted display device. In HMD, the image unit is disposed in a host. The virtual reality system of claim 11, wherein the head mounted display unit, the external tracking unit, and the built-in tracking unit are disposed in a head-mounted display (HMD) The image unit and the control unit are disposed in a host. The virtual reality system of claim 11, further comprising: a position detecting unit for detecting a position information, wherein the control unit adjusts the first weight and the second weight according to the position information . A method for controlling a virtual reality system includes: providing a virtual reality content to a head mounted display unit; Performing control of the virtual reality content by using an orientation information of an outside-in tracking unit according to a first weight; using an inside-out tracking unit according to a second weight Positioning information to control the virtual reality content; and adjusting the first weight and the second weight according to the virtual reality content. The method for controlling a virtual reality system according to claim 15 further includes: detecting a location information; and adjusting the first weight and the second weight according to the location information.