TWI697348B - Stereoscopic display system and stereoscopic display method - Google Patents

Abstract

A stereoscopic display system is provided. The stereoscopic display system includes a head-mounted display, a motor device, a physiological detector and a processor. The head-mounted display is configured to display a stereoscopic video, and includes at least one lens configured to image the stereoscopic video. The motor device is configured to move or rotate the lens of the head-mounted display. The physiological detector is configured to acquire a physiological signal while the head-mounted display displaying the stereoscopic video. The processor is coupled to the head-mounted display, the motor device and the physiological detector, and configured to determine a dizzy status based on the physiological signal and control the motor device to move or rotate the lens based on the dizzy status. In addition, a stereoscopic display method is also provided.

Description

Stereoscopic display system and stereoscopic display method

The present invention relates to the field of stereoscopic display, and particularly relates to a stereoscopic display system and method for reducing dizziness.

Virtual Reality (VR) is the use of computer simulation to generate a virtual world in a three-dimensional space, providing users with a simulation of vision and other senses, making users feel as if they are immersed in the environment, and can observe the three-dimensional space in real time without restriction Things. However, the current virtual reality technology still has many problems to be overcome, and the user's dizziness is one of the most important problems. In past studies, many reasons may cause users to experience dizziness when using virtual reality devices, and different users may have different causes of dizziness.

For example, when the eyes see that the picture is moving but the body does not feel it is moving, it may cause sensory inconsistency and cause dizziness; due to the latency of the picture, the rotation time during the head movement The time difference between the actual change time of the screen may also cause dizziness; the interpupillary distance (IPD) of each user is different, so the pupil center, lens center and screen center may not be available when the user uses the virtual reality device On the same line, the ghosting phenomenon causes dizziness; when the depth of field in the virtual reality screen is different from the user's perception, it may also cause dizziness.

It can be seen that the possible causes of dizziness in virtual reality cannot be summarized, and the related issues of dizziness resolution are also the focus of research by those skilled in the art.

In view of this, the present invention provides a stereoscopic display system and a stereoscopic display method, which can effectively eliminate the problem of dizziness caused by the position and angle of the lens.

The stereoscopic display system of the embodiment of the present invention includes a head-mounted display, a motor device, a physiological detector, and a processor. The head-mounted display is used for displaying stereoscopic dynamic images, and includes at least one lens for imaging the stereoscopic dynamic images. The motor device is used to move or rotate the lens of the head-mounted display. The physiological detector is used to obtain physiological signals when the head-mounted display displays stereoscopic dynamic images. The processor is coupled to the head-mounted display, the motor device and the physiological detector for determining the dizziness state based on the physiological signal, and controls the motor device to move or rotate the lens based on the dizziness state.

The stereoscopic display method of the embodiment of the present invention is applicable to a stereoscopic display system including a head-mounted display. The three-dimensional display method includes the following steps: displaying a three-dimensional dynamic image, and obtaining a physiological signal through a physiological detector when displaying the three-dimensional dynamic image; determining a dizziness state based on the obtained physiological signal; and moving through a motor device based on the dizziness state Or rotate at least one lens of the head-mounted display.

Based on the above, the three-dimensional display system and the three-dimensional display method proposed by the embodiments of the present invention control the motor device through the physiological signal fed back in real time to adjust the spatial relationship between the lens of the head-mounted display and the eyes of the user. Accordingly, it is possible to find a lens adjustment method that can definitely improve the dizziness state of the user, effectively eliminate the dizziness caused by the position and angle of the lens, and improve the user experience of the stereoscopic display device.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail in conjunction with the accompanying drawings.

FIG. 1 is a schematic block diagram of a stereoscopic display system according to an embodiment of the invention. 1, the stereoscopic display system 100 includes a processor 110, a physiological detector 120, a motor device 130, and a head-mounted display 140. The physiological detector 120, the motor device 130, and the head-mounted display 140 are all coupled to Processor 110. In some embodiments, the stereoscopic display system 100 is, for example, a virtual reality (VR) system for displaying stereoscopic dynamic images through the head-mounted display 140.

The processor 110 can be used to send a display signal to the head-mounted display 140 to display a stereoscopic dynamic image through the head-mounted display 140. In addition, the processor 110 is further used to perform appropriate operations to alleviate the dizziness when the user may or does experience dizziness. In some embodiments, the processor 110 includes, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessors (Microprocessors), digital signal processors (Digital Signal Processors). DSP), programmable controllers, application specific integrated circuits (Application Specific Integrated Circuits, ASIC), programmable logic devices (Programmable Logic Device, PLD) or other similar devices or a combination of these devices, but the present invention does not Not limited to this.

The physiological detector 120 is used to obtain physiological signals related to the user's dizziness when the head-mounted display 140 displays a three-dimensional dynamic image, such as a blood oxygen concentration signal or a brain wave signal, etc. The processor 110 can determine by the physiological signal The current dizziness state of the user is to determine whether the user is currently dizzy. In some embodiments, the dizziness state further includes information about the user's dizziness. However, as long as the obtained physiological signal can be used to determine the dizziness state, the present invention does not limit the type of the physiological detector 120 here.

In some embodiments, the physiological detector 120 is, for example, a blood oxygen concentration detector for obtaining a blood oxygen concentration signal. When the human body suffers from dizziness, heatstroke and other conditions, the brain will be hypoxic, and the blood oxygen concentration will drop significantly at this time. Therefore, the blood oxygen concentration signal helps the processor 110 determine the dizziness state of the user.

In some embodiments, the physiological detector 120 is, for example, a brain wave detector such as a single-channel electroencephalometer to obtain the user's brain waves. When a person is physically fatigued, the energy of the alpha wave (ie, 8 to 12 Hz) in the frontal lobe area rises, and the energy of the beta wave (ie, 13 to 30 Hz) decreases when the concentration drops. And fatigue and concentration are closely related to dizziness. Specifically, if the user continues to use the head-mounted display 140 during the process of dizziness, the physical fatigue will be noticeable, and the concentration will also decrease significantly. Therefore, in these embodiments, the physiological detector 120 obtains at least one of the alpha wave signal and the beta wave signal in the brain waves, which helps the processor 110 determine the dizziness state of the user.

The motor device 130 is used to move or rotate at least one lens in the head mounted display 140 under the control of the processor 110. In some embodiments, the motor device 130 can, for example, use elements such as gears, racks or belts, and micromotors to move or rotate the lens in the head-mounted display 140 arbitrarily in a three-dimensional space.

For example, the motor device 130 can move the lens of the head mounted display 140 along the first axis D1 (for example, forward and backward) to adjust the distance between the lens and the user's eyes. If the head mounted display 140 includes the first lens 141 and the second lens 143, the motor device 130 can also move the first lens 141 and the second lens 141 and the second lens along a second axis D2 (for example, left and right) perpendicular to the first axis D1. The lens 143 adjusts the distance between the first lens 141 and the second lens 143, or moves the first lens 141 along a third axis perpendicular to the first axis D1 and the second axis D2 (for example, up and down) With the second lens 143. Furthermore, if the first lens 141 and the second lens 143 are not arranged in parallel, the motor device 130 can also rotate the first lens 141 and the second lens 143 to adjust the angle between the first lens 141 and the second lens 143. In other embodiments, the motor device 130 can also rotate between the first lens 141 and the second lens 143 along other axial directions, and the invention is not limited thereto.

It is worth mentioning that the present invention does not limit the specific implementation of the motor device 130 used to move or rotate the head-mounted display 140. Those with ordinary knowledge in the field can rely on the head-mounted display 140 used. The actual design is to implement the motor device 130 to move or rotate at least one lens in the head mounted display 140.

The head mounted display 140 is coupled to the processor 110, and can receive the display signal from the processor 110 to display a stereoscopic dynamic image. The head-mounted display 140 includes at least one lens for imaging a stereoscopic dynamic image. In some embodiments, the head-mounted display 140 includes only one lens, and both eyes of the user can view the three-dimensional dynamic image through the lens. In some embodiments, the head-mounted display 140 includes, for example, a first lens 141 and a second lens 143, which are respectively used to image the left eye and right eye of the user so that the user can see the display on the head-mounted display 140 The three-dimensional dynamic image. However, the present invention is not limited to this, and those skilled in the art can implement the head-mounted display 140 according to their knowledge of stereoscopic display.

FIG. 2 shows a flowchart of a stereoscopic display method according to an embodiment of the invention. Referring to FIG. 2, in step S110, the processor 110 sends a display signal to the head-mounted display 140, and the head-mounted display 150 displays a stereoscopic dynamic image according to the received display signal. At the same time, in step S120, the processor 110 will synchronously obtain the physiological signal of the user through the physiological detector 120. In step S130, the processor 110 determines the dizziness state based on the acquired physiological signal, that is, determines whether the user is dizzy.

For example, when the physiological detector 120 is a brain wave detector, the alpha wave energy indicated in the alpha wave signal is, for example, positively correlated with the user’s dizziness, and the beta wave indicated in the beta wave signal The energy is, for example, negatively related to the user's dizziness. The processor 110 may, for example, set a first threshold corresponding to the alpha wave energy, or set a second threshold corresponding to the beta wave energy, when the alpha wave energy detected by the physiological detector 120 is greater than the first threshold, or the beta wave energy is less than The second threshold indicates that the user is dizzy.

If the processor 110 determines that the user is not dizzy in step S130, it returns to step 120 to continue to obtain the physiological signal of the user while displaying the three-dimensional dynamic image. Conversely, if the processor 110 determines that the user is dizzy in step S130, then it proceeds to step S140, and moves or rotates the lens of the head mounted display 140 through the motor device 130 based on the dizziness state to try to reduce the user's dizziness .

In some embodiments, as shown in FIG. 3, the processor 110 adjusts the distance between the first lens 141 and the second lens 143 of the head mounted display 140 along the first axis D1 through the motor device 130, for example. distance. Accordingly, it is possible to try to improve the user's dizziness (ie, reduce the degree of dizziness) by adjusting the eye relief.

In some embodiments, as shown in FIG. 4, the predetermined distance between the first lens 141 and the second lens 143 of the head-mounted display 140 is, for example, 63 mm. However, based on the interpupillary distance (IPD) of different users, the processor 110 adjusts the first lens 141 and the second lens 143 of the head-mounted display 140 along the second axis D2 through the motor device 130, for example. (For example, gradually shorten to 60 mm). Accordingly, the dizziness caused by the ghost phenomenon can be improved.

In some embodiments, as shown in FIG. 5, in order to image the images on the left-eye image panel P2 and the right-eye image panel P1 of the head-mounted display 140 to the left and right eyes of the user, the first lens 141 or The angle between the second lens 143 and the connection between the eyes when the user wears the head-mounted display 140 is preset to 23∘, that is, the angle between the first lens 141 and the second lens 143 is 134∘. For example, the processor 110 adjusts the angle between the first lens 141 and the second lens 143 through the motor device 130 (for example, reduced to 129∘), which can change the range of the clear picture that the user sees, thereby improving the use The dizziness of the person.

In particular, the processor 110 will return to step S120 after adjusting in step S140 to continue to obtain the physiological signal. Therefore, in some embodiments, the processor 110 records the dizziness state (for example, recording alpha wave energy or beta wave energy) and the lens adjustment method (for example, axial direction) before adjusting the lens of the head mounted display 140. In this way, when the process enters step S140 again, the processor 110 can compare with the recorded dizziness state based on the current dizziness state to determine whether the previous lens adjustment method in step S140 is helpful The dizziness of the user is improved, and accordingly, the motor device 130 is further controlled to rotate or move the lens of the head mounted display 140.

For example, the processor 110 records the current alpha wave energy as the first energy and extends the eye-fitting distance of the head-mounted display 140 along the first axis D1. Then, the processor 110 will continue to obtain the alpha wave signal through the brain wave detector, where the indicated alpha wave energy is, for example, the second energy. The processor 110 compares the first energy with the second energy to determine whether the alpha wave energy decreases after the eye distance is elongated. If the second energy is less than the first energy, it means that lengthening the eye distance helps to improve the dizziness of the user. Therefore, the processor 110 can continue to control the motor device 130 to continue to lengthen the headwear along the first axis D1. Eye distance of the display 140. If the second energy is greater than the first energy, it means that the eye-distance is lengthened and the user's dizziness is strengthened. Therefore, the processor 110 can control the motor device 130 along the first axis D1 to reversely shorten the head-mounted display 140 Suitable for eye distance. If the first energy is equal to the second energy, it means that the eye distance may not be the main cause of the user's dizziness. Therefore, the processor 110 can control the motor device 130 to move or rotate in other ways (for example, move along another axis). Or rotate) the lens of the head mounted display 140. By analogy, the stereoscopic display system 100 can effectively reduce the user's dizziness caused by the position and angle of the lens of the head-mounted display 140.

To sum up, the three-dimensional display system and the three-dimensional display method proposed by the embodiments of the present invention control the motor device through the physiological signals fed back in real time to adjust the spatial relationship between the lens of the head-mounted display and the eyes of the user. Accordingly, it is possible to find a lens adjustment method that can definitely improve the dizziness state of the user, effectively eliminate the dizziness caused by the position and angle of the lens, and improve the user experience of the stereoscopic display device.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make slight changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be subject to those defined by the attached patent scope.

100‧‧‧Three-dimensional display system 110‧‧‧Processor 120‧‧‧Physiological detector 130‧‧‧Motor device 140‧‧‧Head-mounted display 141‧‧‧First lens 143‧‧‧Second lens D1 ‧‧‧First axis D2‧‧‧Second axis P1‧‧‧Right eye image panel P2‧‧‧Left eye image panel S110, S120, S130, S140‧‧‧Steps of the stereoscopic display method

FIG. 1 is a schematic block diagram of a stereoscopic display system according to an embodiment of the invention. FIG. 2 shows a flowchart of a stereoscopic display method according to an embodiment of the invention. 3 and 4 are schematic diagrams of moving the lens of the head-mounted display in an embodiment of the present invention. FIG. 5 is a schematic diagram of rotating the lens of the head mounted display 140 in an embodiment of the present invention.

Steps of S110, S120, S130, S140‧‧‧3D Display Method

Claims (8)

A three-dimensional display system includes: a head-mounted display for displaying a three-dimensional dynamic image, wherein the head-mounted display includes at least one lens for imaging the three-dimensional dynamic image; and a motor device for moving or rotating the At least one lens; a physiological detector for obtaining a physiological signal when displaying the three-dimensional dynamic image; and a processor coupled to the head-mounted display, the motor device and the physiological detector for Determine a dizziness state based on the physiological signal, and control the motor device to move or rotate the at least one lens based on the dizziness state; wherein the at least one lens includes a first lens and a second lens, and the processor controls the Moving or rotating the at least one lens by the motor device includes: controlling the motor device to adjust the angle between the first lens and the second lens. In the stereoscopic display system described in the first item of the scope of patent application, the physiological detector is a brain wave detector, and the physiological signal is an alpha wave signal or a beta wave signal. The stereoscopic display system according to claim 1, wherein the processor controlling the motor device to move or rotate the at least one lens includes: controlling the motor device to move the at least one lens to adjust an eye distance. The stereoscopic display system according to claim 1, wherein the at least one lens includes a first lens and a second lens, and wherein the processor controlling the motor device to move or rotate the at least one lens includes: The motor device is controlled to adjust the distance between the first lens and the second lens. A three-dimensional display method, suitable for a three-dimensional display system including a head-mounted display, includes: displaying a three-dimensional dynamic image, and obtaining a physiological signal through a physiological detector when the three-dimensional dynamic image is displayed; determining based on the physiological signal A dizziness state; and moving or rotating at least one lens of the head-mounted display through a motor device based on the dizziness state; wherein the at least one lens of the head-mounted display is moved or rotated based on the dizziness state through the motor device The lens step includes: controlling the motor device to adjust the angle between the first lens and the second lens. The stereoscopic display method according to item 5 of the scope of patent application, wherein the physiological detector is a brain wave detector, and the physiological signal is an alpha wave signal or a beta wave signal. The stereoscopic display method according to claim 5, wherein the step of moving or rotating the at least one lens of the head-mounted display through the motor device based on the dizziness state includes: controlling the motor device to move the at least one lens To adjust a suitable eye distance. The stereoscopic display method according to claim 5, wherein the step of moving or rotating the at least one lens of the head-mounted display through the motor device based on the dizziness state includes: controlling the motor device to adjust the first lens The distance from the second lens.

Images