KR100274033B1 - Head mount display - Google Patents

Abstract

PURPOSE: An HMD(head mounted display) and its display method are provided to prevent dizziness, illusion or auditory hallucination of patients or sensitive people by analyzing user's status and regulates output image or sound with a sensor. CONSTITUTION: A human body status detector(10) determines the system operation by detecting the status of a user or according to the control signal input by the user. An image processor(20) transfers an image signal to be displayed to the user's eyes according to the output signal of the human body status detector(10). A sound processor(30) transfers voice signal corresponding to the image signal to the user's ears according to the output signal of the human body status detector(10). A memory(40) stores specified image and sound signals and outputs image and sound signals suitable for the detected status of the user to the image processor(20) and the sound processor(30).

Description

Head mounted display device and display method

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head mounted display device and a display method thereof, and more particularly, to a head mounted display device (HMD) having a function of changing a video signal or an audio signal output according to a human body state and a screen thereof. It is about a display method.

Recently, the demand for personal display devices is increasing according to the trend of miniaturization of display elements, and the image output from the small image display element is enlarged by using an optical system, and the virtual image is visually observed, thereby allowing a large screen at a constant distance. A display device that has the same effect as viewing an image with the above has been developed. Such devices are called head mounted display devices (hereinafter referred to as HMDs) because most of them are worn in the same way as glasses.

1 is a view showing the configuration of an image transfer module in a typical HMD.

Referring to FIG. 1, a liquid crystal (LCD) panel 101 displaying an image according to data input from the outside, and a rear surface disposed behind the liquid crystal panel 101 to emit light to the liquid crystal panel 101. Half mirror that passes through the backlight 102 and the liquid crystal panel 101 to reflect part of the light including the image and passes the rest to the left eye of the human. 103, a total reflection mirror 104 which reflects the light passing through the half mirror 103, and changes the path to the right eye of a person, and changes the light reflected by the half mirror 103 into parallel light. The first eyepiece 105 for forming an image in the left eye, the second eyepiece 106 for converting the light reflected from the total reflection mirror 103 into parallel light, and forming an image in the right eye, and the half mirror 103. ) And the total reflection mirror 104 reduce the image. Writing includes adjusting the optical path length lens 107 to the image displayed on the liquid crystal panel 101 to appear in the same size on the user's left and right eyes.

The HMD configured as described above operates to separate light including an image from the half mirror 103 while passing through the liquid crystal panel 101 and to form an image on the left and right eyes, and the left and right eyes using the optical path length adjusting lens 107. To view the same size image in.

The HMD simply displays an image according to the image and audio data restored from the disk, forms an image with the eyes of the user, and performs only a function of outputting the audio to the earphone. Accordingly, the user may feel dizzy when used for a long time, and even when images of the same size are not properly input to the left and right eyes, eye fatigue may occur.

In particular, the head-mounted display device according to the prior art does not include any means for determining the human body state of the user there is a problem that can cause dizziness or optical illusion, hearing and the like in the case of sensitive people among HMD users.

The present invention has been made to solve the above problems, the object of the head-mounted display device that can help sleep or change the mood by entering the sleep mode or refresh mode according to the user's selection during use and its To provide a screen display method.

In addition, an additional object of the present invention is to provide a head-mounted display device and a method of displaying the same, which are provided with a sensor capable of detecting a human body condition and provide convenience to a user by controlling the operation of the system according to the state. have.

1 is a view showing the configuration of an image transfer module by a general head-mounted display device,

Figure 2 is a block diagram showing the configuration of a head-mounted display device according to an embodiment of the present invention.

<Description of the code | symbol about the principal part of drawing>

10: human body detection unit 11: timer

12: mode selection switching unit 13: EEG sensor

14: EEG analyzer 15: heart rate sensor

16: heart rate analyzer 20: the image processing unit

21: image control unit 22: liquid crystal panel

23: image transmission module 30: voice processing unit

31: voice control unit 32: earphone (earphone)

40: memory

According to a first aspect of the present invention for achieving the above object, a human body state detection unit for detecting the human state or the operation of the system according to the operation control signal input by the user, and the output of the human state state detection unit An image processor for transmitting an image signal to be displayed to a user's eye according to a signal, a voice processor for transmitting an audio signal corresponding to the image signal displayed by the image processor to the user's ear according to an output signal of the human body state detection unit; And a memory configured to store a specific video signal and an audio signal and to output the video signal and the audio signal to the image processor and the audio processor according to the human condition detected by the human body state detection unit. To provide.

In this case, the human body state detection unit is a timer that counts the operation time of the system and outputs a control signal for determining the operation of the system to the image processing unit and the audio processing unit so that a warning message can be output to the user when a predetermined time elapses. Can be configured.

In addition, the human body state detection unit selects a plurality of modes for outputting a control signal for determining the operation of the system to the image processing unit and the audio processing unit by selecting a system operation mode such as a sleep mode, a refresh mode, or an operation stop mode. It can be configured as a switch.

In addition, the human body state detection unit EEG sensor for detecting the brain wave of the user and the EEG analyzer for outputting a control signal for determining the operation of the system to determine the operation of the system according to the detection result of the brain wave sensor to the image processing unit and the audio processing unit It can be configured as.

In addition, the human body state detection unit outputs a heart rate sensor for detecting a user's heart rate and a control signal for determining the operation of the system to determine the operation of the system according to the detection result of the heart rate sensor to the image processing unit and the audio processing unit. It can be configured as a heart rate analyzer.

The image processing unit may terminate the display operation of the system or output image data stored in the memory or image data stored in the memory according to a control signal output from the human state sensor. An image control unit for mixing and outputting an image, a liquid crystal panel (LCD) for displaying an image according to the image data output from the image control unit, and an image transmission module for delivering an image displayed on the liquid crystal panel to an image of a user's eyes. Include. In this case, the image control unit operates to display a message of the contents in the liquid crystal panel when the operation state changes according to the control signal output from the human body state detection unit.

The voice processing unit may terminate the voice output operation of the system or output the voice data stored in the memory or the voice data stored in the memory according to the control signal output from the human body state sensing unit. And a voice controller for mixing and outputting data, and an earphone for outputting voice according to the voice data output from the voice controller. At this time, the voice control unit operates to output the voice message through the earphone when the situation changes according to the control signal output from the human body state detection unit.

Meanwhile, according to a second aspect of the present invention for achieving the above object, a first process of detecting a human body state or analyzing an operation control signal input by a user, and output according to the result of the first process A second process of determining the video signal and the audio signal, and reading the video signal and the audio signal determined in the second process from the memory to display the video signal on the liquid crystal panel and to output the audio signal to the earphones to the user's eyes and ears A screen display method of a head mounted display device comprising a third process is provided.

In this case, the first process may include a first step of determining whether the user selects one of a sleep mode, a refresh mode, and an operation stop mode, and when there is no user's mode selection in the first step. A second step of determining whether the user's EEG is normal by detecting the EEG; and detecting the user's heart rhythm by detecting the user's heartbeat when the EEG of the user is normal in the second step It is preferable that the third step is made.

Hereinafter, with reference to the accompanying drawings, a preferred embodiment of the head-mounted display device and the screen display method according to the present invention will be described in detail.

2 is a block diagram showing a configuration according to an embodiment of the present invention.

Referring to FIG. 2, reference numeral 10 denotes a human body state detecting unit for detecting a human body state or determining an operation of the system according to an operation control signal input by a user, and 20 denotes an output signal of the human body state detecting unit 10. According to the present invention, an image processor for transmitting an image signal to be displayed to the user's eyes, and 30 denotes an audio signal corresponding to the image signal displayed by the image processor 20 according to the output signal of the human body state sensing unit 10. Denotes a voice processing unit for transmitting to the user's ear, 40 stores a specific video signal and a voice signal, and the video signal and the audio signal suitable for the state according to the human body state detected by the human body state detecting unit 10. The memory output to the processing unit 20 and the audio processing unit 30 is shown.

The human body state sensing unit 10 includes a timer 11, a mode selection switching unit 12, an electroencephalogram sensor (EEG) 13, an electroencephalogram analyzer 14, a heart rate sensor 15, and a heartbeat. An analyzer 16.

At this time, the timer 11 counts the operation time of the system and outputs a control signal for determining the operation of the system so that a warning message can be output to the user according to the elapse of a predetermined time.

In addition, the mode selection switching unit 12 selects a system operation mode such as a sleep mode, a refresh mode, an operation stop mode, and outputs a control signal for determining the operation of the system.

In addition, the EEG sensor 13 detects the EEG of the user, and the EEG analyzer 14 outputs a control signal for determining the operation of the system by determining the human state according to the detection result of the EEG sensor 13. .

The electroencephalogram (EEG: electroencephalogram), visual evoked potential (VEP), electrical activity of the retina with respect to light (ERG: electroretinography), and eye movement using the EEG analyzer 14 EOG (electroculography), eye trembling (ENG: electronystagmography), etc. can be recorded.When EEG is recorded, it is additionally connected with an automatic EEG analyzer to detect the abnormal state of EEG in sensitive people among HMD users. The visual side effects of the system can be eliminated by turning off the display unit or correcting the video or audio signal.

In addition, the heartbeat sensor 15 detects the user's heartbeat, and the heartbeat analyzer 16 determines the operation of the system by determining a human condition according to the detection result of the heartbeat sensor 15. Output the signal.

On the other hand, the image processing unit 20 outputs by mixing the image data stored in the memory 40 with the image data restored from the disk (disk) in accordance with the control signal output from the human body state detection unit 10 or An image controller 21 for terminating the display operation, a liquid crystal panel (LCD) 22 for displaying an image according to the image data output from the image controller 21, and an image displayed on the liquid crystal panel 22. It includes an image delivery module 23 for delivering to the user's eyes.

In addition, the voice processing unit 30 mixes and outputs the voice data stored in the memory 40 with the voice data restored from the disk according to the control signal output from the human body state detection unit 10, or the system. A voice controller 31 for terminating the voice output operation and an earphone 32 for outputting voice in accordance with voice data output from the voice controller 31 are included.

In addition, the memory 40 stores audio or video signals to help a person sleep or to clear his head. At this time, the music information and image information to help sleep is to relax the muscles and induce meditation, the audio information may be used music such as lullabies, and the image information is usually repeated patterns, calm water on the lake shore, wavy And the like can be used. The music information and video information for clearing the head may be a star of the night sky, the scenery of grandfather and grandmother walking through the park where deciduous leaves, birds, wind, leaves shaking.

Screen display operation of the head-mounted display device according to the present invention having the above configuration is as follows.

First, the human body state sensing unit 10 detects a human body state or analyzes an operation control signal input by a user. At this time, the timer 11 outputs a control signal to the image processing unit 20 and the audio processing unit 30 when a predetermined time (about 30 minutes) has elapsed. According to the control signal, the video controller 21 and the audio controller 31 may read a warning message from the memory 40 and output a video and audio signal for recommending the user to stop watching.

In addition, when any one of a sleep mode, a refresh mode, and an operation stop mode is selected by the user through the mode selection switching unit 12, the video and audio information corresponding thereto are stored from the memory 40. It is read and output through the image processor 20 and the audio processor 30.

In general, EEG is easier to analyze because EEG during sleep is smaller in pattern than EEG when it is awake.Slow waves, sleep spindles, positive occipital sharp transients of sleep (POSTs) , vertex sharp transients (V waves), and K complexes. Eventually, the degree of sleep can be analyzed by brain waves. In the early stages of sleep, alpha waves disappear, slow waves of 2-7 Hz appear, and V waves appear as deeper sleep.

On the other hand, when there is no user's mode selection, the EEG sensor 13 automatically operates to detect the EEG of the user, and the EEG analyzer 14 determines whether the EEG of the user is in a normal state. In this case, when the user enters the sleep mode and the sleep state of the user is determined, the system may be turned off.

In addition, when the brain wave of the user is in a normal state, the heartbeat sensor 15 operates to detect the heartbeat of the user, and the heartbeat analyzer 16 determines whether the heartbeat of the user is in a normal state. At this time, the operation of the system may be immediately stopped according to the result, and the user may output a video and audio signal recommending the user to stop watching.

The video signal and the audio signal determined in the above operation are read from the memory 40 to display the video signal on the liquid crystal panel 22, and the audio signal is output to the earphone 32 to be transmitted to the eyes and ears of the user.

The technical idea of the present invention described above is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. For example, the present invention can be applied to home appliances and computer devices driven or controlled by brain waves.

As described above, the head mounted display device according to the present invention outputs a video and audio signal suitable for sleep stored in a memory according to a human condition to an HMD in use when a user requests a sleep mode. There is an effect that can help the parallax adaptation. In addition, when the refresh mode is requested, an image and audio signal for clearing the head are output, which may help change the user's mood.

In addition, when performing the VEP test using the head mounted display device of the present invention, even if the examiner looks at another place, the test can be performed accurately so that the VEP test can be efficiently performed. There is a workable effect.

In addition, the present invention is a dizziness that can occur in the patient or sensitive people because the user can adjust the output image or audio by analyzing the user's state, that is, having a sensor that can detect a patient with a disease or a sensitive user, etc. , Optical illusion, hallucinations can be prevented in advance.

Claims (11)

A human body state detection unit for detecting a human body state or determining an operation of the system according to an operation control signal input by a user; An image processor for transmitting an image signal to be displayed to the user's eyes according to the output signal of the human body state detection unit; A voice processor for transmitting a voice signal corresponding to the video signal displayed by the image processor to the user's ear according to the output signal of the human body state detection unit; And a memory for storing a specific video signal and an audio signal and outputting the video signal and the audio signal to the image processor and the audio processor according to the human condition detected by the human body state detecting unit. Mountable display device. The method of claim 1, The human body state detection unit comprises a timer that counts the operation time of the system and outputs a control signal for determining the operation of the system to the image processing unit and the audio processing unit to output a warning message to the user when a predetermined time elapses. A head mounted display device. The method of claim 1, The human body state detection unit includes a plurality of mode selection switches that output a control signal for determining the operation of the system by selecting a system operation mode such as a sleep mode, a refresh mode, an operation stop mode, etc. to the image processor and the audio processor. Head mounted display device, characterized in that configured. The method of claim 1, The human state detection unit includes an EEG sensor for detecting an EEG of a user, and an EEG analyzer for outputting a control signal for determining the operation of the system to determine the operation of the system according to the detection result of the EEG sensor to the image processing unit and the audio processing unit. Head mounted display device, characterized in that. The method of claim 1, The human body state detection unit detects a user's heartbeat and a heartbeat sensor, and a heartbeat outputting a control signal for determining the operation of the system to determine the operation of the system according to the detection result of the heartbeat sensor to the image processor and the audio processor. Head mounted display device, characterized in that consisting of a heart rate analyzer. The method of claim 1, The image processing unit terminates the display operation of the system or outputs the image data stored in the memory or mixes the image data stored in the memory with the image data restored from the image medium according to the control signal output from the human state sensor. And an image control unit for displaying the image, a liquid crystal panel (LCD) for displaying an image according to the image data output from the image control unit, and an image transfer module for transferring an image displayed on the liquid crystal panel to an image of a user's eyes. Head mounted display device, characterized in that. The method of claim 6, And the image controller is operable to display a message of the contents on the liquid crystal panel when the operation state changes according to the control signal output from the human body state sensing unit. The method of claim 1, The voice processing unit terminates the voice output operation of the system or outputs the voice data stored in the memory or the voice data stored in the memory in response to the control signal output from the human state sensor. And a headphone (Earphone) for outputting a voice according to the voice data output from the voice controller. The method of claim 8, The voice control unit is a head-mounted display device, characterized in that when the operation state changes in accordance with the control signal output from the human body state detection unit to output a voice message through the earphone. A first process of detecting a human state or analyzing a motion control signal input by a user; A second process of determining a video signal and an audio signal to be output according to the result of the first process; The video display device and the audio signal determined in the second process is read from the memory to display the video signal on the liquid crystal panel, and the audio signal is output to the earphone by the head-mounted display device, characterized in that consisting of a third process for transferring to the user's eyes and ears. How to display The method of claim 10, The first process may include a first step of determining whether the user selects one of a sleep mode, a refresh mode, and an operation stop mode; A second step of determining whether the user's EEG is normal by detecting the EEG of the user when there is no mode selection of the user in the first step; And a third step of determining whether the user's heartbeat is normal by detecting a heartbeat of the user when the brainwave of the user is in a normal state in the second step.

Images