KR100283526B1 - Controller for head mounted display and sensor for sensing visual angle - Google Patents

Abstract

The present invention provides a head-mounted display control device for detecting visual information of a user based on motion information of a head, and displaying an interactive three-dimensional image based on the detected visual information of a user, and the visual time used therein. The control device of the present invention for this purpose, has a hemispherical shape, is mounted on the upper center portion of the head of the head-mounted display, consisting of a plurality of light sensors made of light-emitting elements, the movement of the head A sensor block for detecting information; An A / D conversion block for sampling the detected motion information provided from each sensor in the sensor block at a predetermined sampling frequency and converting the detected motion information into a digital signal, respectively; A control block which continuously calculates visual motion information of a user based on each motion information of the converted head, and generates user visual information for adjusting an angle of an image expressed in a virtual environment of a head mounted display based on the calculation result. ; And an interface block for interfacing the calculated user visual information and providing the image signal processing means of the head mounted display.

Description

HEAD MOUNTED DISPLAY AND SENSOR FOR SENSING VISUAL ANGLE}

The present invention relates to a three-dimensional head mount display, and more particularly, to a head-mounted display control device suitable for detecting a position of a head for recognizing visual change of a user in a three-dimensional head mounted display and A visual sensor is used.

As is well known, a three-dimensional head mounted display is a display device that enjoys various images such as a movie on a large screen in a virtual environment while the user is mounted on the head. Such a head mounted display is, for example, a VCR, LDP, or CDP. And an image processing apparatus such as an image display apparatus, a display panel for displaying an image (eg, an LCD panel), and two shutters respectively corresponding to human eyes.

Accordingly, such a three-dimensional head mounted display realizes a three-dimensional image by using an afterimage effect of controlling opening and closing of two shutters at high speed when an image is displayed on a display panel to leave an afterimage on the eyes, that is, the human eye. Gives a three-dimensional appearance to the image.

On the other hand, such a three-dimensional head-mounted display displays a stereoscopic image in a virtual environment irrespective of the human (ie, the user's) vision, the user's vision (eg, up and down) when displaying the three-dimensional stereoscopic image , Audio-visual angles such as left and right, etc.), it is possible to display an interactive three-dimensional image.

Therefore, the user's visual detection is essential for the display of such an interactive three-dimensional image, the present invention relates to such a visual detection technique.

The present invention devised in view of the above point, the head mount that can detect the user's visual information based on the head movement information, and can display an interactive three-dimensional image based on the detected user visual information The object is to provide a display control device.

Another object of the present invention is to provide a vision sensor for a head mounted display that can effectively detect visual information of a user based on motion information of a head.

According to an aspect of the present invention, there is provided at least one image signal processing means, a panel displaying an image provided by the image signal processing means, and an image displayed on the panel as a large three-dimensional image. An apparatus for controlling a head mounted display having a virtual environment setting means for representing, having a hemispherical shape, mounted in a central upper portion of the head of the head mounted display, and composed of a plurality of light sensors made of light emitting elements, A sensor block that detects motion information of up, down, left, and right tilt motions of the head; An A / D conversion block for sampling the detected motion information provided from each sensor in the sensor block at a predetermined sampling frequency and converting the detected motion information into a digital signal, respectively; A control block which continuously calculates visual motion information of a user based on each motion information of the converted head, and generates user visual information for adjusting an angle of an image represented on the virtual environment based on the calculation result; And an interface block for interfacing the generated user visual information to the image signal processing means.

According to another aspect of the present invention, at least one image signal processing means, a panel for displaying an image provided by the image signal processing means, and the image displayed on the panel as a large three-dimensional image A sensor for detecting a movement of a head in a head mounted display having a virtual environment setting means, the sensor comprising: a peelable house mounted on the head mounted display, the sealed inner space being filled with an antifreeze; A plurality of sensor means configured to detect a motion information of the head through light emission of each sensor, the sensor comprising a plurality of sensors disposed at predetermined intervals along an upper outer side of the house; A first floating body floating along a magnetic field formed at the center of the house and having a color reflecting light emitted from each sensor; And a second floating body floating along a magnetic field formed at an upper side of the house and having a color reflecting light emitted from each sensor.

1 is a block diagram of a head mounted display control apparatus according to a preferred embodiment of the present invention;

2 is a sensor arrangement structure of a detection sensor according to an embodiment of the present invention,

3 is an external view of a sensing sensor according to a preferred embodiment of the present invention;

4 is a diagram illustrating an example in which the visual sensor of the present invention is mounted on a head mounted display;

5 is a view for explaining the process of detecting the vertical movement, left and right movement, left and right movement by using a head mounted display equipped with a sensor according to the present invention.

<Description of the code | symbol about the principal part of drawing>

10: old 12: antifreeze

14: first float 16: second float

18: light sensor 110: sensor block

130: A / D conversion block 150: control block

170: interface block 200: display block

The above and other objects and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

First, the present invention tracks (ie, detects) up, down, left and right movements, left and right movements of the head, which can be displayed as three-dimensional coordinates, using a sensing sensor using an object of a stimulus, for example, a compass. Based on this tracking result, the display of the interactive 3D image is controlled (the visual angle of the image changes according to the head movement of the user wearing the head mounted display).

1 is a block diagram of a head mounted display control apparatus according to a preferred embodiment of the present invention.

As shown in the figure, the head mounted display control apparatus of the present invention includes a sensor block 110, an A / D conversion block 130, a control block 150 having a plurality of sensors 110/1-110 / n. ), The interface block 170 and the display block 190.

Referring to FIG. 1, the sensor block 110 is mounted on an upper center portion of the head mounted display in a hemispherical shape as shown in FIG. 4 as an example, and uses a plurality of sensors 110/1 using magnetic pole objects. 110 / n), which detects head movements, ie, up and down movements, left and right movements, left and right tilt movements, for the user's visual tracking. / D conversion block 130 is provided. The detailed configuration of the visual sensor of the present invention and the head motion detection process therein will be described later in detail with reference to FIGS. 2, 3, and 4. In this case, the motion detection information detected through each sensor may be expressed as an analog three-dimensional coordinate value such as x, y, z coordinates.

Next, the A / D conversion block 130 converts the detected motion detection signal of the analog type input from each sensor in the sensor block 110 into a digital signal by sampling at a predetermined sample frequency. The digital time detection signal converted at is provided to the next control block 150.

On the other hand, the control block 130 is composed of a microcomputer, for example, based on the motion detection signal (coordinate value information according to the movement of the head) detected from each sensor, that is, the time of the user wearing the head mounted display. The user visual information calculated here is transmitted to the display block 200 in the head through the interface block 170.

On the other hand, the display block 200 has an image processing apparatus such as a VCR, LDP, CDP, etc., and performs signal processing of a 3D image to be displayed on a display panel mounted in a head. According to the present invention, an interactive image is provided based on the detected visual information when displaying a 3D image displayed on the virtual environment.

That is, when the user wearing the head mounted display turns the head to the left direction, the left direction movement of the head is detected by the visual sensor (110 of FIG. 4) of the present invention. Based on the detected information (ie, the detected visual information), the image currently displayed on the display panel and displayed on the virtual environment is displayed as if the user is turning in the direction shown in the left direction. That is, the direction of the image displayed on the virtual environment is automatically switched (left, right, up, down, etc.) according to the head direction movement (ie, visual movement) of the user.

Next, the visual sensor of the present invention employed in the head mounted display control device of the present invention having the above configuration will be described in detail.

First, the visual sensor of the present invention, as shown in FIG. 5 as an example, may be mounted on the upper center portion of the head mounted display in a hemispherical shape, a plurality of sensors as shown in FIG. That is, it has 17 optical sensors. At this time, each optical sensor includes a light emitting side for generating and transmitting light as a reflective sensor and a light receiving side for receiving the light received by reflecting the transmitted light. The light emitting side is configured of, for example, a photodiode. The side can comprise a photo transistor. Accordingly, each optical sensor detects the head movement, ie, the light movement and the light movement, that is, the light movement and the light reception, for the user's visual tracking.

2 shows an arrangement structure of a sensor attached to the visual sensor according to the present invention.

As shown in the figure, the visual sensor of the present invention includes, for example, 17 optical sensors, with one optical sensor S12 mounted at the center thereof, and having a uniform distance around the periphery of the hemisphere. Eight photosensors (S2, S3, S4, S5, S6, S7, S8, S9) are mounted, and eight photosensors (S10, S11, S12, S13) with circular uniform spacing between the center and the perimeter. , S14, S15, S16, S17 are mounted.

3A is a front view of the visual sensor according to the present invention, FIG. 3B is a top view, and FIG. 3C is a view showing only an upper portion including a first float 14 for convenience of description.

Referring to FIG. 3, the hemispherical visual sensor according to the present invention includes a first floating body floating along a magnetic field formed at a predetermined portion of the sphere 10 filled with the antifreeze 12, that is, approximately the center of the sphere ( 14). The first float 14 is white and moves along a magnetic field formed in the sphere 14, and serves to reflect light emitted from each of the plurality of light sensors. In addition, an upper side of the sphere 10 is provided with a substantially triangular second floating body 16 floating along a magnetic field. The first floating body 14 and the second floating body 16 have a head mounted display. When in the correct position (smooth state), the light emitted from the light emitting side of each optical sensor is respectively reflected, and each of the reflected light is disposed at a position that can be received at the light receiving side of each optical sensor, respectively, Each float 14, 16 moves along a magnetic field formed within the sphere 10.

That is, assuming that an optical sensor having an arrangement as shown in FIG. 2 is covered on the upper portion of the sphere 10, it will reflect the light emitted from each optical sensor.

4 is a view for explaining a process of detecting the vertical movement, left and right movement, left and right movement of the head (that is, the user's time wearing the head-mount display) using the head mounted display equipped with a sensor according to the present invention. to be.

As shown in the figure, the head mounted display 100 includes a vision sensor A, a display control device 100, a display block 200, a display panel 300, and a virtual environment block 400. . Here, the visual sensor 110 and the display control device 100 are employed in accordance with the present invention, other components are the usual components mounted to the head mounted display. That is, the visual sensor 110 and the display control device 100 are additionally mounted on a conventional head mounted display for an interactive three-dimensional image display in consideration of the visual direction of the user according to the present invention.

In FIG. 4, the visual sensor 110 is a hemispherical sensor shown in FIG. 3, which corresponds to the sensor block 110 of FIG. 1, and the display control apparatus 100 is the A / D of FIG. 1. Corresponds to the transform block 130, the control block 150, and the interface block 170. In addition, the display block 200 is the same block corresponding to the display block 200 of FIG. 1.

On the other hand, the display panel 300, for example, is composed of an LCD panel, based on the control signal provided from the display block 200, and displays an image to be displayed on the virtual environment.

In addition, the virtual environment block 400, although not shown in detail in the same figure, for example, a concave, mirror, lens, two shutters corresponding to each of the two eyes of the human to set the virtual environment, The image provided from the display panel is displayed in a large screen on the set virtual environment.

Therefore, a user wearing a head mounted display can watch a three-dimensional image represented by a large screen through this virtual environment.

Next, the head movement, that is, the vertical movement, the left and right movements, the left and the right tilt movements of the user's eye wearing the head mounted display using the vision sensor of the present invention having the optical sensor arrangement structure as shown in FIG. 2 as an example. A process of detecting the will be described in detail with reference to FIGS. 2 and 5.

First, as an example, as shown in FIG. 5A, when a user wearing a head mounted display moves his head inclined to the right (ROLL RIGHT), the six light sensors S1 and S2 in the sensing sensor shown in FIG. , S6, S7, S8, and S9 remain in the on state (the state in which the light emitted from the light emitting side is reflected through the floating body and received by the light receiving side thereof), and the three light sensors S3, S4 and S5 are in the off state ( Light emitted from the light emitting side is reflected through the floating body and is not received by the light receiving side thereof.

Therefore, the display control apparatus 100 of FIG. 4 generates user visual information based on the head movement information ROLL RIGHT provided from the optical sensors and provides the generated visual information to the display block 200. As a result, the 3D image currently displayed on the virtual environment under the control of the display block 200 will be displayed in a shape in which the user looks at an object inclined in the right direction.

Contrary to the above, when the user wearing the head mounted display moves his head to the left side (ROLL LEFT), the six light sensors S1, S2, S3, S4, S5, in the sensing sensor shown in FIG. S6 is kept in the on state (the light emitted from the light emitting side is reflected through the floating body and received by the light receiving side thereof), and the three light sensors S7, S8 and S9 are in the off state (the light emitted from the light emitting side is Reflects through the floating body and is not received by the light receiving side thereof.

Therefore, the display control apparatus 100 of FIG. 4 generates user visual information based on the head movement information ROLL LEFT provided from the optical sensors and provides the generated visual information to the display block 200. As a result, the 3D image currently displayed on the virtual environment under the control of the display block 200 will be displayed in a shape in which the user looks at an object tilted to the left.

Also, as an example, as shown in FIG. 5B, when the user wearing the head mounted display lowers his head downward, that is, when he bows down (PITCH DOWN), the six sensors in the sensing sensor shown in FIG. The light sensors S1, S4, S5, S6, S7, and S8 remain in an on state (the light emitted from the light emitting side is reflected through the floating body and received by the light receiving side thereof), and the three light sensors S2, S3, S9 is in an off state (a state in which the light emitted from the light emitting side is reflected through the floating body and is not received by the light receiving side thereof).

Accordingly, the display control apparatus 100 of FIG. 4 generates user visual information based on the head movement information PITCH DOWN provided from the optical sensors and provides the generated visual information to the display block 200. As a result, the three-dimensional image currently displayed in the virtual environment under the control of the display block 200 will be displayed in a shape in which the user looks down at an object from the top to the bottom.

Contrary to the above, when the user wearing the head mounted display raises his head upwards, that is, when he lifts his head up (ROLL UP), the six light sensors S1 in the detection sensor shown in FIG. , S2, S3, S4, S8 and S9 remain on (the state in which the light emitted from the light emitting side is reflected through the floating body and received by the light receiving side thereof), and the three light sensors S5, S6 and S7 are off. A state (state in which light emitted from the light-emitting side is reflected through the floating body and is not received by the light-receiving side thereof).

Therefore, the display control apparatus 100 of FIG. 4 generates the user visual information based on the head movement information ROLL UP provided from the optical sensors and provides the generated visual information to the display block 200. As a result, the three-dimensional image currently displayed in the virtual environment under the control of the display block 200 will be displayed in a shape in which the user looks up at an object from the bottom to the top.

Meanwhile, as an example, as shown in FIG. 5C, when a user wearing a head mounted display rotates his head to the left, that is, rotates it to the left (YAW LEFT), the four in the sensing sensor shown in FIG. The light sensors S11, S13, S16, and S17 remain in an on state (the light emitted from the light emitting side is reflected through the floating body and received by the light receiving side thereof), and the four light sensors S11, S12, S14, and S15 are The light is turned off (the light emitted from the light emitting side is reflected through the floating body and is not received by the light receiving side thereof).

Accordingly, the display control apparatus 100 of FIG. 4 generates the user visual information based on the head movement information YAW LEFT provided from the optical sensors and provides the generated visual information to the display block 200. As a result, the three-dimensional image currently displayed in the virtual environment under the control of the display block 200 will be displayed in a shape in which the user looks at an object in the left direction.

Contrary to the above, when the user wearing the head mounted display rotates his head to the right, that is, rotates to the right (YAW RIGHT), the four light sensors S10, S11, S12 in the sensing sensor shown in FIG. , S15 is in the on state (the light emitted from the light emitting side is reflected through the floating body and received by its light receiving side), and the four light sensors S13, S14, S16, S17 are off (light emitting at the light emitting side) Light is reflected through the floating body and is not received by the light receiving side thereof.

Accordingly, the display control apparatus 100 of FIG. 4 generates user visual information based on the head movement information YAH RIGHT provided from the optical sensors and provides the generated visual information to the display block 200. As a result, the 3D image currently displayed in the virtual environment under the control of the display block 200 will be displayed in a shape in which the user looks at an object in the right direction.

As described above, according to the present invention, the user's visual information such as vertical movement, left and right movements, left and right movements of the head, which can be displayed as three-dimensional coordinates, can be effectively detected using a sensing sensor using a stimulus object such as a compass. In addition, based on the detected visual information, the display of the interactive 3D image (the visual angle of the image changes according to the head movement of the user wearing the head mounted display) can be implemented.

Claims (10)

Controlling a head mounted display having at least one video signal processing means, a panel for displaying an image provided by the video signal processing means, and a virtual environment setting means for representing the image displayed on the panel as a three-dimensional image of a large screen; In the apparatus, Hemispherical shape, mounted on the upper center of the head of the head-mounted display, consisting of a plurality of optical sensors made of light-emitting elements, the movement information of the head up and down, left and right rotation, left and right tilt movement A sensor block for detecting; An A / D conversion block for sampling the detected motion information provided from each sensor in the sensor block at a predetermined sampling frequency and converting the detected motion information into a digital signal, respectively; A control block which continuously calculates visual motion information of a user based on each motion information of the converted head, and generates user visual information for adjusting an angle of an image represented on the virtual environment based on the calculation result; And And an interface block for interfacing the generated user visual information to the image signal processing means. The apparatus of claim 1, wherein the detected head motion information is expressed as a coordinate value according to the movement of the head. The head mounted display includes at least one image signal processing means, a panel for displaying an image provided by the image signal processing means, and a virtual environment setting means for representing the image displayed on the panel as a three-dimensional image of a large screen. In the sensor for detecting movement, A peelable house mounted on the head mounted display, the sealed inner space being filled with an antifreeze; A plurality of sensor means configured to be arranged at predetermined intervals along the upper outline of the house, the plurality of sensor means for detecting the movement information of the head through the light emission of each sensor; A first floating body floating along a magnetic field formed at the center of the house and having a color reflecting light emitted from each sensor; And And a second floating body floating along a magnetic field formed above the inside of the house and having a color reflecting light emitted from each sensor. 4. The visual sensor of claim 3, wherein the hermetic house has a spherical shape and is mounted on a head upper center portion of the head mounted display. 4. The sensor according to claim 3, wherein the sensor means comprises: at least one center sensor disposed at a central portion thereof, a first sensor group comprising a plurality of sensors disposed at uniform intervals along an uppermost outer side of the house, and the center sensor; And a second sensor group comprising a plurality of sensors arranged at uniform intervals between the first sensor groups. 6. The visual sensor of claim 3 or 5, wherein each of the plurality of sensors is an optical sensor having a light emitting element. The visual sensor of claim 3 or 5, wherein the detected head motion information is vertical motion, horizontal motion, and horizontal motion of the head. The visual sensor of claim 3 or 5, wherein the detected head motion information is expressed as a coordinate value according to the movement of the head. 4. The visual sensor of claim 3, wherein the first float is a flat float floating in the center of the closed space of the house. 4. The visual sensor of claim 3, wherein the second float is a triangular float floating at an upper center of the house.