KR100943392B1 - Apparatus for displaying three-dimensional image and method for controlling location of display in the apparatus - Google Patents

Abstract

According to an aspect of the present invention, a stereoscopic image display apparatus displaying an image signal output from an image reproducing apparatus includes: a light emitting unit for generating light, a first display unit for outputting a left eye image and a right eye image, respectively, when a display unit position adjustment command is input; And a second display unit, a photoelectric conversion unit for receiving reflected light of the light generated by the light emitting unit through a lens and converting the light into an electrical signal, and obtaining refractive indices for the left and right eyes using the electrical signal transmitted from the photoelectric conversion unit, respectively. After obtaining the pupillary distance using the obtained refractive index and receiving a positional adjustment request message from the pupillary distance measuring unit and the pupillary distance measuring unit that generate a positional control request message including the pupillary distance, the message is included in the message. Display unit for adjusting the position of the first display unit and the second display unit according to the interspace distance It is composed of a position adjusting unit, it is possible to improve the long-term wearing and immersion of the HMD by solving the gap distance control problem.

Stereoscopic Image, Pupil Distance, Display, Refraction

Description

Apparatus for displaying three-dimensional image and method for controlling location of display in the apparatus}

The present invention relates to a stereoscopic image display apparatus and a display unit position adjusting method in the stereoscopic image display apparatus, and more particularly, when a display unit position adjustment command is input in a stereoscopic image display apparatus equipped with a light emitting unit, the light emitting unit generates the display unit. A three-dimensional image display device that obtains the refractive indices of the left and right eyes using the obtained light, and obtains the interpupillary distance using the obtained refractive indices, and then adjusts the positions of the left and right display units to match the obtained interpupillary distance. And a display unit position adjusting method in the stereoscopic image display apparatus.

The development of integrated technology has led to the emergence of various portable devices.

Beginning with sound playback devices such as tape playback devices and CD players, mobile phones and MP3 players have become widespread, and portable game machines have also emerged.

In particular, the mobile phone may be used in various ways beyond the use as a communication means, of which the role as a watch, a digital camera and an MP3 player is representative.

Virtual Reality is the field of information activities that indirectly experiences situations that cannot be experienced directly in the real world due to spatial and physical constraints through interactions with the human sensory system in virtual spaces built using computers. Is one of the new paradigms.

The ultimate goal of virtual reality is to provide a more realistic communication environment with computers by increasing the ability of computers to communicate with humans using various input / output methods. As a method of input / output between a computer and a human, devices such as a head-mounted display (HMD), a data glove, and a motion capture are used.

The HMD transmits position change data according to the movement of the user's head to the computer so that the computer calculates and simulates the size and depth of the object in the user's field of view.

The data glove detects the position and direction of the user's hand. When the user moves the hand in three-dimensional space, the data glove sends the data flow to the computer in the form of three-dimensional coordinates, and the computer manipulates an object corresponding to the data.

Augmented Reality is generally a term derived from a virtual environment and a virtual reality, and means a mixture of a real world image and a virtual image by inserting a computer graphic image into the real environment. Real-world information may contain information that the user does not need, and sometimes the user may lack information.

However, using computer-generated virtual environments, you can simplify or hide information you don't need. In other words, the augmented reality system combines the real world and the virtual world to allow interaction with the user in real time.

The simplest form of augmented reality is applied in the fields of entertainment and news. If you're forecasting on TV, you'll see the weather map in front of the weather caster changing naturally. Actually, the weather cast is standing in front of the blue-screen, and the computer-generated virtual footage creates a virtual studio environment for augmented reality. To achieve.

In addition, 3D data of the patient is acquired in real time through indirect inspection such as magnetic resonance image, computed tomography image, and ultrasound image, and then the acquired data is rendered in real time and overlapped with the patient. By expressing it, the surgeon can perform a patient's operation smoothly. A virtual image can be displayed on the visor of the pilot's helmet or on the windshield of the cockpit to inform the pilot of a lot of information necessary for the operation.

As such, in order to implement augmented reality, a display device such as a camera capable of receiving a real image and an HMD capable of displaying a real image and a virtual image are required.

As a personal display device, the HMD can enjoy a larger screen while the user wears it on the head, and can enjoy a more realistic and realistic screen.

The HMD device displays an image displayed by a display device such as a liquid crystal display (LCD) or a cathode ray tube (CRT) to a user by using a precise optical mechanism.

Since the HMD has an image screen located very close to the eyes, very precise optical devices are required to focus on a very short distance and to prevent eye fatigue.

However, in the case of the conventional HMD, the apparatus was used in a state in which it was not properly controlled because it relies on the manual method and the human sense in controlling the interpupillary distance.

In addition, when viewing the image in a state where the position of the HMD display unit is not properly adjusted, it leads to side effects such as headache or vomiting, which greatly reduces the fit and immersion in the use of the HMD.

Accordingly, an object of the present invention is to provide a stereoscopic image display device and a display unit position adjusting method in the stereoscopic image display device to solve the problem of coordination distance to improve the long-term wearing and immersion of the HMD.

Another object of the present invention is to obtain a pupillary distance by using the refractive index of the eyeball, and to provide a stereoscopic image display apparatus for adjusting the position of the display unit using the obtained pupillary distance and a display unit position adjusting method in the stereoscopic image display apparatus. It is.

It is still another object of the present invention to provide a stereoscopic image display apparatus capable of adjusting the position of an HMD display unit using a pupil distance different according to a user, and a display unit position adjusting method in the stereoscopic image display apparatus.

According to an aspect of the present invention to achieve the above object, in the three-dimensional image display apparatus for displaying an image signal output from the image reproducing apparatus, the light emitting unit for generating light, the left eye image for generating a light when the display position adjustment command is input A first display unit and a second display unit for outputting an image for the right eye, and a photoelectric conversion unit for receiving the reflected light of the light generated by the light emitting unit through a lens and converting the light into an electrical signal, and an electrical signal transmitted from the photoelectric conversion unit. Obtain a refractive index for each of the left and right eyes using the obtained refractive index, and obtain a pupillary distance using the obtained refractive index, and then adjust the position from the pupillary distance measuring unit and the pupillary distance measurement unit to generate a position adjustment request message including the pupillary distance. When a request message is received, the request message is received according to the interpupillary distance included in the message. Provided is a stereoscopic image display device comprising a display portion position adjusting portion for adjusting the position of the first display portion and the second display portion.

The stereoscopic image display apparatus may include a sink separator that separates the sinks of the image signals output from the image reproducing apparatus, and a video signal that processes the image signals output from the sink separators to be displayed on the first display unit and the second display unit. A processor is configured to alternately drive the light emitters sequentially in accordance with a field signal output from the sink separator to output an image transmitted from the image signal processor to the first display unit and the second display unit. It further comprises a first and second display unit driver.

The light emitting unit is installed in one of a detachable and foldable manner, and includes a first light emitting unit corresponding to the first display unit and a second light emitting unit corresponding to the second display unit.

When the display unit position adjustment command is input, the first display unit and the second display unit may display a scale on the screen, and may move under the control of the display unit position adjuster.

The photoelectric conversion unit receives a reflected light of light generated by the first light emitting unit corresponding to the first display unit through a lens and converts the first photoelectric conversion unit into a first electric signal, and a second light emission corresponding to the second display unit. And a second photoelectric conversion unit which receives the reflected light of the light generated by the unit through the lens and converts the reflected light into a second electric signal.

The pupil distance measuring unit obtains respective indices of refraction for the left and right eyes using the first and second electrical signals transmitted from the first photoelectric converter and the second photoelectric converter, and uses the obtained refractive indices. After calculating the centers of the eyes, the distance between the obtained left eye center and the right eye center is obtained, and the obtained distance is defined as the interspace distance.

In addition, the pupil distance measuring unit determines that the region having the highest refractive index with respect to each of the obtained refractive indices of the left and right eyes is the center of the eye.

In addition, the pupil distance measuring unit determines whether the obtained pupillary distance corresponds to a distance between the first display unit and the second display unit currently set, and if it does not correspond to the determination result, the position adjustment request including the obtained pupillary distance. A message is generated and sent to the display position controller.

The display part position adjusting part may be a step motor.

According to another aspect of the present invention, in the method for adjusting the position of the first and second display unit for outputting the left eye image and the right eye image, respectively, in the three-dimensional image display device equipped with a light emitting unit, (a) display unit position adjustment command When the input, input the refractive index of the left and right eyes using the light generated by the light emitting unit, (b) calculating the interpupillary distance using the obtained refractive index, (c) fit the obtained interpupillary distance And adjusting the position of the first and second display units so as to adjust the position of the display unit in the stereoscopic image display apparatus.

In the step (a), when the display unit position control command is input, generating light by operating the light emitting unit, converting the reflected light of the generated light into an electric signal, and using the converted electric signal to the left and right eyes. Obtaining a refractive index for each.

In the step (b), determining a region having the highest refractive index with respect to each of the obtained refractive indices of the left and right eyes, determining the determined area as the center of the eye, obtaining a distance between the left and right eye centers, and calculating the calculated distance. A step of making a spatial distance is included.

Adjusting the position of the first and second display units to match the obtained interpupillary distance means adjusting the position such that the center of the first and second display units is the region having the highest refractive index.

Accordingly, the present invention can provide a stereoscopic image display device that improves the long-term wearing and immersion of the HMD by solving the space distance adjustment problem, and a method of adjusting the position of the display unit in the stereoscopic image display device.

A stereoscopic image display apparatus for obtaining a pupillary distance using the refractive index of an eyeball and adjusting a position of a display unit using the obtained pupillary distance and a display unit position adjusting method in the stereoscopic image display apparatus can be provided.

In addition, it is possible to provide a stereoscopic image display apparatus capable of adjusting the position of the HMD display unit using a pupil space distance according to a user, and a display unit position adjusting method in the stereoscopic image display apparatus.

Details of the above-described objects and technical configurations of the present invention and the effects thereof according to the present invention will be more clearly understood by the following detailed description based on the accompanying drawings.

1 is a block diagram schematically illustrating a configuration of a stereoscopic image display apparatus according to the present invention, and FIG. 2 is a diagram illustrating a screen output to a display unit by selecting a display unit position adjustment command according to the present invention.

Referring to FIG. 1, when a video signal is input, the 3D image display apparatus may display a sync separation unit 100 separating the sync of the video signal and an image signal output from the sync separating unit 100. The image signal processor 110, the first and second display units 120a and 120b that display the image signal processed by the image signal processor 110, and the first and second display units 120a and 120b, respectively. The light emitting units 150a and 150b corresponding to the light emitting units 150a and 150b alternately drive the two light emitting units 150a and 150b in order to match the field synchronization signals. Using the light emitted by the first and second display unit drivers 180a and 180b and the light emitters 150a and 150b to display the image transmitted from the image signal processor 110, the distance of the pupil space is obtained. Pupil distance measuring unit 190, phase And first and second display unit position adjusting units 200a and 200b for adjusting positions of the first and second display units 120a and 120b to fit the pupil distance measured by the pupil distance measuring unit 190. .

The images displayed on the first and second display units 120a and 120b are images of the first eyepiece system 130a and the second eyepiece system 130b and are provided through the left eye 140a and the right eye 140b. It is made to be recognized by the user.

The light emitting units 150a and 150b refer to light emitting devices such as LEDs and infrared rays, and may be of a folding type or a removable type.

In addition, the stereoscopic image display apparatus includes photoelectric conversion units 170a and 170b for receiving the reflected light of the projection light emitted by the light emitting units 150a and 150b through the lenses 160a and 160b.

The photoelectric converters 170a and 170b convert the reflected light received through the lenses 160a and 160b into electrical signals and transmit the converted light to the pupil distance measuring unit 190.

That is, the photoelectric converters 170a and 170b receive the reflected light of the light generated by the first light emitting unit 150a corresponding to the first display unit 120a through the first lens 160a to receive the first electrical signal. A second electrical signal by receiving the reflected light of the light generated by the first photoelectric conversion unit 170a and the second light emitting unit 150b corresponding to the second display unit 120b through the second lens 160b. The second photoelectric converter 170b to convert to.

Accordingly, the first photoelectric converter 170a converts the reflected light received through the first lens 160a into a first electric signal and transmits the converted light to the pupil distance measuring unit 190. In addition, the second photoelectric converter 170b converts the reflected light received through the second lens 160b into a second electric signal and transmits the converted light to the pupil distance measuring unit 190.

The pupil distance measuring unit 190 obtains the refractive index of the eye by the light emitted by the light emitting units 150a and 150b, and obtains the pupillary distance using the obtained refractive index.

That is, the pupil distance measuring unit 190 obtains the refractive index of the left eye 140a by using the first electrical signal transmitted from the first photoelectric converter 170a, and uses the obtained refractive index to determine the left eye 140a. Find the center of The pupil distance measuring unit 190 obtains a refractive index of the right eye 140b using the second electrical signal transmitted from the second photoelectric converter 170b, and uses the obtained refractive index to right eye 140b. Find the center of Here, when the refractive index is high, it refers to the center of the eye, and the periphery thereof is lower than the refractive index of the center of the eye. Therefore, the pupil distance measuring unit 190 determines that the region having the highest refractive index with respect to each of the left and right eyes is the center of each eye.

Then, the pupil distance measuring unit 190 obtains a distance between the center of the obtained left eye 140a and the center of the right eye 140b. The distance between the obtained left and right eye centers may be a pupil space distance.

As described above, the pupil distance measuring unit 190 calculates a refractive index for each of the left and right eyes 140a and 140b to obtain the pupillary distance.

Then, the pupil distance measuring unit 190 transmits a position adjustment request message to the first and second display unit position adjusting units 200a and 200b to fit the obtained pupil space distance. The position adjustment request message includes a pupil space distance.

Also, the pupil distance measuring unit 190 determines whether the obtained pupillary distance is currently set to correspond to the distance between the first and second display units 120a and 120b. If the pupil distance measuring unit 190 does not correspond to the determination result, the pupil pupil is determined. A position adjustment request message including a space distance is generated and transmitted to the first and second display unit position adjusting units 200a and 200b.

Then, the first and second display unit position adjusting units 200a and 200b adjust the positions of the first and second display unit 120a and 120b according to the interspace distance included in the position adjusting message. The first and second display unit position adjusting units 200a and 200b may be step motors.

The first and second display units 120a and 120b are provided to be moved by the control of the first and second display unit position adjusting units 200a and 200b.

In the stereoscopic image display apparatus configured as described above, when a display position adjustment command is input by a user, a screen displayed in scale on the first and second display units 120a and 120b as shown in FIG. To be displayed.

Referring to FIG. 2, when a user selects a display unit position adjustment command while using a stereoscopic image display apparatus, a screen having a scale is displayed on each of the first and second display units 120a and 120b, and the pupil distance measuring unit is displayed. In operation 190, the interspace distance is obtained using the scales output to the first and second display units 120a and 120b.

When the positions of the first and second display units 120a and 120b are adjusted as described above, the stereoscopic image display apparatus receives the sequentially recorded image signals and separates the sync signals through the sink separator 100.

The image signal output from the sink separating unit 100 is input to the first and second display unit drivers 180a and 180b driving the first and second display units 120a and 120b to display an image.

According to another preferred embodiment of the present invention, the pupil distance measuring unit using the first display unit position adjusting unit 200a and the second display unit position adjusting unit 200b existing in the stereoscopic image display apparatus as one display unit position adjusting unit. The positions of the first and second display units 120a and 120b may be adjusted according to the pupil distance of the position adjustment request message transmitted from 190.

3 is a flowchart illustrating a method of adjusting a position of a display unit in the stereoscopic image display apparatus according to the present invention.

Referring to FIG. 3, when the display unit position control command is input by the user (S300), the stereoscopic image display apparatus obtains the refractive index of each of the left and right eyes using the light emitted by the light emitting unit (S302).

That is, when the user selects the display unit position control command, the stereoscopic image display apparatus generates light by operating the light emitter, and then uses the light to calculate the refractive index of each eye.

Then, the 3D image display apparatus obtains a pupillary distance using the obtained refractive indices for the left and right eyes (S304).

In other words, when the refractive index is high, it refers to the center of the eye, and the periphery is lower than the refractive index of the center of the eye. Accordingly, the stereoscopic image display apparatus determines a region having the highest refractive index for each of the obtained left and right eyes.

Then, the 3D image display apparatus determines the determined region as the center of the eye and calculates the distance between the left and right eye centers. The distance between the obtained left and right eye centers may be a pupil space distance.

When the pupillary distance is obtained through the step S304, the stereoscopic image display apparatus adjusts the position of the display unit to match the calculated pupillary distance (S306).

That is, since the display unit is installed to move in the horizontal and vertical directions, the stereoscopic image display apparatus moves the display unit so that the region having the highest refractive index is at the center of each display unit and adjusts its position.

Then, the 3D image display apparatus displays an image selected by the user (S308).

As described above, by adjusting the position of the first display unit corresponding to the left eye and the second display unit corresponding to the right eye by using the user's pupil distance, the long-term wearing and immersion feeling of the HMD can be enhanced.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

In the stereoscopic image display apparatus and the method of adjusting the position of the display unit in the stereoscopic image display apparatus according to the present invention, since the position of the left and right display units are adjusted by using a pupil distance according to the user, an image signal is output according to the eye position of the user. The present invention may be applied to a technique for improving long-term wearing and immersion of a stereoscopic image, a stereoscopic image display device for augmented reality or virtual reality, and a technique requiring position adjustment of a display unit using a different pupil distance according to a user.

1 is a block diagram schematically showing the configuration of a stereoscopic image display apparatus according to the present invention.

2 is a view showing a screen output to the display by selecting the display position control command according to the present invention.

3 is a flowchart illustrating a method of adjusting a position of a display unit by a stereoscopic image display apparatus according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100: sink separation unit 110: image processing unit

120a, 120b: Display part 130a, 130b: Eyepiece optical system

150a, 150b: light emitting unit 160a, 160b: lens

170a, 170b: photoelectric conversion unit 180a, 180b: display unit driver

190: pupil distance measuring unit 200a, 200b: display unit position adjusting unit

Claims (16)

A stereoscopic image display apparatus displaying an image signal output from an image reproducing apparatus, A light emitting unit for generating light when a display unit position control command is input; A first display unit and a second display unit for outputting a left eye image and a right eye image, respectively; A photoelectric conversion unit receiving the reflected light of the light generated by the light emitting unit through a lens and converting the light into an electrical signal; By using the electrical signal transmitted from the photoelectric conversion unit to obtain the refractive index for the left and right eyes, respectively, using the obtained refractive index to obtain the center of the left and right eyes, respectively, by measuring the distance between the obtained left eye center and the right eye center, A pupil distance measuring unit configured to obtain a pupil distance and generate a position adjustment request message including the pupil distance; and When the position adjustment request message is received from the pupil distance measuring unit, the display unit position adjusting unit for adjusting the position of the first display unit and the second display unit according to the pupil space distance included in the message Stereoscopic image display device comprising a. The method of claim 1, A sink separator for separating the sink of the video signal output from the video reproducing apparatus; An image signal processor configured to process the image signal output from the sink separator to be displayed on the first display unit and the second display unit; and A first driving to sequentially output the light emitting unit in accordance with the field signal output from the sink separating unit in accordance with the synchronization signal of the field to output an image transmitted from the image signal processing unit to the first display unit and the second display unit; And a second display unit driver. The method of claim 1, The light emitting unit is a stereoscopic image display device, characterized in that installed in one of the removable, foldable manner. The method of claim 1, The light emitting unit may include a first light emitting unit corresponding to the first display unit; And a second light emitting unit corresponding to the second display unit. The method of claim 1, And a scale is displayed on the screen when the display position control command is input to the first display unit and the second display unit. The method of claim 1, And the first display unit and the second display unit are installed to be moved by the control of the display unit position adjusting unit. The method of claim 1, The photoelectric conversion unit may include a first photoelectric conversion unit receiving the reflected light of the light generated by the first light emitting unit corresponding to the first display unit through a lens and converting the light into a first electric signal; And a second photoelectric conversion unit which receives the reflected light of the light generated by the second light emitting unit corresponding to the second display unit through a lens and converts the converted light into a second electrical signal. The method of claim 1, The pupil distance measuring unit obtains respective indices of refraction for the left and right eyes using the first and second electrical signals transmitted from the first photoelectric converter and the second photoelectric converter, and uses the obtained refractive indices for the left and right eyes. And calculating a distance between the obtained left eye center and the right eye center after obtaining the centers, respectively, to obtain a pupil space distance. The method of claim 8, And the pupil distance measuring unit determines a region having the highest refractive index with respect to the obtained refractive indices of the left and right eyes as the center of the eye. The method of claim 1, The pupil distance measuring unit determines whether the obtained pupillary distance corresponds to a distance between the currently set first display part and the second display part, and if it does not correspond to the determined result, the pupil distance measurement part includes a position adjustment request message including the obtained pupillary distance. And generating and transmitting the generated image to the display position adjusting unit. The method of claim 1, And the display unit position adjusting unit is a step motor. The method of claim 1, And the display unit position adjusting unit is provided in the first display unit and the second display unit, respectively. In the method for adjusting the position of the first and second display unit for outputting the left eye image and the right eye image, respectively, in the three-dimensional image display device equipped with a light emitting unit, (a) obtaining a refractive index of left and right eyes using light generated by the light emitter when a display position control command is input; (b) determining the center of the eye using the obtained refractive indices, obtaining a distance between the left and right eye centers, and using the obtained distance as the interspace distance; and (c) adjusting the position of the first and second display units to match the interspace distance; Position adjustment method of the display unit in the stereoscopic image display device comprising a. The method of claim 13, In step (a), When the display unit position control command is input, operating the light emitting unit to generate light; And converting the reflected light of the generated light into an electrical signal, and obtaining refractive indices for the left and right eyes using the converted electrical signal, respectively. The method of claim 13, In step (b), Determining a region having the highest refractive index with respect to each of the obtained refractive indices of the left and right eyes; And determining the determined area as the center of the eye to obtain a distance between the left and right eye centers, and using the determined distance as the interspace distance. The method of claim 13, Adjusting the position of the first and second display units to match the interspace distance, adjusts the position such that the center of the first and second display units is the region having the highest refractive index. How to adjust the display position in.

Images