KR100917100B1 - Apparatus for displaying three-dimensional image and method for controlling location of display in the apparatus - Google Patents

Abstract

According to the present invention, a stereoscopic image display apparatus displaying an image signal output from an image reproducing apparatus includes generating a first image and a second image by capturing a user when a command for adjusting the position of the first display unit, the second display unit, and the display unit is input; A pupil position measuring unit configured to detect a pupil from the photographing unit, the first image, and the second image, and obtain first pupil position information and second pupil position information for each of the first pupil and the second pupil, and the obtained A pupil space distance is obtained by using the first pupil position information and the second pupil position information, and if the obtained pupil space distance does not correspond to the currently set pupil space distance, the pupil space distance and the currently set pupil space The inter-space distance measuring unit and the above obtaining a difference value of the distance and generating a display position control message including the obtained difference value It consists of a display position adjuster for adjusting the position of the first and second display portion according to the difference value included in the value adjustment message. When worn, it can provide a suitable environment for the user without any manipulation, thereby eliminating the side effects of wearing for a long time.

Stereoscopic image, pupil distance, display

Description

Apparatus for displaying three-dimensional image and method for controlling location of display in the apparatus}

The present invention relates to a stereoscopic image display apparatus and a display unit position adjusting method in the stereoscopic image display apparatus. More particularly, when a display unit position adjustment command is input, a first image and a second image are generated by photographing a user. The pupil is detected from each of the first image and the second image to obtain position information of each pupil, the pupil space distance is obtained using the position information of each pupil, and the position of the display unit is adjusted according to the pupil space distance. The present invention relates to a stereoscopic image display apparatus capable of eliminating side effects of prolonged wearing by providing an environment suitable for a user without any manipulation when wearing a stereoscopic image display apparatus and a method of adjusting the position of a display unit in the stereoscopic image display apparatus.

The development of integrated technology has led to the emergence of various portable devices.

Beginning with sound playback devices such as tape playback devices and CD players, mobile phones and MP3 players have become widespread, and portable game machines have also emerged.

In particular, the mobile phone may be used in various ways beyond the use as a communication means, of which the role as a watch, a digital camera and an MP3 player is representative.

Virtual Reality is the field of information activities that indirectly experiences situations that cannot be experienced directly in the real world due to spatial and physical constraints through interactions with the human sensory system in virtual spaces built using computers. Is one of the new paradigms.

The ultimate goal of virtual reality is to provide a more realistic communication environment with computers by increasing the ability of computers to communicate with humans using various input / output methods. As a method of input / output between a computer and a human, devices such as a head-mounted display (HMD), a data glove, and a motion capture are used.

The HMD transmits position change data according to the movement of the user's head to the computer so that the computer calculates and simulates the size and depth of the object in the user's field of view.

The data glove detects the position and direction of the user's hand. When the user moves the hand in three-dimensional space, the data glove sends the data flow to the computer in the form of three-dimensional coordinates, and the computer manipulates an object corresponding to the data.

Augmented Reality is generally a term derived from a virtual environment and a virtual reality, and means a mixture of a real world image and a virtual image by inserting a computer graphic image into the real environment. Real-world information may contain information that the user does not need, and sometimes the user may lack information.

However, using computer-generated virtual environments, you can simplify or hide information you don't need. In other words, the augmented reality system combines the real world and the virtual world to allow interaction with the user in real time.

The simplest form of augmented reality is applied in the fields of entertainment and news. If you're forecasting on TV, you'll see the weather map in front of the weather caster changing naturally. Actually, the weather cast is standing in front of the blue-screen, and the computer-generated virtual footage creates a virtual studio environment for augmented reality. To achieve.

In addition, 3D data of the patient is acquired in real time through indirect inspection such as magnetic resonance image, computed tomography image, and ultrasound image, and then the acquired data is rendered in real time and overlapped with the patient. By expressing it, the surgeon can perform a patient's operation smoothly. A virtual image can be displayed on the visor of the pilot's helmet or on the windshield of the cockpit to inform the pilot of a lot of information necessary for the operation.

As such, in order to implement augmented reality, a display device such as a camera capable of receiving a real image and an HMD capable of displaying a real image and a virtual image are required.

As a personal display device, the HMD can enjoy a larger screen while the user wears it on the head, and can enjoy a more realistic and realistic screen.

The HMD device displays an image displayed by a display device such as a liquid crystal display (LCD) or a cathode ray tube (CRT) to a user by using a precise optical mechanism.

Since the HMD has an image screen located very close to the eyes, very precise optical devices are required to focus on a very short distance and to prevent eye fatigue.

However, in the case of a stereoscopic image display device such as a conventional HMD, a device that is not properly controlled is often used because it depends on a manual method and a human sense in adjusting the interpupillary distance.

In addition, when the image is viewed in a state where the display portion of the stereoscopic image display device is not properly adjusted, it may lead to side effects such as headache or vomiting, which greatly reduces the fit and immersion in using the stereoscopic image display device.

Accordingly, an object of the present invention is to provide a stereoscopic image display device for improving the long-term wearing and immersion of the stereoscopic image display device by solving the interpupillary distance adjustment problem different for each user and a method of adjusting the position of the display unit in the stereoscopic image display device. .

Another object of the present invention is to provide a stereoscopic image display apparatus capable of adjusting a display portion of a stereoscopic image display apparatus by using a pupil distance different according to a user, and a display unit position adjusting method in the stereoscopic image display apparatus.

According to an aspect of the present invention to achieve the above object, in the stereoscopic image display apparatus for displaying an image signal output from the image reproducing apparatus, the first display unit and the second display unit for outputting the left eye image and the right eye image, respectively When the display position control command is input, a photographing unit for photographing a user to generate a first image and a second image, and detecting a pupil from the first image and the second image photographed by the photographing unit, respectively, A pupil position measuring unit obtaining first pupil position information and second pupil position information for each of the first pupil and the second pupil, the first pupil position information obtained by the pupil position measuring unit and the second pupil position measuring unit A pupil space distance is obtained using second pupil position information, and the pupil space distance obtained is compared with the currently set pupil space distance. If not, obtain the difference value between the obtained space distance and the currently set space distance, and the display unit position from the space distance measuring unit and the space distance measuring unit for generating a display position control message including the calculated difference value When the adjustment message is received, the stereoscopic image display apparatus includes a display unit position adjusting unit for adjusting the position of the first and second display units in the difference value included in the message.

The stereoscopic image display apparatus may include a sink separator that separates the sinks of the image signals output from the image reproducing apparatus, and a video signal that processes the image signals output from the sink separators to be displayed on the first display unit and the second display unit. And a first display unit driver and a second display unit driver for driving the first display unit and the second display unit to display an image transmitted from the image signal processor in accordance with a synchronization signal of the field signal output from the sink separator. Characterized in that.

The photographing unit includes a first photographing unit which photographs a certain region of the left face of the user and generates a first image, and a second photographing unit which photographs a certain region of the user's right face and generates a second image.

The pupil position measuring unit extracts a first pupil using the contrast of the first image, and obtains first pupil position information by using coordinate information corresponding to the first pupil. And a second pupil position measuring unit extracting a second pupil using the contrast difference from the two images, and obtaining second pupil position information using coordinate information corresponding to the second coating.

The display part position adjusting part may be a step motor.

The first image and the second image photographed by the photographing unit are mapped with the coordinate information.

The first display unit and the second display unit are connected by a connecting line which can be adjusted in position by the control of the display unit position adjusting unit.

According to another aspect of the invention, (a) when the display position control command is input, generating a first image and a second image by photographing the user, (b) pupils in each of the first image and the second image Detecting, (c) obtaining positional information of each detected pupil, (d) obtaining a pupillary distance using the obtained positional information of each pupil, (e) presently setting the pupillary distance If it does not correspond to the pupillary distance, the step of obtaining a difference value between the obtained pupillary distance and the currently set pupillary distance and adjusting the position of the display unit according to the difference value in the stereoscopic image display apparatus Provided is a method of adjusting the position of the display unit.

In the step (a), when the display unit position control command is input, the provided first photographing unit and the second photographing unit are turned on to generate the first image and the second image.

In the step (b), the first pupil and the second pupil are detected using the contrast difference in the first image and the second image.

In the step (c), the coordinate information mapped to the detected pupils is used as position information.

Accordingly, the present invention can provide a stereoscopic image display device for improving the long-term wearing and immersion of the stereoscopic image display device to solve the problem of adjusting the interpupillary distance and a method of adjusting the position of the display unit in the stereoscopic image display device.

In addition, a stereoscopic image display apparatus capable of adjusting a position of a stereoscopic image display apparatus display unit by using a pupil space different according to a user, and a display unit position adjusting method in the stereoscopic image display apparatus may be provided.

In addition, by automatically recognizing the pupil to obtain the optimum pupillary distance, when the user wears a three-dimensional image display device, a stereoscopic image display device that can eliminate the side effects of wearing for a long time by providing a suitable environment for the user without any operation And a method of adjusting the position of the display unit in the stereoscopic image display device.

Details of the above-described objects and technical configurations of the present invention and the effects thereof according to the present invention will be more clearly understood by the following detailed description based on the accompanying drawings.

1 is a view showing an eyepiece area in a stereoscopic image display apparatus according to the present invention.

Referring to FIG. 1, in the eyepiece area of the stereoscopic image display apparatus, a predetermined area of the first display part 100a and the second display part 100b for the left and right eyes, and the predetermined display part of the first display part 100a and the second display part 100b. Each of the photographing units 110a and 110b, such as a camera, is present.

In addition, the first display unit 100a and the second display unit 100b are connected by a connection unit 120 such as a cable whose length is adjustable. Accordingly, the first display unit 100a and the second display unit 100b may be adjusted to fit the interspace distance by the connection unit 120.

That is, when the display position control command is input, the 3D image display apparatus turns on the cameras 110a and 110b to capture a certain region of the user's face.

Then, the stereoscopic image display apparatus detects a pupil from the photographed image, obtains the detected distance of the pupil space, and connects the connection part such that the first display part 100a and the second display part 100b fit the pupil distance. Adjust 120.

For example, when the connection unit 120 is a cable, the stereoscopic image display apparatus adjusts the distance between the first display unit 100a and the second display unit 100b by reducing and increasing the cable in accordance with the interspace distance. do.

A stereoscopic image display apparatus for adjusting the positions of the display units 110a and 110b to fit the interspace distance as described above will be described in detail with reference to FIG. 2.

2 is a block diagram schematically illustrating a configuration of a stereoscopic image display apparatus according to the present invention.

Referring to FIG. 2, when a video signal is input, the 3D image display apparatus may display a sync separation unit 200 that separates the sync of the video signal, and an image signal output from the sync separation unit 200. The field signal output from the image signal processing unit 210, the first and second display units 230a and 230b for displaying the image signal processed by the image signal processor 210, and the sink separator 200. The first and second display unit drivers 220a and 220b for driving the first and second display units 230a and 230b to display an image transmitted from the image signal processor 210 according to a synchronization signal of the user's face. First and second pupil positions for measuring the position of the pupil in the image photographed by the first and second photographing units 240a and 240b and the images captured by the first and second photographing units 240a and 240b. Measuring part 250a, 250b, said 1st and 2nd pupil position Measured by the pupillary distance measuring unit 260 and the pupillary distance measuring unit 260 for obtaining the distance between the left and right pupil spaces using the first and second pupil position information measured by the measurement units 250a and 250b. And a display unit position adjusting unit 270 for adjusting the positions of the first and second display units 230a and 230b to fit the spaced distance.

The images displayed on the first and second display units 230a and 230b are images of the first eyepiece system (not shown) and the second eyepiece system (not shown) and are recognized by the user through the left eye and the right eye. Is done.

The first and second photographing units 240a and 240b may be cameras which photograph certain areas of the user's face using light emitted from a light source.

The images captured by the first and second photographing units 240a and 240b may be a first image including a left eye and a second image including a right eye.

The first and second pupil position measuring units 250a and 250b detect pupils from the images captured by the capturing units 240a and 240b and obtain position information of the detected pupils.

That is, the first pupil position measuring unit 250a detects the first pupil using the contrast difference in the first image photographed by the first photographing unit 240a, and corresponds to the detected first pupil. After obtaining first pupil position information using coordinates, the pupil pupil is transmitted to the pupillary distance measuring unit 260. Since the first image photographed by the first photographing unit 240a is mapped with coordinate information, the first pupil position measuring unit 250a may obtain the coordinates corresponding to the first pupil.

In addition, the first pupil position measuring unit 250a may obtain first pupil position information by calculating a vector representing the movement of the pupil in the first image.

The second pupil position measuring unit 250b detects the second pupil using the contrast difference in the second image photographed by the second photographing unit 240b, and coordinates corresponding to the detected second pupil. After the second pupil position information is obtained, the second pupil position information is transmitted to the pupil space distance measurer 260.

That is, since the second image photographed by the second photographing unit 240b is mapped with coordinate information, the second pupil position measuring unit 250b may obtain coordinates corresponding to the second pupil.

In addition, the second pupil position measuring unit 250b may obtain second pupil position information by calculating a vector representing the movement of the pupil in the second image.

The pupillary distance measurer 260 uses first pupil position information transmitted from the first pupil distance measurer 250a and second pupil position information transmitted from the second pupil distance measurer 250b. Find the distance between the first pupil and the second pupil.

Then, the interspace distance measuring unit 260 compares the obtained interspace distance with the currently set interspace distance to determine whether the corresponding interspace distance is equivalent.

If the determination result does not correspond, the pupillary distance measuring unit 260 obtains a difference value between the obtained pupillary distance and the currently set pupillary distance, and adjusts the display part position control message including the calculated difference value. Transfer to section 270. The position adjustment request message may be a message for adjusting the positions of the first display unit 230a and the second display unit 230b to fit the user's pupil.

The display unit position adjusting unit 270 operates as much as a difference value included in the display unit position control message transmitted from the interspace distance measuring unit 260 to operate the first display unit 230a and the second display unit 230b. Adjust the position of.

The display position adjusting unit 270 serving as described above may be a step motor.

3 is a flowchart illustrating a method of adjusting a position of a display unit in the stereoscopic image display apparatus according to the present invention.

Referring to FIG. 3, when the display position adjustment command is input by the user (S300), the 3D image display apparatus turns on the first and second photographing units (S302).

Then, each of the first and second photographing units captures a certain area of the user's face.

When the first image and the second image photographed by the first and second photographing units are input (S304), the 3D image display apparatus may include a first pupil and a second pupil from the input first and second images. Is detected (S306).

That is, since the information about the pupil (for example, information about the shape, contrast, etc. of the pupil) is registered in the stereoscopic image display apparatus, the pupil may be detected in the image photographed by the photographing unit.

In addition, the stereoscopic image display apparatus may detect a pupil using a contrast difference in the input image.

After the operation S306 is performed, the stereoscopic image display device obtains position information of the detected first pupil and second pupil (S308).

That is, coordinate information is mapped to each area of the image photographed by the photographing unit. Therefore, when the pupil is detected, the stereoscopic image display apparatus may determine the position information of the pupil using coordinate information.

When S308 is performed, the 3D image display apparatus obtains a pupil space distance by using the obtained first pupil position information and second pupil position information (S310).

Then, the 3D image display apparatus determines whether the obtained interpupillary distance corresponds to the currently set interpupillary distance (S312).

If the determination result does not correspond, the 3D image display apparatus obtains a difference value between the obtained pupil distance and the currently set pupil distance (S314), and adjusts the position of the display unit according to the difference value (S316).

For example, when the obtained difference value is '-5', the 3D image display apparatus determines that the distance between the current display units is farther than the pupil space distance of the user and reduces the distance between the display units by a length corresponding to '5'. .

   In addition, when the obtained difference value is '+5', the 3D image display apparatus determines that the distance between the current display units is closer than the pupil space distance of the user and increases the distance between the display units by a length corresponding to '5'.

As described above, the 3D image display apparatus obtains the pupil distance of the user to adjust the position of the display part according to the pupil distance of the user, and adjusts the position of the display part to match the obtained pupil distance.

As described above, if the position of the first display unit corresponding to the left eye and the second display unit corresponding to the right eye is adjusted by using the pupil distance of the user, long-term wearing and immersion of the stereoscopic image display device may be enhanced.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

The stereoscopic image display apparatus and the method of adjusting the position of the display unit in the stereoscopic image display apparatus according to the present invention can be applied to a technique for improving the long-term wearing and immersion feeling of the stereoscopic image display apparatus by solving the problem of adjusting the interpupillary distance for each user. .

1 is a view showing the eyepiece area in the stereoscopic image display apparatus according to the present invention.

Figure 2 is a block diagram schematically showing the configuration of a three-dimensional image display device according to the present invention.

3 is a flowchart illustrating a method of adjusting a position of a display unit by a stereoscopic image display apparatus according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100, 230a, 230b: display unit 110, 240a, 240b: photographing unit

120 connection part 200 sink separation part

210: image signal processor 220a, 220b: display unit driver

250a, 250b: pupil position measuring unit 260: pupil space distance measuring unit

270 display position adjustment unit

Claims (11)

A stereoscopic image display apparatus displaying an image signal output from an image reproducing apparatus, A first display unit and a second display unit for outputting a left eye image and a right eye image, respectively; A photographing unit configured to generate a first image of a certain region of a user's left face and a second image of a predetermined region of a user's right face when the display unit position control command is input; The pupils are detected from the first image and the second image photographed by the photographing unit using the information on the pupils, and the first pupil position information and the second pupil with respect to the detected first pupil and the second pupil, respectively. A pupil position measuring unit obtaining position information; The pupil space distance is obtained by using the first pupil position information obtained by the pupil position measuring unit and the second pupil position information obtained by the second pupil position measuring unit, and the obtained pupil space distance is set to the currently set pupil space distance. If the comparison is not equivalent, the pupil distance measurement unit for obtaining a difference value between the obtained pupil distance and the currently set pupil distance, and generates a display position control message including the calculated difference value; And Display unit position adjusting unit for adjusting the position of the first and second display unit using a step motor according to the difference value included in the message, when the display unit position control message is received from the interspace distance measuring unit Stereoscopic image display device comprising a. The method of claim 1, A sink separator for separating the sink of the video signal output from the video reproducing apparatus; An image signal processor configured to process the image signal output from the sink separator to be displayed on the first display unit and the second display unit; and And a first display unit driver and a second display unit driver for driving the first display unit and the second display unit to display an image transmitted from the image signal processor in accordance with a synchronization signal of the field signal output from the sink separator. A stereoscopic image display device characterized by the above-mentioned. The method of claim 1, The photographing unit photographs a certain region including the left eye of the left face of the user to generate a first image, and photographs a certain region including the right eye of the right face of the user to capture a second image. And a second photographing unit to generate the stereoscopic image display apparatus. The method of claim 1, The pupil position measuring unit may include: a first pupil position measuring unit extracting a first pupil using a contrast difference of the first image, and obtaining first pupil position information using coordinate information corresponding to the first pupil; And a second pupil position measurer configured to extract a second pupil from the second image using the contrast, and obtain second pupil position information using coordinate information corresponding to the second coating. Display device. delete The method of claim 1, And a first image and a second image captured by the photographing unit are mapped to coordinate information, respectively. The method of claim 1, And the first display unit and the second display unit are connected by a connecting unit which is capable of position adjustment by control of the display unit position adjusting unit. (a) photographing the user to generate a first image of a certain area of the left face of the user and a second image of a certain area of the right face of the user when the display position control command is input; (b) detecting the pupil in each of the first image and the second image using information about the pupil; (c) obtaining position information of each detected pupil; (d) obtaining a pupillary distance using the obtained position information of each pupil; and (e) If the calculated pupillary distance does not correspond to the currently set pupillary distance, and obtains a difference value between the obtained pupillary distance and the currently set pupillary distance and uses a step motor according to the difference value. Adjusting the position of the display Position adjustment method of the display unit in the stereoscopic image display device comprising a. The method of claim 8, In the step (a), when the display unit position control command is input, the provided first and second photographing unit is turned on to generate the first image and the second image. How to adjust the position of the display. The method of claim 8, In step (b), The method of claim 1, wherein the first pupil and the second pupil are detected using the contrast in the first image and the second image. The method of claim 8, In the step (c), And coordinate information mapped to the detected pupils as position information.

Images