JPWO2012131937A1 - Measuring device, stereoscopic image display device, and measuring method - Google Patents

Abstract

The measurement apparatus has a property of removing one of the images to be controlled after the control for displaying the stereoscopic image by the first image and the second image on the display unit that displays the stereoscopic image with the naked eye. A display control unit that changes to an image, an imaging unit that captures the eye position of a user who views the image displayed on the display unit, a third image, and the first image or the second image before being changed to the third image A measuring unit that measures a change in the eye position of the user who views the image from a captured image captured by the imaging unit.

Description

  The present invention relates to a measurement apparatus, a stereoscopic image display apparatus, and a measurement method for controlling display of a stereoscopic image with the naked eye.

  It is known that eye strain occurs when viewing stereoscopic images by binocular vision. For this reason, safety guidelines for producing stereoscopic video are well known, and as an example, it is recommended that content with a parallax amount not be excessively applied when producing content for everyone.

  However, there is a difference between individuals in stereoscopic vision, and there are people who feel that the stereoscopic effect is poor if they follow the guidelines, while those who do not feel tired if they keep watching for a long time even within the guidelines, those who do not Appears.

  As a conventional technique for measuring the characteristics of binocular vision, there is a method of measuring the response of the convergence and the refractive state of the eye to the presentation position of the three-dimensional object, and examining “the mismatch between the refractive state of the eye and the convergence”.

  Further, as a display that does not cause eyestrain, there is a method of presenting a left-eye image and a right-eye image that directly depends on the state of eye adjustment or convergence of the observer.

  Further, there is a method of obtaining parallax correction when the focal position of both eyes is obtained from the pupil interval and the range of “mismatch between adjustment and convergence” is entered. There is a method of obtaining a warning point by determining a fatigue state when a gazing point of both eyes is obtained from an inter-iris interval, and time integration is performed and a threshold value is exceeded.

Japanese Patent No. 42223314 Japanese Patent No. 377964 JP 2004-333661 A JP 2006-267578 A

  The conventional technology monitors the eyeball's convergence adjustment state and observes fatigue during viewing. Here, FIG. 1 is a diagram for explaining the mismatch of the congestion adjustment. In FIG. 1, a stereoscopic image with crossing parallax is displayed on the screen 10 of the display. In the case shown in FIG. 1, the left picture 11 enters the right eye R <b> 1 and the right picture 12 enters the left eye L <b> 1, and as a result of forming an image in the brain, the stereoscopic image 13 is localized at a position protruding from the screen 10. It shows that

  At this time, the focus (adjustment) of the eyes is in the image on the screen 10 for both the left eye L1 and the right eye R1. This function that becomes a cross-over is called congestion.

  When looking at things in nature, focus on what you see with a cross-eyed eye. Since this does not match in a binocular stereoscopic image, it is considered that it leads to a feeling of fatigue that is not felt in a natural thing.

  As described above, the discrepancy in convergence adjustment causes eye strain, but the ease of fatigue varies depending on the person even during the same viewing time. Therefore, the prior art does not take into consideration the applicability of the viewer to stereoscopic vision. Therefore, there has been a problem that personal characteristics for stereoscopic vision cannot be measured.

  Therefore, the disclosed technology has been made in view of the above-described problems, and an object thereof is to provide a measuring device, a stereoscopic image display device, and a measuring method that can appropriately measure personal characteristics for stereoscopic vision. .

The measuring device according to one aspect of the disclosure has a property of removing congestion on one of the images to be controlled after the control for displaying the stereoscopic image by the first image and the second image on the display unit that displays the stereoscopic image with the naked eye. A display control unit that changes to a third image, an imaging unit that captures the eye position of a user who views the image displayed on the display unit, a third image, and the first image before the change to the third image A stereoscopic image display apparatus according to another aspect of the disclosure includes a measuring unit that measures a change in the eye position of a user who views the image or the second image from a captured image captured by the imaging unit. Display control for controlling the display unit to display a stereoscopic image based on the first image and the second image on the display unit, and then changing one of the controlled images to a third image having a property of eliminating congestion Part, third image, third image A measurement unit that measures a change in the eye position of the user who views the first image or the second image before being changed to a captured image captured by the imaging unit, and the display control unit measures by the measurement unit Based on the result, the parallax of the stereoscopic image displayed on the display unit is adjusted.

  According to the disclosed technology, it is possible to appropriately measure personal characteristics for stereoscopic vision.

The figure for demonstrating the mismatch of congestion adjustment. The figure for demonstrating the convergence in binocular vision. The figure for demonstrating the shift | offset | difference of the eye position which generate | occur | produces by removing congestion. The figure which shows an example of a naked-eye binocular display. The figure which shows the example which displays a black image with respect to a right eye, and monitors a right eye. FIG. 2 is a block diagram illustrating an example of a configuration of a measurement apparatus according to the first embodiment. The figure which shows the change of an eye position. The figure which shows an example of the relationship between the change of an eye position, and the pixel on an image. 3 is a flowchart illustrating an example of measurement processing according to the first embodiment. FIG. 9 is a block diagram illustrating an example of a configuration of a stereoscopic image display device according to a second embodiment. The figure showing an example of a personal characteristic file in a table format. The figure which shows an example of parallax adjustment. The figure which shows an example of a parallax angle. The figure which shows the similarity relationship for calculating | requiring the parallax Dd on a screen. The figure which shows an example of parallax adjustment near a depth. The figure which shows an example of the parallax adjustment of popping out. 9 is a flowchart illustrating an example of display control processing (part 1) in the second embodiment. 9 is a flowchart showing an example of display control processing (part 2) in the second embodiment. FIG. 10 is a block diagram illustrating an example of a configuration of a stereoscopic image display device according to a third embodiment. 9 is a flowchart illustrating an example of processing of a stereoscopic image display device according to a third embodiment. The block diagram which shows an example of a structure of the image processing apparatus in a modification.

DESCRIPTION OF SYMBOLS 100 Measuring apparatus 101, 201, 301 Display control part 102 1st memory | storage part 103 Display part 104 Imaging part 105 Measuring part 106,202,303 2nd memory | storage part 200,300 Stereoscopic image display apparatus 201 Display control part 202 2nd memory | storage part 302 Iris Authentication Department

First, the movement of human eyeball convergence will be described. FIG. 2 is a diagram for explaining convergence in binocular vision. In the example shown in FIG. 2, three congestion functions will be described.
(1) Tension congestion Tension congestion refers to congestion caused by light that enters when the eyelids are opened. (2) Adjustable congestion adjustment congestion refers to congestion induced by adjusting the focus.
(3) Fusion vergence Fused vergence refers to vergence in which two left and right images become one in the head.

  It can be said that the convergence function is a function in which the muscles are directed inward in the order of (1), (2), and (3) from the state of spreading outward when there is no tension.

  Next, FIG. 3 is a diagram for explaining a shift in eye position that occurs when congestion is removed. In the example shown in FIG. 3, congestion (for example, fusion convergence) is removed by shielding one eye (for example, the right eye R1) with the shielding plate 21 with both eyes looking at the object 20 at a short distance.

  In this case, it is known that there are people who can keep the eye position as it is, and there are people who loosen the convergence and open to the outside (the direction in which the black eyes leave). The latter person is called oblique. An oblique person performs binocular vision while holding the oblique position with his eye muscles when looking at something close to everyday life. For example, it can be said that a person who has an oblique position is easily tired from the stereoscopic view of popping out.

  By tracking the movement of the eyeball with an image sensor such as a camera, it is possible to measure the eye position shift by the individual. However, in an eyeglass-type solid including an HMD (Head Mounted Display), the eyeball is covered, making it difficult to track the black eye part.

  Therefore, in the embodiment described below, a naked-eye type stereoscopic image display device is used. FIG. 4 is a diagram illustrating an example of an autostereoscopic display. As shown in FIG. 4, a parallax barrier 26 is provided in front of the liquid crystal panel 25. In the liquid crystal panel 25, for example, an image for the left eye is displayed in the odd-numbered column and an image for the right eye is displayed in the even-numbered column, and the image is distributed to the left and right eyes by the parallax barrier 26. The image includes a still image and a moving image (video).

  As shown in FIG. 4, the autostereoscopic type has a characteristic that a comfortable viewing area (location and observation distance) without crosstalk is limited. This is because a stereoscopic image cannot be viewed properly unless it is at an appropriate location and observation distance.

  Therefore, it can be said that in the autostereoscopic image display apparatus, the eyeball position is substantially fixed with respect to the display position. For example, if the portable device is capable of being held in the hand, the restriction of the viewing zone does not feel that much.

  FIG. 5 is a diagram illustrating an example in which a black image is displayed for the right eye and the right eye is monitored. As shown in FIG. 5, convergence (for example, fusion convergence) is removed by making the one-sided image black from the binocular viewing state. The black image is an image having a property of removing congestion in order to block light.

  An image having the property of eliminating congestion is not limited to a black image, and may be a single color image that does not include an object. Further, even a single color image is suitable as a single color image having the same background color as the stereoscopic image displayed immediately before.

  By tracking the state of the black eye in the case shown in FIG. 5 with the camera 30 attached to the stereoscopic image display device with the naked eye, the displacement of the eye position can be measured. In this measurement method, the eye position can be directly observed because the eye is naked. Further, since the viewing area is limited, the distance between the stereoscopic image display device and the eyes is fixed to some extent, so that there is an advantage that it is easy to observe the black eyes with the camera 30.

  As described above, it is possible to measure individual differences in the ease of fatigue of a stereoscopic image. Hereinafter, each Example based on said idea is described based on drawing.

[Example 1]
<Configuration>
FIG. 6 is a block diagram illustrating an example of the configuration of the measurement apparatus 100 according to the first embodiment. The measurement apparatus 100 illustrated in FIG. 6 includes a display control unit 101, a first storage unit 102, an imaging unit 104, a measurement unit 105, and a second storage unit 106. The display control unit 101 is connected to the display unit 103. The display unit 103 may be included in the measurement apparatus 100.

  The display control unit 101 controls the autostereoscopic display unit 103 to acquire, for example, a test image from the first storage unit 102 and display the acquired test image sequentially. Further, the display control unit 101 outputs a timing signal indicating the timing for measuring the eye position to the measurement unit 105 after performing display control of the test image.

  The first storage unit 102 stores test images. The test image is initially an image representing a stereoscopic image with left and right images (also referred to as first and second images). After the stereoscopic image, one image is changed to an image having a property of removing congestion. Image (also referred to as a third image). Alternatively, the test image may be changed to the third image after changing one image to the third image for a predetermined time, and then the other image may be changed to the third image for the predetermined time. This is because the third image is displayed for each of the left and right eyes. As described above, the third image is a monochrome image that does not include an object, and is preferably a black solid image. The third image may be a single color image having the same background color as the first and second images.

  The display unit 103 is a display device that can display a stereoscopic image with the naked eye. The display unit 103 displays an image whose display is controlled by the display control unit 101. The display unit 103 includes, for example, the liquid crystal panel 25 and the parallax barrier 26 described with reference to FIGS.

  The display unit 103 is positioned facing the viewer (user). For example, if the display unit 103 is a part of a portable device, the pixel pitch is small, and the display unit 103 is placed at a position in the viewing zone where the viewer can appropriately hold it. This distance is determined by the performance of the display unit 103.

The imaging unit 104 is, for example, a CCD (Charge
An image sensor having a coupled device (CMOS) or a complementary metal oxide semiconductor (CMOS). The imaging unit 104 is attached to, for example, an upper part of the display unit 103 and images the viewer's eyes (eye position). The imaging unit 104 images the viewer's eyes and outputs the captured image to the measurement unit 105.

  The measurement unit 105 measures a change in the eye position of the black eye from the captured image in synchronization with the timing signal acquired from the display control unit 101. Here, the eye position represents the position of the black eye. The timing signal is output, for example, several seconds after displaying a stereoscopic image, and is output five seconds after changing to the third image.

  The second storage unit 106 stores the measurement result of the eye position by the measurement unit 105.

(Eye position measurement process)
Next, the eye position measurement process by the measurement unit 105 will be described. FIG. 7 is a diagram illustrating changes in eye position. The example illustrated in FIG. 7 illustrates the position of the eyeball imaged by the imaging unit 104.

  FIG. 7A shows a state of black eyes during viewing of a test image of the binocular fusion presented first. Then, one image (the image for the right eye) is made a black image, for example. That is, the congestion of the right eye R2 shown in FIG.

  FIG. 7B shows a state in which the position of the black eye is shifted after the congestion is removed. The black eye of the right eye R3 shown in FIG. 7B is shifted outward from the position of the black eye of the right eye R2 shown in FIG. The measurement unit 105 measures the misalignment of the black eye. This misalignment of the black eye is a change in eye position, and can be represented by, for example, the number of pixels in the image. In general, it is considered that a person whose black eyes are shifted by, for example, 5 degrees or more in angle is not good at stereoscopic viewing.

  FIG. 8 is a diagram illustrating an example of the relationship between changes in eye position and pixels on an image. In the example shown in FIG. 8, the viewing distance Vd = 300 mm, the binocular fusion test image localization position Wd = 220 mm, the interocular distance Ce = 63 mm, and the eyeball diameter Re = 24 mm. Also, the convergence angle θ1 = 16 degrees and the threshold θ2 = 5 degrees. The interocular distance is generally 65 mm, but it is 63 mm here because it is in a crossed eye state.

  At this time, the matching angle θ3 is (θ1 / 2) −θ2 = (16/2) −5 = 3 degrees. Here, using the matching angle and trigonometric function, the change in eye position is calculated as 2.1 mm.

Further, the correspondence between the number of pixels and the width mm is determined from the horizontal angle of view and the horizontal resolution of the imaging unit 104. For example, consider a case where the horizontal field angle is 60 degrees and the horizontal resolution is 1600 pixels. In this case, the ratio Ra between the number of pixels and the width mm is calculated by the following equation.
L1 = 2 × 300 × tan (60/2) (1)
L1 = 200 × √3
The ratio Ra is calculated by L1 / number of pixels.
Ratio Ra = 200 × √3 / 1600 Expression (2)
= 0.216 mm / pixel
Thereby, the number of pixels when the black eye changes by the threshold θ2 = 5 degrees is 2.1 / 0.216 = 9.722, and it can be determined that it corresponds to about 10 pixels. As described above, the measurement unit 105 can represent the displacement of the eye position with the number of pixels.

<Operation>
Next, the operation of the measurement apparatus 100 in the first embodiment will be described. FIG. 9 is a flowchart illustrating an example of the measurement process according to the first embodiment. In step S <b> 101 shown in FIG. 9, the display control unit 101 reads the binocular fusion test image stored in the first storage unit 102 and controls the display unit 103 to display the test image. The test images are, for example, left and right images (first and second images) in which one object is stereoscopically viewed. The display control unit 101 outputs a timing signal notifying the timing for measuring the eye position to the measurement unit 105. The timing signal here is output, for example, several seconds after the stereoscopic image of the test image is displayed, after which the stereoscopic image is recognized.

  In step S102, the display control unit 101 performs, for example, an image (third image) having a property of removing congestion (for example, fusion convergence) after a predetermined time has elapsed since display control of the stereoscopically viewed test image. ) Is read from the first storage unit 102, and one image (for example, the first image) is controlled to be changed to the third image. Here, the third image is a black image. After changing to the third image, the display control unit 101 outputs a timing signal notifying the timing for measuring the eye position to the measurement unit 105. The timing signal here is output, for example, after a predetermined time (for example, 5 seconds) required to remove congestion after the third image of the test image is displayed.

  In step S103, the imaging unit 104 captures and monitors the movement of the viewer's eyes. Images captured at the time of shooting are sequentially output to the measurement unit 105.

  In step S <b> 104, the measurement unit 105 measures the eye position deviation based on the timing signal acquired from the display control unit 101. For example, the measurement unit 105 measures the eye position in synchronization with the timing signals of the first and second images.

  The measuring unit 105 measures the eye position in synchronization with the timing signal of the third image. For example, the measurement unit 105 measures the eye position deviation from the position of the eye position before being changed to the third image and the position of the eye position after being changed to the third image after a predetermined time.

  The predetermined time may be set to a time generally required (for example, 5 seconds) when the eyes are opened outside, for example. The measuring unit 105 measures the positional deviation of the eye position by, for example, taking a difference in the position of the eye position before and after the test image is changed.

  In step S <b> 105, the display control unit 101 returns the image to be displayed to the test image to be stereoscopically viewed for a certain period of time, and then displays the multiple images (for example, the second image) as the third in order to make the stereoscopic view again. Control to change to an image. The timing signal is changed to the third image, and a timing signal notifying the timing for measuring the eye position is output to the measurement unit 105.

  In step S106, the imaging unit 104 captures and monitors the movement of the viewer's eyes. Images captured at the time of shooting are sequentially output to the measurement unit 105.

  In step S <b> 107, the measurement unit 105 measures the eye position deviation based on the timing signal acquired from the display control unit 101. For example, the measurement unit 105 measures the position of the eye position in synchronization with the timing signals of the first and second images, and measures the position of the eye position in synchronization with the timing signal of the third image. The measuring unit 105 measures the positional deviation of the eye position by, for example, taking a difference in the position of the eye position before and after the test image is changed. Thereby, the shift | offset | difference of the eye position for every eye can be measured. The shift in eye position for each eye is stored in the second storage unit 106.

  As described above, according to the first embodiment, it is possible to appropriately measure personal characteristics for stereoscopic vision. In addition, since the viewing area is limited for stereoscopic viewing with the naked eye, the imaging unit 104 can appropriately capture the eye position.

[Example 2]
Next, the stereoscopic image display apparatus in Example 2 will be described. In the second embodiment, the parallax of the stereoscopic image is adjusted using the personal characteristics for the stereoscopic vision measured in the first embodiment. For example, a person who is good at stereoscopic vision is stereoscopically viewed in the pop-out direction, and a person who is not good at stereoscopic vision is stereoscopically viewed in the depth direction.

<Configuration>
FIG. 10 is a block diagram illustrating an example of the configuration of the stereoscopic image display apparatus 200 according to the second embodiment. In the configuration illustrated in FIG. 10, the same configuration as the configuration illustrated in FIG. 6 is denoted by the same reference numeral, and the description thereof is omitted. Hereinafter, the display control unit 201 and the second storage unit 202 will be mainly described. The measurement unit 105 writes the measurement result for each eye in the second storage unit 202.

  The second storage unit 202 stores a personal characteristic file. The personal characteristic file is a file for determining whether or not a person is good at stereoscopic viewing based on the symmetry of the eye position shift for each eye.

  FIG. 11 is a diagram illustrating an example of the personal characteristic file in a table format. As shown in FIG. 11, the amount of deviation is small when the amount of deviation of the eye position is less than the threshold, and the amount of deviation is large when the amount of deviation of the eye position is greater than or equal to the threshold. For example, this threshold is 5 degrees in terms of an angle. The threshold value may be expressed by the number of pixels corresponding to the angle.

  Further, it is possible to determine whether a person is poor in stereoscopic vision or weak in stereoscopic vision depending on whether or not the amount of deviation between the left and right eyes is symmetrical. When there is symmetry, “good”, and when there is no symmetry, “bad”.

  For example, when both the right and left eye positions are small and symmetrical, it is possible to determine that they are good at stereoscopic viewing and are less likely to feel eye strain in the stereoscopic display. In this case, since he is good at stereoscopic viewing, the parallax between the left and right images may be adjusted in the pop-out direction (close to the pop-out).

  In addition, when there is a large amount of misalignment between the right and left eye positions, stereoscopic vision is possible, but it can be determined that eye strain is easily felt in the stereoscopic display. In this case, since stereoscopic vision is not good, the parallax between the left and right images may be adjusted in the depth direction (close to the depth).

  Note that the adjustment for jumping out means that the left image is shifted to the right and the right image is shifted to the left to add crossing parallax. Further, the adjustment closer to the depth means shifting the left image to the left and the right image to the right to add an ipsilateral parallax.

  For example, when the displacement between the left and right eye positions is “large” on one side and “small” on the other side, it can be determined that the person is visually impaired. In this case, it is possible to take measures such as calling attention to stereoscopic display.

  The second storage unit 202 stores a personal characteristics file (a small deviation is good, a large deviation is good, or a bad) using the individual eye position deviation amount, which is determined as shown in FIG. You may make it leave.

  Returning to FIG. 10, the display control unit 201 measures the displacement of the eye position for each eye as in the first embodiment. The display control unit 201 calculates the parallax of the stereoscopic video (for example, a television program, a movie, etc.) input to the display control unit 201 based on the measurement result (personal characteristics with respect to stereoscopic vision) stored in the second storage unit 202. adjust.

  FIG. 12 is a diagram illustrating an example of parallax adjustment. In the example shown in FIG. 12, the image 41 shows a left image, and the image 42 shows a right image. When adjusting the stereoscopic image in the pop-out direction, the display control unit 201 shifts the left image 41 to the right, shifts the right image 42 to the left, and adjusts the parallax so that the stereoscopic image 43 is obtained.

  When adjusting the stereoscopic image in the depth direction, the display control unit 201 shifts the left image 41 to the left and the right image 42 to the right so that the stereoscopic image 44 is obtained. Note that the adjustment amount may be adjusted within a predetermined value determined by the guideline for stereoscopic display in both the pop-out direction and the depth direction.

  The display control unit 201 makes it possible to switch between 2D (Dimension) display, shorten the viewing time, and pay attention to the viewing itself when the left-right eye position is not symmetrical and “stereoscopic attention” is set. Display control such as subtitle telop.

(Parallax adjustment processing)
Next, the parallax adjustment process in the display control unit 201 will be described with reference to FIGS. FIG. 13 is a diagram illustrating an example of the parallax angle. In the examples shown in FIGS. 13 to 16, the viewing distance Vd = 300 mm, the eyeball diameter Re = 24 mm, and the interocular distance Ce when viewing the display surface is 64 mm.

  At this time, the angle β for matching the display unit 103 (display) is 12.2 degrees. Furthermore, if a condition of within ± 1 degree of parallax is added as the parallax condition of the stereoscopic image content to be displayed, α = 13.2 degrees and γ = 112 degrees.

Here, the stereo localization positions Pn and Pp at the parallax angles α and γ are considered. The base Be of a triangle formed by the display unit 103 and the fundus of the eyeball is obtained by the following equation.
Be = 64 × (Vd + Re) /Vd=69.1 (mm) (3)
When a right triangle formed by lowering the base Be of an isosceles triangle that forms an angle of α (or γ) with the base Be of this triangle, the following equation is established.
(Be / 2) / (Vd−Pn + Re) = tan (13.2 / 2) (4)
Thereby, Pn is calculated | required with 25.3 mm.

Similarly, when a parallax angle γ and a right triangle are used, the following equation is established.
(Be / 2) / (Vd + Pp + Re) = tan (11.2 / 2) (5)
Thereby, Pp is calculated | required with 28.5 mm.

FIG. 14 is a diagram illustrating a similarity relationship for obtaining the on-screen parallax Dd. The disparity Dd on the screen at the localization position Sd shown in FIG. 14 has the following relationship using the triangle similarity between the dotted-line frame triangle 51 and the diagonal triangle 52.
Dd = Be × Sd / (Vd + Sd + Re) (6)
This equation (6) represents the time of jumping out when Sd <0. When Sd = −Pn, Dd = −5.85, and when Sd = Pp, Dd = 5.59.

  FIG. 15 is a diagram illustrating an example of parallax adjustment closer to the depth. When the parallax is adjusted closer to the depth as in the example illustrated in FIG. 15, for example, the display control unit 201 adjusts the parallax so that the position of half of Pn becomes the surface of the display unit 103. In this case, Sd = −Pn / 2 is substituted and Dd = −2.82.

When the display control unit 201 adjusts the parallax so as to set this Dd to 0 (+2.82), when the parallax amount Dd at the farthest localization position is 5.59 + 2.82 = 8.41 Sd is obtained from the equation.
8.41 = Be × Sd / (Vd + Sd + Re) (7)
Sd is 44.8, which is larger than Pp, so the depth is certainly increasing.

  FIG. 16 is a diagram illustrating an example of parallax adjustment close to popping out. When the parallax is adjusted closer to the pop-out as in the example illustrated in FIG. 16, for example, the display control unit 201 adjusts the parallax so that the position of half of Pp becomes the surface of the display unit 103. In this case, Sd = Pp / 2 is substituted and Dd = 2.92.

When the display control unit 201 adjusts the parallax so that this Dd is set to 0 (−2.92), the parallax amount Dd at the most localized position is −5.85−2.92 = −8.77. In this case, Sd is obtained from the following equation.
−8.77 = Be × (−Sd) / (Vd−Sd + Re) (8)
Since Sd is 36.22, which is larger than Pn, the pop-out certainly increases.

<Operation>
Next, the operation of the stereoscopic image display apparatus according to the second embodiment will be described. The stereoscopic image display apparatus according to the second embodiment performs measurement processing similar to that of the first embodiment, and performs stereoscopic image display control processing based on the measurement result. Hereinafter, the stereoscopic image display control process will be described. A plurality of stereoscopic image display control processes in the second embodiment can be considered, but two examples will be described below.

(Display control processing (part 1))
FIG. 17 is a flowchart illustrating an example of display control processing (part 1) in the second embodiment. In step S <b> 201 shown in FIG. 17, the display control unit 201 reads the measured personal characteristics (measurement result) of the viewer's stereoscopic vision from the second storage unit 202.

  If the read measurement result is, for example, “large deviation and good” and indicates an adjustment closer to the depth, the display control unit 201 newly sets 0 parallax at a position (Sd <0) before the display unit 103. The localization position Sd to be determined is determined.

  If the read measurement result is “small and good” and shows an adjustment of the pop-up, the display control unit 201 is positioned to be newly set to 0 parallax at a position (Sd> 0) behind the display unit 103. The position Sd is determined.

  In step S202, the display control unit 201 obtains the parallax amount Dd on the screen of Sd by Expression (6).

  In step S <b> 203, the display control unit 201 converts Dd into a pixel value on the screen of the display unit 103 based on the size and resolution of the display unit 103. The display control unit 201 can obtain a pixel value based on the idea of Expression (1) or Expression (2).

  In step S204, if the calculated number of pixels is negative, the display control unit 201 shifts the left and right images in the same direction by half the number of pixels. If the obtained number of pixels is positive, the display control unit 201 shifts the left and right images in the crossing direction by half the number of pixels.

  Note that, when the measurement result indicates “defective”, the display control unit 201 may perform control so as to call attention such as enabling switching to 2D display or shortening the viewing time.

(Display control processing (part 2))
FIG. 18 is a flowchart illustrating an example of display control processing (part 2) in the second embodiment. The process illustrated in FIG. 18 is a process of adjusting the parallax amount according to the eye position shift (change amount).

  In step S <b> 301 illustrated in FIG. 18, the display control unit 201 reads the amount of change in the left and right eye positions from the second storage unit 202. Here, the change amount of the left eye position is Δ (L), and the change amount of the right eye position is Δ (R).

  The display control unit 201 determines whether or not the change amounts Δ (L) and Δ (R) are symmetric. As described above, the determination of symmetry is determined to be symmetric when the values are smaller than the threshold or larger than the threshold, and the case where one is smaller than the threshold and the other is larger than the threshold is asymmetric. If it is symmetric (step S301-YES), it will progress to step S302, and if it is non-object (step S301-NO), it will progress to step S306.

In step S302, the display control unit 201 obtains a localization position Sd that is to be newly set to 0 parallax by the following equation.
Sd = −K × (eye position change amount Δ−threshold Th) Expression (9)
K: Constant eye position change amount Δ: Eye position change amount Δ (L) and Δ (R) having a larger threshold value Th: In the example shown in FIG. 8, a displacement of 2.1 mm corresponding to 5 degrees is converted into a pixel. Value Note that the constant K is an amount of protrusion with a parallax angle of 1 degree in consideration of the fact that the eye position change amount Δ is 8 degrees at maximum (parallel viewing), as explained in the example shown in FIG. Determine as follows. Further, the eye position change amount Δ may be an average of Δ (L) and Δ (R).

  Steps S303 to S305 are the same as the processes from step S202 to step S204.

  In step S306, the display control unit 201 performs control so as to display, for example, a screen that urges the viewer to call attention to stereoscopic viewing because the change amount of the left and right eye positions is asymmetric.

  With the above processing, the display control unit 201 sets the parallax adjustment amount so that the localization position where Sd <0 is 0 parallax on the display unit 103 when the eye position change amount is larger than the threshold value of 5 degrees. It can be variably controlled. On the other hand, the display control unit 201 changes the parallax adjustment amount according to the eye position change amount so that the position where the eye position change amount is smaller than the threshold value is 0 parallax on the display unit 103 at the localization position where Sd> 0. Can be controlled.

  As described above, according to the second embodiment, the parallax of the stereoscopic image can be adjusted using the personal characteristics with respect to the stereoscopic vision measured in the first embodiment. For example, a person who is good at stereoscopic vision can be stereoscopically viewed in the pop-out direction, and a person who is not good at stereoscopic vision can be stereoscopically viewed in the depth direction. Further, according to the second embodiment, the amount of parallax can be adjusted according to the amount of change in eye position.

[Example 3]
Next, the stereoscopic image display apparatus 300 in Example 3 will be described. In the third embodiment, personal authentication is performed using the iris of the eye in the captured image, and the iris and the measurement result (personal characteristic) are associated and managed.

<Configuration>
FIG. 19 is a block diagram illustrating an example of a configuration of the stereoscopic image display apparatus 300 according to the third embodiment. In the stereoscopic image display device 300 shown in FIG. 19, the same reference numerals are given to the same components as those in FIG. 6, and description thereof is omitted.

  The iris authentication unit 302 acquires a captured image captured by the imaging unit 104, accesses the second storage unit 303 using the eyes included in the captured image, and performs iris authentication. A known technique may be used for the iris authentication process. The second storage unit 303 includes, for example, a personal authentication database using irises.

  When the iris authentication is successful and the measurement result is associated with the iris, the iris authentication unit 302 acquires the measurement result and outputs it to the display control unit 301. The phrase “successful iris authentication” refers to a case where the iris is already stored in the second storage unit 303.

  The iris authentication unit 302 requests the display control unit 301 to display a test image when the measurement result is not associated even when the authentication is successful or when an iris is newly registered.

The second storage unit 303 manages iris authentication information and measurement results in association with each other.
For example, the second storage unit 303 manages the iris, personal information, and personal characteristics of the individual with respect to stereoscopic vision in association with each other.

  When receiving a test image display request from the iris authentication unit 302, the display control unit 301 controls the display of the test image as described above. Thereby, the measurement of the personal characteristics starts, and the subsequent processing is as described in the second embodiment.

  When the display control unit 301 acquires the measurement result from the iris authentication unit 302, the display control unit 301 adjusts the parallax of the stereoscopic image input based on the measurement result.

<Operation>
Next, the operation of the stereoscopic image display apparatus 300 according to the third embodiment will be described. FIG. 20 is a flowchart illustrating an example of processing of the stereoscopic image display apparatus 300 according to the third embodiment.

  In step S <b> 401 illustrated in FIG. 20, the imaging unit 104 captures the vicinity of the viewer's eyes, and outputs the captured image to the iris authentication unit 302.

  In step S402, the iris authentication unit 302 performs iris authentication based on the iris included in the captured image.

  In step S <b> 403, the iris authentication unit 302 determines whether a measurement result for the authenticated iris is in the second storage unit 303. If the measurement result is stored (step S403-YES), the process proceeds to step S405. If the measurement result is not stored (step S403-NO), the process proceeds to step S404.

  In step S404, the measurement process shown in FIG. 9 is performed.

  In step S405, the display control process shown in FIG. 17 or 18 is performed. Which display control processing is performed may be set in the display control unit 301 in advance.

  As described above, according to the third embodiment, if the measurement result is already stored in association with the iris by performing the iris authentication, the measurement process may not be performed every time. Moreover, although the iris authentication part demonstrated the example with which Example 2 is provided, you may make it provide with the measuring apparatus in Example 1. FIG.

[Modification]
FIG. 21 is a block diagram illustrating an example of the configuration of the image processing apparatus 400 according to the modification. As illustrated in FIG. 21, the image processing apparatus 400 includes a control unit 401, a main storage unit 402, an auxiliary storage unit 403, a drive device 404, an input unit 406, a display control unit 407, and an imaging unit 408. These components are connected to each other via a bus so as to be able to transmit and receive data.

  The control unit 401 is a CPU that controls each device, calculates data, and processes in a computer. The control unit 401 is an arithmetic device that executes a program stored in the main storage unit 402 or the auxiliary storage unit 403. The control unit 401 receives data from the input unit 406 or the storage device, calculates, and processes the display control unit. 407 and the storage device.

  In addition, the control unit 401 executes a measurement processing program or a display control processing program stored in the auxiliary storage unit 403 or the like, and performs the processing described in the embodiment.

The main storage unit 402 is a ROM (Read Only
Memory) and RAM (Random
Access Memory), which is a storage device that stores or temporarily stores programs and data such as OS (Operating System) and application software, which are basic software executed by the control unit 401.

  The auxiliary storage unit 403 is an HDD (Hard Disk Drive) or the like, and is a storage device that stores data related to application software or the like.

  The drive device 404 reads the program from the recording medium 405, for example, a flexible disk, and installs it in the storage device.

  A predetermined program is stored in the recording medium 405, and the program stored in the recording medium 405 is installed in the image processing apparatus 400 via the drive device 404. The installed predetermined program can be executed by the image processing apparatus 400.

  The input unit 406 includes a keyboard having cursor keys, numeric input, various function keys, and the like, and a mouse and a slice pad for performing key selection on the display screen of the display unit. An input unit 406 is a user interface for a user to give an operation instruction to the control unit 401 or input data.

The display control unit 407 is an LCD (Liquid
For a display unit such as Crystal Display), display processing corresponding to display data input from the control unit 401 is controlled. The processing of the display control unit 407 may be processing by the control unit 401.

The imaging unit 408 is, for example, a CCD (Charge
For example, a captured image including left and right eyes is generated. For the captured image captured by the image capturing unit 408, the control unit 401 measures the eye position shift described in each embodiment.

  The image processing device 400 is, for example, a display device having a camera, a mobile terminal device, or the like. The image processing apparatus 400 may be a portable information processing apparatus having an autostereoscopic display function that includes the imaging unit 408.

  In each embodiment, the explanation was made using a naked-eye binocular system. However, even in the case of a multi-view system, if the binocular video data can be divided into multi-view display pixels and displayed, the binocular system is used. It is not limited.

  The measurement unit and the display control unit described in each embodiment described above can be realized by the control unit 401, for example. In addition, each unit in each embodiment can be implemented as one or a plurality of semiconductor integrated circuits in a portable terminal device, a photographing device, an information processing device, or the like.

  Further, by recording a program for realizing the measurement process and the display control process described in the above-described embodiment on a recording medium, the measurement process and the display control process in the embodiment can be performed by a computer.

  It is also possible to record the program on a recording medium and cause the computer or portable terminal device to read the recording medium on which the program is recorded to realize the above-described processing. The recording medium is a recording medium for recording information optically, electrically or magnetically, such as a CD-ROM, flexible disk, magneto-optical disk, etc., and information is electrically recorded such as ROM, flash memory, etc. Various types of recording media such as a semiconductor memory can be used.

  Although the embodiments have been described in detail above, the invention is not limited to the specific embodiments, and various modifications and changes can be made within the scope described in the claims. It is also possible to combine all or a plurality of the components of the above-described embodiments.

Claims (9)

After the control for displaying the stereoscopic image by the first image and the second image on the display unit that displays the stereoscopic image with the naked eye, the one image to be controlled is changed to the third image having the property of removing the congestion. A display control unit;
An imaging unit for imaging the eye position of a user who views the image displayed on the display unit;
A measurement unit that measures a change in the eye position of the user who views the third image and the first image or the second image before being changed to the third image, from a captured image captured by the imaging unit. When,
A measuring apparatus comprising:   The measuring apparatus according to claim 1, wherein the third image is a black monochromatic image.   The measuring apparatus according to claim 1, wherein the third image is a single-color image having the same color as a background of the first and second images. A display unit for displaying a stereoscopic image with the naked eye;
A display control unit that changes the one image to be controlled to a third image having a property of removing congestion after performing control to display a stereoscopic image by the first image and the second image on the display unit;
A measurement unit that measures a change in the eye position of the user who views the third image and the first image or the second image before being changed to the third image, from a captured image captured by the imaging unit. And comprising
The display control unit
A stereoscopic image display device that adjusts a parallax of a stereoscopic image to be displayed on the display unit based on a measurement result by the measurement unit. The display control unit
The stereoscopic image display apparatus according to claim 4, wherein the parallax is adjusted so that the stereoscopic image is stereoscopically viewed based on the measurement result when the changes in the eye positions of the left and right eyes are symmetrical. The display control unit
When the change in the eye position of the left and right eyes is smaller than a predetermined value and symmetric, the parallax is adjusted so that the stereoscopic image is stereoscopically viewed in the direction of popping out, and the change in the eye position of the left and right eyes The stereoscopic image display apparatus according to claim 5, wherein the parallax is adjusted so that the stereoscopic image is stereoscopically viewed in the depth direction when the value is larger than the value and symmetric. A storage unit for storing the iris and the measurement result in association with each other;
An authentication unit that performs authentication using the iris in the captured image and, when the measurement result corresponding to the iris is not stored in the storage unit, further includes an authentication unit that makes a display request to the display control unit;
The display control unit
The solid according to any one of claims 4 to 6, wherein when a display request is received from the authentication unit, the display unit is controlled to display the first image, the second image, and the third image. Image display device. The authentication unit
The measurement result corresponding to the iris is acquired from the storage unit when the measurement result corresponding to the iris in the captured image is stored in the storage unit, and the measurement result is output to the display control unit. 7. The stereoscopic image display device according to 7. After the control for displaying the stereoscopic image with the first image and the second image on the display unit that displays the stereoscopic image with the naked eye, the one image to be controlled is changed to the third image having a property of removing the congestion. ,
Imaging the eye position of the user who sees the image displayed on the display unit by the imaging unit,
A process of measuring a change in the eye position of the user who views the third image and the first image or the second image before being changed to the third image from a captured image captured by the imaging unit. A measurement method performed by a computer.

Images