JP6944110B2 - Display device and display method - Google Patents

Description

The present invention relates to a display device and a display method.

When an observer uses glasses to observe an image displayed on a display device such as a camera finder or a head-mounted display, the observer's glasses may hit the display device and interfere with the display device. Therefore, there is a display device that corrects the focal length of the lens provided in the display device according to the diopter of the observer so that the observer can observe the image displayed on the display device without using glasses. Further, a display device using a varifocal lens that does not use a mechanical mechanism has been developed (see Patent Document 1).

Japanese Unexamined Patent Publication No. 2000-224614

However, although conventional display devices can correct diopters other than normal astigmatism such as myopia and hyperopia, it is necessary to add an expensive and fragile mechanical optical system called an optical system with an adjustable focal length. rice field. Further, even if a non-mechanical variable focus lens is used, there is a problem that even if diopters other than normal astigmatism such as hyperopia and myopia can be corrected, diopters including normal astigmatism cannot be corrected. ..

In view of the above circumstances, it is an object of the present invention to provide a display device and a display method capable of correcting diopters including normal astigmatism.

One aspect of the present invention is a value acquisition unit that acquires a diopter correction value, an image processing unit that generates a display image from a plurality of images based on the correction value, and the above, depending on the position in the pupil of the observer. It is a display device including a display unit that displays the display image so that the mixing ratio of the plurality of images is different.

One aspect of the present invention is the above-mentioned display device, in which the mixing ratio changes linearly depending on the position in the pupil.

One aspect of the present invention is the display device, in which the display unit changes the mixing ratio by outputting the light of the display image to a barrier having an opening.

One aspect of the present invention is the display device, wherein the image processing unit responds to an angle formed by a straight line connecting the pupils of both eyes of the observer and the horizontal direction of the screen of the display unit. The tilt of the plurality of mixed images is corrected.

One aspect of the present invention is the display device, wherein the image processing unit shifts the display position of one or more of the images according to the correction value, and is generated from the image in which the display position is shifted. The display image is output to the display unit.

One aspect of the present invention is the display device, wherein the image processing unit generates a plurality of weighted average images, which are the plurality of images weighted and averaged based on the correction value, and the plurality of weighted images. The average image is output to the display unit as the display image.

One aspect of the present invention is a display method executed by a display device, which includes a step of acquiring a correction value of diopter, a step of generating a display image from a plurality of images based on the correction value, and an observer's step. This is a display method including a step of displaying the display image so that the mixing ratio of the plurality of images differs depending on the position in the pupil.

According to the present invention, it is possible to correct diopters including normal astigmatism.

It is a figure which shows the example of the structure of the display device. It is a figure which shows the example of the structure of the display part. It is a figure which shows the example of the surface lattice. It is a figure which shows the positional relationship between a pixel block and an opening. It is a figure which shows the example of the mixing ratio of incident light. It is a figure which shows the example of the mixing ratio of the incident light in a horizontal direction. It is a figure which shows the example of the mixing ratio of the incident light in the vertical direction. It is a figure which shows the example of the mixing ratio of the incident light in an oblique direction. It is a figure which shows the example of the relationship between the contour position of the display image perceived when image A and image B which are two images are linear blended, and the weighting coefficient of an image. It is a figure which shows the 1st example of the relationship between a perceptual image and a focal position. It is a figure which shows the 2nd example of the relationship between a perceptual image and a focal position. It is a figure which shows the example which displays a plurality of images mixed according to a correction value in each pixel of a pixel block. It is a figure which shows the example of the response of the focus adjustment.

Embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing an example of the configuration of the display device 10. In FIG. 1, a display device 10 having a two-dimensional screen is provided with a barrier in front of the display device 10 when viewed from an observer (not shown). The observer sees the image displayed on the display device 10 through the barrier. In FIG. 1, the observer is looking directly at the screen, but it is existing that the distance from the observer to the display device 10 can be shortened by inserting a lens between the barrier and the observer, and a small display device can be configured. It is similar to the viewfinder and head-mounted display of.

The display device 10 includes an image mixing means composed of a personal computer or the like. The observer inputs the correction value of the diopter with the keyboard and sets the correction value in a personal computer or the like. The display device 10 acquires a plurality of image data with a capture card, mixes the image data at a predetermined ratio, and displays the image data.

In other words, the display device 10 is a device that displays an image. For example, the display device 10 is a camera finder, a head-mounted display device, and the like. In the following, the xyz coordinate system is conveniently defined for the display device 10. In FIG. 1, the plane determined by the x-axis and the z-axis is a horizontal plane. In FIG. 1, the observer (not shown) is located in the positive direction of the z-axis with respect to the display device 10. The observer directs his / her line of sight in the negative direction of the z-axis and observes the image displayed on the display device 10.

The display device 10 includes an image acquisition unit 11, a value acquisition unit 12, an image processing unit 13, a display unit 14, and a surface grid 15. The display device 10 may further include a detection unit 16. A part or all of the image acquisition unit 11, the value acquisition unit 12, and the image processing unit 13 is realized by, for example, a processor such as a CPU (Central Processing Unit) executing a program stored in the storage unit. NS. A part or all of the image acquisition unit 11, the value acquisition unit 12, and the image processing unit 13 may be realized by using hardware such as LSI (Large Scale Integration) or ASIC (Application Specific Integrated Circuit). The storage unit is, for example, a non-volatile recording medium (non-temporary recording medium) such as a flash memory or an HDD (Hard Disk Drive). The storage unit may have, for example, a volatile recording medium such as a RAM (Random Access Memory) or a register. The storage unit may store the image.

The display device 10 may further include a lens between the screen of the display device 10 and the observer. A lens provided between the screen of the display device 10 and the observer refracts the light incident on the observer's eyes from the screen of the display device 10. As a result, the lens provided between the screen of the display device 10 and the observer is the screen of the display device 10 as compared with the case where the lens is not provided between the screen of the display device 10 and the observer. And the distance between the observer and the observer can be shortened.

When the distance between the screen of the display device 10 and the observer is not more than a predetermined distance, the size of the display device 10 is small as a finder or a head-mounted display device. The display device 10 as a head-mounted display device is attached to the observer's head, for example.

The image acquisition unit 11 is a capture card for a moving image or a still image. The image acquisition unit 11 acquires a plurality of images. For example, the image acquisition unit 11 may acquire a plurality of images including a subject image captured from the same time and the same direction. The image acquisition unit 11 may acquire an image by computer graphics. The image acquisition unit 11 outputs a plurality of images to the image processing unit 13.

The value acquisition unit 12 includes operation units such as a keyboard, a touch panel, and a mouse. The operation unit accepts operations by the observer. The value acquisition unit 12 acquires a correction value δ for diopter such as regular astigmatism according to the operation received by the operation unit. The value acquisition unit 12 outputs the diopter correction value δ to the image processing unit 13.

The image processing unit 13 performs image processing on a plurality of images acquired by the image acquisition unit 11. The image processing unit 13 generates one display image for each of the plurality of images by executing an image process of mixing the plurality of images at a predetermined ratio as one of the image processes. The image processing unit 13 may generate a plurality of display images for each of the plurality of images acquired by the image acquisition unit 11. The image processing unit 13 displays on the screen of the display unit 14 an image in which the display positions on the screen of the display unit 14 are deviated from each other by a predetermined distance. The predetermined distance (deviation amount) is, for example, a distance proportional to the diopter correction value δ. The image processing unit 13 outputs the generated display image to the display unit 14.

FIG. 2 is a diagram showing an example of pixels of the display device 10. The screen of the display device 10 is, for example, a field sequential color display type liquid crystal display. Each of the primary colors of red, green, and blue is displayed in one pixel with time division and gradation.

In FIG. 2, the pixel block 140 is composed of 2 × 2 pixels, but the pixel block 140 may be composed of pixels such as (3 × 3) or (4 × 4), for example, and the observer. It may be composed of pixels asymmetrically arranged according to the movable range of the eye. The range of correction can be increased by increasing the number of pixels in the pixel block 140.

Further, the pixel arrangement does not have to be square, and may be a delta arrangement. By slightly reducing the entire mask of the screen, the distance from the observer to the screen, which satisfies the condition that the center of the pixel block 140 can be seen through the openings for all the openings, may be approached from infinity to the viewing distance.

In other words, FIG. 2 is a diagram showing an example of the configuration of the display unit 14. The display unit 14 displays the display image generated by the image processing unit 13 on the screen. The display unit 14 includes a plurality of pixel blocks 140 as a screen. The display unit 14 may include a surface grid 15. That is, the surface grid 15 may be a part of the display unit 14. The screen of the display unit 14 has, for example, a light emitting unit (backlight) and a liquid crystal panel. The plurality of pixel blocks 140 are arranged in a matrix (tile shape) on the display unit 14. In the following, the pixel block 140 (pixel group) is composed of 2 × 2 pixels as an example. The shape of the pixel is, for example, a square.

Pixels adjacent to each other in the x-axis or y-axis direction may be pixels that form different images. That is, the displayed image may be composed of each pixel to which the same number is assigned. For example, each pixel assigned the number "11" in FIG. 2 may constitute an image A. For example, each pixel assigned the number "01" in FIG. 2 may constitute an image B.

The pixel array may be a delta array. Pixels may be arranged asymmetrically on the left and right in consideration of the range of motion of the eye. The pixel block 140 may be composed of, for example, 3 × 3 pixels or 4 × 4 pixels. By increasing the number of pixels in the pixel block 140, the range of diopter correction is expanded.

The display unit 14 is, for example, a field sequential color display type liquid crystal display. In the field sequential color display method, the pixels display images of the primary colors of red, green, and blue in a time-division manner.

FIG. 3 is an explanatory diagram showing an example of the barrier of the display device 10. In FIG. 3, a black region indicates a light-shielding portion, and a white region indicates a transmission portion (opening). The shape of the opening 150 is a square having the same shape as the pixel.

In other words, FIG. 3 is a diagram showing an example of the surface grid 15 (image mixing unit). The surface grid 15 (light-shielding filter) is a barrier having a plurality of openings 150 arranged in a matrix. The shape of the opening 150 is determined according to the shape of the pixel. For example, the shape of the opening 150 is a square having the same size as a pixel. In the surface grid 15, each opening 150 is a portion through which light can be transmitted. The portion of the surface grid 15 other than each opening 150 is a portion (light-shielding portion) through which light cannot be transmitted. The surface grid 15 may have not only a shape in which light-shielding portions are arranged in both the x-axis direction and the y-axis direction, but also a shape in which light-shielding portions are arranged in either the x-axis direction or the y-axis direction.

In the barrier shown in FIG. 3, the opening 150 is aligned with the central position of the pixel block 140 composed of 2 × 2 pixels. The four pixels of the numbers "00", the number "10", the number "01", and the number "11" shown in FIG. 2 form a set of four pixels to form the pixel block 140. The observer observes the pixel block 140 composed of 2 × 2 pixels through the opening 150 as shown in FIG.

In other words, FIG. 4 is a diagram showing the positional relationship between the pixel block 140 and the opening 150. The surface grid 15 is arranged between the observer and the display unit 14. Thereby, the observer can observe the portion of the pixel block 140 by the light transmitted through the opening 150. In FIG. 4, the observer can observe the center of the pixel block 140 as an example, and cannot observe other than the center of the pixel block 140. That is, in FIG. 4, the observer outputs the light output from the portion of the pixel 141, the light output from the portion of the pixel 142, the light output from the portion of the pixel 143, and the light output from the portion of the pixel 144. You can observe the light mixed with the light. The surface grid 15 mixes the image composed of the plurality of pixel blocks 140 so that the mixing ratio changes linearly according to the position in the pupil of the observer.

If the display device 10 uses an eye tracker or the like to detect the inclination of the position of the observer's eyes and the image processing unit 13 performs correction corresponding to the inclination, the correct diopter even if the posture of the observer changes. Can be corrected.

The detection unit 16 (eye tracker) detects the positions of the observer's eyes with respect to the display device 10. The detection unit 16 detects the inclination of the line connecting both eyes of the observer and the predetermined direction. For example, the detection unit 16 detects the inclination of the line connecting both eyes of the observer and the x-axis direction (horizontal direction). For example, the detection unit 16 detects the inclination of the line connecting both eyes of the observer and the y-axis direction (vertical direction). The image processing unit 13 shifts the position of the image in the direction corresponding to the inclination. As a result, the display device 10 can correct the diopter according to the inclination of the astigmatic axis of both eyes of the observer even if the posture of the observer with respect to the display device 10 changes.

As shown in FIG. 5, when the viewpoint position in the pupil 100 of the eye moves, the position of the opening 150 apparently moves on the screen, and the area ratio of the pixels seen through the opening 150 changes. The mixing ratio (blending condition) changes according to the area ratio of the pixels.

In other words, FIG. 5 is a diagram showing an example of a mixing ratio of incident light. In the following, a coordinate system including a ux axis, a ui axis, and a uz axis is conveniently defined on the surfaces of the observer's pupil 100 and the iris 101. The ux axis and the x axis are oriented in the same direction. The ui axis and the y axis are oriented in the same direction. The uz axis and the z axis are oriented in the same direction.

The light output from the pixel block 140 passes through the opening 150 and enters the observer's pupil 100 and the iris 101. The light incident on the pupil 100 from the pixel block 140 differs depending on the positions of the observer's pupil 100 and the iris 101 on the surface. That is, the mixing ratio of the incident light transmitted through the opening 150 changes depending on the positions of the observer's pupil 100 and the iris 101 on the surface. For example, a combination of pixels observed by the observer through the opening 150 and an area of pixels observed by the observer through the opening 150, depending on the position of the observer's pupil 100 and iris 101 on the surface. The brightness (incident light amount) changes as the mixing ratio changes according to the ratio.

In FIG. 5, the range of the angle formed by the incident light 110 and the incident light 112 is the range in which the light incident on the pupil 100 is mixed. That is, the range of the angle formed by the incident light 110 and the incident light 112 is the range in which the display image is blended in the pupil 100. In FIG. 5, the incident light 110 includes the light output by the pixel 143-1 and the light output by the pixel 144-1 in a mixing ratio of “100: 0”. The incident light 111 includes the light output by the pixel 143-1 and the light output by the pixel 144-1 in a mixing ratio of "50:50". The incident light 111 includes the light output by the pixel 143-1 and the light output by the pixel 144-1 at a mixing ratio of "0: 100".

The distance at which the apparent area (viewing angle) of the opening 150 and the apparent area (viewing angle) of the pixels are equal can be brought closer to the viewing distance from infinity by slightly reducing the entire screen mask. You may.

FIG. 6 is a diagram showing a mixing ratio in which each pixel of the pixel block 140 contributes when the apparent position of the opening 150 is moved by one pixel in the x-axis direction. FIG. 6 shows that linear blending is realized because the mixing ratio changes linearly when the apparent position of the opening 150 moves according to the viewpoint position in the pupil 100. ing.

In other words, FIG. 6 is a diagram showing an example of a mixing ratio of incident light in the horizontal direction (x-axis direction). The horizontal axis indicates the apparent position of the opening 150 in the x-axis direction shown in FIG. The apparent position of the opening 150 changes depending on the position in the horizontal direction (ux axis direction) on the surfaces of the observer's pupil 100 and the iris 101. The vertical axis shows the mixing ratio of the apparent area of each pixel of the pixel block 140.

The straight line 200 represents the addition result of half of the apparent area of the pixel 141-1 and half of the apparent area of the pixel 143-1. The straight line 201 represents the addition result of half of the apparent area of the pixel 142-1 and half of the apparent area of the pixel 144-1. In FIG. 6, the mixing ratio changes linearly depending on the positions of the observer's pupil 100 and the iris 101 on the surface. As a result, horizontal linear blending (linear blending) of the image is realized in the pupil of the observer.

The mixing ratio shown in FIG. 7 for the case where the viewpoint position changes in the y-axis direction is the same as the mixing ratio shown in FIG. 6 for the case where the viewpoint position changes in the x-axis direction.

FIG. 7 is a diagram showing an example of a mixing ratio of incident light in the vertical direction (y-axis direction). The horizontal axis indicates the apparent position of the opening 150 in the x-axis direction shown in FIG. The apparent position of the opening 150 changes depending on the position in the vertical direction (uy axis direction) on the surfaces of the observer's pupil 100 and the iris 101. The vertical axis shows the mixing ratio of the apparent area of each pixel of the pixel block 140.

The straight line 202 represents the addition result of half of the apparent area of the pixel 141-1 and half of the apparent area of the pixel 142-1. The straight line 203 represents the addition result of half of the apparent area of the pixel 143-1 and half of the apparent area of the pixel 144-1. In FIG. 7, the mixing ratio changes linearly depending on the positions of the observer's pupil 100 and the iris 101 on the surface.

When the viewpoint position changes in the oblique 45-degree direction, the mixing ratio becomes complicated because all the pixels of the pixel block 140 are involved in the mixing ratio as shown in FIG. The mixing ratio changes smoothly according to the viewpoint position in the pupil 100, and the display device 10 can obtain the same effect as linear blending.

In other words, FIG. 8 is a diagram showing an example of a mixing ratio of incident light in an oblique direction (y = x-axis direction). The horizontal axis indicates the apparent position of the opening 150 in the x-axis direction shown in FIG. The apparent position of the opening 150 changes depending on the position in the oblique direction (ux = ui axis direction) on the surface of the observer's pupil 100 and the iris 101. The vertical axis shows the mixing ratio of the apparent area of each pixel of the pixel block 140.

The straight line 204 represents the apparent area of pixels 141-1. The straight line 205 represents the apparent area of the pixel 144-1. The straight line 206 represents a mixing ratio according to the apparent area of the pixel 142-1 and the apparent area of the pixel 143-1. In FIG. 8, the mixing ratio changes non-linearly depending on the positions of the observer's pupil 100 and the iris 101 on the surface.

FIG. 9 is a diagram showing the relationship between the weighted average of the two images and the contour position. Hereinafter, the points corresponding to the points of interest are referred to as "corresponding points". The contour position is a perceived position on a straight line connecting a point of interest on the contour of image A and a corresponding point on the contour of image B in the contours of the mixed image A and image B. When the directional image is displayed so that the width of the image shift (parallax amount) between adjacent viewpoint positions is as small as about 3 to 5 arcmin, the weight ratio is 0 to weight as shown in FIG. Since the contour position changes linearly and continuously up to the ratio 1, an image of an appropriate contour position according to the viewpoint position is generated. That is, since the two images with small image deviations are connected at a linearly changing ratio, the observer can faithfully perceive the image from the intermediate viewpoint. The display device 10 presents the correct image for each viewpoint position, and connects the images at the viewpoint position by linear blending to reproduce the motion parallax within the range in which the linear blending is realized.

In other words, FIG. 9 is a diagram showing an example of the relationship between the contour position of the display image perceived when the two images, image A and image B, are linearly blended and the weighting coefficient of the image. The horizontal axis shows the weighting coefficient of the weighted average of the image. The vertical axis indicates the position of the perceived outline of the displayed image on the screen. In FIG. 9, the vertical axis shows the position in the x-axis direction as an example. When the deviation between the image A and the image B becomes a small value of about 3 to 5 arcmin, the contour position of the image (perceived image) perceived by the observer changes continuously depending on the weighting coefficient. The amount of deviation between the contours of the image is expressed by using the difference in the angle of the light incident on the pupil 100 from the pixel representing the contour. The display device 10 can generate an image perceived as an intermediate between the image A and the image B by linear blending by changing the weighting coefficient by the observer.

In FIG. 9, the motion parallax is reproduced within the range in which the relationship between the position of the pixel block 140 and the weighting coefficient changes linearly. That is, the motion parallax is reproduced within the range in which the weighted average of the pixel blocks changes linearly. Since the motion parallax is reproduced, the observer can adjust the focus correctly.

Next, the relationship between the position of the perceptual image according to the linear blending and the focus adjustment of the observer's eye will be described in detail.

Each figure from FIG. 10 to FIG. 12 is an explanatory view showing a deviation of the adjustment (focus) position according to the image display condition of the linear blending. For the sake of simplicity, the viewpoint position is set to one-dimensional coordinates, and the case of horizontal movement will be described. Generally, in the image Iobs (u, x, y) viewed by the observer at the viewpoint position of the coordinates u, the brightness of the displayed image at the viewpoint A is IA (x, y), and the brightness of the displayed image at the viewpoint B is IB. When (x, y) is set, it is represented by the equation (1). Here, uA represents the coordinates of the viewpoint A. uB represents the coordinates of the viewpoint B. x represents the x coordinate on the screen. y represents the y coordinate on the screen.

In other words, FIG. 10 is a diagram showing a first example of the relationship between the perceived image 300 and the image 400. The brightness (incident light amount) Iobs (u, x, y) of the light incident on the position u of the ux axis on the surface of the observer's pupil 100 is represented by the equation (1).

Here, IA (x, y) represents the brightness of the image to be seen from the position uA on the surface of the observer's pupil 100. IB (x, y) represents the brightness of the image to be seen from position uB on the surface of the observer's pupil 100. x represents the x-coordinate of the screen of the display unit 14. y represents the y coordinate of the screen of the display unit 14.

FIG. 10 is a diagram showing an example of displaying an image in focus on the screen. In this case, since the display image on the screen is the same regardless of the position of the viewpoint, the equation (2) holds, and the brightness I0 (x, y) of the displayed two-dimensional image is the equation (3). It is expressed as.

In other words, if the position of the in-focus image 400 coincides with the position of the screen of the display unit 14 as shown in FIG. 10, at any position on the surface of the observer's pupil 100. , The brightness of the observed image is the same as expressed by the equation (2).

The luminance Iobs (u, x, y) of the display image observed at the position u is represented by the equation (3).

Here, I0 (x, y) represents the brightness of the image displayed on the display unit 14. That is, I0 (x, y) represents the brightness of the displayed image. The observer can observe the perceptual image 300 at the position of the image 400.

Next, consider the case where there is a parallax 2δ between the image A and the image B as shown in FIG. At this time, as shown in equations (4) to (6), when δ is positive, the focus position is in the back. That is, the correction is suitable for people with hyperopia. Generally, the correction amount is discrete because only the shift in pixel units is possible, but the display device 10 can correct the diopter by shifting the viewpoint image. Further, by setting the image shift amount in the x-axis direction and the image shift amount in the y-axis direction to different values, the display device 10 can also compensate for regular astigmatism.

In other words, FIG. 11 is a diagram showing a second example of the relationship between the perceived image 300 and the image 400. In FIG. 11, the parallax between the image seen from the position uA and the image seen from the position uB is 2δ. The brightness IA (x, y) of the image seen from the position uA is expressed by the equation (4). The brightness IB (x, y) of the image seen from the position uB is expressed by the equation (5).

The images Iobs (u, x, y) seen at the position u are represented by the equation (6) according to the linear blending of the image seen from the position uA and the image seen from the position uB.

When the distance δ is a positive value, the image 400 is in the negative direction of the z-axis with respect to the display unit 14. When the distance δ is a positive value, the image processing unit 13 can correct the hyperopia of the observer. Further, the image processing unit 13 translates one or more images according to the correction value. By setting the distance δx between the displayed image A and the displayed image B in the x-axis direction and the distance δy between the displayed image A and the displayed image B in the y-axis direction to different values, the image The processing unit 13 can correct the observer's normal vision.

The images displayed on the screen in FIG. 12 are linearly blended between the viewpoints A'and B'outside the pupil 100 by a distance d as compared with the images displayed on the screen in FIG. As such, they are displayed apart from each other on the screen. In FIG. 12, the focus position is close to the screen. Assuming that the amount of movement of the viewpoint is d, the coordinates of the viewpoint A'are uA', and the coordinates of the viewpoint B'are uB', Iobs (u, x, y) is expressed by the equation (7). That is, by blending the images of the viewpoints A and B shown in FIG. 12 at a predetermined ratio into the images of the viewpoints A and B, the display device 10 displays an image in which the viewpoint positions are apparently shifted. It is possible to shift the adjustment position of the focal point of the eye. With this method, the adjustment is not discrete, so that the display device 10 can continuously correct the diopter. The display device 10 can also correct normal astigmatism by changing the mixing ratio in the vertical direction and the horizontal direction.

In other words, FIG. 12 is a diagram showing an example in which a plurality of images mixed according to the correction value are displayed on each pixel of the pixel block. FIG. 12 shows a change in brightness depending on the position on the pupil when the distance between the positions on the pupil where the mixing ratio of the images is 100% is wider than that in FIG. The position uA'is represented as the position (uA + d). The position uB'is represented as the position (uB-d). Linear blending occurs in the range from position uA'to position uB'. In FIG. 12, the position of the image 400 is closer to the display unit 14 than the position of the perceived image 300.

The luminance Iobs (u, x, y) of the light incident on the position u is represented by the equation (7) representing the linear blending on the pupil of the observer.

The image processing unit 13 includes a range from position uA to position uB in the result of mixing the brightness of position uA and the brightness of position uB shown in FIG. 11, and the brightness and position uB of position uA'shown in FIG. The image of the position uA and the image of the position uB are generated so that the range from the position uA to the position uB in the result of mixing the brightness of'is equal. As a result, the image processing unit 13 can obtain an effect equivalent to the effect of blending between the brightness of the position uA and the brightness of the position uB. As is obvious from the formula (7), a plurality of weighted average images, which are a plurality of weighted average images, are represented by the formula (8). The image processing unit 13 generates a plurality of weighted average images.

In FIG. 12, the diopter correction values are not discrete. The image processing unit 13 can continuously correct the diopter. Further, by setting the distance δx between the pixel block A and the pixel block B in the x-axis direction and the distance δy between the pixel block A and the pixel block B in the y-axis direction to different values, the image processing unit 13 observes. It is possible to correct a person's normal vision.

The fact that the accurate motion parallax is reproduced indicates that the light rays are reproduced equivalently at each position on the pupil. When the light rays are reproduced equivalently, the display device 10 can also correctly present the accommodation (focus) of the focus of the eye. FIG. 13 shows the result of evaluating the adjustment response when the display device 10 displays optotypes having different depths. The vertical axis shows the accommodation (focus) of the focus of the eye. The horizontal axis shows the time. The dashed line shown in FIG. 13 indicates the theoretical depth position of the optotype. The disk shows the measured value. From FIG. 13, it can be confirmed that the actually measured values follow well, and it can be confirmed that the adjustment is properly reproduced.

In the case of an image having a small high frequency component of the spatial frequency, the observer perceives the image from the intermediate viewpoint even if the deviation width is about 10 arcmin. Therefore, the display device 10 increases the deviation between the images depending on the content of the image. be able to.

Up to this point, for the sake of simplicity, it has been assumed that the axis of astigmatism is horizontal or vertical, but in the case of the shift method of FIG. 11, the shift direction of the image may be a direction orthogonal to the axis of astigmatism.

In other words, FIG. 13 is a diagram showing an example of the accommodation response. The horizontal axis shows time. The vertical axis shows the adaptation of accommodation of the eye. That is, the vertical axis indicates the focal position (depth) of the eye. The broken line in FIG. 13 represents the theoretical value of the position of the perceived image in the z-axis direction. The circles in FIG. 13 represent the measured values of the positions of the perceived image in the z-axis direction. The measured value of the position of the perceived image in the z-axis direction closely follows the theoretical value of the position of the perceived image in the z-axis direction. The accommodation of the observer's eyes is well reproduced.

In the case of an image having a small amount of high-frequency components of the spatial frequency, the observer can perceive the image from the intermediate viewpoint even if the deviation width of the image on the screen is about 10 arcmin. The display device 10 of the embodiment can increase the deviation between the pixel blocks according to the spatial frequency of the image content.

As described above, the display device 10 of the embodiment includes an image acquisition unit 11, a value acquisition unit 12, an image processing unit 13, a display unit 14, and a surface grid 15. The image acquisition unit 11 acquires at least the first image and the second image. The value acquisition unit 12 acquires the correction value in the horizontal direction and the correction value in the vertical direction. The image processing unit 13 shifts the position of the first image in the horizontal direction by a distance corresponding to the correction value in the horizontal direction, shifts the position of the first image in the vertical direction by a distance corresponding to the correction value in the vertical direction, and shifts the position in the horizontal direction. And a display image is generated based on the first image and the second image shifted in the vertical direction. The display unit 14 displays a display image in pixel block units including a plurality of pixels. The opening 150 of the surface grid 15 outputs a display image by each pixel of the pixel block to the observer's eye so that the images are mixed at different mixing ratios depending on the position in the observer's eye.

The display device 10 of the embodiment includes a value acquisition unit 12, an image processing unit 13, and a display unit 14. Value acquisition unit 12 Acquires the correction value of diopter. The image processing unit 13 generates a display image from a plurality of images based on the correction value. The display image is displayed so that the mixing ratio of the plurality of images differs depending on the position of the display unit 14 in the pupil of the observer. Thereby, the display device 10 of the embodiment can correct the diopter including normal astigmatism.

The mixing ratio changes linearly depending on the position in the pupil. The display unit 14 changes the mixing ratio by outputting the light of the display image to the surface grid 15 (barrier) having the opening 150. The image processing unit 13 corrects the inclination of the plurality of mixed images according to the angle formed by the straight line connecting the pupils of both eyes of the observer and the horizontal direction of the screen of the display unit 14. The image processing unit 13 shifts the display position of one or more images according to the correction value, and outputs a display image generated from the image whose display position is shifted to the display unit 14. The image processing unit 13 generates a plurality of weighted average images, which are a plurality of images weighted and averaged based on the correction value. The image processing unit 13 outputs a plurality of weighted average images to the display unit as display images.

The display device 10 of the embodiment can mix a plurality of images at different ratios depending on the position on the pupil. The display device 10 of the embodiment generates a plurality of images in which a plurality of images are mixed according to a predetermined value determined from a correction value. The display device 10 of the embodiment assigns a plurality of images generated according to a predetermined rule to each pixel.

In other words, the display device 10 of the embodiment can mix a plurality of images according to the position on the pupil of the observer. The display device 10 of the embodiment determines the amount of deviation according to the correction value. The display device 10 of the embodiment generates a display image by mixing a plurality of images based on the amount of deviation. The display device 10 of the embodiment may generate a plurality of images. The display device 10 of the embodiment allocates a plurality of images generated according to a predetermined rule to each pixel arranged on a two-dimensional screen.

In the above embodiment, an observer with normal astigmatism diopter can observe the image without using spectacles. The display device 10 of the embodiment can correct normal astigmatism without using a mechanical mechanism. In the case of the shift method of FIG. 11, the shift direction may be a direction orthogonal to the axis of astigmatism. The display device 10 may include not only the display unit 14 arranged in the order of the light emitting unit, the liquid crystal panel, and the light-shielding unit, but also the display unit 14 arranged in the order of the light-emitting unit, the light-shielding unit, and the liquid crystal panel. The display device 10 may be a projection type display device.

At least a part of the display device in the above-described embodiment may be realized by a computer. In that case, the program for realizing this function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system. Further, a "computer-readable recording medium" is a communication line for transmitting a program via a network such as the Internet or a communication line such as a telephone line, and dynamically holds the program for a short period of time. It may also include a program that holds a program for a certain period of time, such as a volatile memory inside a computer system that serves as a server or a client in that case. Further, the above program may be for realizing a part of the above-mentioned functions, and may be further realized for realizing the above-mentioned functions in combination with a program already recorded in the computer system. It may be realized by using a programmable logic device such as FPGA (Field Programmable Gate Array).

Although the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs and the like within a range that does not deviate from the gist of the present invention.

The present invention can be applied to display devices such as camera finder, head-mounted display device, personal computer device, tablet terminal, and smartphone terminal.

10 ... Display device, 11 ... Image acquisition unit, 12 ... Value acquisition unit, 13 ... Image processing unit, 14 ... Display unit, 15 ... Surface grid, 16 ... Detection unit, 100 ... Pupil, 101 ... Iridescent, 110 ... Incident light , 111 ... Incident light, 112 ... Incident light, 140 ... Pixel block, 141 ... Pixel, 142 ... Pixel, 143 ... Pixel, 144 ... Pixel, 150 ... Aperture, 300 ... Perceived image, 400 ... Image

Claims (6)

A value acquisition unit that acquires the correction value of diopter,
An image processing unit that generates a display image from a plurality of images based on the correction value, and an image processing unit.
A display unit for displaying the display image is provided so that the mixing ratio of the plurality of images differs depending on the position in the pupil of the observer .
The image processing unit moves one or more of the plurality of images in parallel according to the correction value so that the horizontal image shift amount and the vertical image shift amount have different values. Then, the inclination of the plurality of mixed images is corrected according to the angle formed by the straight line connecting the pupils of both eyes of the observer and the horizontal direction of the screen of the display unit.
Display device. The display device according to claim 1, wherein the mixing ratio changes linearly according to the position in the pupil. The display device according to claim 1 or 2, wherein the display unit changes the mixing ratio by outputting light of the display image to a barrier having an opening. The image processing unit shifts the display position of one or more of the images according to the correction value, and outputs the display image generated from the image whose display position is shifted to the display unit, according to claim 1. The display device according to any one of claims 3. The image processing unit generates a plurality of weighted average images which are the plurality of images weighted and averaged based on the correction value, and outputs the plurality of weighted average images as the display image to the display unit. The display device according to any one of items 1 to 3. It is a display method executed by the display device.
Steps to get the diopter correction value and
A step of generating a display image from a plurality of images based on the correction value, and
Depending on the position of the observer's pupil possess the steps of mixing ratios of the plurality of images to display the display image differently,
In the step of generating the display image, one or more of the plurality of images are adjusted according to the correction value so that the horizontal image shift amount and the vertical image shift amount are different values. And corrects the tilt of the plurality of mixed images according to the angle formed by the straight line connecting the pupils of both eyes of the observer and the horizontal direction of the screen of the display unit.
Display method.

Images