JP2012022150A - Display device and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce visual fatigue of a viewer viewing an image.SOLUTION: A display device which displays an image for a viewer comprises: a display part for displaying an image for a viewer; a fatigue detection part for detecting a visual fatigue amount of the viewer; and a display control part for allowing the display part to display a change image for changing the view position of the viewer in the depth direction when the visual fatigue amount detected at the fatigue detection part exceeds a prescribed threshold. The display control part allows the display part to display the change image for changing the view position of the viewer in the depth direction without changing the parallax.

Description

  The present invention relates to a display device and a display method.

It is known that fatigue is accumulated in a viewer when an image displayed on a monitor such as a liquid crystal display device is viewed for a long time. For example, when viewing a two-dimensional image, eye strain accumulates because the eye muscle tone persists at a certain level (see, for example, Patent Document 1). Further, when viewing a stereoscopic image, fatigue is accumulated in the viewer due to a mismatch in the convergence angle of the eye and the adjustment position.
Japanese Patent Application Laid-Open No. 2003-47636

  The above-described fatigue is reduced by moving the viewpoint to a region other than the monitor and changing the focus position of the eye. However, if the image is viewed in a concentrated manner, the image is viewed for a long time, and fatigue is accumulated in the viewer. Further, for example, in a wall-mounted monitor, it is difficult to change the focus position of the eye greatly even when viewing an area other than the monitor. Further, while viewing an area other than the monitor, it is difficult for the viewer to obtain image information on the monitor.

  In order to solve the above-described problem, in the first aspect of the present invention, a display device that displays an image to a viewer, a display unit that displays the image to the viewer, and eye strain of the viewer A fatigue detection unit for detecting the amount, and when the eye fatigue amount detected by the fatigue detection unit exceeds a predetermined threshold, a change image for changing the viewpoint position of the viewer in the depth direction is displayed on the display unit Provided is a display device including a display control unit.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

The structural example of the display apparatus 100 which displays an image to the viewer 200 is shown. An example of the change image 14 displayed on the display unit 10 by the display control unit 30 is shown. The example of a display in the display part 10 is shown. The structural example of the fatigue | exhaustion detection part 20 is shown. The structural example of the display part 10 is shown. The flowchart of the operation example of the display apparatus 100 is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a configuration example of a display device 100 that displays an image to a viewer 200. The display device 100 includes a display unit 10, a fatigue detection unit 20, and a display control unit 30. The display unit 10 displays a stereoscopic image using a right-eye image and a left-eye image having parallax on a display device such as a liquid crystal display. The display unit 10 may display a two-dimensional image on the display device.

  When displaying a stereoscopic image, the display unit 10 may simultaneously display the right-eye image and the left-eye image. In this case, the display unit 10 collects light from the right-eye image at the right eye position of the viewer 200 and condenses light from the left-eye image at the left eye position of the viewer 200. Good. For example, the display unit 10 condenses the light of the right eye image and the left eye image on the right eye position and the left eye position of the viewer 200 by a parallax barrier method or a lenticular method. Further, the display unit 10 may change the polarization directions of light from the right-eye image and the left-eye image. In this case, the display device 100 includes polarizing glasses that allow the right eye image light to pass through the right eye of the viewer 200 and allow the left eye image light to pass through the left eye of the viewer 200. Also have. The polarized glasses are attached to the viewer 200.

  The display unit 10 may alternately display the right-eye image and the left-eye image in a time division manner. In this case, the display device 100 further includes glasses with shutters that are attached to the viewer 200 and allow light to pass through the viewer 200 alternately to the right eye and the left eye. The glasses with shutters allow light to pass through the right eye of the viewer 200 at the timing when the display unit 10 displays the right-eye image, and do not pass light through the left eye. In addition, the glasses with shutters do not allow light to pass to the right eye of the viewer 200 and allow light to pass to the left eye at the timing when the display unit 10 displays the image for the left eye.

  The fatigue detection unit 20 acquires fatigue information indicating the amount of eye fatigue of the viewer 200. The fatigue detection unit 20 may acquire fatigue information that directly indicates the amount of eye fatigue of the viewer 200, such as the number of blinks detected from the eye image of the viewer 200, the opening area of the eye, and the like. . In addition, the fatigue detection unit 20 determines the amount of eye fatigue of the viewer 200 such as the history of images viewed by the viewer 200 and the length of time that the viewer 200 viewed images. Indirect fatigue information may be acquired.

  The display control unit 30 changes the viewpoint position of the viewer 200 in the depth direction without changing the parallax of the image when the amount of eye fatigue detected by the fatigue detection unit 20 exceeds a predetermined threshold. The change image is displayed on the display unit 10. The change image may include an image element that changes the viewpoint position of the viewer 200 in the depth direction due to psychological influence. For example, the change image may include an image element whose size gradually changes with the passage of time, and may include an image element whose brightness gradually changes with the passage of time.

  FIG. 2 shows an example of the change image 14 that the display control unit 30 displays on the display unit 10. The display unit 10 of this example displays the same two-dimensional image as the right eye image and the left eye image. That is, the change image 14 is displayed as a two-dimensional image instead of a stereoscopic image.

  The display control unit 30 may display an image whose size and position change with time as the change image 14. Further, the display control unit 30 may cause the display unit 10 to display the auxiliary image 12 together with the change image 14. The auxiliary image 12 may be an image drawn by a perspective method (or a perspective method) and has a vanishing point 11.

  The display control unit 30 may display the change image 14 whose position changes along the auxiliary image 12 from the initial position as time elapses. For example, the change image 14 may change in position from the initial position (for example, the position of the change image 14-1) toward the vanishing point 11, and from the initial position (for example, the position of the change image 14-2) to the vanishing point 11. May change position in the opposite direction.

  When the change image 14 is moved toward the vanishing point 11, the display control unit 30 may gradually reduce the size of the change image 14. Further, when the change image 14 is moved toward the vanishing point 11, the display control unit 30 may gradually decrease the brightness of the change image 14.

  When the change image 14 is moved in a direction away from the vanishing point 11, the display control unit 30 may gradually increase the size of the change image 14. When the change image 14 is moved in the direction away from the vanishing point 11, the display control unit 30 may gradually increase the brightness of the change image 14.

  By displaying such a change image 14, the viewpoint position (focus position) of the viewer 200 can be changed in the depth direction by a psychological influence obtained from the image to be viewed. For example, when the change image 14 moves toward the vanishing point 11 while becoming smaller, the viewer 200 feels that the change image 14 is moving away, and the viewpoint position changes in the depth direction. For this reason, the muscle tone of the eye of the viewer 200 can be relieved, and the amount of eye fatigue of the viewer 200 can be reduced.

  The display control unit 30 may display the change image 14 on the display unit 10 and give a predetermined sound to the viewer 200. For example, when the size of the change image 14 is gradually reduced, the display control unit 30 gradually reduces the amount of sound given to the viewer 200. The display control unit 30 gradually increases the amount of sound given to the viewer 200 when the size of the change image 14 is gradually increased. By such processing, the psychological influence on the viewer 200 can be increased, and the viewpoint position of the viewer 200 can be easily changed in the depth direction.

  Further, when displaying the change image 14 on the display unit 10, the display control unit 30 may display the change image 14 on either the right eye or the left eye of the viewer 200. For example, when the viewer 200 wears glasses with shutters, the display control unit 30 controls the glasses with shutters to display an image on either the right eye or the left eye during the period during which the change image 14 is displayed. Pass through and occlude the image to the other eye.

  The period during which the change image 14 is displayed on each eye may be a period required to change the change image 14 in a predetermined manner. The period during which the change image 14 is displayed on each eye may be, for example, about several seconds to several tens of seconds. The display control unit 30 may repeatedly display the change image 14 in a predetermined number of times.

  When the viewer 200 is wearing polarized glasses, the display control unit 30 displays the change image 14 on one of the right-eye image and the left-eye image displayed on the display unit 10 and the other image. A solid black image may be displayed. When the display unit 10 is a lenticular method or a parallax barrier method, the display control unit 30 displays the change image 14 on one of the right-eye image and the left-eye image displayed on the display unit 10 and the other A solid black image may be displayed as the image. By displaying the change image 14 for each eye, the influence of the convergence angle of both eyes on the viewpoint position of the viewer 200 can be reduced. For this reason, psychological influence can be emphasized and the viewpoint position of the viewer 200 can be easily changed.

  The display device 100 displays the viewing image designated by the viewer 200 or the like on the viewer 200. The display control unit 30 stops displaying the viewing image on the display unit 10 when the amount of eye fatigue detected by the fatigue detection unit 20 exceeds a predetermined threshold, and the change image as shown in FIG. 14 may be displayed on the display unit 10. In this case, after displaying the change image 14 for a predetermined period, the display control unit 30 resumes displaying the viewing image from the stopped position.

  The display control unit 30 may display both the viewing image and the change image 14 on the display unit 10 when the amount of eye fatigue detected by the fatigue detection unit 20 exceeds a predetermined threshold. In this case, the display control unit 30 may display the change image 14 outside the region where the viewing image is displayed on the display unit 10 or may display the change image 14 superimposed on the viewing image. . When the change image 14 is displayed superimposed on the viewing image, for example, the above-described change image 14 may be displayed at the center of the viewing image.

  FIG. 3 shows a display example on the display unit 10. The display unit 10 of this example displays both the viewing image 16 and the change image 14. The change image 14 in this example is displayed outside the area where the viewing image 16 is displayed.

  The display control unit 30 may make the area where the viewing image 16 is displayed when the change image 14 is displayed smaller than the area where the viewing image 16 is displayed when the change image 14 is not displayed. For example, when the change image 14 is not displayed, the viewing image 16 is displayed on the entire display surface of the display unit 10. When the change image 14 is displayed, the viewing image 16 may be reduced and displayed in any area of the display surface of the display unit 10 as shown in FIG. For example, the viewing image 16 is displayed at the end of the display surface of the display unit 10.

  Further, the display control unit 30 may make the luminance of the viewing image 16 when displaying the change image 14 lower than the luminance of the viewing image 16 when not displaying the change image 14. In addition, the display control unit 30 may make the contrast of the viewing image 16 when displaying the change image 14 smaller than the contrast of the viewing image 16 when not displaying the change image 14. Through such processing, the viewer 200 can be focused on the change image 14.

  Further, the display control unit 30 displays the right-eye image and the left-eye image having parallax on the display unit 10 as the normal viewing image 16 when the change image 14 is not displayed, and displays the change image 14. As the viewing image 16 in this case, a right-eye image and a left-eye image (that is, the same right-eye image and left-eye image) that do not have parallax may be displayed on the display unit 10. Further, when displaying the change image 14, the display control unit 30 may display only one of the right-eye image and the left-eye image on the display unit 10. Further, when displaying the change image 14 on the display unit 10, the display control unit 30 displays the viewing image 16 and the change image 14 for each of the right eye or the left eye of the viewer 200 for several seconds to several tens of seconds. The period may be selectively displayed.

  FIG. 4 shows a configuration example of the fatigue detection unit 20. The fatigue detection unit 20 includes a reference storage unit 22, an eye image acquisition unit 24, and a fatigue measurement unit 26. The eye image acquisition unit 24 acquires an image of the eyes of the viewer 200 who views the display unit 10. From the acquired eye image, the eye image acquisition unit 24 blinks the viewer 200 within the predetermined period, the opening area of the eye of the viewer 200, the change rate of the pupil area of the viewer 200, or Fatigue information such as the convergence angle change rate may be acquired.

  The reference storage unit 22 stores reference information to be compared with the fatigue information output by the eye image acquisition unit 24. The reference storage unit 22 may store in advance a reference image of the eye movement as a reference for each viewer 200.

  The reference storage unit 22 preferably stores reference information measured by the viewer 200 in which fatigue has not accumulated. For example, the reference storage unit 22 captures a reference image of the eye movement of the viewer 200 on the condition that the display unit 10 has not displayed an image for a predetermined period or longer, and within a predetermined period. Fatigue information such as the number of blinks of the viewer 200, the opening area of the eyes of the viewer 200, the change rate of the pupil area of the viewer 200, or the change rate of the convergence angle may be acquired.

  The reference storage unit 22 may store reference information obtained from the image of the eye of the viewer 200 immediately after the display unit 10 starts image display. Further, the display device 100 may display an image for acquiring reference information before displaying an image designated to be viewed by the viewer 200. The image is an image in which characteristics such as a luminance value, a luminance value change pattern, and contrast are predetermined.

  Moreover, the reference | standard storage part 22 may store the reference | standard information measured in the viewer 200 of the state which accumulated fatigue. For example, the reference storage unit 22 stores reference information obtained from the image of the eye movement of the viewer 200 captured in the past after the display unit 10 has displayed an image for a predetermined period or longer.

  In addition, the reference storage unit 22 acquires reference information in a state in which the viewer 200 views the image for a long time and the viewer 200 blinks, the pupil area change rate deterioration, and the like are saturated. May be.

  The fatigue measurement unit 26 compares the information acquired from the eye image acquisition unit 24 with the reference information stored in the reference storage unit 22, and determines whether or not the fatigue of the viewer 200 exceeds the reference value. For example, the fatigue measurement unit 26 may determine whether or not the number of blinks acquired from the eye image acquisition unit 24 exceeds the reference value stored in the reference storage unit 22. When the fatigue measurement unit 26 determines that the fatigue of the viewer 200 has exceeded the reference value, the fatigue measurement unit 26 notifies the display control unit 30 accordingly.

  When the display unit 10 displays a moving image, the fatigue measurement unit 26 displays information indicating the characteristics of the right-eye image and the left-eye image displayed by the display unit 10 within a predetermined period immediately before. You may acquire the fatigue information which contains. In this case, the fatigue detection unit 20 may not have the eye image acquisition unit 24. The image characteristics may include at least one of a change in the amount of parallax of each subject (image element), a change in luminance, and a change in contrast between frames of the image.

  Moreover, the fatigue measurement part 26 may acquire the integral value of the absolute value of the said variation | change_quantity in the said period. For example, when displaying an image in which the display unit 10 blinks during the period, it is evaluated that the integrated value of the change in luminance is large, and the accumulation of eye fatigue of the viewer 200 is large. Further, the fatigue measurement unit 26 obtains information such as the average value of the brightness of the image displayed on the display unit 10 within the predetermined period immediately before or the period during which the display unit 10 displays images continuously. Also good.

  FIG. 5 shows a configuration example of the display unit 10. The display unit 10 of this example independently displays a right-eye image and a left-eye image for each viewer 200 at a different position. In this example, a case where a corresponding right-eye image and left-eye image are displayed on each eye (right eye 1, left eye 1, right eye 2, left eye 2) of two viewers 200 will be described. To do.

  The display unit 10 includes a display device 32 and a barrier unit 34. The display device 32 corresponds to each eye of the viewer 200 (right eye 1, left eye 1, right eye 2, left eye 2), a right eye image R1, a left eye image L1, and a right eye image R2. Then, an image in which the pixel columns of the left-eye image L2 are arranged in the horizontal direction in a predetermined order is displayed. For example, the display device 32 includes a pixel row of the left eye image L1 corresponding to the left eye 1, a pixel row of the right eye image R1 corresponding to the right eye 1, and a pixel of the left eye image L2 corresponding to the left eye 2. An image in which pixel columns of the right-eye image R2 corresponding to the columns and the right eye 2 are arranged in this order is displayed.

  The barrier unit 34 is disposed to face the image display surface of the display device 32. The barrier unit 34 includes a plurality of passage portions 38 and a plurality of shielding portions 36. The barrier unit 34 may be a parallax barrier.

  The plurality of shielding portions 36 are provided such that the plurality of passage portions 38 are arranged at a predetermined cycle in the horizontal direction. Here, the horizontal direction refers to an arrangement direction in which the passage portions 38 and the shielding portions 36 are alternately arranged. For example, if the horizontal width of each passing portion 38 is W and the number of viewpoints is N, the plurality of passing portions 38 may be arranged in a cycle of W × N. As shown in FIG. 5, when the width of the passing portion 38 is equal to one pixel and the number of viewpoints is four, the passing portion 38 is arranged every four pixels in the horizontal direction. A shielding portion 36 is provided between the passage portions 38.

  With such a configuration, the plurality of passage portions 38 cause each viewpoint to pass and display light from the corresponding pixel column among the plurality of pixel columns displayed by the display device 32. On the other hand, the plurality of shielding units 36 shield light from non-corresponding pixel columns among the plurality of pixel columns displayed by the display device 32 with respect to each viewpoint.

  For example, the corresponding pixel column L1 can be observed from the position of the left eye 1, but the other pixel columns L2, R1, and R2 are blocked by the shielding unit 36 and cannot be observed. Similarly, from the other viewpoints, the corresponding pixel columns can be observed, but the other pixel columns cannot be observed. With such a configuration, the right eye image and the left eye image can be provided to a plurality of viewers 200.

  The configuration of the display unit 10 is not limited to the configuration. For example, the display unit 10 can provide each of the right-eye image and the left-eye image to the plurality of viewers 200 by using a lenticular lens instead of the barrier unit 34.

  Further, the display unit 10 displays the left-eye image L1, the right-eye image R1, the left-eye image L2, and the right-eye image R2 in a time-sharing manner, and the glasses with shutters that are attached to the respective viewers 200. Thus, by causing each viewer 200 to view the corresponding image, the right eye image and the left eye image can be provided to the plurality of viewers 200. Also, the display unit 10 displays each image with a different polarization direction, and causes each viewer 200 to view the corresponding image with polarized glasses worn by each viewer 200. Each of the right eye image and the left eye image can be provided to the plurality of viewers 200.

  In this example, it is preferable that the fatigue detection unit 20 measures fatigue for each viewer 200. In this example, the display control unit 30 controls whether or not to display the change image 14 on the corresponding viewer 200 based on the fatigue of each viewer 200. Thereby, the change image 14 can be displayed for each viewer 200 according to the fatigue of each viewer 200.

  In addition, when displaying an image with respect to the plurality of viewers 200, the fatigue measurement unit 26 measures a predetermined parameter for each viewer 200. The display control unit 30 displays the change image 14 for each viewer 200 based on the change in the parameters of each viewer 200 and the average of the change in the parameters of the plurality of viewers 200. Control whether or not.

  For example, the fatigue measurement unit 26 measures, for each viewer 200, the increase rate of the number of blinks in the latest predetermined period with respect to the number of blinks in the predetermined period immediately after the start of image display. The display control unit 30 calculates the average value of the increase ratios for all the viewers 200. Then, the display control unit 30 calculates how much the increase rate of each viewer 200 is deviated from the average value of all viewers 200 of the increase rate. The display control unit 30 displays the change image 14 on the corresponding viewer 200 when the degree of the deviation exceeds the reference value. In addition, the fatigue measurement unit 26 may measure biological information such as the body temperature and pulse of the viewer 200 as the parameter.

  FIG. 6 shows a flowchart of an operation example of the display device 100. First, a viewing image designated by the viewer 200 or the like is displayed on the display unit 10 (S300). For example, the viewing image may be an image of a television, a movie, a game, or the like. The display unit 10 may end the image display when the viewing image ends (S302).

  If the viewing image has not ended, the fatigue detection unit 20 detects eye fatigue of the viewer 200 (S304). When the eye fatigue amount detected by the fatigue detection unit 20 does not exceed the predetermined threshold, the display unit 10 continues to display the viewing image (S306). When the eye fatigue amount detected by the fatigue detection unit 20 exceeds a predetermined threshold, the display control unit 30 displays the change image 14 on the display unit 10 (S308). At this time, the display unit 10 may continue or stop displaying the viewing image.

  When the change image 14 is displayed for a predetermined period, the display control unit 30 ends the display of the change image 14 (S310). In this case, the display unit 10 resumes normal viewing image display.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 ... Display part, 12 ... Auxiliary image, 14 ... Change image, 16 ... Viewing image, 20 ... Fatigue detection part, 22 ... Reference | standard storage part, 24 ... Eye image acquisition unit, 26 ... fatigue measurement unit, 30 ... display control unit, 32 ... display device, 34 ... barrier unit, 36 ... shielding unit, 38 ... passage unit, 100 ... Display device, 200 ... Viewer

Claims (13)

A display device for displaying an image to a viewer,
A display unit for displaying the image to the viewer;
A fatigue detection unit for detecting an eye fatigue amount of the viewer;
A display control unit that causes the display unit to display a change image that changes the viewpoint position of the viewer in the depth direction when the eye fatigue amount detected by the fatigue detection unit exceeds a predetermined threshold; A display device provided. The display unit displays a right-eye image and a left-eye image having parallax,
The display device according to claim 1, wherein the display control unit causes the display unit to display the change image that changes the viewpoint position of the viewer in the depth direction without changing parallax. The display device displays a predetermined viewing image to the viewer,
The display control unit stops display of the viewing image on the display unit when the eye fatigue amount detected by the fatigue detection unit exceeds a predetermined threshold, and displays the change image on the display unit. The display device according to claim 1 or 2. The display device displays a predetermined viewing image to the viewer,
The display control unit causes the display unit to display both the viewing image and the change image when the eye fatigue amount detected by the fatigue detection unit exceeds a predetermined threshold. 2. The display device according to 2. The display device according to claim 4, wherein the display control unit displays the change image outside an area where the viewing image is displayed on the display unit. The said display control part makes the area | region where the said image for viewing in the case of displaying the said change image smaller than the area | region where the image for viewing in the case of not displaying the said change image is displayed. Display device. The display device according to claim 5, wherein the display control unit lowers the luminance of the viewing image when the change image is displayed lower than the luminance of the viewing image when the change image is not displayed. The display unit displays a moving image,
The fatigue detection unit, based on characteristic information indicating characteristics of the right-eye image and the left-eye image displayed on the display unit within a predetermined period immediately before the eye fatigue amount of the viewer The display device according to claim 2. The fatigue detection unit is at least one of a change in parallax amount, a change in luminance, and a change in contrast between frames of the right-eye image and the left-eye image displayed on the display unit. The display device according to claim 8, wherein an eye fatigue amount of the viewer is detected based on the display. The display unit displays an image for each viewer at different positions,
The fatigue detection unit detects the amount of eye fatigue for each viewer,
The said display control part displays the said change image on the area | region of the said display part corresponding to the said viewer whose said eye fatigue amount exceeded the predetermined threshold value. Display device. The fatigue detection unit measures a predetermined parameter for each of the viewers, and changes the parameters of the viewers and an average of the parameter changes of the viewers. The display device according to claim 1, wherein the eye fatigue amount of each viewer is detected based on the display device. The fatigue detection unit
For the viewer, a reference storage unit that stores in advance a reference image of eye movement;
An eye image acquisition unit that acquires an image of the eye movement of the viewer who is viewing the image displayed by the display unit;
The fatigue measurement unit that measures the amount of eye fatigue of the viewer by comparing the image acquired by the eye image acquisition unit with the reference image stored by the reference storage unit. The display device according to any one of the above. A display method for displaying an image to a viewer,
A fatigue detection step of detecting an eye fatigue amount of the viewer;
A display control step of displaying, on a display unit, a change image that changes the viewpoint position of the viewer in the depth direction when the eye fatigue amount detected in the fatigue detection step exceeds a predetermined threshold value. A display method provided.

Images