JP5212521B2 - Image display device - Google Patents

Description

  The present invention relates to an image display device.

  The following operation control devices are known. This operation control device can operate an image according to the movement of the user's hand (for example, Patent Document 1).

JP 2010-81466 A

  It has not been noted that the operation control technique as described above is applied to a case where images having different parallaxes are displayed for a plurality of viewpoints using a parallax barrier or the like (so-called 3D display). In general, when a hand is held over a multi-viewpoint display screen, parallax cannot be obtained in an area behind the hand as seen from the user's eyes. For this reason, the stereoscopic effect is impaired around the hand, and the user who observes the display screen feels uncomfortable.

  An image display device according to the present invention displays a display unit that displays at least two images with different parallaxes for a plurality of viewpoints, a detection unit that detects an object in front of the display unit, and a detection result of the detection unit. A region specifying unit for specifying a region observed with an object on the display screen of the unit, and a display mode of a peripheral region of the specified region in the image displayed by the display unit different from other regions And a display control unit that performs display control.

  With the image display device according to the present invention, it is possible to reduce the viewer's uncomfortable feeling due to the object on the display screen when performing multi-viewpoint display.

It is a block diagram which illustrates the composition of the image display device by a first embodiment. It is a figure which illustrates the external appearance of a digital photo frame. It is a flowchart which shows the flow of the display control process which a control apparatus performs. It is a figure which illustrates the monitor which is reproducing and displaying an image. It is a figure which illustrates the case where a hand is held in front of the monitor which is reproducing and displaying an image. It is a figure explaining a peripheral region. It is a figure explaining the peripheral area | region in 2nd embodiment. It is a figure explaining the state which changed the parallax.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram illustrating the configuration of the image display device according to the first embodiment of the invention. As an image display device, for example, a digital photo frame 100 as shown in FIG. 2 is used. The digital photo frame 100 includes an operation member 101, a camera 102, a connection IF (interface) 103, a control device 104, a storage medium 105, and a monitor 106. The operation member 101 includes various operation buttons operated by the user of the digital photo frame 100.

  The camera 102 includes a CCD image sensor or a CMOS image sensor. As shown in FIG. 2, the camera 102 is arranged in front of the digital photo frame 100 and can capture a user facing the digital photo frame 100. An image signal output from an image sensor included in the camera 102 is output to the control device 104. The control device 104 generates image data based on the image signal.

  The connection IF 103 is an interface for connecting the digital photo frame 100 and an external device. The digital photo frame 100 of the present embodiment is connected to an external device in which image data is recorded, such as a digital camera, via the connection IF 103. Then, the control device 104 takes in the image data from the external device via the connection IF 103 and records it in the storage medium 105.

  As the connection IF 103, a USB interface for connecting an external device and the digital photo frame 100 by wire, a wireless LAN module for wireless connection, or the like is used. Alternatively, a memory card slot may be provided instead of the connection IF 103, and a memory card in which image data is recorded may be inserted into the memory card slot so that the image data is captured.

  The control device 104 includes a CPU, a memory, and other peripheral circuits, and controls the entire digital photo frame 100. In addition, the memory which comprises the control apparatus 104 is volatile memories, such as SDRAM, for example. This memory includes a work memory for the CPU to expand the program when the program is executed, and a buffer memory for temporarily recording data.

  The storage medium 105 is a non-volatile memory such as a flash memory, and stores a program executed by the control device 104, image data captured via the connection IF 103, and the like. The monitor 106 is composed of, for example, a 3D liquid crystal panel, and displays an image 2b to be reproduced as shown in FIG. Specifically, a parallax barrier (not shown) is provided on the display surface of the monitor 106, and a plurality of images having different parallaxes are displayed at different viewpoints (multi-viewpoint display). Thereby, the user can observe a 3D image in three dimensions.

  When the reproduction target image 2b is displayed on the monitor 106, the control device 104 displays two (or more) parallax images that are cut in the vertical direction and arranged alternately. The period of the parallax barrier is configured to be the same as the period of arranging the parallax images, and the width of the opening of the parallax barrier is the same as that of the parallax image. When the user observes the image from a predetermined distance, binocular parallax occurs because separate images can be observed with the left and right eyes. Since the display for obtaining such a stereoscopic view is a known technique, a detailed description thereof is omitted here.

  Further, when the control device 104 detects the movement of the user's hand 2a based on the image captured by the camera 102 and detects that the user's hand 2a has moved sideways, as shown in FIG. The image 2b being reproduced is switched according to the movement of the user's hand 2a. For example, when the control device 104 detects that the user's hand 2a has moved to the left, the control unit 104 slides the image 2b being reproduced to the left and also displays the next image to the left. To do. On the other hand, when the control device 104 detects that the user's hand 2a has moved to the right, the control device 104 slides the image 2b being reproduced to the right and also displays the previous image to the right. To do. In this way, the user can instruct switching of the image to be displayed intuitively by shaking his hand.

  In the first embodiment, in the image 2b being reproduced, the display mode is changed in the peripheral region of the region observed overlapping the user's hand 2a. Hereinafter, display control processing according to the movement of the user's hand 2a by the control device 104 will be described.

  FIG. 3 is a flowchart showing the flow of the display control process according to the movement of the user's hand 2a. The processing shown in FIG. 3 is executed by the control device 104 as a program that is started when the reproduction display of the image 2b is started on the monitor 106. The monitor 106 is configured to display a parallax image suitable for observation at a distance of, for example, 50 cm to 1 m from the monitor 106.

  In step S <b> 10 of FIG. 3, the control device 104 causes the camera 102 to start capturing an image. In the first embodiment, the camera 102 performs imaging at a predetermined frame rate (for example, 30 frames / second), and the control device 104 continuously receives image data from the camera 102 at time intervals corresponding to the frame rate. Is entered. When starting the imaging, the control device 104 proceeds to step S20.

  In step S20, the control device 104 determines whether or not the user's hand 2a is shown in the input image based on the image data input from the camera 102. For example, an image of the user's hand 2a is recorded in advance in the storage medium 105 as a template image, and the control device 104 performs matching processing between the input image and the template image, so that the user's hand 2a is captured in the input image. Judge whether or not. When it is determined that the user's hand 2a is captured, the control device 104 makes an affirmative determination in step S20 and proceeds to step S30. On the other hand, if it is determined that the user's hand 2a is not captured, the control device 104 makes a negative determination in step S20 and proceeds to step S80.

  In step S30, the control device 104 detects the user's hand 2a in step S20, and in the vicinity of the area observed with the user's hand 2a on the monitor 106 screen, The display mode is changed. FIG. 4 is a diagram illustrating the monitor 106 that is reproducing and displaying the image 2b. FIG. 5 is a diagram illustrating a case where the user holds the hand 2a in front of the monitor 106 that is reproducing and displaying the image 2b.

  For example, the control device 104 causes the display luminance in the peripheral region 5 of the region observed on the screen of the monitor 106 to overlap the hand 2 a to be relatively dark compared to the display luminance in other regions other than the peripheral region 5. Display control. By changing the display mode in this way, the impression that the peripheral area 5 is separated from other areas is given to the user.

  FIG. 6 is a diagram for explaining the peripheral region 5. In FIG. 6, the user observes the objects 63 to 66 included in the observation image with the left and right eyes 61 and 62. Since the user holds the hand 2a, it is difficult for the user to observe the objects 63 to 66. Symbol A indicates an area that is not visible to the user. A symbol B indicates a region where appropriate parallax cannot be obtained when at least one of the left and right eyes 61 and 62 enters the shadow of the hand 2a. A symbol C indicates a region where appropriate parallax can be obtained even if the hand 2a is held over.

  The peripheral region 5 illustrated in FIG. 5 corresponds to the region indicated by the symbol B in FIG. In the areas indicated by the symbols B and A, the user cannot observe the left and right images separately. For this reason, it is easy for the user who observes the peripheral region 5 on the display screen of the monitor 106 to feel the sense of incongruity because the stereoscopic effect of the observation image is impaired. However, by giving the user the impression that the peripheral area 5 is separated from other areas, the uncomfortable feeling caused by the inability to stereoscopically view is reduced.

  In the storage medium 105, the distance from the camera 102 to the user's hand 2a and the position of the shooting user's hand 2a on the screen imaged by the camera 102 are observed in an overlapping manner with the hand 2a on the display screen of the monitor 106. The information for specifying the area to be displayed and the information indicating the coordinates and range on the display screen of the monitor 106 for which the display mode should be changed are stored. The control device 104 reads the information from the storage medium 105 based on the image captured by the camera 102, specifies the range (corresponding to the peripheral area 5) in which the display mode is changed according to the read information, Display control for the monitor 106 is performed.

  In addition to lowering the display brightness in the peripheral area 5 relative to other areas as a change in display mode, the color saturation in the peripheral area 5 can be relatively lowered compared to other areas, Display control may be performed so that the contrast in 5 is relatively lowered as compared with other regions. These display controls may be appropriately combined.

  Thereafter, the control device 104 proceeds to step S40, and monitors the change in the position of the hand 2a in the image between the image data input in time series from the camera 102, whereby the position of the user's hand 2a in the image. Whether or not the movement of the user's hand 2a is detected. When the movement of the hand 2a is detected, the control device 104 makes an affirmative decision in step S40 and proceeds to step S50. If the movement of the hand 2a is not detected, the control device 104 makes a negative determination in step S40 and proceeds to step S60.

  In step S50, the control device 104 operates the image 2b being reproduced according to the movement of the user's hand 2a detected in step S40. When it is detected that the user's hand 2a has moved sideways, the image 2b being reproduced is switched according to the movement of the user's hand 2a, as shown in FIG. For example, when it is detected that the user's hand 2a has moved leftward, the image 2b being reproduced is slid leftward and the next image is also slid leftward for display. On the other hand, when the control device 104 detects that the user's hand 2a has moved to the right, the control device 104 slides the image 2b being reproduced to the right and also displays the previous image to the right. To do. Thus, the user can instruct switching of the image to be displayed intuitively by shaking his hand.

  In step S <b> 60, the control device 104 determines whether the user's hand 2 a is shown in the input image based on the image data input from the camera 102. When it is determined that the user's hand 2a is continuously captured, the control device 104 makes a positive determination in step S60, returns to step S40, and repeats the above-described processing. If the control device 104 determines that the user's hand 2a is not captured, the control device 104 makes a negative determination in step S60 and proceeds to step S70.

  In step S <b> 70, the control device 104 performs display control so as to reverse the change in the display mode of the image that has continued since step S <b> 30. Thereby, the change of the display mode with respect to the peripheral region 5 of the region observed overlapping with the user's hand 2a is completed.

  Thereafter, the process proceeds to step S80, and the control device 104 determines whether or not the user has instructed to end the reproduction of the image. When the control device 104 receives an operation signal indicating a reproduction end instruction from the operation member 101, the control device 104 makes an affirmative determination in step S80 and ends the processing of FIG. When the control device 104 does not receive the operation signal indicating the reproduction end instruction, the control device 104 makes a negative determination in step S80 and returns to step S20.

According to the first embodiment described above, the following operational effects can be obtained.
(1) The digital photo frame 100 includes a monitor 106 that displays at least two images (parallax images) having different parallaxes for a plurality of viewpoints, a camera 102 that detects a hand 2a in front of the monitor 106, and detection by the camera 102. Based on the result, the control device 104 that identifies the region observed on the hand 106 in the display screen of the monitor 106, and the display mode of the peripheral region 5 of the identified region among the images displayed on the monitor 106 are displayed. Since the control device 104 that controls the display so as to be different from other regions is provided, it is possible to reduce the user's uncomfortable feeling caused by the hand 2a on the display screen when performing multi-viewpoint display. Specifically, for the user who observes on the display screen of the monitor 106, the stereoscopic effect of the observation image in the peripheral area 5 is easily lost and the user feels uncomfortable, but the peripheral area 5 is separated from the other areas for the user. By giving such an impression, it is possible to reduce a sense of incongruity caused by being unable to stereoscopically view.

(2) In the digital photo frame 100 of the above (1), the control device 104 changes the display mode by changing at least one of the luminance, color, and contrast of the display image. An impression that the peripheral area 5 is separated from other areas can be given.

(3) In the digital photo frame 100 of (1) and (2) above, since the camera 102 detects the hand 2a based on the image signal output from the image sensor, it appropriately detects the hand 2a in front of the monitor 106. can do.

(4) In the digital photo frame 100 of the above (1) to (3), a control device 104 that receives an operation according to the movement of the hand 2a detected by the camera 102 is further provided. Even when a device that performs multi-viewpoint display is configured to accept a so-called gesture operation, it is possible to reduce a sense of incongruity caused by the fact that stereoscopic viewing is not possible.

(5) In the digital photo frame 100 of (1) to (4) above, since the camera 102 detects the human hand 2a, the user feels uncomfortable due to the fact that the user cannot hold the hand 2a in front of the monitor 106. Can be reduced.

(Second embodiment)
In the second embodiment, the display mode is changed by making the parallax of the parallax image greatly different from the peripheral area 5 of the area observed on the screen of the monitor 106 so as to overlap the hand 2a. . By changing the display mode in this way, the impression that the peripheral area 5 is separated from other areas is given to the user.

  FIG. 7 is a diagram for explaining the peripheral region 5. In FIG. 7, the user observes the objects 73 to 76 included in the observation image with the left and right eyes 71 and 72. Since the user holds the hand 2a, it is difficult for the user to observe the objects 73 to 76. Symbol A indicates an area that is not visible to the user. Reference symbol B indicates a region in which appropriate parallax cannot be obtained when at least one of the left and right eyes 71 and 72 is behind the hand 2a. A symbol C indicates a region where appropriate parallax can be obtained even if the hand 2a is held over. The peripheral area 5 corresponds to the area indicated by the symbol B.

  As in the first embodiment, the control device 104 according to the second embodiment specifies a range (corresponding to the peripheral region 5) in which the display mode is changed based on an image captured by the camera 102, and then monitors the monitor. Display control for 106 is performed. FIG. 8 is a diagram for explaining a state in which the parallax is changed. The control device 104 performs control so that the parallax of the parallax image displayed on the monitor 106 is different from the parallax in the other area for the area B2 on the boundary side with the area C in the area B, so that the image looks far from the image. . In the example of FIG. 8, the parallax is given so that the part 73B of the object 73 and the part 76B of the object 76 are in the distance. A part 73B of the object 73 and a part 76B of the object 76 correspond to the region B2.

  As described above, in the second embodiment, by making the object appear to exist in the distance, an impression that the peripheral area 5 is separated from other areas is given to the user, and stereoscopic viewing cannot be performed. To reduce discomfort.

  According to the second embodiment described above, the same effects as those of the first embodiment can be obtained. Further, in the digital photo frame 100, the control device 104 changes the display mode by changing the parallax of the display image, so that the peripheral area 5 is appropriately separated from other areas for the user. Can give an impression.

(Modification 1)
An infrared light source that illuminates the user facing the monitor 106 may be provided. In this case, the camera 102 images the user's hand 2a illuminated by the infrared light source. By configuring so as to capture an infrared image, the brightness of the region corresponding to the hand 2a in the infrared image is increased, so that the process of detecting the hand 2a from the infrared image is facilitated.

(Modification 2)
In the above embodiment, the method of using the camera 102 to detect the user's hand 2a has been described. However, the user's hand may be detected using a non-touch type electrostatic detection method. Moreover, you may comprise using the distance sensor for game machines.

(Modification 3)
In the above description, an example in which the user holds one hand 2a in front of the monitor 106 has been described, but both hands may be held. In this case, the control device 104 specifies a plurality of areas that are observed to overlap the left and right hands on the display screen of the monitor 106 based on the image captured by the camera 102, and displays in the plurality of peripheral areas. Display control is performed so that the mode is relatively different from the display mode of other areas. In the third modification, even when the user holds both hands, it is possible to give the user an impression that each peripheral area corresponding to both hands is separated from the other areas.

  In the above description, the finger of the hand held up in front of the monitor 106 is not released. However, in the case of holding up an extended hand so that the finger is separated from the finger, a peripheral area is provided for each finger, The display control may be performed so that the display mode in each peripheral area is relatively different from the display mode in other areas.

(Modification 4)
In the description of the above-described embodiment, display control is uniformly performed in a display mode that is different from the display mode of other regions in the peripheral region 5 of the region that appears to overlap the hand 2a. Instead of this, the display mode may be controlled to gradually adjust to the surroundings by gradually changing the display mode at the boundary between the peripheral region 5 and other regions.

(Modification 5)
Although the digital photo frame has been described as an example of the image display device, the present invention can be applied to a digital camera, a mobile phone, a television, or the like as long as the image display device includes the monitor 106 and the camera 102.

  The above description is merely an example, and is not limited to the configuration of the above embodiment. Moreover, you may combine each embodiment and each modification suitably.

2a ... hand 2b ... display image 5 ... peripheral area 100 ... digital photo frame 101 ... operation member 102 ... camera 103 ... connection IF
104 ... Control device 105 ... Storage medium 106 ... Monitor

Claims (6)

A display unit that displays at least two images having different parallaxes for a plurality of viewpoints;
A detection unit for detecting an object in front of the display unit;
Based on the detection result by the detection unit, a region specifying unit that specifies a region observed with the object on the display screen of the display unit,
A display control unit that performs display control so that a display mode of a peripheral region of the specified region is different from other regions among images displayed by the display unit;
An image display device comprising: The image display device according to claim 1,
The image display device, wherein the display control unit changes the display mode by changing at least one of luminance, color, and contrast of the display image. The image display device according to claim 1 or 2,
The image display device, wherein the display control unit changes the display mode by changing the parallax of the display image. In the image display device according to any one of claims 1 to 3,
The image display apparatus, wherein the detection unit detects the object based on an image signal output from an image sensor. In the image display device according to any one of claims 1 to 4,
An image display device, further comprising an operation control unit that receives an operation according to the movement of the object detected by the detection unit. In the image display device according to any one of claims 1 to 5,
An image display device, wherein the object is a human hand.

Images