JP5049723B2 - Image display device - Google Patents

Description

  The present invention relates to an image display device that stereoscopically displays a two-dimensional image.

  In recent years, various systems for providing stereoscopic images to an observer have been proposed.

  In this type of image display device, a method of providing a two-dimensional image on an image display surface such as a display as a stereoscopic image by using binocular parallax is well known.

  However, in this image display device using binocular parallax, the observer gazes at a virtual image as a three-dimensional image of the target object. Therefore, the focus (focus adjustment) on the image display surface and the convergence are not observed. May cause a physiological impact on the viewer.

  Therefore, separately from this method, an image transmission panel (for example, a microlens array composed of a plurality of lenses) is arranged in front of the image display surface of a two-dimensional image at a predetermined interval, thereby There has been provided an image display device that displays a pseudo-stereoscopic image (floating image) of a two-dimensional image on a front space (see, for example, Patent Document 1 and Patent Document 2). This image display device displays a two-dimensional image as if a three-dimensional image is projected by forming an image by raising the image with an image transmission panel.

  In such an image display device, two two-dimensional image display surfaces are provided, and an image displayed on one display surface is recognized as a pseudo-stereoscopic image of the above-described two-dimensional image, and the other display surface is displayed. There is also an image display device that recognizes a projected image as a direct-view image (see, for example, Patent Document 3).

JP 2001-255493 A JP 2003-98479 A JP-A-2005-234240

  Since the image display device including the two two-dimensional image display surfaces described above can perform image display in which a direct-view image and a floating image are integrated, a three-dimensional visual effect can be enhanced.

  However, if the three-dimensional visual effect can be further enhanced in the image display in which the direct-view image and the floating image are interlocked, an image with more realistic sensation can be provided to the user, and the production effect can be further enhanced.

  In addition, if a new user interface that has never existed can be constructed by linking a direct-view image and a floating image, intuitive and easy-to-understand operations and displays are possible.

  The present invention has been made in view of the above circumstances, and as an example of the problem, the direct effect image and the floating image can be strengthened to enhance the production effect, and the intuitive and easy-to-understand operation and An object of the present invention is to provide an image display device capable of realizing display.

  In order to achieve the above object, an image display device according to an aspect of the present invention includes a first display unit including a first image display surface that displays a two-dimensional image, and the first image display surface. An image transmission panel disposed in an optical path of emitted light, and the light emitted from the first image display surface is opposite to the side facing the first display unit of the image transmission panel A floating image display means for displaying as a floating image in a space located in the space, and a second display section having a second image display surface for displaying a two-dimensional image at the outer edge of the space where the floating image is displayed. And a direct-view image display means for displaying one or more objects as a direct-view image on the second image display surface, light is emitted from the second image display surface, and the second image display surface. Detecting means for detecting the position of the detected object in the space And controlling at least one of the two-dimensional image displayed on the first display unit or the two-dimensional image displayed on the second display unit based on the position of the detected object detected by the position detection unit. An image control unit configured to detect the position of the detected object detected by the position detecting unit when the detected object touches the object displayed on the second image display surface. The selected object is identified, and when the detected object leaves the second image display surface after the detected object touches the object displayed on the second image display surface. The first display so that the floating image corresponding to the specified object is displayed in a direction away from the second image display surface from the position where the specified object was displayed. Controls the displayed two-dimensional image, and the detected floating image is detected based on the position where the identified object is displayed and the position of the detected object detected by the position detecting means. The two-dimensional image displayed by the first display unit is controlled so as to follow the trajectory of the body.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  1 and 2 are schematic configuration diagrams of an image display apparatus 100 according to an embodiment of the present invention. FIG. 1 is an external perspective view of the image display device 100, and FIG. 2 is an external configuration diagram and a functional configuration diagram when the image display device 100 is viewed from the side surface direction (AA direction in FIG. 1).

  The image display device 100 is a pseudo-stereoscopic image display device that displays on a predetermined plane in space a two-dimensional image that the viewer H can visually recognize as a stereoscopic display, and is roughly classified as a floating image that displays a floating image. The display unit 1 includes a direct-view image display unit 2 that displays a two-dimensional image that the observer H directly views. Here, the floating image is a two-dimensional image displayed on a predetermined plane in the space, and is a real image image that appears to the observer H as if it is floating in the air. Further, the direct-view image refers to a two-dimensional image that the observer H directly views on the image display surface.

  The floating image display unit 1 includes a display unit 10 and an image transmission panel 20 that is disposed apart from the display unit 10.

  The display unit 10 includes an image display surface 11 that displays a two-dimensional image, and a display drive unit (not shown) that drives and controls the display unit 10. Specifically, the display unit 10 can be a color liquid crystal display (LCD), and includes a flat image display surface 11, a display driving unit including a backlight illumination unit, a color liquid crystal driving circuit, and the like. . Of course, the display unit 10 may be other than the LCD, and may be a display such as an EL (electro-luminescence) display, a plasma display, or a CRT (Cathode Ray Tube).

  The image transmission panel 20 is configured by, for example, a microlens array 25, and the panel surface is arranged substantially in parallel with the image display surface 11 of the display unit 10 (see FIGS. 1 and 2). As shown in FIG. 3, the microlens array 25 includes two lens array halves 21a and 21b arranged in parallel to each other. In each of the lens array halves 21a and 21b, a plurality of minute micro convex lenses 23 having the same radius of curvature are arranged adjacent to each other two-dimensionally on both surfaces of a transparent substrate 22 made of glass or resin having excellent translucency. Is. The optical axis of each micro-convex lens 23a formed on one surface is adjusted to be the same as the optical axis of the micro-convex lens 23b on the other surface formed at the opposite position. That is, each pair of the micro convex lenses 23a and 23b adjusted to have the same optical axis is two-dimensionally arranged so that the respective optical axes are parallel to each other.

  The microlens array 25 is disposed at a position that is parallel to the image display surface 11 of the display unit 10 by a predetermined distance (the working distance of the microlens array 25). The microlens array 25 is on the imaging surface 30 where light corresponding to the image emitted from the image display surface 11 of the display unit 10 is separated by a predetermined distance (the working distance of the microlens array 25) opposite to the image display surface 11. The image displayed on the image display surface 11 is displayed on the image formation surface 30 which is a two-dimensional plane in space. This formed image is a two-dimensional image. If the image has a sense of depth, or if the background image on the display is black and the contrast is emphasized, it will float in space. Since it is displayed, it looks as if a stereoscopic image is projected from the front observer H. The imaging plane 30 is a plane virtually set in the space and is not an entity, but a plane in the space defined according to the working distance of the microlens array 25.

  The floating image display parameters of the microlens array 25 (specifically, an effective area (such as a microconvex lens array area capable of effectively forming incident light on the imaging surface 30) and a microconvex lens array pitch), The floating image display parameters of the display unit 10 (specifically, the pixel pitch of the image display surface 11, the effective pixel area, the brightness, contrast, and color of the image displayed on the image display surface 11) are the imaging plane 30. Are mutually optimized so that the floating images displayed on the screen are clearly displayed.

  As a result, as shown in FIG. 4, the microlens array 25 causes the light corresponding to the image P1 emitted from the image display surface 11 of the display unit 10 to be incident from the lens array half 21a and inverted once inside. Then, it is adjusted and arranged so that it is inverted again and emitted from the lens array half 21b. Accordingly, the microlens array 25 can display the two-dimensional image P1 displayed on the image display surface 11 of the display unit 10 as an upright floating image P2 on the imaging surface 30.

  More specifically, among the light forming the two-dimensional image P <b> 1 displayed on the image display surface 11, the image light in the region corresponding to each micro convex lens 23 of the micro lens array 25 is taken into each micro convex lens 23. Then, it is inverted inside each micro convex lens 23, inverted again and emitted, and the floating image P <b> 2 is displayed as a set of erect images formed by each micro convex lens 23.

  The microlens array 25 is not limited to a lens array half 21a, 21b, and may be composed of a single lens, or may be composed of a plurality of three or more. May be. Of course, even in the case where floating image formation is performed with an odd number of lens array halves 21 such as one, three, etc., as shown in FIGS. Since the light is inverted once inside and then inverted again, an upright floating image can be displayed.

  As described above, various configurations can be considered for the microlens array 25. The microlens array 25 configured in this way is not a single distance as a working distance for imaging light, but a certain fixed distance. It is possible to have an effective range.

  In the present embodiment, the image transmission panel 20 is the microlens array 25. However, the image transmission panel 20 is not limited to the microlens array 25, and an erect image, preferably an erect life-size image. As long as it forms an image, it may be anything, and it may be a lens or another prism having an image forming action other than a lens of another form. For example, the microlens array may be a gradient index lens array, a GRIN lens array, a rod lens array, or the like. The micromirror array may be a roof mirror array, a corner mirror array, or the like. The prism array may be a roof prism array, a dove prism array, or the like. Moreover, although it becomes a reverse image, it may be a single Fresnel lens having a necessary effective area instead of an array.

  The direct view image display unit 2 includes a display unit 40. Similar to the display unit 10, the display unit 40 includes an image display surface 41 that displays a two-dimensional image, and a display driving unit (not shown) that drives and controls the display unit 40. Specifically, the display unit 40 can be a color liquid crystal display (LCD), and includes a flat image display surface 41, a display driving unit including a backlight illumination unit, a color liquid crystal driving circuit, and the like. . Of course, the display unit 40 may be other than the LCD, and may be a display such as an EL (electro-luminescence) display, a plasma display, or a CRT (Cathode Ray Tube).

  The image display surface 41 of the display unit 40 is disposed substantially perpendicular to the imaging surface 30 below the floating image P2 in a region on the near side (imaging surface 30 side; + X direction) of the image transmission panel 20. The image displayed on the image display surface 41 can be directly viewed. In other words, in the present embodiment, the display unit 10 and the image transmission panel 20 are adjusted and arranged so that the floating image P2 is displayed in the space above the image display surface 41. In the present embodiment, the image display surface 41 is arranged below the floating image. However, the arrangement position of the image display surface 41 is not limited to this, and the image displayed on the image display surface 41 is the viewer H. May be arranged in any of the vertical and horizontal directions of the floating image. Further, if the image displayed on the image display surface 41 is at a position where the observer H can directly view the image, the image display surface 41 may be disposed so as to cross the image formation surface 30 of the floating image P2. Good.

  The position detection unit 120 is a sensor that detects the position and movement of the detection target (eg, a finger) F of the observer H, and outputs a detected signal (position information) to the image control unit 110. Yes. Specifically, the position detection unit 120 is disposed on the image display surface 41 of the display unit 40, a touch sensor that detects the contact position of the detection target F with respect to the image display surface 41, and a space above the image display surface 41. (Specifically, for example, the space above the image display surface 41 in the direction perpendicular to the image display surface 41 is excluded, and the space above the surface outside the image display surface 41 is excluded). It consists of sensors. That is, the image display surface 41 of the display unit 40 is a touch panel region, and the space above the image display surface 41 is a space sensor detection region. Note that the touch sensor and the spatial sensor may be of any type, for example, a capacitive type or resistive type touch sensor, an optical spatial sensor, or the like is assumed. In the present embodiment, two sensors are provided to detect the position of the detection object F. However, the configuration of the sensor is not limited to this, and the image display surface 41 and the image of the display unit 40 are not limited thereto. Any sensor may be used as long as the position of the detection object F can be detected in the space above the display surface 41.

  In this embodiment, in order to prevent malfunction, priority is given to the detection result of the touch sensor when touching the touch sensor, and priority is given to the detection result of the space sensor when not touching the touch sensor. It has become.

  The image control unit 110 generates image data to be displayed on the display unit 10 and the display unit 40, and displays the image data displayed on the display unit 10 and the image data displayed on the display unit 40 in conjunction with each other. Image control is performed. For example, the two-dimensional image P3 displayed on the display unit 40 is changed according to the change of the two-dimensional image P1 displayed on the display unit 10, or the display is changed according to the change of the two-dimensional image P3 displayed on the display unit 40. The two-dimensional image P1 displayed on the unit 10 is changed.

  In addition, the image control unit 110 performs control so that the two-dimensional image P1 displayed on the display unit 10 and the two-dimensional image P3 displayed on the display unit 40 are changed according to the output signal of the position detection unit 120. That is, the image control unit 110 changes the floating image P2 and the direct-view image P3 according to the position and movement of the detection target F of the observer H. For example, as will be described later, the display image P3 displayed on the display unit 40 is changed by the position detection of the detection target F by the position detection unit 120 (touch sensor), or the detection by the position detection unit 120 (spatial sensor). By detecting the position of the body F, the two-dimensional image P1 displayed on the display unit 10 is changed, and the floating image P2 is changed.

  Next, with reference to FIG. 6 and FIG. 7, an effect (hereinafter referred to as an interlocked effect) in which the floating image and the direct-view image of the image display device 100 according to the present embodiment are interlocked will be described. FIG. 6 is a flowchart showing the operation of the interlocking effect of the image display device 100. Here, the solid line portion indicates the operation of the image display apparatus 100, and the dotted line portion indicates the operation of the observer H. FIG. 7 is a diagram for explaining a specific example of the operation of FIG.

  First, the image control unit 110 of the image display device 100 displays one or more objects on the image display surface 41 of the display unit 40 (step S110). For example, in the specific example shown in FIG. 7, three objects P3a, P3b, and P3c are displayed on the image display surface 41. In the specific example shown in FIG. 7, the object displayed on the image display surface 41 has a circular shape. However, this is only an example, and the shape and color of the object may be any shape or color.

  In such a state, the observer H touches one object with the finger F among the objects displayed on the image display surface 41 (step S115). In the specific example shown in FIG. 7A, the finger F of the observer H touches the direct-view image P3b showing the object B. The object B is displayed on the image display surface 41 on the intersection line C between the image forming surface 30 and the image display surface 41.

  Thereby, since the touch sensor of the position detection unit 120 of the image display device 100 detects the contact position of the finger F (step S120), the image control unit 110 is based on the contact position detected by the position detection unit 120. The object selected by the observer H is specified (step S130). In the specific example illustrated in FIG. 7, the image control unit 110 grasps that the object B is selected from the contact position of the finger F. When the image control unit 110 identifies an object, the object selected by the observer H may be confirmed by changing the color of the identified object.

  Next, the observer H moves the finger F touching the image display surface 41 (touching the object B) upward from the image display surface 41 (step S135). That is, the finger F does not exist on the image display surface 41 but exists in the space above the image display surface 41.

  Thereby, the spatial sensor of the position detection unit 120 of the image display device 100 detects the position of the finger F of the observer H, more specifically, the height (Z coordinate) from the image display surface 41 (step S140). Here, the height of the finger F detected by the space sensor means, for example, the lowest position among the detected heights of the fingers F because the space sensor may detect the positions of a plurality of fingers F. And In the specific example shown in FIG. 7B, the spatial sensor of the position detection unit 120 detects the height H.

  Next, the image control unit 110 of the image display apparatus 100 displays the floating image P2 corresponding to the selected object according to the height detected by the position detection unit 120 (step S150). Here, the floating image P2 corresponding to the selected object is displayed by being expanded from the position of the selected object (on the image display surface 41) toward the space above the position of the selected object. The floating image P <b> 2 is displayed and displayed according to the height detected by the position detection unit 120. The position of the finger F of the observer H gradually increases, and thus follows the movement (trajectory) of the finger F. Thus, the floating image P2 is displayed with the height gradually increased. More specifically, the floating image P2 is displayed such that the shape of the object displayed on the image display surface 41 extends as it is to the height detected by the position detection unit 120 as a column (step S150). In the specific example shown in FIG. 7B, a floating image P <b> 2 of a columnar body having a height H, in which an elliptical object B is stretched upward as it is, is displayed on the image plane 30. The trigger for starting the display of the floating image P2 is when the space sensor detects the height (> 0) with respect to the finger F after selecting the object.

  As described above, in the interlocking effect of the present embodiment, the object selected by the observer H following the movement of the finger F by performing an operation of lifting the object selected on the image display surface 41 by the finger F. Since the floating image P2 corresponding to is displayed, the observer H can experience the feeling of pulling up the selected object (feeling of lifting).

  Next, in such a state, the observer H moves the finger F from the space above the image display unit 41 to a space outside thereof (step S155). That is, the finger F is moved from the detection area of the spatial sensor of the position detection unit 120 to the non-detection area. For example, in the specific example shown in FIG. 7C, the finger F of the observer H pulls out the finger F from the floating image P <b> 2 of the object B to the right space of the image display surface 41.

  As a result, the spatial sensor of the position detection unit 120 of the image display device 100 cannot detect the position of the finger F of the observer H (step S160). The height of the displayed floating image P2 of the object is gradually lowered, and finally the floating image P2 of the object is not displayed (step S170). More specifically, the height of the floating image P2 of the columnar body that exists up to the height H of the finger F (the final height when the finger F is present in the detection area of the space sensor) is gradually shortened downward. The floating image P2 that is going to be displayed is displayed, and finally the floating image P2 of the object is eliminated and not displayed (step S170).

  As described above, in the interlocking effect of the present embodiment, since the finger F is moved to the non-detection area of the space sensor and the height of the floating image P2 is gradually lowered and displayed, the observer H selects the selected object. The floating image P2 can be released and the user can experience a feeling that the floating image P2 falls according to gravity.

  As described above, according to the interlocking effect of the image display device 100 according to the present embodiment, when the finger F touches the object displayed on the image display surface 41 and the finger F touching the object is moved upward. Since the floating image P2 corresponding to the object becomes an object image having the height of the finger F following the movement of the finger, the observer H has a pseudo-experience as if he grabbed and lifted the selected object. Can do. Further, if the finger F is pulled out from the sensor detection area to the sensor non-detection area while holding the floating image P2, the height of the floating image P2 is gradually lowered and finally disappears. Can let go of the floating image P2 of the selected object and have a simulated experience as if the floating image P2 was dropped. As described above, the interlocking effect according to the present embodiment is a novel effect that has not existed in the past, and it is possible to enhance the effect of the effect by strengthening the interlocking between the direct-view image and the floating image, and an intuitive and easy-to-understand user interface. Can be provided.

  In the present embodiment, the image display surface 41 of the image display unit 40 is arranged at a position below the floating image P2. However, as described above, the arrangement position of the image display surface 41 of the image display unit 40 Is not limited to this, and may be arranged in any direction (up / down / left / right, diagonal) of the outer edge of the floating image P2. For example, when the display surface 41 is arranged on the left side of the floating image P2 and substantially perpendicular to the imaging surface 30, the finger F is touched to the object displayed on the image display surface 41, and the finger F is moved to the right side. When moved (when the finger F is released from the image display surface 41), the floating image P2 corresponding to the object follows the movement of the finger F and moves to the right from the position where the object is displayed on the image display surface 41. Elongate. When the finger F is pulled out from the detection area of the space sensor, the displayed floating image P2 is gradually shortened to the left and eventually disappears. As described above, when the image display surface 41 is arranged on the left side of the floating image P2, a feeling of pulling and stretching an elastic body such as a spring and a feeling of returning to the original when the pulled elastic body is released. Can experience.

  However, when the image display surface 41 of the image display unit 40 is disposed at a position below the floating image P2, the human knows instinctively that the object will fall when it is released due to gravity. You can get a very natural feeling that matches the law. Therefore, the configuration in which the image display surface 41 of the image display unit 40 is disposed below the floating image P2 is more preferable as a user interface. Then, when the floating image P2 is pulled up or dropped, image control that is affected by gravity may be performed. For example, when pulling up a heavy object, the speed of following the finger F of the floating image P2 is slow, and when the object is light and heavy, the image control is performed so that the falling speed of the floating image P2 is different. May be. Thereby, the observer H can obtain a more natural feeling.

  Moreover, in step S155 of the interlocking production described above, control is performed so that the floating image P2 is lowered by moving the finger F to the non-detection region of the position detection unit 120 (spatial sensor). The trigger for lowering the image P2 is not limited to this, and the floating image P2 may be controlled to fall based on other actions of the observer H.

  For example, as shown in FIGS. 8 and 9A, the finger of the observer H is displayed while the floating image P2 corresponding to an object is being displayed (the floating image P2 is displayed following the movement of the finger F). The floating image P <b> 2 may be lowered when F touches another object displayed on the image display surface 41 of the display unit 40 (Modification 1). Here, FIG. 8 is a flowchart showing the operation of the modified example 1 of the interlocking effect of the image display device 100. Here, the solid line portion indicates the operation of the image display apparatus 100, and the dotted line portion indicates the operation of the observer H. FIG. 9A is a diagram illustrating a specific example showing the operation of FIG. In FIG. 9, steps denoted by the same reference numerals as those in FIG. 7 indicate the same processing contents as the processing contents shown in FIG. 7, and therefore description thereof will be omitted, and only steps having different processing contents will be described.

  In the state where the floating image P2 is displayed, the observer H touches another object displayed on the image display surface 41 (an object different from the object of the currently displayed floating image P2) with the finger F (step S156). For example, in the specific example shown in FIG. 9A, the finger F of the observer H touches the direct view image P3c of the object C from the floating image P2 of the object B.

  Accordingly, the touch sensor of the position detection unit 120 of the image display device 100 detects the contact position of the finger F (step S161). Based on the contact position detected by the position detection unit 120, the image control unit 110 The object newly selected by the observer H is specified (step S162). In the specific example illustrated in FIG. 9A, the image control unit 110 grasps that the object C is selected from the contact position of the finger F.

  Next, since the image control unit 110 of the image display device 100 has found that an object different from the object corresponding to the floating image P2 currently displayed on the image display device 100 has been selected, the displayed object The height of the floating image P2 is gradually lowered, and finally the floating image P2 of the object is hidden (step S170). More specifically, the height of the floating image P2 of the columnar body that exists up to the height H of the finger F (the final height when the finger F is present in the detection area of the space sensor) is gradually shortened downward. The floating image P2 that is going to be displayed is displayed, and finally the floating image P2 of the object is eliminated and not displayed (step S170). After this, the transition to the operation of lifting the object C is as described above (steps S110 to S150).

  Thus, various triggers for lowering the floating image P2 can be set by other actions of the observer H.

  In the above-described interlocking effect, the case where the finger F of the observer H is moved in the direction perpendicular to the image display surface 41 (+ Z axis direction) has been described. However, the moving direction of the finger F is not limited to this. . For example, as shown in FIG. 9B, it may be moved obliquely upward. In this case, not only the height (Z coordinate) of the finger F of the observer H is detected, but the position of the finger F, more specifically, the spatial position coordinates of the finger F (X coordinate, Y coordinate, Z coordinate). ) And the floating image P2 may be displayed so as to follow the movement of the finger F based on the position of the object selected on the image display surface 41 and the detected position of the finger F. .

  In the above-described interlocking effect, the shape of the floating image P2 is the columnar floating image P2 extended from the image display surface 41. However, the shape of the floating image P2 is not limited to this, and the floating image P2 is not limited thereto. If the shape of the column is a column having a finite predetermined height and the finger F is moved upward beyond this height, the floating image P2 of the column is lifted from the image display surface 41 and displayed. You may make it do. For example, as shown in FIG. 9C, when the floating image P2 of the cylindrical body having the height H1 is displayed and the finger F is moved to a position higher than the height H1, the floating image P2 is displayed. May be displayed in a floating manner. In this case, a direct-view image P3b such as a shadow of a cylindrical body may be displayed on the image display surface 41 in order to emphasize that it is floating.

  Further, the floating image P2 may be displayed only when a predetermined condition is satisfied, instead of always displaying the floating image P2. For example, the floating image P2 corresponding to the object may be displayed only when the finger F is moved to a height equal to or higher than the threshold value. In this case, even if the finger F is moved to a height less than the threshold value, the floating image P2 is not displayed.

  In the specific example of the interlocking effect described above, the interlocking effect relating to the object B displayed on the intersection line C between the imaging surface 30 and the image display surface 41 has been described. However, the interlocking effect is displayed at another position on the image display surface 41. Of course, the present invention is also applied to the object. However, when an interlocking effect is performed on an object displayed at a position that is not on the intersection line C between the imaging surface 30 and the image display surface 41, it is necessary to devise a more natural three-dimensional display. Since the position of the object displayed on the image display surface 41 as the direct-view image P3 and the position (imaging plane 30) where the floating image P2 corresponding to the object is displayed are different in the depth direction (X direction), the observer H This is because it may give a sense of incongruity.

  FIG. 10 is a diagram illustrating a state of the interlocking effect for the object B displayed at a position not on the intersection line C. FIG. In FIG. 10, as shown in FIG. 9C, image control is performed so that the floating image P <b> 2 of the cylindrical body with respect to the selected object is lifted and displayed. As an example, when the floating image P2 is lifted as shown in FIG. 10B, the direct-view image showing the shadow of the cylinder instead of the direct-view image P3b of the object B displayed on the image display surface 41. P3b ′ may be displayed on the image display surface 41, and the direct-view image P3b ′ may be moved on the intersection line C. As another example, when the floating image P2 is lifted as shown in FIG. 10B, the direct-view image P3 displayed on the image display surface 41 may be deleted.

  As a result, even an object that is not displayed on the intersection line C of the image display surface 41 can be displayed in a more natural three-dimensional display, so that the linkage between the floating image P2 and the direct-view image P3 in the linkage effect is expressed without a sense of incongruity. be able to. When such a device is not performed, the direct-view image P3 is controlled so that the object is displayed on the image display surface 41 in the vicinity of the imaging plane 30, and the floating image is displayed with respect to the object in the vicinity of the imaging plane 30. It is preferable to display P2.

  In the above embodiment, the floating image display unit 1 has a configuration in which a real image is displayed on the imaging plane 30 (a method in which a floating image is formed on one plane; hereinafter, a 3D floating vision (registered trademark) method). However, the configuration of the floating image display unit 1 is not limited to this method, and any method may be used as long as a real image is displayed as a floating image. For example, an IP (integral photography) system that displays a real image as a floating image may be adopted.

  FIG. 11 is a schematic configuration diagram of an image display apparatus 100A employing the IP method. In the case of the IP system, as shown in FIG. 11, the image transmission panel 20A is arranged at a position closer to the display unit 10 than in the 3D floating vision (registered trademark) system. Specifically, the image transmission panel 20A is a pinhole array, a microlens array, a lenticular lens, and the like. The image transmission panel 20A does not form an image on a single plane, but instead of the light emitted from the display unit 10. Since it is used to change or control the direction, the floating image P2A is formed as a floating image having a depth.

  That is, the floating image according to the present embodiment includes not only a two-dimensional image P2 displayed on a predetermined plane in the space but also a three-dimensional image P2A displayed with a physical depth in the space. It is.

  In the case where the above-described interlocking effect is performed by the image display device 100A, since the floating image P2A is displayed with a depth, consideration as shown in FIG. 10 is not necessary, and a more realistic interlocking effect is provided. It can be carried out. However, in the case of the image display device 100A, since the floating image P2A having a depth is displayed, the two-dimensional image displayed on the display unit 10 is displayed as compared with the case of the 3D floating vision (registered trademark) system of the image display device 100. Therefore, the 3D floating vision (registered trademark) system of the image display device 100 is more suitable from the viewpoint of easily producing a stereoscopic image.

  FIG. 12 shows an example when the image display device 100 (100A) is used for the user interface of the music playback device. This music playback apparatus displays the title menu of an album such as a CD or a record on the image display unit 41 of the display unit 40, and plays back the music of the album selected by the viewer H (viewer).

  First, since the image display device 100 (100A) displays the title menu on the image display surface 41 of the display unit 40 (see FIG. 12A), the observer H operates the scroll bar to operate the title menu. While scrolling, search for an album to be reproduced from the title menu, and when an album to be reproduced is found, touch the title of the album to be reproduced displayed on the image display surface 41 with a finger F (see FIG. 12B).

  When the image display device 100 (100A) grasps the album selected from the position touched by the finger of the observer H (specifically, the touch sensor of the position detection unit 120 detects the contact position of the finger F, and the image control unit 110 determines the selected album from the detection position), the color of the title area of the selected album is changed (see FIG. 12B), so that the observer H can confirm the title of the selected album. it can.

  Next, when the observer H lifts the finger F touching the image display surface 41, the image display device 100 (100 </ b> A) selects the album by moving the finger (the finger F touches the image display surface 61 of the display unit 40). After that, the movement of the finger F moving away from the image display surface 41 is detected, so that the “jacket image” of the selected album is displayed as the floating image P2 in accordance with the movement of the finger F (FIG. 12 (c)).

  This is because the position detection unit 120 (spatial sensor) detects the position of the finger F (the height of the display unit 60 from the image display surface 61), so that the image control unit 110 matches the detected height of the finger F. Thus, image control is performed so that the “jacket image” is displayed as the floating image P2. Therefore, when the finger F is gradually moved upward from the image display surface 61, the height of the “jacket image” gradually increases following the movement of the finger F and reaches the height position of the finger F. The floating image P2 will be displayed. Thereby, the observer H can taste as if he / she lifted the album of the record he / she selected.

  More preferably, it is assumed that the position detection unit 120 (space sensor) can detect the position of each of the plurality of fingers F. From the positions of the plurality of fingers F detected by the position detection unit 120 (space sensor), The shape of F may be specified, and the floating image P2 may be displayed based on the specified shape of the finger F. That is, when the finger F touches the image display surface 41 and grabs the album (a state in which the finger and the finger are combined) and moves upward as it is, it is selected according to the movement of the finger F. The “jacket image” of the album may be displayed as the floating image P2.

  More preferably, assuming that the position detection unit 120 (space sensor) can detect the position of each of the plurality of fingers F, from the positions of the plurality of fingers F detected by the position detection unit 120 (space sensor), The shape of F may be specified, and the displayed floating image P2 may be hidden based on the specified shape of the finger F. In other words, when the floating image P2 is displayed and the finger F is shaped to release the album (in a state where the interval between the combined fingers is widened), the floating “jacket image” of the selected album is displayed. The height of the image P2 may be gradually lowered and finally hidden.

  As described above, the image display apparatus 100 (100A) includes a suitable user interface for searching for desired information from a large amount of information (album in the example shown in FIG. 12) list. In other words, the observer H can intuitively change information at high speed, such as grasping and lifting and releasing, and then grasping and lifting the next, and also obtains a more natural sense using gravity. be able to.

  When the music of the selected album is reproduced, for example, a predetermined operation for reproducing the music may be executed such as moving the finger F to the left. That is, during the operation of moving the finger F upward, control is performed to display the “jacket image” that is the floating image P2 of the selected album, and the finger F lifted with the “jacket image” displayed is leftward When moving to, the music of the selected album should be played.

  As described above, the image display device 100 according to the present embodiment includes the first display unit 10 including the first image display surface 11 that displays a two-dimensional image, and the first image display surface 11. An image transmission panel 20 disposed in the optical path of the emitted light, and the light emitted from the first image display surface 11 is opposite to the side facing the first display unit 10 of the image transmission panel 20 A floating image display unit 1 that displays a floating image P2 in a space located on the side, and a second image display surface 41 that displays a two-dimensional image on the outer edge of the space where the floating image P2 is displayed. A direct-view image display unit 2 that displays one or a plurality of objects as direct-view images on the second image display surface, the second image display surface 41, and the second image display surface. Detects the position of the detection object F in the space where light is emitted 2D image P1 displayed by the first display unit 10 or the 2D image displayed by the second display unit 40 based on the position detection unit 120 and the position of the detection object F detected by the position detection unit 120. An image control unit 110 that controls at least one of P3, and the image control unit 110 detects a position detection unit when the detected object F touches an object displayed on the second image display surface 41. Based on the position of the detected object F detected by 120, the selected object is specified, and after the detected object F touches the object displayed on the second image display surface 41, the detected object F becomes the first object. When moving away from the second image display surface 41, the floating image P2 corresponding to the specified object is expanded and displayed in a direction away from the second image display surface 41 from the position where the specified object was displayed. As described above, the two-dimensional image P1 displayed by the first display unit 10 is controlled, and based on the position where the specified object is displayed and the position of the detected object F detected by the position detection unit 120, Since the two-dimensional image P1 displayed by the first display unit 10 is controlled so that the displayed floating image P2 follows the trajectory of the detection object F, the linkage between the direct-view image and the floating image is strengthened, and the rendering effect In addition, the operation and display can be realized intuitively and easily.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications can be made to the embodiments of the present invention without departing from the gist of the present invention. Such modifications and changes can be made, and those accompanying such modifications and changes are also included in the technical scope of the present invention.

1 is an external perspective view of an image display device according to an embodiment of the present invention. It is the external view and functional block diagram seen from the side of the image display apparatus which concerns on embodiment of this invention. It is a block diagram of the image transmission panel of the image display apparatus which concerns on embodiment of this invention. It is a figure explaining the optical effect | action of the micro lens array which is an image transmission panel of the image display apparatus which concerns on embodiment of this invention. It is a figure explaining the optical effect | action of the microlens array of a structure different from the microlens array shown in FIG. It is a flowchart which shows the operation | movement of the interlocking production of the image display apparatus which concerns on embodiment of this invention. It is a figure which shows the example of an image of the interlocking production shown in FIG. It is a flowchart which shows operation | movement of the modification of the interlocking production of the image display apparatus which concerns on embodiment of this invention. It is a figure which shows the example of an image of the interlocking production shown in FIG. It is a figure which shows the example of an image of the interlocking production of the image display apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the image display apparatus which concerns on another embodiment of this invention. It is a figure which shows the example of an image of the interlocking production of the image display apparatus which concerns on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Floating image display part 2 Floating image recognition part 10,40 Display part 11,41 Image display surface 20,20A Image transmission panel 21 Lens array half body 22 Transparent substrate 23 Micro convex lens 25 Micro lens array 30 Imaging surface 100,100A Image Display device P1 2D image P2, P2A Floating image P3 Direct view image (2D image)
H Observer F Object to be detected

Claims (9)

A first display unit having a first image display surface for displaying a two-dimensional image;
An image transmission panel disposed in an optical path of light emitted from the first image display surface,
Floating image display means for displaying light emitted from the first image display surface as a floating image in a space located on the opposite side of the image transmission panel from the side facing the first display unit;
A second display unit having a second image display surface for displaying a two-dimensional image at an outer edge of a space in which the floating image is displayed; and one or a plurality of objects on the second image display surface Direct view image display means for displaying as a direct view image;
Position detecting means for detecting the position of the detection object in the second image display surface and a space on the side where light is emitted from the second image display surface;
Based on the position of the detection object detected by the position detection means, at least one of the two-dimensional image displayed by the first display unit or the two-dimensional image displayed by the second display unit is controlled. Image control means;
With
The image control means includes
When the detected object touches the object displayed on the second image display surface,
Based on the position of the detected object detected by the position detecting means, the selected object is identified,
After the detected object touches the object displayed on the second image display surface, when the detected object leaves the second image display surface,
The first display unit displays the floating image corresponding to the identified object from the position where the identified object was displayed so as to extend in a direction away from the second image display surface. While controlling 2D images,
Based on the position where the identified object is displayed and the position of the detected object detected by the position detecting means, the displayed floating image is made to follow the locus of the detected object. An image display device that controls a two-dimensional image displayed by one display unit. The image control means includes
After the floating image is displayed, when the position detection unit cannot detect the detected object,
2. The two-dimensional image displayed by the first display unit is controlled so that the displayed floating image is gradually shortened toward the second image display surface and disappears. Image display device. The image control means includes
Based on the position of the detected object detected by the position detecting means, the object to be detected is touched on an object different from the object associated with the floating image displayed on the second image display surface. If it is determined that the selected object is the different object,
2. The two-dimensional image displayed by the first display unit is controlled so that the displayed floating image is gradually shortened toward the second image display surface and disappears. Image display device. The image control means includes
When the floating image corresponding to the identified object is displayed by being lifted from the second image display surface, the shadow of the floating image corresponding to the identified object is displayed on the second image display surface. The image display apparatus according to claim 1, wherein the two-dimensional image displayed by the second display unit is controlled. The floating image is
The image display device according to claim 1, wherein the image display device is a real image based on a two-dimensional image displayed on the first image display surface. The floating image is
The image display device according to claim 5, wherein the image display device is a real image formed on an image plane in space by the image transmission panel. The floating image display means includes
Forming the floating image on an image plane in space;
The image control means includes
The floating image corresponding to the specified object is displayed by being lifted from the second image display surface, and the detected object is located on the intersection line of the imaging surface and the second image display surface. When an object displayed at a position other than is touched, the shadow of the floating image corresponding to the specified object is not displayed on the second image display surface, or the shadow of the floating image corresponding to the specified object is not displayed. The image display apparatus according to claim 4, wherein the specified object is moved from a position where the specified object is displayed to a position on the intersection line. The detected object is composed of a plurality of parts,
The position detecting means includes
In the space where light is emitted from the second image display surface, it is possible to detect the respective positions of the plurality of portions of the detected object;
The image control means includes
When the detected object touches the object displayed on the second image display surface,
Based on the position of the detected object detected by the position detecting means, the selected object is identified,
After the detected object touches the object displayed on the second image display surface and a plurality of portions of the detected object form a first shape, the detected object displays the second image display When away from the surface
The floating image corresponding to the identified object from the position where the identified object is displayed by identifying the first shape from the positions of the plurality of portions of the detected object detected by the position detecting means. And controlling the two-dimensional image displayed by the first display unit so as to extend and display in a direction away from the second image display surface,
Based on the position where the identified object is displayed and the position of the detected object detected by the position detecting means, the displayed floating image is made to follow the locus of the detected object. Controlling the two-dimensional image displayed by one display unit,
After displaying the floating image, when a plurality of portions of the detected object has a second shape,
The displayed floating image is gradually shortened toward the second image display surface by specifying the second shape from the positions of the plurality of portions of the detected object detected by the position detecting means. The image display apparatus according to claim 1, wherein the two-dimensional image displayed by the first display unit is controlled so as to be erased.   5. The image display device according to claim 1, wherein the second image display surface of the second display unit is disposed below the floating image. 6.

Images