JP4076090B2 - Image display system - Google Patents

Description

  The present invention relates to an image display system, an image display method, and an image display program, and more particularly, to a technique effective when applied to an image display system in which a touch panel and a three-dimensional display device are combined.

  Conventionally, there is a flat switch called a touch panel as input means (man machine interface) for inputting operation information such as selection of an image (object) displayed on a display device. In an image display system in which the touch panel and the display device are combined, the touch panel is arranged on the image display surface of the display device. When the user touches the touch panel with an input pen such as a fingertip or a stylus, an object on the image display surface corresponding to the position touched by the fingertip or the pen tip of the input pen can be selected.

  Such an image display system can provide a feeling of operation while directly touching an object displayed on the image display surface, for example. Therefore, the image display system is applied to various uses as a system capable of intuitive operation close to the real world as compared with, for example, operation using a keyboard, mouse, mechanical buttons, and the like.

  Further, in the image display system, as a method for obtaining an operation feeling closer to the real world, for example, a system using a three-dimensional display device (stereoscopic display device) as the display device has been proposed (for example, (See Patent Document 1).

  In the image display system using the three-dimensional display device, for example, an object such as a button can be displayed three-dimensionally, or a plurality of objects can be displayed at depth positions with different distances from the user. That is, by using the 3D display device, for example, when one of a plurality of objects displayed at the same depth position is selected, it is possible to display only the selected object while changing the depth position. is there. Therefore, by using the 3D display device, an image (object) can be displayed in a state closer to the real world (3D space), and a more intuitive operational feeling can be obtained.

  Examples of the three-dimensional display device include a stereoscopic display device using a fixed focus lens and a refractive index variable substance (see, for example, Patent Document 2), and a three-dimensional display device called DFD (for example, Patent Document 3). See.) Is known.

  The stereoscopic display device described in Patent Document 2 is a device that stereoscopically displays a two-dimensional image displayed on the display means, and the difference in dielectric constant when a voltage of the first frequency is applied is positive. A layer of a refractive index variable material having two or more different dielectric constants, wherein the difference between the dielectric constants when the voltage of the second frequency is applied becomes a negative value, and a fixed focus lens having a predetermined focal length And an imaging position shift that moves the imaging position of the two-dimensional image displayed on the display means, comprising at least a pair of transparent electrodes that sandwich a layer made of the fixed focus lens and the refractive index variable substance. Means, a synchronizing means for synchronizing the update cycle of the two-dimensional image displayed on the display means and the moving period of the imaging position of the imaging position moving means, and the different first based on the synchronizing means Frequency and said second frequency Wherein the driving output consisting of a three-dimensional display apparatus comprising a drive means for driving the imaging position moving means. In other words, the stereoscopic display device described in Patent Document 1 synchronizes the change in the refractive index of the refractive index variable substance with the switching period of the two-dimensional image, so that the fixed focus lens, the refractive index variable substance, This is a device that displays (presents) a three-dimensional image by changing the focal length of the layer consisting of the above, displaying a plurality of floating images with different depth positions as viewed from the observer. Therefore, in order to display the three-dimensional image, display means having a high image display switching speed (response speed) is required, and the dielectric constant of the refractive index variable substance is synchronized with the image switching. Each of the above means for changing is necessary.

  Further, in the stereoscopic display device described in Patent Document 1, increasing the resolution of a high-speed display element is not only difficult to manufacture, but the amount of information to be supplied to the device during driving becomes enormous. It is not realistic. Therefore, for example, there is a problem that it is difficult to apply to a display device including a touch panel that performs display that requires high definition such as character information.

Further, the DFD described in Patent Document 2 is a two-dimensional image obtained by projecting a display target object from a plurality of display surfaces at different depth positions as viewed from the observer, from the line-of-sight direction of the observer. And displaying the generated two-dimensional image on a plurality of display surfaces at different depth positions as viewed from the observer, and the brightness of the displayed two-dimensional image for each display surface. It is an apparatus that generates a three-dimensional stereoscopic image by changing it independently. Such a DFD is a ratio of the luminance of the image displayed on the front display surface (display means) viewed from the observer and the luminance of the image displayed on the back display surface viewed from the observer. By changing the display device, the display device appears to display the image at a position corresponding to the luminance ratio of the image between the display surfaces. That is, in the DFD, the generated three-dimensional stereoscopic image is limited between the display surfaces for displaying the two-dimensional image. Therefore, in the case of a conventional image display system in which the DFD and the touch panel are combined, an image (object) displayed by the DFD is displayed only behind the front display surface (touch panel) as viewed from the user. The In such an image display system, for example, when one of a plurality of objects (buttons) displayed at the same depth position is selected and the selected object is displayed, the selected object is displayed. Moves in the direction toward the back as viewed from the user. For this reason, when viewed from the user, the sense of discomfort may be felt in the distance between the touched position and the selected object, and the behavior of the object may be unnatural.
JP 2004-192294 A Japanese Patent No. 3310157 Japanese Patent No. 3460671

  The problem to be solved by the present invention is that, as described in the background art, for example, a stereoscopic display device (three-dimensional display device) as described in Patent Document 1 or Patent Document 3 and the touch panel are used. In the case of a combined image display system, the touch panel exists at substantially the same depth position as the foremost display surface among the display surfaces displayed on the display device, so that the displayed image (object ) Is likely to feel unnatural behavior when touched.

  As another problem, in the case of an image display system in which the stereoscopic display device and the touch panel described in Patent Document 2 are combined, the configuration is complicated and the system is enlarged. Further, in the case of such an image system, in order to display the stereoscopic image, a display means having a high image display switching speed (response speed) is required, and the dielectric constant of the refractive index variable substance. Must be changed in synchronization with the switching of the image, and there is a problem that the application range is limited.

  An object of the present invention is to provide a technique capable of reducing discomfort in the behavior of a displayed image (object) and improving operability in an image display system combining a touch panel and a three-dimensional display device. It is in.

  Another object of the present invention is to provide a technique capable of simplifying the configuration of the three-dimensional display device and reducing the size of the device.

  The above and other objects and novel features of the present invention will be apparent from the description of this specification and the accompanying drawings.

  The outline of the invention disclosed in the present application will be described as follows.

(1) a three-dimensional display device capable of displaying a three-dimensional stereoscopic image of an object, a detection means for detecting the position of the tip of a fingertip or a rod-like operation means, and the fingertip or the operation means detected by the detection means An image display system including control means for performing switching control of a display image of an object displayed on the three-dimensional display device in accordance with a position of a tip, wherein the detection means is the three-dimensional display as viewed from an observer. It is means for detecting the position of the fingertip or the tip of the operating means in a detection area that is in front of the apparatus and overlaps with the three-dimensional display device, and the three-dimensional display device is configured to detect the detection as viewed from an observer. on the image presentation space including the inner space than before the space and the detecting means from the region, Ri display der a plurality of object displays a 3-dimensional image three-dimensionally arranged, the three-dimensional The display device includes a display unit that displays the three-dimensional stereoscopic image, and an equal-magnification imaging optical system that forms the three-dimensional stereoscopic image displayed on the display unit in the image presentation space at an equal magnification. The equal-magnification imaging optical system includes n lenses (n is an integer of 2 or more) arranged in front of the display unit when viewed from the observer, and the n lenses In the recurrence formulas represented by the following formulas (1) to (4) , where f is the focal length of each lens and M _k is the magnification of image formation of light that has passed through the k lenses . M _{k = n} = 1 or −1, and the image display system is arranged at equal intervals with an interval d that does not depend on L ₀ .

(2) a three-dimensional display device capable of displaying a three-dimensional stereoscopic image of an object, a detection means for detecting the position of the tip of a fingertip or a rod-like operation means, and the fingertip or the operation means detected by the detection means An image display system including control means for performing switching control of a display image of an object displayed on the three-dimensional display device in accordance with a position of a tip, wherein the detection means is the three-dimensional display as viewed from an observer. It is means for detecting the position of the fingertip or the tip of the operating means in a detection area that is in front of the apparatus and overlaps with the three-dimensional display device, and the three-dimensional display device is configured to detect the detection as viewed from an observer. A display device for displaying a three-dimensional stereoscopic image in which a plurality of objects are three-dimensionally arranged on an image presentation space including a space in front of an area and a space behind the detection means, The display device includes display means for displaying the three-dimensional stereoscopic image, and an equal magnification imaging optical system that forms the three-dimensional stereoscopic image displayed on the display means in the image presentation space at an equal magnification. The equal-magnification imaging optical system includes n + 1 (n is an integer equal to or greater than 1) focal length f ₁ lenses and n focal lengths arranged in front of the display means as viewed from the observer. There and a lens f _2, the focal length is the focal length of the lens f ₁ is f ₂ lenses are arranged alternately, and the focal length of f ₁ lens, a k lenses In the recursion formula represented by the following formulas (5) to (8) when the magnification of imaging of the light passing therethrough is M _k , M _{k = 2n + 1} = 1 or −1 is satisfied, and An image display system arranged at equal intervals with an interval d independent of L ₀ .

(3) In the image display system of (1) or (2), the control means includes a detection signal receiving means for receiving a detection signal from the detection means, and a detection signal received by the detection signal receiving means. When the tip of the fingertip or the operation means is detected, image data generated by moving other objects excluding the object corresponding to the position of the fingertip or the tip of the operation means to the front as viewed from the observer is generated. When the tip of the fingertip or the operating means is no longer detected, the image data generating means for generating image data in which the object moved forward as viewed from the observer is returned to the position before the movement, and Video signal transmission means for transmitting the image data generated by the image data generation means to the three-dimensional display device as a video signal.

(4) In the image display system according to (1) or (2), when the detection unit is pushed in the depth direction by the fingertip or the operation unit in addition to the three-dimensional display device, the detection unit, and the control unit. And a repelling means for applying a repulsive force according to the pushing amount of the detecting means to the detecting means, the control means receiving a detection signal from the detecting means, and a pushing amount of the detecting means A pushing amount signal receiving means for receiving a pushing amount signal indicating a repulsion control signal transmitting means for calculating a repulsive force corresponding to the pushing amount and transmitting it as a repulsion control signal to the repelling means; and receiving by the detection signal receiving means When the tip of the fingertip or the operating means is detected from the detected signal, the fingertip or the tip of the operating means is detected based on the amount of pushing of the detecting means. The image data is generated by moving the object corresponding to the position so that the relative positional relationship with the detection means does not change, and the moved object is detected when the tip of the fingertip or the operation means is no longer detected. Image data generating means for generating image data returned to the position before movement, and video signal transmitting means for transmitting the image data generated by the image data generating means to the three-dimensional display device as a video signal.

(5) In the image display system according to (3) or (4), the detection unit detects a position of the fingertip or the tip of the operation unit by touching the fingertip or the tip of the operation unit. And a second detection for detecting the position of the fingertip or the tip of the operating means by the tip of the fingertip or the operating means entering the detection space in front of the first detecting means as viewed from the observer And when the position of the tip of the fingertip or the operating means is detected only by the second detection means in addition to the respective means, the control means has an object corresponding to the detected position Image data obtained by translating each object in the depth direction so as to be at a predetermined depth position in the image presentation space is generated, and the fingertip or If the position of the tip of the operating means is not detected comprises means for generating image data that returned said each object by the translation to the original depth position.

(6) In the image display system according to any one of (1) to (3), the detection unit includes a plurality of cameras that photograph the detection area, and the control unit includes images of the plurality of cameras. And a means for obtaining the position of the fingertip or the operating means.

The image display system of the present invention, by displaying the three-dimensional image on the image presentation space comprising inner space from the space and the detecting means of front of the detection region when viewed from the observation person, for example, the When the detection means is touched with a fingertip or an operation means, an image (object) can be displayed in front of the detection means. Therefore, compared to the conventional image display system in which an image (object) is displayed only behind the detection area as viewed from the observer, a more operational feeling in the real world is obtained and displayed. It is possible to reduce a sense of incongruity in the behavior of the image (object) that is present and improve operability.
At this time, the three-dimensional display device may be any display device as long as it can display the three-dimensional stereoscopic image (object) on the image presentation space, but can be applied to various applications. In view of the above, a simple configuration is preferable.

As the three-dimensional display device, for example, it is preferable to use a display device including an equal-magnification imaging optical system in which a plurality of lenses having the same focal length are stacked as in the image display system of (1). The equal-magnification imaging optical system has a distance L from the equal-magnification imaging optical system to a display image (object). ₀ Regardless of the distance, an image can be formed at an equal magnification at any distance. Therefore, an object displayed in a three-dimensional manner on the three-dimensional display device can be easily displayed on an image presentation space including a space in front of the detection unit and a space in the back of the detection unit.

Further, by using an equal magnification imaging optical system having a simple configuration as in the image display system of (1), for example, the configuration of the display device is simplified compared to the stereoscopic display device described in Patent Document 2. And can be downsized.

The 1 × imaging optical system in the image display system of (1) is an optical system in which n lenses are stacked. However, the present invention is not limited to this, and the 1 × imaging optical system and optical of (1) are not limited thereto. The same effect can be obtained with a substantially equivalent configuration. Therefore, for example, a curved mirror having the same focal length can be used instead of the lens. In addition, for example, by using a plane mirror, a half mirror, or a polarization beam splitter, the light incident on the optical system is passed through one lens a plurality of times, thereby stacking n lenses with less than n lenses. A configuration equivalent to the optical system described above can also be used.

Further, when using an optical system in which a plurality of lenses are stacked as the equal magnification imaging optical system, for example, as in the equal magnification imaging optical system in the image display system of (2), n + 1 sheets Focal length is f ₁ Lens and n focal lengths are f ₂ An optical system in which these lenses are alternately stacked may be used. In this way, for example, the focal length is f ₁ The distance when the m lenses are arranged is set so that the focal length is f in the equal-magnification imaging optical system of (1). ₁ As compared with the case where only m lenses are arranged, the interval can be reduced, and the display device can be further downsized.

The equal-magnification imaging optical system is not limited to an optical system in which a plurality of lenses are stacked as in (1) or (2), but, for example, one or two or more concave mirrors are combined. It may be an optical system. Furthermore, an optical system composed of a rod-shaped lens array in which rod-shaped lenses are arranged in a two-dimensional array may be used.

In addition, when a display device having the same-magnification imaging optical system as in (1) or (2) is used as the three-dimensional display device, for example, the three-dimensional stereoscopic image displayed by the display means is detected. Even if it is behind the means (detection region), the three-dimensional stereoscopic image can be formed on the image presentation space by passing through the equal-magnification imaging optical system. Therefore, the display means for displaying a 3D stereoscopic image of an object (object) may be any means as long as it can display a 3D stereoscopic image. For example, a general liquid crystal display or a plasma display may be used. For example, it may be a two-dimensional display unit that displays a two-dimensional image, or a three-dimensional display unit that can display a three-dimensional stereoscopic image, such as a DFD or a volume scanning display device.

In the image display system according to (1) or (2), it is desirable that the control means includes, for example, each means as described in (3). In this case, for example, when the detection means detects the tip of the fingertip or the operation means, the object other than the object pointed to by the fingertip or the operation means is the front direction when viewed from the observer Can be moved to. At this time, for example, if a plurality of buttons are displayed on the detection means as the object, an object other than the object (button) pointed to by the fingertip or the tip of the operation means moves forward, The operator (operator) can obtain a visual effect as if the object (button) pointed to is pressed, and can obtain an operation feeling close to the operation of pressing the button in the real world.

In the image display system of (1) or (2), for example, the repulsion means may be provided as in (4). In this way, for example, when the tip of the fingertip or the operating means is pushed down, only the object pointed to by the fingertip or the operating means can be moved in the back direction as viewed from the observer. . At this time, for example, if a plurality of buttons are displayed on the detection means as the object, only the object (button) pointed to by the fingertip or the tip of the operation means moves to the back, so that the observer ( The visual effect as if the operator) pressed the indicated object (button) is obtained. At this time, when the detection means is pushed in the depth direction as viewed from the observer, a repulsive force corresponding to the pushing amount is applied to the detection means from the repulsion means. Therefore, the observer (operator) can feel the repulsive force applied from the repulsion means to the detection means through the fingertip or the operation means. Therefore, it is possible to obtain an operation feeling close to the operation of pressing a button in the real world.

In the image display system of (3) or (4), the detection means may include two detection means of the first detection means and the second detection means as in (5). Good. At this time, when the first detection means detects the position of the fingertip or the tip of the operation means, the image data generation means (3) or (4) generates an image. When the position of the tip of the fingertip or the operating means is detected by the second detecting means, an object corresponding to the position of the fingertip or the tip of the operating means detected by the second detecting means is previously stored in the image presentation space. The object is translated in the depth direction while maintaining the relative positional relationship of the objects so as to reach a predetermined depth position. By doing so, it becomes easier to recognize the object pointed by the fingertip or the tip of the operation means, and the operability is further improved.

In the image display systems of (1) to (3), it is preferable that the detection unit is a unit that detects the position by touching with the fingertip or the operation unit, such as a touch panel. For example, a plurality of cameras may be used as in (6) above. When the detection means is composed of a plurality of cameras, each camera captures an image around the image presentation space having parallax. For example, in the control means, the fingertip or the operation means using the principle of triangulation Find the position of.

Hereinafter, the present invention will be described in detail together with embodiments (examples) with reference to the drawings.
Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiments, and the repetitive description thereof is omitted.

FIG. 1 is a schematic diagram showing the principle of the image display system of the present invention.
In FIG. 1, 1 is a three-dimensional display device, 2 is a detection means (touch panel), 3 is a control means, 4 is an observer, 5A, 5B and 5C are objects, and 6 is an image presentation space.

  As shown in FIG. 1, the image display system of the present invention includes a 3D display device 1 capable of displaying a 3D stereoscopic image of an object, and the presence / absence and position of a pen tip of an input pen (operation means) such as a fingertip or a stylus. And a control unit 3 that performs switching control of a three-dimensional stereoscopic image displayed on the three-dimensional display device 1 in accordance with a detection signal from the detection unit 2.

  At this time, the detection unit 2 is a unit that detects the coordinates of the contact point by touching with the fingertip or the input pen, for example, as in a touch panel. Further, it is assumed that the detection means 2 is configured so that the observer 4 can see images (objects 5A and 5B) displayed at a position on the back side as viewed from the observer 4. Further, the operation means is not limited to a pen-like one such as a stylus, and may be any shape that can detect the coordinates of the contact point.

  At this time, the three-dimensional stereoscopic image that can be displayed by the three-dimensional display device 1 is not limited to an image in which one object (object) is displayed three-dimensionally (stereoscopically). For example, as shown in FIG. It is also assumed that an image in which a plurality of objects (objects 5A, 5B, 5C) are arranged three-dimensionally is also included. In other words, the three-dimensional display device 1 is a device that can display a two-dimensional image or a three-dimensional image at an arbitrary position in a certain three-dimensional space. Further, as shown in FIG. 1, the three-dimensional stereoscopic image is a space (image presentation space) 6 including a space in front of the detection means 2 and a space behind the detection means 2 when viewed from the observer 4. Is displayed. In other words, the detection means 2 is arranged so as to pass through the image presentation space 6.

  Thus, if the detection means 2 is arranged so as to pass through the image presentation space 6, for example, the object 5 C shown in FIG. Also, an image (object) can be displayed in the foreground. Therefore, for example, when the display position in the depth direction of the selected button and the other buttons is changed, such as when one of a plurality of buttons is selected and pressed, the selected button is the detection means. The display can be switched while maintaining the state displayed on the screen 2, and an intuitive operation can be performed with a feeling close to that in the real world.

  As shown in FIG. 1, the 3D display device 1 is a device capable of displaying the 3D stereoscopic image (object) in the external space (image presentation space 6) of the 3D display device 1. The display device may have any configuration. However, when considering application to various uses, it is preferable that the three-dimensional display device 1 has a simple configuration. Therefore, an example of a preferable configuration of the three-dimensional display device 1 will be briefly described.

2 to 6 are schematic views for explaining an example of the three-dimensional display device used in the image display system of the present invention. FIG. 2 is a diagram showing an example of the configuration, and FIG. 3 is a method for obtaining the lens interval. FIG. 4 and FIG. 5 are diagrams for explaining the principle of DFD, and FIG. 6 is a diagram showing a specific example in the case of combining DFD and equal magnification imaging optical system.
In FIG. 2, 1A is an equal magnification imaging optical system, 1B is a display surface, 1B ′ is a floating image of an image on the display surface, and 101 _n (h = 1, 2, 3, n) is a lens with a focal length f. is there.

  The three-dimensional display device 1 of the image display system according to the present invention includes, for example, a combination of display means called a DFD (three-dimensional display device) and an equal magnification imaging optical system composed of a plurality of lenses described below. A display device can be used.

The same-magnification imaging optical system 1A composed of a plurality of lenses includes, for example, as shown in FIG. 2, n lenses 101 _h (h = 1, 2, 3,..., N) having the same focal length. This is an optical system arranged (laminated) at equal intervals with an interval d1.

By using the same-magnification imaging optical system 1A in which n lenses 101 _h having the same focal length are arranged at equal intervals, for example, it is located on the left side of the same-magnification imaging optical system in FIG. when imaging the image displayed on the display surface 1B to the right of the like Baiyuizo optical system 1A, the focal length f, and the distance of the lens is d, the imaging by up lens 101 _k of the k-th The magnification M _k is expressed by a recurrence formula such as the following formulas (1) to (4).

When an erect image of equal magnification is formed by the equal magnification imaging optical system 1A, the lens is obtained by obtaining d satisfying M _{k = n} = 1 using the equations (1) to (4). An interval d1 of 101 _h is obtained. Further, when forming an inverted image of equal magnification, the distance d1 of the lens 101 _h is determined by obtaining d satisfying M _{k = n} = −1 using the equations (1) to (4). I want. When d obtained in this way is used and the n lenses 101 _h are arranged at an interval d1 = d, the image displayed on the display surface 1B is formed at the same magnification as shown in FIG. The same magnification is applied to the right side of the optical system 1A. That is, by using the 1 × magnification optical system 1A, the image displayed on the display surface 1B can be displayed as a floating image 1B ′ in a space different from the display surface 1B.

Here, as an example of how to obtain the distance d1 of the lens 101 _h , as shown in FIG. 3, a case where _two lenses 101 ₁ and 101 ₂ with a focal length f are overlapped is given, and how to solve the recurrence formula Is briefly explained.

It is assumed that the _two lenses 101 ₁ and 101 ₂ having the focal length f are arranged at a distance d _k−1 = d ₁ as shown in FIG. At this time, the distance from the _first lens 101 ₁ to the object (display surface 1B) is −L _0, and the magnification of the image 1C formed by the first lens 101 ₁ to the first lens 101 ₁ is M _1. , the distance to the imaging 1C and L _1, 'the magnification of M _2, an imaging 1B' imaging 1B by up to the second sheet of lenses 101 ₂ the distance to the L _2. At this time, the L ₂ is represented by the following formula (9) from the formulas (3) and (4), and the M ₂ is represented by the following formula (10) from the formulas (1) and (9). The

In the mathematical formula (9) and the mathematical formula (10), the L ₁ is represented by the following mathematical formula (11) from the mathematical formula (3) and the mathematical formula (4), and the M ₁ is represented by the mathematical formula (1) and the mathematical formula ( 11) to the following formula (12).

When L ₁ represented by the mathematical formula (11) and M ₁ represented by the mathematical formula (12) are substituted into the mathematical formula (10), M ₂ is represented by the following mathematical formula (13).

When the equation (13) obtained in this way is solved for d with M ₂ = 1, d becomes the following equation (14).

However, in this case, as shown in the equation (14), d depends on the distance −L ₀ from the _first lens 1011 to the display surface 1B. Therefore, for example, the display surface 1B is made up of one of the planes, such as when to intact floating one two-dimensional image displayed on the display surface. 1B, to the display surface from the lens 101 ₁ of the first sheet By stacking the lenses at an interval d based on the distance −L ₀ , a two-dimensional image displayed on the display surface 1B can be formed. However, when the display surface 1B is a plurality of stacked display surfaces such as a DFD, for example, the L ₀ is different for each display surface, and therefore the lens interval is based on the equation (14). d1 = d cannot be determined. Therefore, d obtained by the mathematical formula (14) is not suitable as a solution.

On the other hand, when Equation (14) is solved for d with M ₂ = −1, d becomes Equation (15) below.

In this case, d does not depend on the distance −L ₀ from the _first lens 1011 to the display surface 1B. Therefore, if the distance between the two lenses is d1 = 2f, the distance from the _first lens 1011 is arbitrary. The image on the display surface 1B at the distance −L ₀ can be formed as an inverted image with the same magnification.

When n = 3 or more, that is, when three or more lenses are stacked, the recurrence formula is solved by the same procedure to obtain d that does not depend on the distance −L ₀ from the first lens to the object. For example, by arranging the lenses at intervals of the values, it is possible to form an equal-magnification erect image or an inverted image. At this time, although a detailed calculation procedure is omitted, in the case of n = 2 to 8 using the above recurrence formula, an inverted image that is the same as the lens interval d1 when an erect image of the same magnification is formed. When the value of the lens interval d1 in the case of forming an image is obtained, it is as shown in Table 1 below.

As described above, the equal-magnification imaging optical system 1A includes n lenses 101 _h (h = 1, 2, 3,..., N) having the same focal length as expressed by the equations (1) to (4). In the recurrence formula represented by (), M _n = 1 or −1, and the distance d1 is not dependent on the distance −L ₀ between the object and the lens 101 ₁ closest to the object. Therefore, for example, a plurality of objects are arranged in a three-dimensional manner, and even when the distance -L ₀ between each object and the lens lens 101 ₁ closest to the object is different, each object is imaged at the same magnification. Can do. In addition, since the same-magnification imaging optical system 1A includes a plurality of lenses having the same focal length arranged at equal intervals, the configuration is simple and the miniaturization (thinning) is easy.

  On the other hand, for example, display means (three-dimensional display device) such as DFD can be used as display means for displaying a three-dimensional stereoscopic image in which the plurality of objects are three-dimensionally arranged.

For example, as shown in FIG. 4, the DFD is a display means arranged such that _two display surfaces 1B ₁ and 1B ₂ overlap in the depth direction when viewed from the viewpoint P of the observer. When displaying an image, a two-dimensional image obtained by projecting the display target object from the viewpoint direction of the observer is generated and displayed on each of the display surfaces 1B ₁ and 1B ₂ . At this time, the luminance of the two-dimensional image Obj ₁ displayed on the front display surface 1B ₁ as viewed from the observer is γ ₁ , and the luminance of the two-dimensional image Obj ₂ displayed on the back display surface 1B ₂ is γ _2. Then, from the observer's viewpoint P, it is between the display surfaces 1B ₁ and 1B ₂ and is a distance H1 from the front display surface 1B ₁ and a distance H2 from the back display surface 1B _2. It appears that the image Obj of the object is displayed at a depth position where the ratio H1: H2 becomes γ ₂ : γ ₁ . Therefore, for example, when a plurality of objects are displayed on each display surface, the luminance of the two-dimensional image displayed on the front display surface and the luminance of the two-dimensional image displayed on the back display surface for each region in which each object is displayed. By controlling the ratio, a three-dimensional stereoscopic image in which the plurality of objects are three-dimensionally arranged can be displayed.

At this time, for example, as shown in FIG. 5, one object Obj ₁ , Obj ₂ displayed on each of the display surfaces 1B ₁ and 1B ₂ is divided into small areas, and the front display surface 1B _{1 is} divided for each small area. By controlling the ratio of the luminance of the two-dimensional image displayed on the screen and the luminance of the two-dimensional image displayed on the back display surface 1B ₂ , the one object Obj can be displayed three-dimensionally. Therefore, by combining the principles as shown in FIGS. 4 and 5, for example, as shown in FIG. 1, an image in which a plurality of three-dimensional objects 5A, 5B, 5C are arranged three-dimensionally is displayed. be able to.

In the case of using a display device in which the same-magnification imaging optical system 1A and the DFD are combined as the three-dimensional display device of the image display system of the present invention, for example, as shown in FIG. further arranging the like Baiyuizo optical system 1A in front of the display surface 1B _1. At this time, the equal-magnification imaging optical system 1A has four lenses 101 _h (h = 1, 2, 3, 4) having the same focal length, for example, as shown in FIG. . When four lenses are stacked, as shown in Table 1, both an erect image and an inverted image can be formed, but the interval between the lenses can be narrowed when an inverted image is formed. . Therefore, the like Baiyuizo optical system 1A, the optical system for forming an inverted image of the equal magnification by laminating four lenses 101 _h, and the focal length of the lens 101 _h to is f, distance of the lens Is 0.6 f. At this time, the distance between the lenses does not depend on the distance −L ₀ between the display surface and the lens 101 ₁ closest to the display surface, as described above. Even when there are _two display surfaces 1B ₁ and 1B ₂ having different distances from the lens 101 _1, the inverted images 1B ₁ ′ and 1B ₂ ′ of the same magnification as the display surfaces 1B ₁ and 1B ₂ are formed. Can do.

As the three-dimensional display device 1, as an example of using the configuration of the display device as shown in FIG. 6, equal magnification imaging optical system 1A of the focal length f were placed four lenses 101 _h of 77mm by 46mm intervals Is disposed so as to be in close contact with the display surface 1B ₁ in front (front) of the display means (DFD) in which the two display surfaces 1B ₁ and 1B ₂ are stacked with a surface spacing of 5 mm. An inverted image 1B ₁ ′ of the front display surface 1B ₁ is formed at a position of about 20 mm from the lens (lens 101 _{4 at the} right end of the paper surface), and an inverted image 1B ₂ ′ of the rear display surface 1B ₂ is formed at a position of about 15 mm. The inventors of the present invention confirmed that the image was formed by experiments.

When this three-dimensional display device 1 is used, the inverted images 1B ₁ ′ and 1B ₂ ′ having the same magnification as the images displayed on the display surfaces 1B ₁ and 1B ₂ of the DFD float in the external space of the DFD. By viewing the inverted images 1B ₁ ′ and 1B ₂ ′, the same visual effect as when the DFD is directly viewed can be obtained. Therefore, as shown in FIG. 6, if a touch panel (detection means 2) is arranged between the inverted images 1B ₁ ′ and 1B ₂ ′ (image presentation space) of the _two display surfaces, the viewer sees it. An object can also be displayed in front of the touch panel 2.

In the example shown in FIG. 6, a case where a DFD that displays a three-dimensional stereoscopic image of an object using _two display surfaces 1B ₁ and 1B ₂ is used is described, but three or more display surfaces are used. There may be. The display means for displaying the three-dimensional stereoscopic image is not limited to the DFD, and may be a display means (three-dimensional display device) such as a volume scanning display device.

  Further, the number of lenses to be stacked is not limited to four as shown in FIG. 6, and may be two or more as shown in Table 1, for example. However, when the number of lenses is small, the viewing angle becomes narrow. In addition, when the number of lenses is large, the viewing angle is widened, but the image is deteriorated due to absorption loss or scattering of the lens. For these reasons, it is preferable that the number of laminated lenses is about 4 to 8.

  In addition, various lenses such as a variable focus lens such as a bulk lens, a Fresnel lens, and a liquid crystal lens can be used as the lens, but it is preferable to use a Fresnel lens from the viewpoint of reducing the thickness.

  In addition, various optical materials such as acrylic, polycarbonate, and glass can be used as the material of the lens, but it is preferable to use acrylic from the viewpoints of ease of processing and high transparency.

  7 and 8 are schematic diagrams for explaining an application example of the equal magnification imaging optical system used in the three-dimensional display device. FIG. 7 is optically equivalent to the equal magnification imaging optical system in FIG. FIG. 8 is a diagram illustrating a first configuration example of the optical system, and FIG. 8 is a diagram illustrating a second configuration example of an optical system that is optically equivalent to the equal-magnification imaging optical system in FIG.

In the three-dimensional display device shown in FIG. 6, as the equal magnification imaging optical system, for example, four lenses 101 _h (h = 1, 2, 3, 4) having the same focal length (f) are separated by a distance d1. = 0.6f, the images are displayed on the display surfaces 1B ₁ and 1B ₂ , and inverted images 1B ₁ ′ and 1B ₂ ′ having the same magnification can be formed. In other words, the lens in which the light incident on the optical system from the display means 1B side is arranged at the interval d1 = 0.6f, even if it is not configured and arranged as shown in FIG. This means that an inverted image 1B ′ having the same magnification as the image displayed on the display means 1B can be formed by passing through the (imaging element) four times and then exiting from the optical system. Therefore, a configuration example of an optical system that is optically equivalent to the optical system shown in FIG. 6 and can form an inverted image 1B ′ having the same magnification as the image displayed on the display means 1B will be described below. To do.

As an optical system optically equivalent to the equal-magnification imaging optical system shown in FIG. 6, for example, as shown in FIG. 7, three lenses 101 _h (h = 1, 2, 4) having the same focal length are used. ), A plane mirror 102, and a half mirror 103. In this case, the light incident from the display unit 1B side initially first sheet of lens 101 ₁ to pass the second sheet of lenses 101 ₂ passing a second time to place at intervals d1 = 0.6f. Further, the half mirror 103 is disposed between the first sheet of the lens 101 ₁ and the second sheet of lenses 101 _2. At this time, for example, the light from the _first lens 101 ₁ to the second lens 101 ₂ goes straight, and the half mirror 103 advances straight from the second lens 101 ₂ to the first lens 101. _The light traveling toward ₁ is arranged so that its path changes in the orthogonal direction. Then, placing the third sheet of lens 101 ₄ in the traveling direction of the light path is changed by the half mirror 103. In this case, said second sheet lenses 101 ₂ and 3rd lens 101 ₄ of the spacing on the optical axis shown by a one-dot chain line in FIG. 7 (optical path) is arranged such that d1.

Also, the plane mirror 102, the light passing through the lens 101 ₂ of the second sheet is arranged so as to pass through the second sheet of lenses 101 ₂ again. At this time, the plane mirror 102 is disposed at a distance d1 / 2 (= 0.3f) from the _second lens 1012.

In the case of such an optical system, the light incident from the display means 1B side passes through the _first lens 101 ₁ , the half mirror 103, and the second lens 101 ₂ , and then the plane mirror. The light is reflected at 102 and passes through the _second lens 1012 again. Then, light passing through the lens 101 ₂ of the second sheet again, the path is changed by the half mirror 103, passes through the lens 101 ₄ of the third sheet, it is emitted from the optical system.

At this time, the light incident from the display means 1B side passes through a lens having a focal length f four times in total before being emitted. Therefore, if the interval and the interval of the second sheet of lenses 101 ₂ and the plane mirror 102 of the lens 101 _h (h = 1,2,4) are as described above, the optical system and the optical shown in FIG. 6 And an inverted image 1B ′ having the same magnification as the image displayed on the display means 1B can be formed.

In the optical system shown in FIG. 7, the light path is changed using the half mirror 103. However, the present invention is not limited to this. For example, a combination of a polarizing beam splitter, a quarter-wave plate, and a polarizing plate is used. You can also change your course. In this case, for example, the polarizing beam splitter disposed between the first sheet of the lens 101 ₁ and the second sheet of lens 101 _2, the second sheet of lenses 101 ₂ and the plane mirror instead of the half mirror 103 The quarter wavelength plate is disposed between the two. Further, the polarizing plate is disposed, for example, at a position optically in front of the _first lens 1011 so that light incident from the display means 1B side becomes p-polarized light. At this time, the gap and the distance of the second sheet of lenses 101 ₂ and the plane mirror 102 of the lens 101 _h (h = 1,2,4) are the same as in the case of the optical system shown in FIG. 7 .

In addition, the optical system shown in FIG. 6 has four lenses 101 _h (h = 1, 2, 3, 4) stacked, but instead of the lens, an imaging effect equivalent to that of the lens is obtained. The obtained curved mirror, that is, a curved mirror having a focal length f can also be used.

As an optical system using the curved mirror, for example, as shown in FIG. 8, an optical system in which a curved mirror 104 having a focal length f instead of the _third lens 1013 is arranged. In this case, the first sheet of the lens 101 ₁ and the second sheet of the lens 101 _{and second} interval, the distance of the second sheet of lenses 101 ₂ and the curved mirror 104 on the optical axis shown by a one-dot chain line in FIG. 8 and be placed so that the distance of the curved surface mirror 104 and 4th lens 101 ₄ is respectively d1 = 0.6f, optical system and becomes optically equivalent shown in FIG. 6, displayed on the display means 1B An inverted image 1B ′ having the same magnification as the formed image can be formed.

8 shows an example in which the curved mirror 104 is used instead of the _third lens 1013, the present invention is not limited to this, and the curved mirror may be used instead of other lenses. The curved mirror may be used in place of a single lens, a plurality of lenses, or all lenses.

  The optical system shown in FIGS. 7 and 8 is an example of an optical system that is optically equivalent to the optical system shown in FIG. 6, and the optical system shown in FIG. Other configurations and arrangements may be used as long as they are optically equivalent. 6 to 8, the case where there are four lenses has been described. However, in the case where the number of lenses is not four, any configuration and arrangement may be used as long as they are optically equivalent.

Furthermore, when using the 1 × imaging optical system 1A in which the plurality of lenses are laminated, as described above, for example, instead of arranging only the lenses having the focal length f at equal intervals, for example, n + 1 focal lengths. there a lens f _1, a focal length of the n sheets are alternately laminated lens f _2, and may be an optical system in which the focal distance is disposed at equal intervals of the lens f ₁ at intervals d2.

In the case of such an equal magnification imaging optical system 1A, if the distance between the lenses having the focal length f ₁ is d, the imaging magnification M _k up to the k-th lens is expressed by the following formula (5) (8) ).

When an erect image 1B having the same magnification is formed by the equal-magnification imaging optical system, d satisfying M _{k = 2n + 1} = 1 is _obtained using the equations (5) to (8). focal length is obtained lenses 101 _h distance d2 of f _1. Further, when forming an inverted image 1C with the same magnification, the focal length f _{1 is} obtained by obtaining d satisfying M _{k = 2n + 1} = −1 using the equations (5) to (8). The lens interval d2 is obtained.

When the same-magnification imaging optical system 2 in which two types of lenses having focal lengths f ₁ and f ₂ are alternately laminated is used, the interval d2 when m lenses having the focal length f ₁ are laminated is as follows. As in the first embodiment, it can be made narrower than when only m lenses having a focal length of f ₁ are stacked. Therefore, the equal magnification imaging optical system can be thinned.

In such an equal magnification imaging optical system, since the focal length f ₁ and the focal length f ₂ are independent variables, the focal point is satisfied under the condition satisfying M _{2n + 1} = 1 or −1 in the equation (5). By changing the distance f ₁ and the focal distance f ₂ , the imaging position L _{k = 2n + 1} can be freely changed. As a most typical example of this point, consider a case where n = 2, that is, the total number of lenses is five. At this time, for example, when M ₅ = −1 is solved in the equation (5), the following equation (16) is obtained as one of the solutions.

At this time, by changing f ₁ and f ₂ so as to satisfy the formula (16), the imaging position L ₅ can be controlled while maintaining the same magnification relationship.

  In the case of the 1 × magnification optical system having such a configuration, it is preferable to use a variable focus lens, that is, a lens capable of changing the focal length as the lens. An example of the variable focus lens is a liquid crystal lens.

When a variable focus lens is used as the lens, for example, the focal length f ₁ and the focal length f ₂ are satisfied in a set of optical systems under the condition that M _{2n + 1} = 1 or −1 in the formula (5). Can be changed. In other words, for example, the case the total number of lenses is five, when the focal length is spaced a certain lens f ₁ is a focal length f _1, f ₂ of each lens, the equation (16 ), Any combination is acceptable. When the combination of the focal lengths f ₁ and f ₂ of each lens is changed, the imaging position L ₅ of the inverted image 1C is changed from the equation (7). Therefore, for example, even when the depth display range that can be displayed on the three-dimensional display device is narrow, a wide depth range can be expressed by changing the focal lengths f ₁ and f ₂ of the lenses.

  As described above, when the three-dimensional display device 1 is a display device that combines the DFD with the same magnification imaging optical system 1A in which a plurality of lenses having the same focal length are stacked and arranged at equal intervals, it is very much used. A simple configuration can be achieved. The combination of the equal-magnification imaging optical system 1A and the DFD is one example of the configuration of the three-dimensional display device 1, and is not limited to this. Any display device may be used as long as it can be displayed.

  FIGS. 9 to 11 are schematic diagrams for explaining the image display method according to the first embodiment of the present invention. FIG. 9 is a diagram for explaining the outline of the image display method according to the first embodiment. FIG. 11 is a flowchart showing an example of the configuration of the control means in the image display system for realizing the image display method of Example 1, and FIG. 11 is a flowchart showing the procedure of processing performed by the control means shown in FIG.

  The image display method of the first embodiment is a display method using the image display system. For example, as shown on the upper side of FIG. 9, the fingertip 4A or the pen tip of the input pen is the touch panel (detection means) 2. When not touched, images (objects 5A, 5B, 5C) displayed by the three-dimensional display device 1 are displayed on the touch panel 2. In the first embodiment and the following embodiments, when the objects 5A, 5B, 5C and the touch panel 2 are in a positional relationship as shown on the upper side of FIG. 9, the objects 5A, 5B, 5C are It is assumed that it is displayed on the touch panel 2.

  Then, as shown on the lower side of FIG. 9, when the fingertip 4A or the pen tip of the input pen touches the touch panel 2, an object 5A other than the object 5B corresponding to the position of the fingertip 4A or the pen tip of the input pen or the like. , 5C are moved forward and displayed. In this way, only the object 5B selected with the fingertip 4A or the pen tip of the input pen appears to be behind the other objects 5A and 5C. Further, the selected object 5B remains displayed on the touch panel 2. Therefore, when the observer (operator) selects the object 5B, a visual effect as if the object 5B was pressed is obtained. For example, the observer operates with the same feeling as when the button is pressed in a real space. be able to.

  In the image display system for realizing the image display method according to the first embodiment, the control means 3 receives, for example, a detection signal receiving means 301 for receiving a detection signal from the touch panel (detection means) 2 as shown in FIG. When the tip of the fingertip 4A or the operating means is detected from the detection signal received by the detection signal receiving means 301, other than the object corresponding to the position of the tip of the fingertip 4A or the operating means When the image data is generated by moving the object to the front as viewed from the observer 4 and the tip of the fingertip 4A or the operating means is no longer detected, the object moved to the front as viewed from the observer 4 Image data generating means 302 for generating image data that is returned to the position before the movement, and the image data generated by the image data generating means 302 The may be provided a video signal transmission unit 303 for transmitting a video signal to the three-dimensional display device 1.

  Although not shown, the control means 3 may include image data holding means for holding several patterns of image data prepared in advance. In that case, the image data generation means 302 only needs to select an image corresponding to the position of the fingertip or the pen tip of the input pen from the image data holding means based on the detection signal.

  When the image display method according to the first embodiment is executed by the image display system configured as shown in FIG. 10, the control unit 3 first sets the initial display in the three-dimensional display device 1 as shown in FIG. A video signal of image data representing the state is transmitted to display an initial image (step 701).

  When the initial screen is displayed, for example, when the touch panel (detection means) 2 is touched with the fingertip 4A or the pen tip of the input pen, a pressing signal of the touch panel 2 becomes active, and the control is performed from the touch panel 2. A contact point coordinate signal indicating the coordinates of the position where the pressing signal and the fingertip or the pen tip of the input pen are in contact is transmitted to the means 3. The pressing signal and the contact point coordinate signal are received by the detection signal receiving means 301 of the control means 3 (step 702).

  When the detection signal receiving unit 301 receives the pressing signal and the contact point coordinate signal, the control unit 3 receives the fingertip on the touch panel 2 based on the contact point coordinate signal in the image data generation unit 302. The position in the space (image presentation space 6) where the 3D stereoscopic image corresponding to the position touched by 4A or the pen tip of the input pen or the like is displayed is calculated (step 703). Further, the image data generation unit 302, based on the calculation result of the step 703, for example, as shown on the lower side of FIG. 7, other than the object 5B corresponding to the position of the fingertip 4A or the pen tip of the input pen The image data obtained by moving the objects 5A and 5C to the front is generated, and the generated image data is transmitted as a video signal to the three-dimensional display device 1 via the video signal transmission means 303 (step 704). The three-dimensional display device 1 that has received the video signal from the control means 3 switches the display image based on the video signal. In this way, for example, the state shown on the upper side of FIG. 9 is switched to the state shown on the lower side of FIG.

  If the control means 3 holds several patterns of image data in advance, in step 704, an object other than the corresponding object at the position of the fingertip 4A or the pen tip of the input pen is moved forward. The selected image data may be selected and transmitted as a video signal.

  The control means 3 determines whether or not the fingertip 4A or the pen tip of the input pen is touching the touch panel 2 after transmitting the video signal, that is, whether or not the pressing signal is active. Confirm (step 705). At this time, if the pressing signal is active, it is determined whether or not the touch point coordinates of the fingertip 4A or the pen tip of the input pen have changed (step 706). This continues while the detection signal is received by the detection signal receiving means 301. If the contact point coordinates change, the process returns to Step 703 to generate image data corresponding to the new contact point coordinates or The selected information is transmitted to the three-dimensional display device 1 and displayed.

  In addition, when the pressing signal is not active, that is, when the fingertip 4A or the pen tip of the input pen moves away from the detecting means, the detection signal receiving means 301 does not receive the detection signal (pressing signal). Therefore, when it is determined in step 705 that the pressing signal is not active, the image data generation means 302 is, for example, the initial image data as shown on the upper side of FIG. Immediately before the determination, the image data after performing the specific processing associated with the object corresponding to the position of the fingertip 4A or the pen tip of the input pen is transmitted to the 3D display device 1 as a video signal (step 707). ).

  As described above, according to the image display method using the image display system of the first embodiment, the object other than the object selected with the fingertip 4A or the pen tip of the input pen is moved forward and displayed. Can do. Therefore, the observer (operator), for example, can obtain a visual effect as if the object is pressed when the object is selected, and operate with the same feeling as when the button is pressed in real space. Can do. Therefore, it is possible to reduce discomfort in the behavior of the displayed image (object) and improve operability.

  Further, in the image display system that realizes the image display method according to the first embodiment, as the three-dimensional display device 1, for example, as shown in FIG. 6, a plurality of lenses having the same focal length are arranged at equal intervals. If a display device composed of the same-magnification imaging optical system 1A and the DFD arranged in layers is used, the configuration of the image display system can be simplified and the device can be downsized.

  12 to 15 are schematic diagrams for explaining the image display method according to the second embodiment of the present invention. FIG. 12 is a diagram illustrating a schematic configuration of an image display system that realizes the image display method according to the second embodiment. FIG. 13 is a diagram for explaining the outline of the image display method of the second embodiment, FIG. 14 is a diagram showing a configuration example of control means in the image display system for realizing the image display method of the second embodiment, and FIG. 15 is a flowchart showing a procedure of processing performed by the control means shown in FIG.

  The image display method of the second embodiment is basically the same as the image display method of the first embodiment. When the fingertip 4A or the pen tip of an input pen touches the touch panel (detection means) 2, the touched position This is a display method in which the display is switched to an image display in which an object other than the object corresponding to is moved forward.

  However, unlike the case of the first embodiment, the image display method of the second embodiment is applied to an image display system in which the touch panel (detection means) 2 can be pushed in the depth direction viewed from the observer. It is a display method.

  As shown in FIG. 12, the image display system for realizing the image display method of the second embodiment includes the touch panel in addition to the three-dimensional display device 1, the touch panel (detection means) 2, and the control means 3. 2 is provided with a repulsion means 8 that can apply a repulsive force to the touch panel 2 in accordance with the amount of pressing in the depth direction.

  The image display method of the second embodiment is realized by the image display system as shown in FIG. At this time, for example, as shown in the upper side of FIG. 13, when the fingertip 4A or the pen tip of the input pen is not touching the touch panel (detection means) 2, an image (object) displayed by the 3D display device 1 is displayed. 5A, 5B, 5C) are displayed on the touch panel 2. Then, when the fingertip 4A or the pen tip of the input pen touches the touch panel 2 and pushes the touch panel 2 in the depth direction, as shown in the lower side of FIG. The object 5B selected by 4A or the pen tip of the input pen moves to the back and is displayed. In this way, only the object 5B selected with the fingertip 4A or the pen tip of the input pen appears to be behind the other objects 5A and 5C. At this time, when the touch panel 2 is pushed into the back as viewed from the observer 4, a repulsive force corresponding to the pushing amount is applied to the touch panel 2 from the repulsion means 8. Therefore, the observer (operator) 4 can feel the repulsive force applied to the touch panel 2 from the repulsive means 8 through the fingertip 4A or the operating means. Therefore, when the observer (operator) 4 depresses the touch panel 2 and selects the object, a visual effect and a bodily sensation effect as if the object was pressed are obtained. For example, the button is pressed in a real space. You can operate with the same feeling.

  In the image display system that realizes the image display method according to the second embodiment, the control unit 3 includes, for example, as shown in FIG. 14, a detection signal receiving unit 301 that receives a detection signal from the detection unit, and the touch panel. (Detection means) Push-in amount signal receiving means 304 for receiving a push-in amount signal indicating the push-in amount of 2, and repulsion control signal transmission for calculating a repulsive force according to the push-in amount and sending it to the repulsion means 8 as a repulsion control signal When the tip of the fingertip 4A or the operating means is detected from the detection signal received by the means 305 and the detection signal receiving means 301, the tip of the fingertip 4A or the operating means is detected based on the pushing amount signal. Image data is generated by moving the object corresponding to the position of the touch panel 2 so that the relative positional relationship with the touch panel 2 does not change, and the fingertip 4A Alternatively, when the front end of the operation unit is no longer detected, the image data generation unit 302 generates image data in which the moved object is returned to the position before the movement, and the image generated by the image data generation unit 302 Video signal transmitting means 303 for transmitting data as a video signal to the three-dimensional display device 1 may be provided.

  Although not shown, the control means 3 may include image data holding means for holding several patterns of image data prepared in advance. In that case, the image data generation means 302 holds the image data corresponding to the position of the fingertip 4A or the pen tip of the input pen and the push amount of the touch panel 2 based on the detection signal and the push amount signal. It is only necessary to select from the means.

  When the image display method according to the second embodiment is executed by the image display system configured as shown in FIG. 14, the control means 3 first sets the initial display in the three-dimensional display device 1 as shown in FIG. A video signal of image data representing the state is transmitted to display an initial image (step 711).

  When the initial screen is displayed, for example, when the touch panel (detection means) 2 is touched with the fingertip 4A or the pen tip of the input pen, a pressing signal of the touch panel 2 becomes active, and the control is performed from the touch panel 2. A contact point coordinate signal indicating the coordinates of the position where the pressing signal and the fingertip 4A or the pen tip of the input pen are in contact is transmitted to the means 3. The pressing signal and the contact point coordinate signal are received by the detection signal receiving unit 301 of the control unit 3. At this time, the control means 3 also receives the push amount signal indicating the amount of movement of the touch panel (detection means) 2 in the depth direction by the push amount signal receiving means 304 (step 712).

  The control means 3 receives the pressing signal and the contact point coordinate signal by the detection signal receiving means 301, and receives the pressing amount signal by the pressing amount signal receiving means 304, the image data generating means 302 Based on the contact point coordinate signal and the push amount signal, the three-dimensional corresponding to the position touched by the fingertip 4A on the touch panel 2 or the pen tip of the input pen and the push amount (depth position) of the touch panel 2 A position in a space (image presentation space 6) in which a stereoscopic image can be displayed is calculated (step 713). Then, for example, as shown on the lower side of FIG. 13, only the object 5B corresponding to the position of the fingertip 4A or the pen tip of the input pen is moved in the depth direction so as to coincide with the pressing amount of the touch panel 2. Image data is generated, and the generated image data is transmitted as a video signal to the three-dimensional display device 1 through the video signal transmission means 303 (step 714). In this way, for example, the state shown on the upper side of FIG. 13 is switched to the state shown on the lower side of FIG.

  In step 714, the video signal is transmitted, the repulsive force corresponding to the amount of pressing of the touch panel 2 is calculated, and the repulsive control signal is transmitted to the repulsive means 8 via the repulsive control signal transmitting means 305. To do. By doing so, the repulsive means 8 pushes the touch panel 2 toward the front as viewed from the observer 4 with a repulsive force based on the repulsive control signal, so that the repulsive force applied to the touch panel 2 from the repulsive means 8 Can be felt through the fingertip 4A or the operating means.

  If the control means 3 holds several patterns of image data in advance, in step 714, only the object corresponding to the position of the fingertip 4A or the pen tip of the input pen is pressed after the touch panel 2 is pressed. It is only necessary to select image data that has been moved to a position corresponding to this position and transmit it as a video signal.

  In addition, after the video signal and the repulsion control signal are transmitted, the control means 3 continues whether the fingertip 4A or the pen tip of the input pen is touching the touch panel 2, that is, the pressing signal is active. It is confirmed whether or not there is (step 715). At this time, if the pressing signal is active, it is determined whether or not the touch point coordinates of the fingertip 4A or the input pen or the pressing amount (depth position) of the touch panel 2 has changed (step 716). This is continued while the detection signal is received by the detection signal receiving means 301. When the contact point coordinates or the push amount changes, the process returns to the step 713, and a new contact point coordinate or the touch panel 2 is returned. The image data corresponding to the amount of pressing is generated or selected and transmitted to the three-dimensional display device 1 for display.

  In addition, when the pressing signal is not active, that is, when the fingertip 4A or the pen tip of the input pen moves away from the touch panel 2, the detection signal receiving unit 301 does not receive the detection signal. Therefore, when it is determined in step 715 that the pressing signal is not active, the image data generation means 302 is, for example, the initial image data as shown on the upper side of FIG. Image data after performing specific processing associated with the object corresponding to the position of the fingertip 4A or the tip of the input pen immediately before the determination is transmitted to the 3D display device 1 as a video signal (step 717). ). At this time, the touch panel 2 returns to the original depth position, that is, the position where the pushing amount is 0 by the repulsive force received from the repulsive means 8.

  As described above, according to the image display method using the image display system of the second embodiment, only the object selected with the fingertip 4A or the pen tip of the input pen is pushed into the touch panel (detection means) 2. It can be moved and displayed in the depth direction according to the amount. Therefore, the observer (operator), for example, can obtain a visual effect as if the object is pressed when the object is selected, and operate with the same feeling as when the button is pressed in real space. Can do. In the image display method according to the second embodiment, the repulsive force applied to the touch panel 2 from the repulsive means 8 can be realized through the fingertip 4A or the operating means. Therefore, it is possible to reduce discomfort in the behavior of the displayed image (object) and improve operability.

  In the image display system for realizing the image display method according to the second embodiment, as the three-dimensional display device 1, for example, as shown in FIG. 6, a plurality of lenses having the same focal length are arranged at equal intervals. If a display device composed of the same-magnification imaging optical system 1A and the DFD arranged in layers is used, the configuration of the image display system can be simplified and the device can be downsized.

  FIGS. 16 to 19 are schematic diagrams for explaining the image display method according to the third embodiment of the present invention. FIG. 16 is a diagram illustrating an example of display switching control according to the presence / absence of the fingertip or the tip of the operation unit. FIG. 17 is a diagram showing an example of display switching control according to the movement of the tip of the fingertip or the operating means, and FIG. 18 is a diagram showing a configuration example of an image display system for realizing the image display method of the third embodiment. 19 is a flowchart showing the procedure of processing performed by the control means of the image display system shown in FIG.

  The image display method of the third embodiment is an image display method suitable for use in combination with, for example, the image display methods of the first and second embodiments, and before touching the detection means 2 such as the touch panel. This is an image display method for detecting a position to be pointed by an operator and switching display images.

  In the image display method of the third embodiment, for example, as shown in FIG. 16, a fingertip detection space 9 having an arbitrary depth is provided on the touch panel (detection means) 2. The detection of the presence or position of the fingertip 4A or the pen tip of the input pen in the fingertip detection space 9 is performed by, for example, creating an infrared grid as in an infrared scanning method and shielding the place where the finger or the input pen is shielded. This is done by reading the coordinates. In addition to the infrared scanning method, for example, the fingertip detection space 9 is photographed with a camera, and the presence or position of a shape corresponding to the fingertip 4A or the pen tip of the input pen is detected from the image. You can also.

  And, for example, as shown on the lower side of FIG. 16, when the fingertip 4A or the pen tip of the input pen enters the fingertip detection space 9, the position of the fingertip 4A or the pen tip of the input pen is detected, For example, the object corresponding to the position of the fingertip 4A or the pen tip of the input pen moves so as to come to a predetermined depth position on the touch panel 2 or the like. In the example shown in the lower part of FIG. 16, the fingertip 4A or the pen tip of the input pen points to the center object 5B among the three objects 5A, 5B, 5C, so that the center object 5B is the touch panel. The three objects 5A, 5B, 5C are translated forward so as to be on the top. Further, when the fingertip 4A is taken out of the fingertip detection space 9 in the state as shown in the lower side of FIG. 16, the three objects 5A, 5B, 5C as shown in the upper side of FIG. Moves back to the original position.

  In the case of the image display method according to the third embodiment, for example, as shown in the upper side of FIG. 17, the fingertip 4A is detected in the fingertip detection space 9, and the fingertip 4A includes three objects 5A, 5B, 5C. When the fingertip 4A is moved from the state of pointing to the center object 5B to the position pointing to the upper object 5A of the three objects 5A, 5B, 5C, as shown in the lower side of FIG. As the fingertip 4A moves, the three objects 5A, 5B, 5C are translated forward so that the upper object 5A is on the touch panel 2. In addition, when the fingertip 4A is moved to a position indicating the center object 5B in the state shown in the lower side of FIG. 17, the upper side of FIG. 17 is moved in accordance with the movement of the position of the fingertip 4A. As shown, the three objects 5A, 5B, 5C are translated back so that the center object 5B is on the touch panel 2.

  In this way, for example, when a plurality of objects are arranged three-dimensionally, it becomes easy to recognize which object is pointed to by the fingertip 4A or the pen tip of the input pen, and the operability is improved. Will improve.

  Moreover, although description is omitted, for example, when the touch panel 2 is touched with the fingertip 4A or the pen tip of the input pen from the lower side of FIG. 16 and the state shown in FIG. The display image is switched by the method described in the above.

  In the image display system that realizes the image display method according to the third embodiment, for example, as illustrated in FIG. 18, the detection unit touches the fingertip or the penpoint of the input pen to touch the fingertip or the penpoint of the input pen. A touch panel (first detection means) 2A for detecting the position of the fingertip 4A or the presence or position of the fingertip 4A or the pen tip of the input pen in the fingertip detection space 9 in front of the touch panel 2 using the infrared scanning method Finger position detecting means (second detecting means) 2B.

  At this time, the control means 3 includes a first detection signal receiving means 301A for receiving a detection signal from the first detection means 2A and a second detection signal for receiving a detection signal from the second detection means 2B. Receiving means 301B is provided. Further, when the image data generation unit 302 provided in the control unit 3 receives the detection signal from the first detection signal reception unit 301A, for example, the image data generation unit 302 generates image data according to the procedure described in the first embodiment. When the detection signal is received from the second detection unit 301B, the object pointed to by the fingertip 4A or the pen tip of the input pen is positioned at a predetermined depth position such as on the first detection unit 2A. Generate a moved image. FIG. 18 shows a configuration example in the case where the image data generating unit 302 generates an image even when a detection signal from the second detecting unit 2B is received. Image data may be generated or selected by another means independent of the data generation means 302.

  When the image display method of the third embodiment is executed by the image display system having the configuration as shown in FIG. 18, the control means 3 first sets the initial display in the 3D display device 1 as shown in FIG. A video signal of image data representing the state is transmitted to display an initial image (step 721).

  In a state where the initial screen is displayed, for example, when the touch panel (first detection means) 2A is touched with the fingertip 4A or the pen tip of the input pen, the pressing signal of the touch panel 2A becomes active, and the touch panel 2A A first detection signal, that is, a contact point coordinate signal indicating the coordinates of the position where the pressing signal and the fingertip 4A or the pen tip of the input pen contact each other is transmitted to the control means 3. If the fingertip 4A or the pen tip of the input pen enters the fingertip detection space 9 without touching the touch panel, the second detection signal, that is, the control signal is sent from the second detection means 2B to the control means 3. A finger position coordinate signal indicating the coordinates of the position of the fingertip 4A or the pen tip of the input pen is transmitted. Therefore, after displaying the initial image, the control means 3 determines whether or not the first detection signal or the second detection signal has been received (step 722). When receiving the first detection signal, the fingertip 4A or the pen tip of the input pen passes through the fingertip detection space 9 and is in contact with the touch panel 2A. Therefore, the second detection signal is also received. However, in the third embodiment, when the first detection signal and the second detection signal are received simultaneously, it is expressed that the first detection signal is received.

  When the control unit 3 receives the first detection signal, that is, the pressing signal and the contact point coordinate signal from the touch panel 2A, the image data generation unit 302 performs, for example, the procedure described in the first embodiment. Image data is generated or selected and transmitted to the 3D display device 1 as a video signal (step 723). When the processing in step 723 is performed according to the procedure described in the first embodiment, the processing corresponding to step 702 to step 707 shown in FIG.

  On the other hand, when the control means 3 receives only the second detection signal, that is, only the finger position table signal from the second detection means 2B, the image data generation means 302, as shown in FIG. Based on the finger position coordinate signal, the plane position in the image presentation space 6 corresponding to the position of the fingertip 4A or the pen tip of the input pen is calculated (step 724). Then, the object corresponding to the calculated plane position, that is, the object pointed by the fingertip 4A or the pen tip of the input pen or the like is positioned at a predetermined depth position on the touch panel, for example. Image data obtained by translating the object in the depth direction is generated or selected and transmitted to the 3D display device 1 as a video signal (step 725). By doing so, the image (object) displayed on the detection means becomes as shown in the lower part of FIG. 16 or FIG.

  In addition, after transmitting the video signal, the control means 3 receives whether the fingertip 4A or the pen tip of the input pen touches the touch panel (first detection means) 2A, that is, the first detection signal. (Step 726). At this time, if the first detection signal is received, the process proceeds to step 723.

  On the other hand, if the first detection signal has not been received, it is determined whether or not the second detection signal (finger position coordinate signal) continues to be received (step 727). If reception of the second detection signal continues, it is checked whether the position of the fingertip 4A or the pen tip of the input pen based on the second detection signal has changed (step 728). If it has changed, the process returns to step 724 to generate or select image data corresponding to a new finger position coordinate, and transmit it to the 3D display device 1 for display. If the finger position coordinates have not changed, the process returns to step 726, and the presence / absence of reception of the detection signal and the change of the finger position coordinates are monitored.

  Further, when the fingertip 4A or the penpoint of the input pen comes out of the fingertip detection space 9, the second detection signal receiving means 302 does not receive the second detection signal. Therefore, if it is determined in step 727 that reception of the second detection signal has been interrupted, the process returns to step 721. Then, the image data generating unit 302 generates or selects initial image data as shown on the upper side of FIG. 16, for example, and transmits it to the 3D display device 1 for display.

  As described above, according to the image display method using the image display system of the third embodiment, without touching the touch panel 2A in the fingertip detection space 9 on the touch panel (first detection means) 2A, When the image (object) displayed on the fingertip or the pen tip of the input pen is pointed, the pointed object is set at a predetermined depth position of the image presentation space 6 such as on the touch panel 2A, for example. It can be moved and displayed. Therefore, for example, when a plurality of objects are arranged three-dimensionally, it becomes easy to recognize which object is the object pointed by the fingertip 4A or the pen tip of the input pen.

  Further, like the image display method of the third embodiment, the image (object) displayed at the fingertip 4A or the pen tip of the input pen without touching the touch panel 2A in the fingertip detection space 9 is indicated. If the fingertip 4A or the pen tip of the input pen touches the touch panel, the image display of the first embodiment or the second embodiment is performed when the pointed object is moved to a predetermined depth position. By using the method, it is possible to improve the operability when a plurality of objects are arranged three-dimensionally.

  In the image display system that realizes the image display method according to the third embodiment, as the three-dimensional display device 1, for example, as shown in FIG. 6, a plurality of lenses having the same focal length are arranged at equal intervals. If a display device comprising the same-magnification imaging optical system and the DFD arranged in layers is used, the configuration of the image display system can be simplified and the device can be miniaturized.

  Still further, the second detection means 2B is not limited to the means using the infrared scanning method or the means using a camera, but the presence / absence or position of the fingertip 4A or the pen tip of the input pen in the fingertip detection space 9 Any means may be used as long as it can be detected.

  In the image display method of the third embodiment, the case of combining with the image display method of the first embodiment or the second embodiment has been described. However, the present invention is not limited to this, and image display other than the first embodiment or the second embodiment is described. You may combine with a method. Moreover, it is also possible to use the second detection means as detection means in place of the touch panel used in the first or second embodiment.

  FIG. 20 is a schematic diagram illustrating a schematic configuration of the image display system according to the fourth embodiment of the present invention.

  In the first to third embodiments, a configuration example of an image display system when a touch panel is used as the detection unit 2 (first detection unit 2A) is shown. However, the detection means 2 only needs to be able to detect the position of the fingertip 4A or the operation means, and thus various means (devices) can be used without being limited to the touch panel. Therefore, in the fourth embodiment, a configuration example of an image display system when a means other than a touch panel is used as the detection means 2 will be described.

  In the image display system of the fourth embodiment, for example, two cameras 201 and 202 are used as the detection means 2 as shown in FIG. At this time, each of the cameras 201 and 202 captures an image of the detection area 10 corresponding to the contact surface (detection surface) of the touch panel, and two images having parallax can be obtained. At this time, the control means 3 first measures the depth position of the fingertip 4A or the operation means from the two images having the parallax based on the principle of triangulation. When the measured depth position is within the detection area 10, for example, in the procedure as described in the first embodiment, other objects other than the object corresponding to the position of the fingertip 4A or the operation means are removed. Switch to the image moved to the front. By doing in this way, the effect similar to the image display system of the said Example 1 is acquired.

  Further, at this time, if a transparent plate such as an acrylic plate is provided on the detection area 10, it can be operated with the same feeling as the image display system using the touch panel.

  The present invention has been specifically described above based on the above-described embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention. is there.

  For example, in the first to third embodiments, the control unit 3 has been described as an example in which independent units perform processing in cooperation with each other. However, the present invention is not limited to this. For example, a computer and a program (software) ) Can also be used. When a computer is used as the control means 3, a program comprising instructions for causing the computer to execute the procedures described in the first to third embodiments, that is, the flows shown in FIGS. 11, 15, and 19. May be created and executed by the computer. At this time, the program can be provided through, for example, a magnetic, electrical, or optical recording medium, or can be provided through the Internet.

In addition, when the image display system of the present invention is applied to, for example, an automatic teller machine or an automatic ticket vending machine, the control unit 3 may be an independent unit that performs only display switching. It may be a part of means for performing processing (operation) control performed in an automatic teller machine or an automatic ticket vending machine. In the former case, the control means 3 transmits a video signal to the three-dimensional display device 1 and transmits a detection signal received from the touch panel (detection means) to a means for performing other processing control, and detects the detected contact. What is necessary is just to perform the process according to a point coordinate. In the latter case, a means for controlling the other processing may be provided inside the control means 3.

It is a schematic diagram which shows the principle of the image display system of this invention. It is a schematic diagram for demonstrating an example of the three-dimensional display apparatus used with the image display system of this invention, and is a figure which shows one structural example. It is a schematic diagram for demonstrating an example of the three-dimensional display apparatus used with the image display system of this invention, and is a figure explaining how to obtain | require the space | interval of a lens. It is a schematic diagram for demonstrating an example of the three-dimensional display apparatus used with the image display system of this invention, and is a figure explaining the principle of DFD. It is a schematic diagram for demonstrating an example of the three-dimensional display apparatus used with the image display system of this invention, and is a figure explaining the principle of DFD. It is a schematic diagram for demonstrating an example of the three-dimensional display apparatus used with the image display system of this invention, and is a figure which shows a specific example in the case of combining DFD and a 1x imaging optical system. It is a schematic diagram for demonstrating the application example of the equal magnification imaging optical system used with a three-dimensional display apparatus, and shows the 1st structural example of an optical system optically equivalent to the equal magnification imaging optical system of FIG. FIG. It is a schematic diagram for demonstrating the application example of the equal magnification imaging optical system used with a three-dimensional display apparatus, and shows the 2nd structural example of an optical system optically equivalent to the equal magnification imaging optical system of FIG. FIG. It is a schematic diagram for demonstrating the image display method of Example 1 by this invention, and is a figure explaining the outline | summary of the image display method of this Example 1. FIG. It is a schematic diagram for demonstrating the image display method of Example 1 by this invention, and is a figure which shows the structural example of the control means in the image display system which implement | achieves the image display method of this Example 1. FIG. It is a schematic diagram for demonstrating the image display method of Example 1 by this invention, and is a flowchart which shows the procedure of the process performed by the control means shown in FIG. It is a schematic diagram for demonstrating the image display method of Example 2 by this invention, and is a figure which shows schematic structure of the image display system which implement | achieves the image display method of this Example 2. FIG. It is a schematic diagram for demonstrating the image display method of Example 2 by this invention, and is a figure explaining the outline | summary of the image display method of this Example 2. FIG. It is a schematic diagram for demonstrating the image display method of Example 2 by this invention, and is a figure which shows the structural example of the control means in the image display system which implement | achieves the image display method of this Example 2. FIG. It is a schematic diagram for demonstrating the image display method of Example 2 by this invention, and is a flowchart which shows the procedure of the process performed by the control means shown in FIG. It is a schematic diagram for demonstrating the image display method of Example 3 by this invention, and is a figure which shows an example of the display switching control according to the presence or absence of the tip of a fingertip or an operation means. It is a schematic diagram for demonstrating the image display method of Example 3 by this invention, and is a figure which shows an example of the display switching control according to the movement of the tip of a fingertip or an operation means. It is a schematic diagram for demonstrating the image display method of Example 3 by this invention, and is a figure which shows the structural example of the image display system which implement | achieves the image display method of this Example 3. FIG. It is a schematic diagram for demonstrating the image display method of Example 3 by this invention, and is a flowchart which shows the procedure of the process performed by the control means of the image display system shown in FIG. It is a schematic diagram which shows schematic structure of the image display system of Example 4 by this invention.

Explanation of symbols

1 ... 3 dimensional display device 1A ... equal magnification imaging optical system _{101 1, 101 2, 101 3} , 101 4, 101 n ... focal length lens 102 ... the plane mirror 103 ... half mirror 104 ... focal length of f is f curved Mirror 1B ₁ ... Front (front) display surface 1B ₂ ... Rear (back) display surface 2 ... Detection means (touch panel)
2A ... 1st detection means (touch panel)
2B ... second detection means 201, 202 ... camera 3 ... control means 301 ... detection signal reception means 301A ... first detection signal reception means 301B ... second detection signal reception means 302 ... image data generation means 303 ... video signal transmission means 304 ... Push-in amount signal receiving means 305 ... Repulsion control signal transmitting means 4 ... Observer (operator)
4A ... fingertips 5A, 5B, 5C ... object 6 ... image presentation space 8 ... repulsion means 9 ... fingertip detection space 10 ... detection area

Claims (6)

A three-dimensional display device capable of displaying a three-dimensional stereoscopic image of an object; a detecting means for detecting a tip position of a fingertip or a bar-like operating means; and a position of the fingertip or the tip of the operating means detected by the detecting means An image display system comprising control means for performing switching control of a display image of an object displayed on the three-dimensional display device according to
The detection means is means for detecting the position of the fingertip or the tip of the operation means in a detection region that is in front of the 3D display device as viewed from an observer and overlaps the 3D display device,
The three-dimensional display device is a three-dimensional stereoscopic image in which a plurality of objects are three-dimensionally arranged in an image presentation space including a space in front of the detection region and a space behind the detection means when viewed from the observer. display device der that displays is,
The three-dimensional display device includes a display unit that displays the three-dimensional stereoscopic image, and an equal-magnification imaging optical system that forms the three-dimensional stereoscopic image displayed on the display unit in the image presentation space at an equal magnification. Have
The equal-magnification imaging optical system has n (n is an integer of 2 or more) lenses having the same focal length, which are arranged in front of the display unit when viewed from the observer.
Each lens is a recurrence formula expressed by the following formulas (1) to (4) , where f is the focal length of each lens and M _k is the magnification of image formation of light passing through the k lenses. The image display system is characterized in that M _{k = n} = 1 or −1, and is arranged at equal intervals with an interval d independent of L ₀ .

A three-dimensional display device capable of displaying a three-dimensional stereoscopic image of an object; a detecting means for detecting a tip position of a fingertip or a bar-like operating means; and a position of the fingertip or the tip of the operating means detected by the detecting means An image display system comprising control means for performing switching control of a display image of an object displayed on the three-dimensional display device according to
The detection means is means for detecting the position of the fingertip or the tip of the operation means in a detection area that is in front of the 3D display device and viewed from the observer and overlaps the 3D display device,
The three-dimensional display device is a three-dimensional stereoscopic image in which a plurality of objects are three-dimensionally arranged in an image presentation space including a space in front of the detection region and a space behind the detection means as viewed from the observer. A display device for displaying
The three-dimensional display device includes a display unit that displays the three-dimensional stereoscopic image, and an equal-magnification imaging optical system that forms the three-dimensional stereoscopic image displayed on the display unit in the image presentation space at an equal magnification. Have
In the equal-magnification imaging optical system, the focal length of n + 1 sheets (n is an integer of 1 or more) arranged in front of the display unit when viewed from the observer is f. ₁ Lens and n focal lengths are f ₂ And the focal length is f ₁ And the focal length is f ₂ Lenses are arranged alternately,
The focal length is f ₁ The magnification of the image of light that has passed through k lenses is M _k In the recurrence formula represented by the following formulas (5) to (8), _{k = 2n + 1} = 1 or -1 and L ₀ The image display system is characterized by being arranged at equal intervals at intervals d that do not depend on.

The control means includes a detection signal receiving means for receiving a detection signal from the detection means;
When the fingertip or the tip of the operating means is detected from the detection signal received by the detection signal receiving means, other objects other than the object corresponding to the position of the fingertip or the tip of the operating means are excluded from the observer Image data moved to the front as viewed from the front, and when the fingertip or the tip of the operating means is no longer detected, the object moved to the front as viewed from the observer is returned to the position before the movement. Image data generating means for generating image data;
The image display system according to claim 1 or claim 2, characterized in that it comprises a video signal transmitting means for transmitting the image data generated by the image data generating unit to the 3-dimensional display device as a video signal. In addition to the three-dimensional display device, the detection means, and the control means, when the detection means is pushed in the depth direction by the fingertip or the operation means, a repulsive force corresponding to the pushing amount of the detection means is applied to the detection means. With repulsive means to give,
The control means includes a detection signal receiving means for receiving a detection signal from the detection means;
A push amount signal receiving means for receiving a push amount signal indicating the push amount of the detection means;
A repulsion control signal transmitting means for calculating a repulsive force according to the pushing amount and transmitting the repulsion control signal to the repulsion means;
When the fingertip or the tip of the operating means is detected from the detection signal received by the detection signal receiving means, it corresponds to the position of the fingertip or the tip of the operating means based on the amount of pressing of the detecting means. Image data is generated by moving the object so that the relative positional relationship with the detection means does not change. When the tip of the fingertip or the operation means is no longer detected, the moved object is moved Image data generating means for generating image data returned to the position;
The image display system according to claim 1 or claim 2, characterized in that it comprises a video signal transmitting means for transmitting the image data generated by the image data generating unit to the 3-dimensional display device as a video signal. The detection means includes a first detection means for detecting a position of the fingertip or the tip of the operation means by touching the tip of the fingertip or the operation means, and a front side of the first detection means as viewed from an observer. Second detection means for detecting the position of the fingertip or the tip of the scanning means by entering the tip of the fingertip or the operation means in a detection space;
When the control means detects the position of the tip of the fingertip or the operating means only with the second detection means in addition to the means, the object corresponding to the detected position is within the image presentation space. When image data obtained by translating each object in the depth direction so as to come to a predetermined depth position is generated, and the position of the fingertip or the tip of the scanning unit is no longer detected by the second detection unit the image display system according to claim 3 or claim 4, characterized in that it comprises means for generating image data that returned said each object by the translation to the original depth position. The detection means comprises a plurality of cameras that photograph the detection area,
The image according to any one of claims 1 to 3, wherein the control means includes means for obtaining a position of the fingertip or the operation means based on images of the plurality of cameras. Display system.

Images