JP6427981B2 - Image display device - Google Patents

Description

  The present invention relates to an image display device, and more particularly to an image display device including a distance measuring unit that acquires distance information from an image display device to an indicator.

  2. Description of the Related Art Conventionally, an image display device that includes a distance measurement unit that acquires distance information from an image display device to an indicator is known (see, for example, Patent Document 1).

  Patent Document 1 discloses a playground equipment device including a time-of-flight distance image sensor that acquires distance information from a light emitting unit to a person (indicator). This playground equipment is provided with a home television receiver, a time-of-flight distance image sensor, and an application processor. Then, the application processor acquires distance information from the time-of-flight distance image sensor, and based on the acquired distance information, the amount of change in the distance between the playground equipment (light emitting unit) and the person (indicator) Operation information indicating the change direction is calculated. The application processor is configured to perform control to reflect the calculated operation information on the content displayed on the home television receiver (image display unit).

  In addition, conventionally, an image display provided with an image forming unit that makes the image light from the image display unit incident from one surface side and forms the incident image light as an optical image in the air on the other surface side. The device is known.

  In a conventional image display device including an image display unit and an image forming unit, when acquiring distance information from the image display device to the indicator, the conventional image display device is changed from the image display device of Patent Document 1 to the indicator. It is conceivable to apply a time-of-flight distance image sensor configured to be able to acquire distance information up to. In this case, a time-of-flight distance image sensor is disposed on the image display device, and distance information from the image display device to the indicator (such as a user's finger) is obtained as a time-of-flight distance image sensor (distance measurement). A configuration obtained by (1) is conceivable. Also, when accepting a touch operation by the indicator, whether or not the indicator has performed the touch operation using the position of the optical image as a position (virtual touch screen) for determining whether or not the indicator has performed the touch operation. A configuration may be considered in which a control unit is provided that determines whether or not the pointer has performed a touch operation based on the position for determining the position and the position of the pointer (distance information acquired by the distance measuring unit).

JP 2011-27707 A

  In general, since an optical image formed in space has a narrow viewing range, the height (eye position) of a user who can visually recognize the entire optical image is limited. For this reason, it is necessary to move the position where the optical image is formed in accordance with the height of the user. However, in this case, there is a problem that it may not be possible to appropriately determine whether or not the indicator has performed a touch operation on the optical image due to the movement of the position where the optical image is formed. .

  The present invention has been made to solve the above-described problems, and one object of the present invention is to provide an indicator with respect to an optical image even when the position where the optical image is formed moves. An object of the present invention is to provide an image display device capable of appropriately determining whether or not a touch operation has been performed.

In order to achieve the above object, an image display device according to one aspect of the present invention includes an image display unit that displays an image, and light of an image displayed by the image display unit is incident from one surface side. An image forming unit that forms an optical image as a virtual touch screen corresponding to the image in the air on the other surface side, and moves at least one of the image display unit and the image forming unit A display unit configured to be able to move a position where an optical image is formed, and a detection unit that detects an indicator that virtually touches the optical image, and faces the indicator via the optical image. A distance image data acquisition unit that acquires image data including distance information indicating a distance from the detection unit to the indicator, and at least one of the image display unit and the imaging unit, and the distance image data acquisition unit Relative Is generated as moving in response to the relative movement from the movement information location, and the virtual touch detection surface for a user to recognize a face touching virtually, the range image data image data acquired by the acquisition unit And a control unit that determines whether or not the indicator has touched the optical image based on the included distance information.

In the image display device according to one aspect of the present invention, as described above, the control unit includes the relative movement information between at least one of the image display unit and the imaging unit and the distance image data acquisition unit, and the distance image data acquisition. Based on the distance information acquired by the unit, it is configured to determine whether or not the indicator has touched the optical image. As a result, even when the position where the optical image is formed moves, the position for determining whether or not the indicator has touched the optical image is the position where the optical image is formed based on the movement information. Can be moved to a position corresponding to. As a result, even when the position where the optical image is formed moves, it is possible to appropriately determine whether or not the indicator has performed a touch operation on the optical image.

In the image display device according to the above aspect, preferably, the image display unit and the image forming unit are configured to be movable relative to each other, and the control unit is configured such that the image display unit and the image forming unit are relative to each other. It is configured to determine whether or not the indicator has touched the optical image based on the touch detection surface generated from the movement information and the distance information. If comprised in this way, since the position of an optical image can be moved, without moving the whole image display apparatus, an image display apparatus (mechanism part for moving the position of an optical image) will enlarge. The optical image can be moved to a height position that is easy for the user to visually recognize.

In this case, preferably, the image display unit is arranged to have a predetermined tilt angle with respect to the image forming unit, and is configured to be movable with respect to the image forming unit while maintaining the predetermined tilt angle. The control unit is configured to display the optical image on the basis of the touch detection surface generated from the movement information of the image display unit moved while maintaining a predetermined inclination angle with respect to the imaging unit, and the distance information. It is configured to determine whether or not a touch operation has been performed. If comprised in this way, the distance of a user and an optical image can be easily changed into the distance which a user can visually recognize easily.

In the image display device including the image display unit configured to be movable with respect to the imaging unit while maintaining the predetermined tilt angle, preferably, the imaging unit is along the same plane of the imaging unit. The imaging unit is configured to be rotatable about a predetermined rotation axis as a rotation center, and the control unit rotates the image about the predetermined rotation axis along the same plane of the imaging unit as the rotation center. Based on the touch detection surface generated from the rotation information of the unit and the distance information, it is configured to determine whether or not the indicator has touched the optical image. If comprised in this way, the inclination-angle of an optical image can be easily changed into the angle which a user can visually recognize easily.

In the image display device in which the image display unit and the image forming unit are configured to be movable relative to each other, preferably, the image forming unit is arranged to be parallel to the horizontal plane and The control unit is configured to be movable in the direction, and the control unit touches the optical image based on the touch detection surface generated from the movement information of the imaging unit moved in the vertical direction and the distance information. It is configured to determine whether or not an operation has been performed. If comprised in this way, the height of an optical image can be easily changed to the height (height according to a user's height) which a user can visually recognize easily.

In the image display device according to the above aspect, the distance image data acquisition unit and the display unit are preferably configured to be movable together. Here, if the distance image data acquisition unit and the display unit is moved integrally moving the position of the optical image, the relative positional relationship between the distance image data acquisition unit and the display unit does not change. For this reason, as described above, the distance image data acquisition unit and the display unit are moved together to move the position of the optical image, so that the control unit can move the distance image data acquisition unit and the display unit relative to each other. Thus, it is possible to appropriately determine whether or not the indicator has performed a touch operation on the optical image without acquiring specific position information.

In the image display device according to the above aspect, the detection unit preferably includes a light emitting unit that emits light and a light receiving unit that receives the light emitted from the light emitting unit and reflected by the indicator, and the distance image data acquisition unit Obtains distance information from the detection unit to the indicator based on the elapsed time from the time when the light emitting unit emits light to the time when the light receiving unit receives light emitted from the light emitting unit and reflected by the indicator. It is configured as follows. If comprised in this way, the distance information from a detection part to an indicator will be easily acquired by measuring the elapsed time until the light-receiving part receives the light emitted from the light emission part and reflected by the indicator. can do.

  According to the present invention, as described above, even when the position where the optical image is formed moves, it is possible to appropriately determine whether or not the indicator has performed a touch operation on the optical image.

It is sectional drawing (1) which showed the whole structure of the image display apparatus by 1st Embodiment of this invention. It is sectional drawing (2) which showed the whole structure of the image display apparatus by 1st Embodiment of this invention. 1 is a block diagram illustrating an overall configuration of an image display device according to a first embodiment of the present invention. It is a figure for demonstrating the distance image data and touch detection surface by 1st Embodiment of this invention. It is a flowchart for demonstrating the touch operation detection process by 1st Embodiment of this invention. It is sectional drawing which showed the whole structure of the image display apparatus by 2nd Embodiment of this invention. It is the block diagram which showed the whole structure of the image display apparatus by 2nd Embodiment of this invention. It is sectional drawing which showed the whole structure of the image display apparatus by 3rd Embodiment of this invention. It is the block diagram which showed the whole structure of the image display apparatus by 3rd Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
With reference to FIGS. 1-4, the structure of the image display apparatus 100 by 1st Embodiment of this invention is demonstrated.

  In the image display device 100 according to the first embodiment of the present invention, as shown in FIG. 1, the image display device main body 1 is installed on the ground (floor or the like).

  The image display apparatus 100 is provided with a display unit 2. The display unit 2 includes a display unit housing unit 21 and a rotation mechanism unit 22. The display unit housing part 21 is disposed inside the image display apparatus main body 1. Moreover, the rotation mechanism part 22 is attached to the image display apparatus main body 1, and is comprised so that the display unit housing | casing part 21 can be rotated.

  Further, the image display device 100 is provided with a reflective element aggregate substrate 3. The reflective element aggregate substrate 3 is formed in a flat plate shape. The reflective element aggregate substrate 3 is arranged on the upper side (arrow Z1 direction side) of the display unit housing part 21 and is arranged on the rotation mechanism part 22 on the arrow Y1 direction side of the display unit housing part 21. Installed. The reflective element aggregate substrate 3 is an example of the “imaging unit” in the present invention.

  The image display device 100 is provided with an image display unit 4. The image display unit 4 is disposed inside the display unit housing unit 21.

  In addition, the image display device 100 is provided with a distance measuring unit 5. The distance measuring unit 5 is disposed on the upper side (arrow Z1 direction side) of the display unit 2 and is attached to the image display apparatus main body 1.

  The image display device 100 is provided with a main body side control unit 6. The main body side control unit 6 is disposed inside the image display apparatus main body 1 and is connected to the display unit 2 and the distance measuring unit 5. The main body side control unit 6 is an example of the “control unit” in the present invention.

  The image display device 100 is provided with an operation unit 7. The operation unit 7 is attached to the upper surface (the surface on the arrow Z1 direction side) of the image display device main body 1 and the arrow Y1 direction side (the side on which the user is located). And the operation part 7 is comprised so that the operation from a user can be received. Specifically, the operation unit 7 is provided with a plurality of operation buttons (not shown). The operation unit 7 is connected to the main body side control unit 6 and is configured to transmit the operation contents of the operation buttons by the user to the main body side control unit 6.

  Here, in the first embodiment, as shown in FIG. 1, the reflective element assembly substrate 3 has a display unit housing section with the rotational axis C1 along the same plane of the reflective element assembly substrate 3 as the rotational center. 21 is configured to be rotatable integrally with the main body 21.

  Specifically, a rotation drive unit 23 is provided in the vicinity of the rotation mechanism unit 22 to which the reflective element assembly substrate 3 is attached. The rotation drive unit 23 is configured by a motor or the like, and based on a command from the main body side control unit 6, the rotation mechanism unit 22 moves the rotation axis C <b> 1 along the same plane of the reflective element assembly substrate 3. Is configured to rotate in the direction of arrow A1 (or the direction opposite to the direction of arrow A1) on the YZ plane. Then, when the turning mechanism portion 22 is turned in the arrow A1 direction, the reflective element assembly substrate 3 attached to the turning mechanism portion 22 (integrated with the display unit housing portion 21) is moved in the arrow A1 direction. It is comprised so that it may rotate.

  Further, a rotation displacement detection unit 24 is provided in the vicinity of the rotation mechanism unit 22. The rotation displacement detection unit 24 includes a rotary encoder and the like, and is configured to be able to acquire information on a rotation angle at which the rotation mechanism unit 22 is rotated by the rotation drive unit 23. The rotation displacement detection unit 24 is connected to the main body side control unit 6 and is configured to transmit the acquired information on the rotation angle of the rotation mechanism unit 22 to the main body side control unit 6. The rotation angle information is an example of the “movement information” in the present invention.

  Here, in the first embodiment, as shown in FIG. 2, the image display unit 4 is disposed so as to have an inclination angle B with respect to the reflective element aggregate substrate 3, while maintaining the inclination angle B. The reflection element assembly substrate 3 is configured to be movable.

  Specifically, the image display unit 4 is provided with a liquid crystal panel 41. The liquid crystal panel 41 is disposed on the lower side (arrow Z2 direction side) of the reflective element assembly substrate 3 and is disposed so as to have an inclination angle B with respect to the reflective element assembly substrate 3. The liquid crystal panel 41 is configured to display an image, and is arranged to irradiate the image light toward the lower surface 31 of the reflective element assembly substrate 3. The lower surface 31 is an example of “one surface” in the present invention.

  The image display unit 4 is provided with a linear motion mechanism unit 42 and a linear motion drive unit 43. The linear motion mechanism portion 42 supports the liquid crystal panel 41 and is attached to the display unit housing portion 21. The linear motion drive unit 43 is configured by a motor or the like, and is configured to be driven based on a command from the main body side control unit 6. The linear motion drive unit 43 is connected to the linear motion mechanism unit 42, and when the linear motion drive unit 43 is driven, the liquid crystal panel 41 attached to the linear motion mechanism unit 42 is tilted in the arrow D1 direction. It is configured to move while maintaining the corner B.

  More specifically, the liquid crystal panel 41 is provided with a hole portion (not shown) configured to allow the shaft portion 42a having a trapezoidal screw of the linear motion mechanism portion 42 to pass through and to be screwed. Yes. The shaft portion 42a is rotated about the axis by the linear motion drive portion 43, so that the liquid crystal panel 41 is moved in the direction of the arrow D1. That is, the linear motion mechanism unit 42 and the linear motion drive unit 43 are configured to be driven as linear actuators.

  Further, a linear displacement detector 44 is provided in the vicinity of the linear motion mechanism 42. The linear motion displacement detection unit 44 is configured to be able to acquire information on the movement distance that the linear motion mechanism unit 42 has been moved by the linear motion drive unit 43. That is, the information on the movement distance by which the linear motion mechanism unit 42 is moved is expressed as relative movement information between the image display unit 4 and the reflective element aggregate substrate 3. The linear motion displacement detection unit 44 is connected to the main body side control unit 6 and is configured to transmit the acquired information on the movement distance of the linear motion mechanism unit 42 to the main body side control unit 6. The movement distance information is an example of the “movement information” in the present invention.

  Here, in the first embodiment, as shown in FIG. 2, the reflective element assembly substrate 3 is configured such that the image light displayed by the liquid crystal panel 41 is incident from the lower surface 31 and the incident image light is incident on the upper surface. It is configured to form an optical image E corresponding to an image incident in the air on the 32 side (arrow Z1 direction side). Moreover, the optical image E is comprised as a virtual touch screen which receives a user's touch operation virtually by the distance measurement part 5, the main body side control part 6, etc. so that it may mention later. The upper surface 32 is an example of the “other surface” in the present invention.

  Specifically, the reflective element assembly substrate 3 is formed in a flat plate shape parallel to the XY plane. The reflective element assembly substrate 3 is formed with a plurality of through holes (not shown) provided so as to penetrate from the upper surface 32 toward the lower surface 31, and the inner wall surfaces of the plurality of through holes serve as mirror surfaces. Is formed. In the reflective element aggregate substrate 3, light incident on the plurality of through holes from the liquid crystal panel 41 is reflected by each mirror surface, and the lower surface 31 side to the upper surface 32 side of the reflective element aggregate substrate 3 while changing the traveling direction of the light. It is configured to pass through. The reflective element aggregate substrate 3 is coupled as an optical image E corresponding to the image of the liquid crystal panel 41 at a position where the light emitted from the upper surface 32 side is symmetrical with respect to the reflective element aggregate substrate 3. It is configured to image. That is, the reflective element aggregate substrate 3 is configured to form the optical image E on the surface having an inclination angle equal to the inclination angle B on the upper surface 32 side (arrow Z1 direction side).

  Here, in the first embodiment, as shown in FIG. 1, the distance measurement unit 5 is provided with a detection unit 51 and a distance measurement unit side control unit 52. The detection unit 51 includes an infrared light source 51a that emits light and a CCD (Charge Coupled Device) camera 51b that receives light emitted from the infrared light source 51a and reflected by the indicator (finger F). The infrared light source 51a is an example of the “light emitting unit” in the present invention. The CCD camera 51b is an example of the “light receiving unit” in the present invention.

  Further, in the first embodiment, as shown in FIG. 4, the distance measuring unit side control unit 52 starts the CCD camera 51b from the infrared light source 51a from the time when the infrared light source 51a emits light. The distance image data from the detection unit 51 to the finger F is acquired based on the elapsed time until the light reflected by F) is received. The distance measurement unit side control unit 52 is connected to the main body side control unit 6 and is configured to transmit the acquired distance image data to the main body side control unit 6. The distance image data is an example of “distance information” in the present invention.

  Specifically, as shown in FIG. 1, the infrared light source 51 a is on the upper side of the display unit 2 (arrow Z <b> 1 direction side) and toward the user, based on a command from the distance measurement unit side control unit 52. (In the direction of arrow Y1) is configured to irradiate infrared light.

  As shown in FIG. 3, the distance measuring unit side control unit 52 is provided with a light source control unit 52a and a detection control unit 52b. The detection control unit 52b is configured to acquire a control signal from the main body side control unit 6, and is configured to transmit the acquired control signal to the light source control unit 52a. And the light source control part 52a is comprised so that the infrared light source 51a may be driven based on the transmitted control signal.

  As shown in FIGS. 1 and 2, the CCD camera 51b is configured to receive light reflected and reflected from the infrared light source 51a. The CCD camera 51b is configured to capture the reflected light as an image from the infrared light source 51a in the imaging region G above the display unit 2 (arrow Z1 direction side). The CCD camera 51b is configured to transmit the acquired imaging data to the distance measuring unit side control unit 52.

  As shown in FIG. 3, the distance measurement unit side control unit 52 includes a signal integration unit 52c, a signal calculation unit 52d, and an image generation unit 52e. The signal accumulation unit 52c is configured to acquire imaging data from the CCD camera 51b and accumulate imaging data. Then, the signal calculation unit 52d is configured such that the CCD camera 51b is emitted from the infrared light source 51a and the indicator (finger F) from the time when the infrared light source 51a emits infrared light and the imaging data accumulated by the signal accumulation unit 52c. The information of the elapsed time until the time of receiving the light reflected by, for example, is acquired, and the distance from the distance measuring unit 5 to the indicator (finger F) is calculated. The image generation unit 52e is configured to generate distance image data (see FIG. 4) that is data of a captured image having distance information based on the captured data and the calculated distance data. Yes. For example, the distance image data is configured to include distance data for each pixel of a two-dimensional image. The image generation unit 52 e is connected to the main body side control unit 6 and is configured to transmit the generated distance image data to the main body side control unit 6.

  As shown in FIG. 3, the main body side control unit 6 is provided with a control unit 61. The control unit 61 is configured to perform overall control of the image display apparatus 100. For example, the control unit 61 obtains control information for outputting an image to be displayed on the liquid crystal panel 41, control for outputting a control signal for obtaining distance image data to the distance measurement unit 5, and operation information from the operation unit 7. And control to perform.

  The operation information from the operation unit 7 includes operation information indicating the movement direction and movement distance of the image display unit 4 by the user, operation information indicating the movement direction and movement distance of the display unit 2 by the user, and the like.

  The main body side control unit 6 is provided with a linear motion control unit 62. The linear motion control unit 62 is configured to transmit a control signal for moving the liquid crystal panel 41 to the linear motion drive unit 43 based on the operation information acquired by the control unit 61.

  Further, the main body side control unit 6 is provided with a rotation control unit 63. The rotation control unit 63 is configured to transmit a control signal for moving the display unit 2 to the rotation drive unit 23 based on the operation information acquired by the control unit 61.

  The main body side control unit 6 is provided with a touch detection surface generation unit 64. As shown in FIG. 4, the touch detection surface generation unit 64 is configured to acquire movement information from the rotational displacement detection unit 24 and the linear movement displacement detection unit 44 and generate the touch detection surface H1 (and H2). Has been. Specifically, the touch detection surface H <b> 1 (and H <b> 2) refers to the position where the main body side control unit 6 corresponds to the optical image E formed on a surface having a predetermined distance from the detection unit 51. This is a virtual detection surface for recognizing as a surface to be touched.

  As shown in FIG. 3, the main body side control unit 6 is provided with a touch detection surface storage unit 65. The touch detection surface storage unit 65 is configured to store information on the touch detection surface H1 (and H2) generated by the touch detection surface generation unit 64.

  Further, the main body side control unit 6 is provided with an image storage unit 66. The image storage unit 66 is configured to acquire distance image data from the distance measurement unit 5 and store the acquired distance image data.

  The main body side control unit 6 is provided with a touch operation determination unit 67. The touch operation determination unit 67 is configured to read the data of the touch detection surface H1 (and H2) stored in the touch detection surface storage unit 65 and to read the distance image data stored in the image storage unit 66. ing.

  Then, the touch operation determination unit 67 determines whether or not the finger F performs a touch operation on the optical image E by determining whether or not the finger F is disposed in the vicinity of the touch detection surface H1 (and H2). Is configured to determine. That is, when the finger F is arranged in the vicinity of the touch detection surface H1 (and H2) (when it is within a predetermined distance from the touch detection surface H1 (and H2)), the touch operation determination unit 67 The control unit 61 is configured to determine that the touch operation has been performed and transmit the coordinate information of the touched position to the control unit 61. On the other hand, when the finger F is not arranged in the vicinity of the touch detection surface H1 (and H2), the touch operation determination unit 67 determines that the touch operation is not performed and also indicates that the touch operation is not performed. Is transmitted to the control unit 61.

  Further, the control unit 61 is configured to acquire coordinate information of a position where the touch operation is performed from the touch operation determination unit 67 or a signal indicating that the touch operation is not performed.

  Next, a touch operation detection process flow of the image display device 100 according to the first embodiment will be described with reference to FIG. The processing of the image display device 100 is performed by the main body side control unit 6.

  In the first embodiment, the movement information (movement distance information) of the image display unit 4 moved while maintaining a predetermined inclination angle B with respect to the reflection element assembly substrate 3, and the reflection rotated at the rotation center C1. On the basis of the rotation information (rotation angle information) of the element assembly substrate 3 (display unit 2) and the distance information (distance image data) acquired by the distance measurement unit 5, the finger F corresponds to the optical image E. It is then determined whether or not a touch operation has been performed. This will be specifically described below.

  First, in step S <b> 1, it is determined whether user operation information has been acquired from the operation unit 7. If the user operation information is acquired from the operation unit 7, the process proceeds to step S2. If the user operation information is not acquired from the operation unit 7, the process proceeds to step S6.

  In step S2, the reflective element aggregate substrate 3 or the liquid crystal panel 41 is moved. That is, in step S1, based on the user operation information acquired from the operation unit 7, the rotation drive unit 23 or the linear motion drive unit 43 is driven, and the reflection element assembly substrate 3 is rotated (the display unit 2 is rotated). ) (See FIG. 1) or the liquid crystal panel 41 is moved (see FIG. 2).

  For example, as shown in FIG. 2, the linear motion drive unit 43 is driven based on the user operation information acquired from the operation unit 7, and the liquid crystal panel 41 is moved in the direction of arrow D1. Then, when the liquid crystal panel 41 is moved in the direction of the arrow D1, the optical image E is moved in the direction of the arrow D2. Thereafter, the process proceeds to step S3.

  In step S3, movement information is acquired. That is, the movement information of the reflecting element assembly substrate 3 or the liquid crystal panel 41 moved in step S2 is acquired by the rotational displacement detection unit 24 or the linear movement displacement detection unit 44, and the acquired movement information is generated as a touch detection surface. Is transmitted to the unit 64. Thereafter, the process proceeds to step S4.

  In step S4, a touch detection surface is generated. That is, based on the movement information acquired in step S3, the touch detection surface generation unit 64 generates the touch detection surface H2 (see FIG. 4).

  For example, as shown in FIGS. 2 and 4, before the liquid crystal panel 41 is moved in the arrow D1 direction (before the optical image E is moved in the arrow D2 direction), the touch detection surface H1 is generated. After the liquid crystal panel 41 is moved in the arrow D1 direction (after the optical image E is moved in the arrow D2 direction), the touch detection surface H2 is generated. In this case, as shown in FIG. 4, the optical image E after movement is imaged at a position closer to the distance measurement unit 5 than the optical image E before movement (arrow Y2 direction side). Is formed larger than the size of the touch detection surface H1. Further, since the optical image E after movement is formed below the optical image E before movement, the touch detection surface H2 is generated below the touch detection surface H1 (arrow Z2 direction side). The Thereafter, the process proceeds to step S5.

  In step S5, the touch detection surface is stored. That is, the touch detection surface H <b> 2 generated by the touch detection surface generation unit 64 is stored in the touch detection surface storage unit 65. Then, it progresses to step S6.

  Then, after step S5, or in step S6, which is performed when the user operation information is not acquired in step S1, the distance image data is acquired from the distance measuring unit 5. Then, it progresses to step S7.

  In step S7, the distance image data is stored in the image storage unit 66. Thereafter, the process proceeds to step S8.

  In step S8, it is determined whether or not the touch detection surface H2 (optical image E) is touched. That is, as shown in FIG. 4, the distance image data stored in the image storage unit 66 is read out in step S7, and the touch detection surface H2 stored in the touch detection surface storage unit 65 is read out in step S5. A comparison is made.

  For example, as shown in FIG. 4, when the finger F (indicator) in the distance image data is in the vicinity of the touch detection surface H2 (optical image E) (the portion with the smallest hatching line interval in FIG. 4), touch detection is performed. It is determined that the touch operation is performed on the surface H2 (optical image E). On the other hand, when the finger F (indicator) in the distance image data is not near the touch detection surface H2 (optical image E), it is determined that the touch detection surface H2 (optical image E) is not touched. In the case of the example shown in FIG. 4, it is determined that the part of the finger F (the part with the smallest hatching line interval) is touched, while the part other than the finger F (the part other than the part with the smallest hatching line interval). ) Determines that no touch operation has been performed. If a part (optical image E) of the touch detection surface H2 is touch-operated, the process proceeds to step S9. If the entire touch detection surface H2 (optical image E) is not touch-operated, step S1 is performed. Return to.

  In step S9, the coordinate information that has been touched is acquired. For example, in the example shown in FIG. 4, the coordinate information of the part of the finger F (the part with the smallest hatching line interval) is acquired. In this case, the coordinate information of the touch operation on the touch detection surface H2 is acquired. Then, it progresses to step S1.

  In the first embodiment, the following effects can be obtained.

  In the first embodiment, as described above, the main body side control unit 6 controls the relative movement information (movement distance information, rotation) between at least one of the image display unit 4 and the reflective element assembly substrate 3 and the distance measurement unit 5. Whether or not the indicator (finger F) has touched the optical image E based on the information on the moving angle and the touch detection surface H2) and the distance information (distance image data) acquired by the distance measurement unit 5. It is configured to determine whether or not. Thereby, even when the position where the optical image E is formed moves, the position (touch detection surface H1) for determining whether or not the indicator (finger F) has touched the optical image E is determined. The movement information can be moved to a position (touch detection surface H2) corresponding to a position where the optical image E is formed. As a result, even when the position where the optical image E is formed moves, it is possible to appropriately determine whether or not the indicator (finger F) has performed a touch operation on the optical image E.

  In the first embodiment, as described above, the image display unit 4 and the reflective element assembly substrate 3 are configured to be movable relative to each other, and the main body side control unit 6 is configured to reflect the image display unit 4 and the reflection. The indicator (finger F) touches the optical image E based on the relative movement information (movement distance information and touch detection surface H2) with the element assembly substrate 3 and the distance information (distance image data). It is configured to determine whether or not an operation has been performed. As a result, the position of the optical image E can be moved without moving the entire image display device 100, so that the size of the image display device 100 (the turning mechanism unit 22 and the linear motion mechanism unit 42) is increased. The optical image E can be moved to a height position that is easy for the user to visually recognize.

  In the first embodiment, as described above, the image display unit 4 is arranged so as to have a predetermined inclination angle B with respect to the reflective element assembly substrate 3, and while maintaining the predetermined inclination angle B, The reflection element assembly substrate 3 is configured to be movable. Accordingly, the movement information (movement distance information and touch detection surface H2) of the image display unit 4 that has moved the main body side control unit 6 while maintaining the predetermined inclination angle B with respect to the reflective element assembly substrate 3, and the distance Based on the information (distance image data), it is configured to determine whether or not the indicator (finger F) has touched the optical image E. Thereby, the distance between the user and the optical image E can be easily changed to a distance that is easy for the user to visually recognize.

  In the first embodiment, as described above, the reflecting element assembly substrate 3 is configured to be rotatable about the rotation axis C1 along the same plane of the reflecting element assembly substrate 3 as the center of rotation. Further, the main body side control unit 6 controls the rotation information (rotation angle information and rotation angle) of the reflection element assembly substrate 3 rotated about the rotation axis C1 along the same plane of the reflection element assembly substrate 3. Based on the touch detection surface H2) and distance information (distance image data), it is configured to determine whether or not the indicator (finger F) has touched the optical image E. Thereby, the inclination | tilt angle of the optical image E can be easily changed into the angle which a user can visually recognize easily.

  In the first embodiment, as described above, the detection unit 51 receives the infrared light source 51a that emits light and the CCD camera that receives the light emitted from the infrared light source 51a and reflected by the indicator (finger F). 51b. Further, the distance measuring unit 5 is set to the elapsed time from the time when the infrared light source 51a emits light until the time when the CCD camera 51b receives the light emitted from the infrared light source 51a and reflected by the indicator (finger F). Based on this, the distance information (distance image data) from the detection unit 51 to the indicator (finger F) is acquired. As a result, by measuring the elapsed time until the CCD camera 51b receives the light emitted from the infrared light source 51a and reflected by the indicator (finger F), the indicator (finger) can be easily detected from the detector 51. Distance information (distance image data) up to F) can be acquired.

(Second Embodiment)
Next, the configuration of the image display device 200 according to the second embodiment will be described with reference to FIGS. In the second embodiment, unlike the image display device 100 according to the first embodiment in which the display unit and the reflective element aggregate substrate are configured to be integrally rotatable, the reflective element aggregate substrate is in the vertical direction (vertical direction). It is configured to be movable.

  As shown in FIGS. 6 and 7, the image display device 200 according to the second embodiment is provided with a display unit 202. The display unit 202 is fixed to the image display apparatus main body 1, and includes a display unit housing unit 221, a movement mechanism unit 222, a movement drive unit 223 (see FIG. 7), and a movement displacement detection unit 224 (see FIG. 7). ). The moving mechanism unit 222 is configured by a gear or the like, and the gear is disposed so as to mesh with a tooth portion 231 of a reflective element assembly substrate 203 described later. Moreover, the movement drive part 223 is comprised by the motor etc., and is comprised so that the gear of the movement mechanism part 222 may be rotated based on the command of the main body side control part 206 mentioned later. Further, the movement displacement detection unit 224 is configured to acquire information (movement information) of a rotation angle at which the movement driving unit 223 rotates the movement mechanism unit 222.

  Here, in the second embodiment, as shown in FIG. 6, the reflective element assembly substrate 203 is arranged so as to be parallel to the horizontal plane (XY plane), and also in the vertical direction (vertical direction) (Z Direction).

  Further, the reflective element assembly substrate 203 is connected to the tooth portion 231 on the arrow Y1 direction side. The display unit 202 is provided with a fixing portion 232 that is fixed to the display unit housing portion 221. The fixing portion 232 is configured to be able to penetrate the tooth portion 231 in the Z direction. The tooth portion 231 is engaged with the movement mechanism portion 222, and the tooth portion 231 is configured to move in the Z direction when the movement mechanism portion 222 rotates. The reflective element assembly substrate 203 is configured to move in the vertical direction (Z direction) when the tooth portion 231 moves in the Z direction.

  For example, as shown in FIG. 6, when the reflective element aggregate substrate 203 is moved to the arrow Z1 direction side by the moving distance I1 with respect to the image display unit 4, the optical image E is displayed on the reflective element aggregate substrate 203. Since the image is formed at the position having the plane symmetry of the part 4, the position after the movement of the optical image E is an arrow corresponding to the movement distance I2 (twice as large as the movement distance I1). It is moved in the Z1 direction.

  Here, in the second embodiment, as illustrated in FIG. 7, the main body side control unit 206 includes the movement information of the reflecting element assembly substrate 203 moved in the vertical direction (vertical direction) (Z direction) and the distance information (distance). The indicator (finger F) is configured to determine whether or not the optical image E is touched based on the image data.

  Specifically, as shown in FIG. 7, the main body side control unit 206 is provided with a control unit 261, a movement control unit 263, and a touch detection surface generation unit 264. The control unit 261 is configured to acquire user operation information from the operation unit 7 and transmit a control signal to the movement control unit 263. The movement control unit 263 is configured to control the operation of the movement driving unit 223 based on a control signal from the control unit 261.

  Then, the touch detection surface generation unit 264 is configured to acquire movement information from the movement displacement detection unit 224 and the linear motion displacement detection unit 44 and generate a touch detection surface based on the acquired movement information. . Then, the touch operation determination unit 67 performs a touch operation on the optical image E by the indicator (finger F) based on the comparison between the generated touch detection surface and the distance image data acquired from the distance measurement unit 5. It is configured to determine whether or not. Note that the distance image data in the second embodiment and the method for comparing the generated touch detection surface and the distance image data acquired from the distance measurement unit 5 are the distance image data in the first embodiment and the generated method. This is the same as the comparison method between the touch detection surface and the distance image data acquired from the distance measurement unit 5. Other configurations of the image display device 200 according to the second embodiment are the same as those of the image display device 100 according to the first embodiment.

  In the second embodiment, the following effects can be obtained.

  In the second embodiment, as described above, the reflective element assembly substrate 203 is arranged so as to be parallel to the horizontal plane (XY plane) and configured to be movable in the vertical direction (vertical direction) (Z direction). To do. Further, the indicator (finger F) is controlled based on the movement information of the reflecting element aggregate substrate 203 moved in the vertical direction (vertical direction) (Z direction) and the distance information (distance image data). Is configured to determine whether or not the optical image E has been touched. Thereby, the height (position in the Z direction) of the optical image E can be easily changed to a height that is easy for the user to visually recognize (a height according to the height of the user). The other effects of the image display device 200 according to the second embodiment are the same as those of the image display device 100 according to the first embodiment.

(Third embodiment)
Next, the configuration of the image display apparatus 300 according to the third embodiment will be described with reference to FIGS. In the third embodiment, unlike the image display device 100 according to the first embodiment in which the distance measurement unit is fixed to the image display device main body, the distance measurement unit and the display unit are integrated with the image display device main body. It is configured to be movable.

  As shown in FIGS. 8 and 9, in the image display device 300 according to the third embodiment, the distance measuring unit 305 and the display unit 302 are configured to be integrally movable with respect to the image display device main body 1. Yes. Specifically, as shown in FIG. 8, the display unit 302 includes a display unit housing part 321, and the distance measurement unit 305 is attached to the display unit housing part 321. As shown in FIG. 9, the display unit 302 is provided with a rotation mechanism unit 322 and a rotation drive unit 323. As shown in FIG. 8, the rotation mechanism unit 322 is attached to the image display device main body 1, and the distance measurement unit 305 and the display unit 302 are connected by the rotation drive unit 323 to the image display device main body 1. On the other hand, it is configured to integrally rotate in the direction of arrow J1.

  When the display unit 302 is rotated in the arrow J1 direction with respect to the image display apparatus main body 1, the optical image E is rotated in the arrow J2 direction by substantially the same rotation angle by which the display unit 302 is rotated. Is done. Further, since the distance measuring unit 305 is rotated integrally with the display unit 302, the imaging area changes from the imaging area K1 to the imaging area K2. However, the relative positional relationship between the distance measurement unit 305 and the optical image E before and after the rotation of the distance measurement unit 305 does not change.

  As shown in FIG. 9, the main body side control unit 306 is provided with a control unit 361, a rotation control unit 363, and a touch detection surface generation unit 364. The control unit 361 is configured to acquire user operation information from the operation unit 7 and transmit a control signal to the rotation control unit 363. The rotation control unit 363 is configured to control the operation of the rotation drive unit 323 based on a control signal from the control unit 361.

  The touch detection surface generation unit 364 is configured to acquire movement information from the linear movement displacement detection unit 44 and generate a touch detection surface based on the acquired movement information. That is, unlike the touch detection surface generation unit 64 according to the first embodiment, the touch detection surface generation unit 364 according to the third embodiment generates a touch detection surface without using the movement information of the rotation mechanism unit 322. It is configured. Then, the touch operation determination unit 67 performs a touch operation on the optical image E by the indicator (finger F) based on a comparison between the generated touch detection surface and the distance image data acquired from the distance measurement unit 305. It is configured to determine whether or not. Note that the distance image data in the third embodiment and the method for comparing the generated touch detection surface and the distance image data acquired from the distance measurement unit 305 are the distance image data in the first embodiment and the generated method. This is the same as the comparison method between the touch detection surface and the distance image data acquired from the distance measurement unit 5. The other configuration of the image display device 300 according to the third embodiment is the same as that of the image display device 100 according to the first embodiment.

  In the third embodiment, the following effects can be obtained.

  In the third embodiment, as described above, the distance measuring unit 305 and the display unit 302 are configured to be movable together. Here, when the position of the optical image E is moved by integrally moving the distance measurement unit 305 and the display unit 302, the relative positional relationship between the distance measurement unit 305 and the display unit 302 does not change. Therefore, as in the third embodiment, the distance measurement unit 305 and the display unit 302 are moved integrally to move the position of the optical image E, so that the main body side control unit 306 causes the distance measurement unit 305 to move. It is possible to appropriately determine whether or not the indicator (finger F) has performed a touch operation on the optical image E without acquiring relative position information between the display unit 302 and the display unit 302. The other effects of the image display device 300 according to the third embodiment are the same as those of the image display device 100 according to the first embodiment.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description of the embodiments but by the scope of claims for patent, and further includes all modifications within the meaning and scope equivalent to the scope of claims for patent.

  Moreover, although the example which uses a liquid crystal panel as an image display part of this invention was shown in the said 1st-3rd embodiment, this invention is not limited to this. In the present invention, an image display unit other than the liquid crystal panel may be used as the image display unit. For example, a screen irradiated with projection light from a projector may be used as the image display unit of the present invention.

  In the first to third embodiments, as a method of acquiring the distance image data of the distance measuring unit, the process from the time when the infrared light source emits light to the time when the CCD camera receives the light reflected by the indicator. Although the example using the method of acquiring distance image data by calculating time has been shown, the present invention is not limited to this. In the present invention, a method of acquiring distance image data other than a method of calculating an elapsed time from the time when the infrared light source emits light to the time when the CCD camera receives the light reflected by the indicator may be used. For example, the distance image data may be obtained by calculating the distance between the three-dimensional camera and the indicator using a three-dimensional camera provided with two imaging units.

  In the first and third embodiments, the example in which the display unit is configured to rotate on the YZ plane has been described. However, the present invention is not limited to this. In the present invention, the display unit may be configured to rotate in a plane other than the YZ plane. For example, the display unit may be configured to rotate in a plane on the XY plane.

  Moreover, although the example which arrange | positions the image display apparatus main body of this invention on the ground was shown in the said 1st-3rd embodiment, this invention is not limited to this. In this invention, you may comprise so that an image display apparatus main body may be arrange | positioned other than the ground. For example, the image display device main body may be arranged on the ceiling or on the wall.

  Moreover, although the said 1st-3rd embodiment showed the example comprised so that the distance information acquired by the distance measurement part of this invention may be acquired as distance image data, this invention is not limited to this. In this invention, you may comprise so that the distance information acquired by a distance measurement part may be acquired as information other than distance image data. That is, the distance measurement unit may be configured to be able to acquire the positional relationship between the indicator (such as a user's finger) and the detection unit.

  Moreover, in the said 1st-3rd embodiment, although the example using the displacement amount of a movement distance and a rotation angle was shown as movement information of this invention, this invention is not limited to this. In the present invention, the position after movement and the rotation angle value after rotation may be used as movement information.

  In the first to third embodiments, for convenience of explanation, the processing of the control unit of the present invention has been described using a flow-driven flowchart in which processing is performed in order along the processing flow. Not limited to. In the present invention, the processing operation of the control unit may be performed by event-driven (event-driven) processing that executes processing for each event. In this case, it may be performed by a complete event drive type or a combination of event drive and flow drive.

DESCRIPTION OF SYMBOLS 1 Image display apparatus main body 2,202,302 Display unit 3,203 Reflective element assembly board (imaging part)
4 Image display unit 5, 305 Distance measurement unit 6, 206, 306 Main body side control unit (control unit)
31 Bottom (one side)
32 Upper surface (the other surface)
51 Detection Unit 51a Infrared Light Source (Light Emitting Unit)
51b CCD camera (light receiving unit)
100, 200, 300 Image display device

Claims (7)

An image display unit for displaying an image, and light of the image displayed by the image display unit is incident from one surface side, and incident light of the image is incident on the image in the air on the other surface side. An image forming unit that forms an optical image as a corresponding virtual touch screen, and moving the position at which the optical image is formed by moving at least one of the image display unit and the image forming unit A display unit configured to be possible,
Distance information that includes a detection unit that detects an indicator that virtually touches the optical image, is disposed to face the indicator via the optical image, and indicates distance from the detection unit to the indicator A distance image data acquisition unit for acquiring image data including:
As a surface that is generated so as to move according to the position of relative movement from the relative movement information of at least one of the image display unit and the imaging unit and the distance image data acquisition unit, and the user virtually touches Whether the indicator touches the optical image based on a virtual touch detection surface for recognition and the distance information included in the image data acquired by the distance image data acquisition unit. An image display device comprising: a control unit that determines whether or not. The image display unit and the imaging unit are configured to be movable relative to each other,
The control unit touches the optical image based on the touch detection surface generated from relative movement information between the image display unit and the imaging unit and the distance information. The image display device according to claim 1, wherein the image display device is configured to determine whether or not an operation has been performed. The image display unit is arranged to have a predetermined inclination angle with respect to the imaging unit, and is configured to be movable with respect to the imaging unit while maintaining the predetermined inclination angle. And
The control unit performs the instruction based on the touch detection surface generated from movement information of the image display unit moved while maintaining the predetermined tilt angle with respect to the imaging unit, and the distance information. The image display device according to claim 2, wherein the image display device is configured to determine whether or not a body touches the optical image. The imaging unit is configured to be rotatable about a predetermined rotation axis along the same plane of the imaging unit as a rotation center,
The control unit includes the touch detection surface generated from rotation information of the imaging unit rotated about a predetermined rotation axis along the same plane of the imaging unit, and the distance. The image display device according to claim 3, wherein the image display device is configured to determine whether or not the indicator performs a touch operation on the optical image based on the information. The imaging unit is arranged so as to be parallel to the horizontal plane, and is configured to be movable in the vertical direction.
The control unit determines whether the indicator has touched the optical image based on the touch detection surface generated from movement information of the imaging unit moved in the vertical direction and the distance information. The image display device according to claim 2, configured to determine whether or not. The image display device according to claim 1, wherein the distance image data acquisition unit and the display unit are configured to be integrally movable. The detection unit includes a light emitting unit that emits light, and a light receiving unit that receives light emitted from the light emitting unit and reflected by the indicator,
The distance image data acquisition unit is configured to detect the detection based on an elapsed time from a time when the light emitting unit emits light to a time when the light receiving unit receives light emitted from the light emitting unit and reflected by the indicator. The image display device according to claim 1, configured to acquire the distance information from a part to the indicator.

Images