JP2015069572A - Optical imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an optical imaging device capable of operating while viewing an optical image.SOLUTION: An optical imaging device 10 includes: a display unit 60 that displays an object; and an optical panel 11 which has plural reflection transmission films 13 for reflecting display light 26 from the display unit 60. The optical imaging device 10 convergences display light 26 to form an optical image of an object. The optical imaging device 10 further includes an imaging unit 70 that takes an image in a direction of the optical image. The reflection transmission film 13 transmits entering light which is received by the imaging unit 70.

Description

  The present disclosure relates to an optical imaging apparatus.

  FIG. 9 shows a conventional optical imaging apparatus disclosed in Patent Document 1 among various optical imaging apparatuses proposed so far.

  The optical imaging device 110 in FIG. 1 is an optical imaging device that focuses scattered light (display light) from an object to form an optical image of the object, and is opaque or translucent. A large number of reflective elements 112 having reflective surfaces orthogonal to the surface of the panel 111 are arranged on the panel 111.

Japanese Patent Laid-Open No. 9-5503

  In recent years, in tablet PCs, smartphones, etc., by giving movement near the surface of the display panel toward the display image displayed on the display panel, such as liquid crystal and organic EL mounted on those devices, In addition to displaying images, the apparatus can be operated without using a keyboard or the like.

  However, the conventional technique disclosed in Patent Document 1 has a problem that it can only display an optical image (aerial image) and cannot perform operations on the optical image (aerial image). doing.

  In view of the above problems, the present disclosure provides an optical imaging device that can be operated.

  In order to solve the above problems, an optical imaging apparatus according to an aspect of the present disclosure includes at least one display unit that displays an object and a plurality of reflection / transmission films that reflect display light from the display unit. An optical imaging device that converges the display light to form an optical image of the object, wherein the optical imaging device further images the direction of the optical imaging An imaging unit is provided, and the reflection / transmission film transmits incident light received by the imaging unit.

  In the optical imaging apparatus according to one aspect of the present disclosure, the incident light may belong to a wavelength region different from the wavelength region of the display light.

  In the optical imaging device according to one embodiment of the present disclosure, the display light may be visible light, and the incident light may be near infrared light.

  In the optical imaging device according to one embodiment of the present disclosure, the imaging unit may be installed on the opposite side of the optical imaging with the optical panel interposed therebetween.

  In the optical imaging device according to one aspect of the present disclosure, the imaging unit may include a display unit on the same side with respect to the optical panel.

  The optical imaging device according to one embodiment of the present disclosure further includes a light emitting element, the imaging unit receives reflected light of light emitted from the light emitting element, and the reflective / transmissive film transmits the reflected light. You may do it.

  In the optical imaging apparatus according to one aspect of the present disclosure, the imaging unit may be a passive single camera or a stereo camera.

  Further, in the optical imaging apparatus according to an aspect of the present disclosure, the imaging unit may be an active single camera or a stereo camera.

  In the optical imaging device according to one aspect of the present disclosure, the optical imaging device includes a plurality of the optical panels, and converges the display light from the display unit via the plurality of optical panels. Thus, an aerial stereoscopic image may be formed as the optical imaging.

  In the optical imaging device according to one aspect of the present disclosure, at least two of the plurality of optical panels may be installed in parallel.

  Moreover, in the optical imaging apparatus according to one aspect of the present disclosure, the adjacent optical panels among the plurality of optical panels may be installed with the panel surfaces facing each other at a predetermined angle.

  In the optical imaging device according to an aspect of the present disclosure, the display unit may be the object.

  According to the optical imaging apparatus according to the present disclosure, it is possible to perform an operation while viewing the optical imaging.

1 is a diagram illustrating a first configuration example of an optical imaging apparatus according to Embodiment 1. FIG. FIG. 4 is a diagram showing a detailed configuration of part A in the first configuration example according to the first embodiment. 6 is a diagram illustrating a second configuration example of the optical imaging apparatus according to Embodiment 1. FIG. FIG. 6 is a diagram showing a detailed configuration of part A in a second configuration example according to the first embodiment. 3 is a plan view illustrating a first configuration example of the optical imaging apparatus according to Embodiment 1. FIG. 6 is a plan view showing a second configuration example of the optical imaging apparatus according to Embodiment 1. FIG. FIG. 4 is a diagram illustrating light reflectance characteristics of a reflection / transmission film provided in the optical imaging apparatus according to Embodiment 1. FIG. 4 is a diagram showing light transmittance characteristics of a reflective / transmissive film provided in the optical imaging apparatus according to Embodiment 1. 6 is a diagram illustrating a configuration example of an optical imaging apparatus according to Embodiment 2. FIG. FIG. 10 is a diagram showing a detailed configuration of part A in a configuration example according to Embodiment 2. 6 is a diagram illustrating another configuration example of the optical imaging apparatus according to Embodiment 2. FIG. 6 is a diagram illustrating a first configuration example of an optical imaging apparatus according to Embodiment 3. FIG. 6 is a diagram illustrating a second configuration example of the optical imaging apparatus according to Embodiment 3. FIG. It is the schematic which shows the optical imaging device of a prior art.

  Hereinafter, an optical imaging apparatus according to an embodiment of the present disclosure will be described with reference to the drawings. Each of the following embodiments shows a specific example of the present disclosure, and numerical values, shapes, materials, components, arrangement positions and connection forms of the components are examples, and the present disclosure It is not limited.

(Embodiment 1)
FIG. 1A is a diagram illustrating a first configuration example of the optical imaging apparatus according to the first embodiment. FIG. 1B is a diagram showing a detailed configuration of part A in FIG. 1A. FIG. 2A is a diagram illustrating a second configuration example of the optical imaging apparatus according to the first embodiment. FIG. 2B is a diagram showing a detailed configuration of part A in FIG. 2A.

  A first configuration example of the optical imaging apparatus 10 in FIG. 1A includes a display unit 60, an optical panel 11, and an imaging unit 70.

  The display unit 60 is a display panel such as a liquid crystal or an organic EL, for example, and displays an object to be shown to an observer (operator).

  The optical panel 11 includes the reflective / transmissive film 13 that reflects the display light 26a from the display unit 60, and converges the reflected display light 26b to generate an optical image 30 of the object. The reflective / transmissive film 13 transmits the incident light 51 received by the imaging unit 70.

  The imaging unit 70 includes a solid-state imaging element 71 and images the direction of the optical imaging 30. For example, a hand or finger 35 of a person who operates the optical imaging 30 is imaged.

  Further, the second configuration example of the optical imaging apparatus 10 in FIG. 2A is different from that in FIG. 1A in that another solid-state imaging element 71 is added in the imaging unit 70. In other words, the first configuration example in FIG. 1A is an example including a single camera, and the second configuration example in FIG. 2A is an example including a stereo camera.

  In FIG. 1A, FIG. 1B, FIG. 2A, and FIG. 2B, the optical imaging apparatus 10 according to the present embodiment is configured by arranging a large number of reflection / transmission films 13 on an opaque panel 11. The opaque optical panel 11 is made of, for example, an opaque thin plate material such as metal (vertical and horizontal: 200 mm, thickness: 0.5 mm).

  Further, the display light 26 a emitted from the display unit 60 and indicated by a solid line in the drawing is reflected by the reflection / transmission film 13 arranged in large numbers in the optical panel 11. The display light 26a includes visible light, for example, includes at least light in the wavelength region (400 nm to 700 nm) of the three primary colors RGB, and emits light in the wavelength region of invisible light (other than 400 nm to 700 nm, for example, infrared light IR). May be included.

  Then, the reflected display light 26b indicated by the solid line in the drawing converges and forms an image corresponding to the object (point B as an example) displayed on the display unit 60, thereby optical imaging (aerial image). 30 (as an example, an optical image corresponding to point B is 'B').

  In FIGS. 1A and 2A, in order to facilitate understanding of the present invention, it has been described that the display light 26 (26a, 26b) converges and forms an image using only the point B in the object. A plurality of display lights 26 in the object converge to form an image, and an optical image (aerial image) 30 is formed.

  The observer (operator) moves the hand or the finger (operation means) 35 so as to access (touch) this image while viewing the optical image (aerial image) 30, thereby causing the optical image forming apparatus 10. Alternatively, an operation (instruction) to another device connected to the optical imaging device 10 is performed.

  The imaging unit 70 is provided as a part for recognizing the movement of the hand or the finger 35. In addition to the solid-state imaging device (image sensor) 71, the imaging unit 70 includes, for example, a camera lens, an A / D converter, an arithmetic circuit, and the like.

  Further, the imaging unit 70 of the present embodiment is a passive type, and takes an image with incident light (passive light) 51 indicated by a broken line on the drawing from the hand or finger (operation means) 35, and the movement of the image data is determined from the image data. Recognize and measure distance. The incident light 51 includes light in a wavelength region of invisible light (other than 400 nm to 700 nm, for example, infrared light IR).

  The solid-state image sensor 71 has a light receiving sensitivity with respect to at least the wavelength region of the incident light 51. For example, as shown in FIG. I can do it. As an example of the operation, the imaging unit 70 captures continuous images, compares the current frame (image) with the previous frame (image), and calculates the motion and distance by calculation. Alternatively, the movement and distance are calculated by a single-plate CCD image sensor, CMOS image sensor, or the like that can capture a phase difference image.

  Alternatively, for example, as shown in FIG. 2A, a stereo camera equipped with a plurality of solid-state imaging devices 71 such as a CCD image sensor and a CMOS image sensor and performing image recognition based on a phase difference between the captured images can be used. The stereo camera can compare the current frame (image) with the previous frame (image) and calculate a distance by calculation, or can capture a phase difference image, as in the single camera described above. For example, a method of mounting a plurality of solid-state imaging devices 71 can be combined as appropriate.

  2A and 2B show an example in which a plurality of solid-state imaging devices 71 are sequentially arranged as a stereo camera in the vertical direction with respect to the optical panel 11, but the arrangement is not limited to this, and will be described later, for example As shown in FIG. 3B, a plurality of solid-state imaging elements 71 can be sequentially arranged in the horizontal direction with respect to the optical panel 11.

  FIG. 3A is a schematic configuration plan view of the first configuration example of the optical imaging apparatus according to Embodiment 1 viewed from above. FIG. 3B is a schematic configuration plan view of the second configuration example of the optical imaging apparatus according to Embodiment 1 viewed from above. FIG. 3A is an example including a single camera, and FIG. 3B is an example including a stereo camera.

  3A and 3B, the optical imaging 30 from the display unit 60 installed under the optical panel 11 is imaged at the same position above the optical panel 11. The imaging unit 70 is disposed in front of the optical imaging 30 below the optical panel 11. In this case, if the center line 14 of the display unit 60 and the imaging unit 70 (or between a plurality of solid-state imaging devices in the case of a stereo camera) is set to coincide, the movement of the hand or finger (operation means) 35 is changed. Furthermore, it becomes possible to recognize correctly.

  3A and 3B show an example in which the reflection / transmission films 13 are arranged orthogonally. However, the present invention is not limited to this example. For example, a number of cylindrical reflection / transmission films 13 may be arranged. It is possible to arrange in Moreover, in FIG. 3A and FIG. 3B, although the space | interval of the reflective transmission film 13 is drawn large for easy understanding, it is arrange | positioned densely actually. 4A and 4B are diagrams showing light reflectance characteristics and light transmittance characteristics of the reflective / transmissive film provided in the optical imaging apparatus according to Embodiment 1. FIG.

  The reflection / transmission film 13 is a film that selects and reflects and transmits light by selecting a wavelength of light by being composed of a multilayer film or the like, reflects visible light, and transmits visible light (more preferably infrared light, near red). It has a function of transmitting part of the external light.

  Therefore, the display light 26 that is visible light emitted from the display unit 60 (for example, RGB light by red light (R light), green light (G light), and blue light (B light)) is inside the optical panel 11. Since the optical image 30 is reflected by the reflection / transmission film 13, the observer can recognize the optical image 30. On the other hand, incident light 51, which is visible light, passes through the reflective / transmissive film 13, and the imaging unit 70 can detect the movement of the hand or finger (operation means) 35.

  As described above, in the optical imaging apparatus according to the first embodiment described above, the observer (operator) gives the movement of the hand or the finger (operation means) 35 to the optical imaging 30 displayed on the display unit 60. As a result, the apparatus can be operated in addition to displaying an image.

  Furthermore, the imaging unit 70 can be installed without the need to arrange protrusions, cables, etc. in the observer's field of view, and the optical imaging device 10 can be downsized and the design flexibility of the optical imaging device 10 can be increased. . That is, when a general reflective film (reflective element) is used, the imaging unit 70 needs to be installed on the upper surface of the optical panel 11, but the optical imaging apparatus according to the present embodiment has such a layout. No more restrictions.

  Furthermore, the imaging unit 70 can be placed on the same side as the display unit 60 with respect to the optical panel 11, and the operability of the observer is greatly improved.

  Furthermore, since the imaging unit 70 does not interfere with the formation of the optical imaging 30, the imaging unit 70 can be installed in front of the observer as shown in FIGS. 3A and 3B, and the movement of the hand or finger (operation means) 35. Can be recognized easily and can be recognized with higher accuracy.

  In this embodiment, the infrared light (near infrared light) is described as the passive light. However, the present invention is not limited to this. For example, the imaging unit may receive ultraviolet light as passive light. .

  In the present embodiment, an object can be used as the display unit 60, for example, the object can be irradiated with light, and the reflected light can be used as the display light 26.

(Embodiment 2)
Hereinafter, with reference to the drawings, the configuration and operation of the optical imaging apparatus 10 according to the second embodiment will be described in detail with a focus on differences from the contents described in the previous embodiments.

  FIG. 5A is a diagram illustrating a configuration example of the optical imaging apparatus according to the second embodiment. FIG. 5B is a diagram showing a detailed configuration of part A in FIG. 5A.

  The configuration example of the optical imaging apparatus 10 in FIG. 5A is different from that in FIG. 1A in that a light emitting element 72 is added in the imaging unit 70. The optical imaging apparatus according to Embodiment 2 includes a light emitting element (an LED element as an example) 72 as a light source, and visible light (more preferably infrared light) indicated by a two-dot chain line on the drawing irradiated from the light emitting element 72. The solid-state image sensor 71 receives reflected light (active light) 53 that is invisible light from the hand or finger (operation means) 35 indicated by a one-dot chain line in the drawing with respect to the irradiation light 52 that is near infrared light). (Exposure), that is, an active type imaging unit 70 is provided.

  In addition, the imaging unit 70 includes a signal generation unit, and the signal generation unit generates a light emission signal instructing irradiation of the irradiation light 52 and an exposure signal instructing exposure of the reflected light 53. The light emitting element 72 irradiates the irradiation light 52 for recognizing (ranging) the movement of the hand or the finger 35 according to the timing of receiving the light emission signal generated by the signal generation unit.

  In addition to the solid-state imaging device (image sensor) 71, the imaging unit 70 includes, for example, a circuit that generates and outputs RAW data such as a camera lens and an A / D converter, an arithmetic unit, and the like. In addition, the imaging unit 70 performs exposure a plurality of times in accordance with the timing indicated by the exposure signal generated by the signal generation unit with respect to the region including the target object (subject), and RAW data corresponding to the sum of the plurality of exposure amounts. (For example, TOF (Time Of Flight) information for calculating the distance) is output. The calculation unit calculates based on the RAW data received from the imaging unit 70 and outputs distance information (detection information) to the subject.

  The optical imaging apparatus according to the present embodiment is an active type, and recognizes the movement of the hand or the finger 30 with higher accuracy by synchronizing the light emission signal to the light emitting element 72 and the exposure signal to the solid-state imaging element 71. (Ranging) can be performed. In addition, since the light emitting element 72 is included, the light emitting element 72 can be used in a dark scene where the surrounding brightness is insufficient. Furthermore, noise components can be reduced, and measurement accuracy can be further improved.

  5A shows an example in which the light emitting element 72 is provided in the imaging unit 70, the position of the light emitting element 72 is not limited thereto, and as shown in FIG. 6, the display unit 60, the imaging unit 70, It is also possible to arrange them on the same side. Accordingly, it is possible to avoid placing components on the side where the optical imaging 30 is displayed while increasing the degree of freedom of design of the imaging unit 70, and to realize an optical imaging device with high operability. I can do it.

(Embodiment 3)
Hereinafter, the configuration example and operation of the optical imaging apparatus 10 according to Embodiment 3 will be described in detail with a focus on differences from the contents described in the above embodiments, with reference to the drawings.

  The present embodiment includes a plurality of optical panels 11. Thus, the optical imaging apparatus converges the display light from the display unit via the plurality of optical panels 11 to form an aerial stereoscopic image as optical imaging. That is, in the present embodiment, an optical imaging device that is more preferable for forming a three-dimensional aerial image (hereinafter, aerial stereoscopic image) will be described.

  FIG. 7 is a diagram illustrating a first configuration example of the optical imaging apparatus according to the third embodiment. FIG. 8 is a diagram illustrating a second configuration example of the optical imaging apparatus according to the third embodiment.

  The first configuration example shown in FIG. 7 is different from FIG. 1A in that the optical panel 11 has a configuration of a plurality of sheets (two in FIG. 7) instead of a single configuration, and the display unit 60 The difference is that the stereoscopic display unit 65 is provided. That is, it has the structure of the several sheet | seat which has the optical panel 11a and the optical panel 11b.

  The optical panel 11 a reflects the display light 26 a from the stereoscopic display unit 65.

  The optical panel 11b reflects the display light 26b reflected by the optical panel 11a, and converges the reflected display light 26c to generate a three-dimensional optical image of the object. The optical panels 11a and 11b may be the same as the optical panel 11 shown in FIG. 1A, for example, or may have different sizes and external shapes.

  In this way, the display light 26a from the stereoscopic display unit 65 capable of stereoscopic display using the plurality of optical panels 11 on which the reflective / transmissive films 13 are formed is reflected by the reflective / transmissive film 13 in the optical panel 11a. The display light 26b that is the reflected light from the optical panel 11a is further reflected by the reflective / transmissive film 13 in the optical panel 11b. The display light 26c, which is the reflected light from the second optical panel 11b, forms an uneven optical image (aerial stereoscopic image) 31 on the upper portion of the optical panel 11b.

  The observer (operator) moves the hand or finger (operation means) 35 so as to access (touch) the optical image formation while viewing the optical image formation (aerial stereoscopic image) 31, thereby forming an optical connection. An operation (instruction) to the image device 10 or another device connected to the optical image forming device 10 is performed.

  In addition, the imaging unit 70 of the present embodiment captures an image with incident light 51 indicated by a broken line in the drawing from the hand or finger (operation means) 35, and performs motion recognition, distance measurement, and the like from the image data.

  In FIG. 7, the optical imaging apparatus 10 in which the two optical panels 11 are installed in parallel has been described. However, the present invention is not limited to this, and in the present embodiment, for example, as shown in FIG. The angles formed by the corresponding surfaces (approximately 90 degrees in FIG. 8) may be arbitrarily set by making the surfaces of the optical panel 11a and the optical panel 11b face each other. Here, “parallel” includes substantially parallel, that is, an error in manufacturing.

  Of the plurality of optical panels 11, at least two optical panels 11 may be installed in parallel.

  Further, when the optical panel 11 has a configuration of a plurality of sheets, the arrangement is not limited to the arrangement shown in FIGS. 7 and 8, and various arrangements can be used.

  For example, it is also possible to use the optical imaging device 10 that is installed so that the shapes viewed from the sides of the plurality of optical panels 11 are fan-shaped with the surfaces of the adjacent optical panels 11 facing each other. When the optical panel 11 is composed of three or more optical panels 11, the angles formed by the opposing surfaces of the adjacent optical panels 11 may be arbitrarily set. That is, the adjacent optical panels 11 among the plurality of optical panels 11 may be installed with their panel surfaces facing each other at a predetermined angle.

  That is, when the optical panel 11 has a configuration of a plurality of sheets, various arrangements such as an arrangement in which the plurality of optical panels 11 are orthogonal (for example, FIG. 8), a coaxial arrangement (for example, FIG. 7), and a columnar arrangement are used. It is possible.

  In the present embodiment, a three-dimensional object may be used as the three-dimensional display unit 65. For example, light may be applied to the three-dimensional object and the reflected light may be used as the display light 26a.

  Further, in the optical imaging apparatus of FIGS. 7 and 8, another solid-state imaging device 71 may be added to the imaging unit 70 and a stereo camera as shown in FIG. 2A may be provided.

  Furthermore, in the optical imaging apparatus of FIGS. 7 and 8, a light emitting element 72 may be added, and an active imaging unit as shown in FIG. 6 or 7 may be provided.

  The optical imaging apparatus according to the present disclosure can be operated by an observer as an action to the optical imaging, and is industrially useful.

DESCRIPTION OF SYMBOLS 10 Optical imaging device 11, 11a, 11b Optical panel 14 Center line 13 Reflecting / transmitting film | membrane 26, 26a, 26b, 26c Display light 30 Optical imaging (aerial image)
31 Optical imaging (aerial stereoscopic image)
35 Hand or finger (operating means)
51 Incident Light 52 Irradiation Light 53 Reflected Light 60 Display Unit (Display Panel)
65 Three-dimensional display unit 70 Image pickup unit 71 Solid-state image pickup device 72

Claims (12)

A display unit that displays an object; and at least one optical panel provided with a plurality of reflective and transmissive films that reflect display light from the display unit; and the optical imaging of the object by converging the display light An optical imaging device for imaging
The optical imaging apparatus further includes an imaging unit that images the direction of the optical imaging,
The reflection / transmission film is an optical imaging device that transmits incident light received by the imaging unit. The optical imaging apparatus according to claim 1, wherein the incident light received by the imaging unit belongs to a wavelength region different from a wavelength region of the display light. The optical imaging apparatus according to claim 1, wherein the display light is visible light, and the incident light is infrared light. The optical imaging apparatus according to claim 1, wherein the imaging unit is installed on the opposite side of the optical imaging with the optical panel interposed therebetween. The optical imaging apparatus according to claim 1, wherein the imaging unit is provided on the same side as the display unit with respect to the optical panel. The optical imaging apparatus further includes a light emitting element,
The incident light includes reflected light of light emitted from the light emitting element,
The optical imaging apparatus of any one of Claims 1-5. The optical imaging apparatus according to claim 1, wherein the imaging unit is a passive single camera or a stereo camera. The optical imaging apparatus according to claim 1, wherein the imaging unit is an active single camera or a stereo camera. The optical imaging device includes a plurality of the optical panels,
The optical imaging according to any one of claims 1 to 8, wherein an aerial stereoscopic image is formed as the optical imaging by converging the display light from the display unit via the plurality of optical panels. apparatus. The optical imaging apparatus according to claim 9, wherein at least two of the plurality of optical panels are installed in parallel. The optical imaging apparatus according to claim 9, wherein among the plurality of optical panels, the adjacent optical panels are installed with their panel surfaces facing each other at a predetermined angle. The optical imaging apparatus according to claim 1, wherein the display unit is the object.

Images