JP6121097B2 - Information presentation device - Google Patents

Description

  The present invention relates to an information presentation apparatus used for optical camouflage. In particular, the present invention relates to an information presentation apparatus that cognitively transparentizes an object by presenting information (such as a landscape behind the object) hidden by the object on the surface of the object.

  There are technologies that provide augmented reality (AR) or mixed reality (MR) by projecting an image on the surface of an object. Some of these technologies can make it difficult to recognize the presence of an object by presenting an image behind the object (hereinafter referred to as a “background image”) on the surface of the object. Specifically, in these techniques, a background image that is less uncomfortable with the environment (external environment) around the object is presented (projected or the like) on the surface of the object. Thereby, the object can be buried in the external environment. As a result, the presence of the object can be made thin (cognitively transparent).

  In Patent Document 1, a projector disposed at a position optically conjugate with an observer's position, an imaging unit that captures an image to be projected, and an image (image) when the captured image is viewed from the observer. The technology which can hide all or a part of a real object cognitively using the information presentation device which has a processing device which processes so that it may correspond to is disclosed.

JP 2008-198196 A

  In order to project a background image that does not give the viewer a sense of incongruity on the surface of the object, the object is viewed from a position where the viewpoint of the observer (the position of both eyes) and the projection point at which the image is projected are optically conjugate. It is necessary to project a background image on the surface of the screen. In other words, it is necessary to project a plurality of background images corresponding to the parallax of both eyes of the observer onto the surface of the object.

  In the technique disclosed in Patent Document 1, since the observer's viewpoint is limited to one point, it may not be possible to project a plurality of background images corresponding to the parallax between the eyes of the observer on the surface of the object. It was. In the technique disclosed in Patent Document 1, when an observer moves during observation, an image corresponding to a background image observed from the moved position cannot be projected onto the surface of the object. was there. Furthermore, in the technique disclosed in Patent Document 1, when projecting a plurality of background images corresponding to multiple viewpoints, it is necessary to use a plurality of projectors. In some cases, the cost for installation increases.

  The present invention has been made under such circumstances, and an object thereof is to provide an information presentation device capable of cognitively making an object transparent by projecting a plurality of background images onto the surface of the object. .

  According to one aspect of the present invention, an information presentation device that cognitively transparentizes an object by projecting a background image behind the object onto the surface of the object, the projection corresponding to the background image Projection means for projecting light, optical system means for generating a plurality of projection lights from the projection light, projecting the generated projection lights onto the object, and a gap between the object and the optical system means And a retroreflecting unit that reflects the projected plurality of projected light, the projecting unit converging the projected light in a plurality of directions by transmitting the projected light to the optical system unit An information presentation device characterized by generating the plurality of projection lights corresponding to the plurality of projection images related to the background image from the projection light, and projecting the generated plurality of projection lights onto the object. Provided. Further, the optical system means converges the projection light in a plurality of directions to generate the plurality of projection lights corresponding to the plurality of projection images from the projection light, and the generated plurality of the plurality of projection lights. A second lens that irradiates the projection light and a mirror member that reflects the irradiated projection light in the direction of the object, wherein the projection means uses the second lens to The projection light is irradiated to the mirror member, the plurality of projection light irradiated using the mirror member is reflected in the direction of the object, and the plurality of projection light is reflected using the retroreflecting means. The information presentation is characterized in that the plurality of projection images are projected onto the surface of the object to make the object cognitively transparent by emitting only in the incident direction of the plurality of projection lights. An apparatus is provided. Furthermore, an information presentation apparatus is provided, further comprising an imaging unit that acquires the background image.

  According to the present invention, a plurality of background images are projected on the surface of the object, so that the object can be transparently recognized.

It is a schematic structure figure showing an example of an information display device concerning an embodiment of the present invention. It is explanatory drawing explaining the retroreflection member of the information display apparatus which concerns on embodiment of this invention. FIG. 4A is an explanatory diagram illustrating an example of the retroreflective member 40 used in the information display apparatus 100 according to the present embodiment. FIG. (B) is an explanatory view illustrating an example of another reflecting member. It is explanatory drawing explaining operation | movement of the information display apparatus which concerns on embodiment of this invention. It is explanatory drawing explaining arrangement | positioning of each structure of an information display apparatus. FIG. 1A is an explanatory diagram for explaining the arrangement of each component of the information display apparatus according to the first embodiment of the present invention. FIG. 7B is an explanatory diagram for explaining the arrangement of each component of another information display device. It is explanatory drawing explaining arrangement | positioning of each structure of the information display apparatus which concerns on Example 2 of this invention. FIG. 5A is an explanatory diagram for explaining the arrangement of each component of the information display device 120 according to the second embodiment of the present invention. FIG. 5B is an explanatory diagram for explaining the interior of the vehicle before the information display device 120 according to the present embodiment projects a projection image. FIG. 7C is an explanatory diagram for explaining the interior of the vehicle after the information display apparatus 120 according to the present embodiment projects a projection image.

  Non-limiting exemplary embodiments of the present invention will be described with reference to the accompanying drawings. In the description of all the attached drawings, the same or corresponding members or parts are denoted by the same or corresponding reference numerals, and redundant description is omitted. Also, the drawings are not intended to show the relative ratio between members or parts. Accordingly, specific dimensions can be determined by one skilled in the art in light of the following non-limiting embodiments.

  Hereinafter, the present invention will be described using the information presentation apparatus 100 according to the present embodiment. Here, the present invention can be used for any one other than the present embodiment as long as it forms a plurality of projection images on the surface of an object from a plurality of projection points.

(Configuration of information presentation device)
A configuration of the information presentation apparatus 100 according to the embodiment of the present invention will be described with reference to FIG.

  FIG. 1 is a schematic configuration diagram of an information display apparatus 100 according to the present embodiment.

  As shown in FIG. 1, the information presentation apparatus 100 according to the present embodiment is an apparatus that uses a recursive projection technology (RPT), which is one technique for virtualizing an object. Specifically, the information presenting apparatus 100 has a retroreflective member (such as a screen) from a position where an observer's viewpoint and a projection point of a projection unit (such as a projector, a projection apparatus, and a projection apparatus) are optically conjugate. An image behind the object (hereinafter, referred to as “background image Ib”) is projected onto the surface of the object covered with. The background image Ib includes, for example, a state behind the object and a landscape behind the object. Thereby, the information presentation apparatus 100 can make an observer recognize the object as if it has seen through (hereinafter referred to as “cognitively transparentize the object”). That is, the information presentation apparatus 100 is an apparatus that realizes optical camouflage (Optical Camouflage, Active Camouflage) that is cognitively transparent.

  In the present embodiment, the information presentation apparatus 100 instructs the components of the entire information presentation apparatus 100 to operate, thereby controlling the operation of the entire information presentation apparatus 100 and the projection light corresponding to the background image Ib. Projecting means 20 for projecting, optical system means 30 for projecting a plurality of projection lights generated from the projected projection light onto the surface of the object, retroreflecting means 40 for reflecting the projected plurality of projection lights, Have Further, in the present embodiment, the information presentation apparatus 100 is configured such that the control conditions of the control unit 10, the image information of the image projected by the projection unit 20, and the like, and the optical system unit 30 projects the projection light onto the surface of the object. An I / F unit 50 is provided for inputting conditions and the like to the information presentation apparatus 100 from outside the information presentation apparatus 100.

  Here, the object is cognitively transparent by the projection light projected on the surface of the object by the information presentation apparatus 100. Therefore, the object includes, in the present embodiment, anything that can project light onto the surface of the object without being limited to a planar or curved shape or a gas, liquid, or solid.

  The control means 10 is a means for instructing each component of the information presentation apparatus 100 to operate and controlling the operation of each component. In this embodiment, the control means 10 controls the projection means 20 and the like described later based on the control conditions and the like input by the I / F means 50 described later. Further, the control unit 10 outputs image information and the like related to the background image Ib input by the I / F unit 50 to the projection unit 20. Further, the control unit 10 outputs the state of the information presentation device 100 to the I / F unit 50.

  The projection unit 20 is a unit that projects light corresponding to the background image Ib (hereinafter referred to as “projection light LP”). In the present embodiment, a commercially available projector, a projection device, a projection device, or the like can be used as the projection unit 20.

  The optical system member 30 is means for generating a plurality of lights (hereinafter referred to as “projection light Lp”) from the projection light LP and projecting the generated plurality of projection lights Lp onto the surface of the object. In this embodiment, the optical system member 30 includes a first lens 31 that generates a plurality of projection lights Lp from the projection light LP projected by the projection unit 20, and a second lens that irradiates the generated projection lights Lp. 32, and a mirror member 33 that reflects the irradiated projection light Lp in the direction of the object.

  The first lens 31 is a lens that generates a plurality of projection lights Lp from the projection light LP by converging the projection light LP projected by the projection unit 20 in a plurality of directions. The first lens 31 includes a plurality of lenses (for example, 31La, 31Lb, and 31Lc in FIG. 3) that generate a plurality of parallel lights. Here, a convex lens (for example, a field lens) can be used as the plurality of lenses. In the present embodiment, the first lens 31 transmits the projection light LP projected by the projection unit 20 to the plurality of convex lenses and converges the projection light LP in a plurality of directions. That is, the first lens 31 generates a plurality of parallel lights (for example, Lpa, Lpb, and Lpc in FIG. 3) from the projection light LP as the plurality of projection lights Lp. Accordingly, the first lens 31 generates a plurality of projection lights Lp (Lpa, Lpb, and Lpc) corresponding to the plurality of projection images Ip (background image Ib) from the projection light LP projected by the projection unit 20. it can. Further, since the first lens 31 generates a plurality of parallel lights, it is possible to prevent the generated parallel lights from being superimposed (crosstalk, interference, etc.). For this reason, the information presentation apparatus 100 according to the present embodiment can efficiently utilize the light energy from the light source (projection unit 20), and can provide information presentation (projection of projection images) with low power consumption and high luminance. can do.

  The second lens 32 transmits a plurality of projection lights Lp and forms a plurality of projection points (hereinafter referred to as “projections”) in order to form the plurality of projection lights Lp generated by the first lens 31 on the surface of the object. It is a lens that forms a point PL ”). In the present embodiment, the second lens 32 includes a plurality of projection lenses (for example, a lens array, a projector lens, etc.) corresponding to the plurality of lenses of the first lens 31. The second lens 32 transmits a plurality of projection lights Lp (for example, Lpa, Lpb, and Lpc in FIG. 3) generated by the first lens 31 to a plurality of projection lenses (for example, 32La, 32Lb, and 32Lc in FIG. 3). Then, the light is condensed to form a plurality of projection points PL (for example, PLa, PLb, and PLc in FIG. 3). As a result, the second lens 32 projects a plurality of projection lights Lp onto the surface of the object from the plurality of projection points PL, and generates a plurality of projection images (hereinafter referred to as “projection image Ip”). Can be imaged. That is, in the second lens 32, a plurality of observation points corresponding to the parallax of both eyes of the observer and a plurality of projection points PL for projecting a plurality of background images Ib (projection images Ip) are optically conjugate. From the position, a plurality of background images Ib can be projected onto the surface of the object.

  The mirror member 33 is a member that reflects, in the direction of the object, a plurality of projection light Lp that has been transmitted through the second lens 32 and irradiated. The mirror member 33 is a member that transmits light reflected from the surface of the object by the retroreflecting means 40 (to be described later) (hereinafter referred to as “reflected light LR”) in the direction of the observer (observation point). . Here, as the mirror member 33, a transflective mirror can be used in this embodiment. As the semi-transmissive mirror, a mirror having a reflectivity of 70 to 90% (for example, a half mirror or a combiner) can be used.

  The information presentation apparatus 100 projects a plurality of projection images Ip corresponding to the plurality of background images Ib on the surface of the object using the optical system member 30 (the first lens 31, the second lens 32, and the mirror member 33). Details of the operation to be performed will be described later (operation of the information presenting apparatus).

  Note that the first lens 31, the second lens 32, and the mirror member 33 of the optical system member 30 are driven by a motor or the like, and the first lens 31, the second lens 32, the mirror member 33, and the projection unit. It is good also as a structure which can change the relative positional relationship of 20 and the retroreflection means 40. FIG. Specifically, the optical system member 30 changes the positional relationship relative to the optical axis direction of the projection light LP or the projection light Lp or the plurality of lenses of the first lens 31 and the second lens 32. It is good also as a structure which can do. Thereby, the optical system member 30 forms a plurality of projection images Ip (projection images) corresponding to the plurality of background images Ib on the surface of the retroreflective means 40 (object) which is at an arbitrary position or moves during observation. Can be imaged.

  The retroreflecting unit 40 is a unit that is disposed in a gap between the object on which the plurality of projection lights Lp are projected and the optical system unit 30 and reflects the projected plurality of projection lights Lp (projection image Ip). In this embodiment, the retroreflective means 40 emits (reflects) a plurality of projection lights Lp only in the incident direction (recursively reflects). The shape of the retroreflective means 40 can be any shape. The surface shape (projection surface shape) of the retroreflective means 40 may be the same shape as the image (object) presented by the projection image Ip or a shape approximate thereto. Further, the surface shape of the retroreflective means 40 may be an arbitrary shape such as a flat surface, a curved surface, or a closed curved surface. Here, the closed curved surface is a spherical shape, an egg shape, a polyhedron, or a donut shape. Further, the material constituting the retroreflective means 40 is preferably a material that is lightweight and can be easily processed into an arbitrary shape (for example, polystyrene foam). The retroreflecting material can be configured using a corner cube array or glass beads as a material that reflects with a strong directivity in the direction of the light source.

  The light reflection operation of the retroreflecting means 40 will be specifically described with reference to FIG.

  As shown in FIG. 2A, the retroreflecting means 40 used in the information presentation apparatus 100 of the present embodiment emits the reflected light LR only in the incident direction of the incident light LC. Therefore, the projected image (video, image, etc.) projected on the surface of the retroreflective means 40 can have high brightness in the viewing direction of the observer. Specifically, the retroreflective unit 40 projects the projection image Ip on the surface based on the projection light Lp projected by the projection unit 20 and the optical system unit 30. Thereby, the retroreflection means 40 can visually present a specific background image of the plurality of background images Ib to the observer corresponding to the observation points (for example, multiple viewpoints) of the observer. That is, by using the information presentation apparatus 100 according to the embodiment of the present invention for the optical camouflage technology (optical camouflage system), the optical camouflage technology can be improved from a monocular type to a multi-eye type. Moreover, the information presentation apparatus 100 according to the embodiment of the present invention can be applied to an optical camouflage technique (optical camouflage system) capable of stereoscopic viewing by projecting a plurality of background images Ib corresponding to parallax.

  On the other hand, as shown in FIG. 2B, in the other reflecting member 41, the reflected light LR41 is emitted in almost all directions without depending on the incident direction of the incident light LC41. For this reason, in the other reflection member 41, the projection image with which the several background image Ib was superimposed is shown to an observer.

  Next, the I / F unit 50 (interface unit) illustrated in FIG. 1 is an information transmission unit or an information communication unit that inputs / outputs information to / from the information presentation apparatus 100. In the present embodiment, the I / F unit 50 generates image light Lp from the projection light LP, and image information related to the background image Ib used when the projection unit 20 projects the projection light LP. An input unit that inputs the projection conditions and the like to be projected onto the surface of the object from the outside of the information presentation device 100 to the information presentation device 100, an output unit that outputs the state of the information presentation device 100, and / or a display unit that displays the information be able to. For the I / F means 50, a known technique can be used.

(Operation of information presentation device)
The operation of the information presentation apparatus 100 according to the embodiment of the present invention will be described with reference to FIG. FIG. 3 is a diagram for explaining the arrangement (and operation) of the information display apparatus 100 according to the present embodiment.

  As shown in FIG. 3, the information display apparatus 100 generates a plurality of projection lights Lp from the projection unit 20 (for example, a projector) that projects the projection light LP, and generates the plurality of projection lights Lp from the projection light LP. Optical system means 30 (first lens 31 (for example, field lens), second lens 32 (for example, lens array) and mirror member 33 (for example, half mirror Mh)) for projecting on reflecting member 40 (object) and retroreflection A member 40 (for example, a retroreflective screen) is disposed in the optical path of the projection light LP or the like. The first lens 31 converges the projection light LP projected by the projection unit 20 in a plurality of directions, thereby generating a plurality of lenses (31La, 31Lb, and 31Lc) that generate a plurality of projection lights Lp from the projection light LP. including. Further, the second lens 32 includes a plurality of projection lenses (32La, 32Lb, and 32Lc) that transmit the plurality of projection lights Lp to form the plurality of projection points PL.

Here, f _p and f _o in the figure, a lens and the focal length of the second lens 32 of the projection means 20. In the figure, f _f is the projection distance of the lens of the projection means 20. Da is a separation distance between the first lens 31 and the second lens 32. Db is a separation distance between the observation position (Ob1 and Ob2) and the retroreflective member 40 (imaging position of the projection image). Dd is the distance between the optical axes of the plurality of lenses (32La, 32Lb, and 32Lc) of the second lens 32. Further, θ is a projection angle of view of a plurality of lenses (32La, etc.) of the second lens 32.

  As shown in FIG. 3, the information display device 100 first projects the projection light LP from the projection unit 20 onto the first lens 31. Here, the separation distance R between the lens of the projection unit 20 and the first lens 31 satisfies Formula 1. In this embodiment, the optical axes of the projection unit 20 and the first lens 31 are the same.

(Equation 1)
R = f _p + f _f
Next, the information display apparatus 100 uses the first lens 31 to generate a plurality of parallel lights (Lpa, Lpb, and Lpc) from the projection light LP as the plurality of projection lights Lp. As a result, the information display apparatus 100 uses the first lens 31 to project a plurality of projection lights Lp (Lpa, Lpb, and Lpc) corresponding to a plurality of projection images Ip (background image Ib) from the projection light LP projected by the projection unit 20. ) Can be generated.

  Next, the information display apparatus 100 causes the plurality of projection lights Lp (Lpa and the like) generated by the first lens 31 to be transmitted and condensed by the second lens 32 to the plurality of projection lenses (32La and the like). A plurality of projection points PL (PLa, etc.) are formed. As a result, the second lens 32 projects a plurality of projection lights Lp from the plurality of projection points PL onto the surface of the object, and forms a plurality of projection images (projected images Ip) on the surface of the object. it can. Here, when the size of the projection image Ip is 1, the size L of the image formation (projection image Ip) observed from the observation position (Ob1 and Ob2) and the projection field angle θ of the plurality of projection lenses (32La, etc.) The following formulas 2 and 3 hold.

(Equation 2)
L = (Db / f _o ) × l

(Equation 3)
θ = 2 arctan (L / 2Db) = 2 arctan (l / 2 f _o )
Also, the size l _o of the projected image Ip on the image element is given by Equation 4.

(Equation 4)
l = (f _f / f _p ) × l _o
Next, the information presentation apparatus 100 of the present embodiment emits (reflects) (reflects retroreflects) the plurality of projection lights Lp only in the incident direction by the retroreflecting unit 40. Thereby, the information presentation apparatus 100 according to the present embodiment projects a plurality of projection points PL that project a plurality of observation points (Ob1 and the like) corresponding to the parallax of both eyes of the observer and a plurality of background images Ib (projection images Ip). A plurality of background images Ib can be projected on the surface of the object from a position where and are optically conjugate. That is, by using the information presentation apparatus 100 according to the embodiment of the present invention for the optical camouflage technology (optical camouflage system), the optical camouflage technology can be improved from a monocular type to a multi-eye type. In addition, the information presentation apparatus 100 according to the embodiment of the present invention can project a plurality of background images Ib from a plurality of projection points PL that are optically conjugate with a plurality of observation points. It can be used for an optical camouflage technique for observing from an observation point. That is, the information presentation apparatus 100 according to the embodiment of the present invention can project a plurality of background images Ib corresponding to arbitrary observation points by changing the relative positional relationship of the optical system means 30. The degree of freedom of observation position can be increased.

The present invention will be described using examples including the information presentation apparatus 100 of the embodiment.
Example 1
(Configuration of information presentation device)
The structure of the information presentation apparatus 110 according to the first embodiment of the present invention is shown in FIGS. In addition, since the structure of the information presentation apparatus 110 which concerns on a present Example is fundamentally the same as the structure of the information presentation apparatus 100 of embodiment, only a different part is demonstrated.

  As shown in FIGS. 1 and 4A, the information presentation apparatus 110 according to the present embodiment uses a projector as the projection unit 20 that projects the projection light LP corresponding to the background image Ib. Moreover, the information presentation apparatus 110 uses a half mirror as the mirror member 33 of the optical system means 30 that reflects a plurality of irradiated projection lights Lp in the direction of a person. Furthermore, the information presentation apparatus 110 uses a retroreflective coating as the retroreflective means 40 that reflects a plurality of projected light beams Lp. 4B, a plurality of projectors are used as the projection unit 20.

  With the above configuration, the information presentation apparatus 110 according to the first embodiment of the present invention applies the plurality of background images Ib (scenery behind the person) concealed by the person to the retroreflective coat (40) that covers the surface of the person. By projecting, it is possible to make the person transparent for the observer (Ob1, Ob2). In addition, the information presentation apparatus 110 according to the present embodiment provides a specific background image of the plurality of background images Ib to the observer corresponding to the observer's observation points (for example, multiple viewpoints, the moving observation point Ma). Can be presented visually.

(Operation of information presentation device)
Since the operation of the information presentation apparatus 110 according to the present example is the same as the operation of the information presentation apparatus 100 of the embodiment, the description thereof is omitted.
(Example 2)
(Configuration of information presentation device)
The structure of the information presentation apparatus 120 according to the second embodiment of the present invention is shown in FIGS. In addition, since the structure of the information presentation apparatus 120 which concerns on a present Example is fundamentally the same as that of the information presentation apparatus 100 of embodiment, only a different part is demonstrated.

  As shown in FIGS. 1 and 5A, the information presentation apparatus 120 according to the present embodiment uses a projector as the projection unit 20 that projects the projection light LP corresponding to the background image Ib. In addition, the information presentation apparatus 120 uses a small mirror (for example, a rearview mirror) as the mirror member 33 of the optical system means 30 that reflects the irradiated projection light Lp in the direction of the object. Furthermore, the information presentation apparatus 120 uses a retroreflective cover (for example, a seat cover) as the retroreflective means 40 that reflects the projected plurality of projected lights Lp.

  In addition, the information presentation apparatus 120 according to the present embodiment further uses the imaging unit 21 that acquires the background image Ib. Thereby, the information presentation apparatus 120 can project the projection light LP corresponding to the background image Ib by the projection unit 20 using the background image Ib acquired by the imaging unit 21.

  With the above configuration, the information presentation apparatus 120 according to the second embodiment of the present invention projects the scenery outside the vehicle onto the retroreflective cover that covers the vehicle seat, so that it can be viewed from the driver's seat (driver) in the vehicle. It is possible to make the driver recognize the scenery outside the vehicle (FIG. 5B) that cannot be performed (FIG. 5C).

(Operation of information presentation device)
Since the operation of the information presentation apparatus 120 according to the present example is the same as the operation of the information presentation apparatus 100 of the embodiment, the description thereof is omitted.

  Although the present invention has been described above with reference to the exemplary embodiments and examples, the present invention is not limited thereto, and can be variously modified or changed in light of the appended claims. .

DESCRIPTION OF SYMBOLS 100,110,120: Information presentation apparatus 10: Control means 20: Projection means, 21: Imaging means 30: Optical system means 31: 1st lens, 32: 2nd lens 33: Mirror member Mh: Half mirror 40: Retroreflective means 50: I / F means (interface means)
Ib: background image Ip: projection image LP: projection light Lp: projection light LC: incident light, LR: reflected light PL: projection point _{f p,} f _o: a focal length, _{f f:} projection distance

Claims (2)

An information presentation device that cognitively transparentizes an object by projecting a background image behind the object onto the surface of the object,
Projection means for projecting projection light including a plurality of projection images corresponding to a plurality of background images corresponding to the parallax of both eyes of the observer;
A first lens that converts the projection light into a plurality of light beams corresponding to the plurality of projection images and emits the light;
A second lens that converges the plurality of light beams from the first lens to a plurality of conjugate positions where the observer's viewpoint and the projection point of the projection unit are optically conjugate;
Optical means for guiding the plurality of light beams from the plurality of conjugate positions to the surface of the object;
Wherein said object is disposed between the optical means, possess a recursive reflecting means for reflecting the projected plurality of light bundles,
The optical means is a mirror member that reflects the plurality of light beams from the plurality of conjugate positions in the direction of the object and transmits the plurality of light beams reflected by the retroreflecting means in the direction of the observer. information presentation device, characterized in that there. The information presentation apparatus according to claim 1, further comprising imaging means for acquiring the background image.

Images