JP2011213184A - See-through display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make an observer observe a part concealed by a member blocking the vision of the observer such as a pillar in a vehicle.SOLUTION: A see-through display device includes image pickup units 17L, 17R for picking up images of part concealed by blocking members 22L, 22R at the position of observation, holographic optical elements 20L, 20R arranged on surfaces of the blocking members 22L, 22R at the opposing side with respect to the position of observation, and projector units 10L, 10R for projecting the images picked up by the image pickup units 17L, 17R on the holographic optical elements 20L, 20R. The holographic optical elements 20L, 20R diffract the images projected by the projector units 10L, 10R in the direction of the position of observation.

Description

  The present invention relates to a see-through display device that projects an image captured by an imaging device onto a structure that blocks vision, such as a pillar in a vehicle, and compensates for the visual information of the blocked portion.

  2. Description of the Related Art Conventionally, in a moving body such as an automobile, a pillar that supports the roof of a vehicle forms a blind spot for a vehicle driver and is a factor that hinders safe driving. In particular, the A pillar supporting the front window forms a blind spot ahead of the driver of the vehicle at an intersection or a sharp curve, and the driver needs to drive while paying sufficient attention to this blind spot. There is.

  In order to solve such a blind spot portion caused by pillars, various display devices have been proposed in which a display device such as an LCD or an organic EL is arranged on the A-pillar on the vehicle interior side and the blind spot is filled by displaying an image from an external camera. ing.

  In Patent Document 1, as a display device that fills such a blind spot, the installation area of the liquid crystal display 40 is determined from the viewpoint position of the driver based on the acquired information on the viewpoint position and the information on the installation state of the liquid crystal display 40. A vehicle surrounding image providing device is disclosed that coordinates-converts an image captured by the image capturing device 10 so that the same image as when the outside of the vehicle is seen through is displayed on the liquid crystal display 40. According to this vehicle surrounding image providing device, it is possible to display an image on the liquid crystal display 40 as if the liquid crystal display 40 is transmitted and the outside of the vehicle can be seen.

  Patent Document 2 discloses a photographing device for photographing a driver's driving blind spot image by a front pillar, a video control device for analyzing, converting and processing video information photographed from the photographing device, and video control. A driving blind spot monitoring device using a front pillar of a vehicle that displays a video signal supplied from the device to a driver is disclosed.

JP 2007-96638 A JP 2004-34957 A

  Both the vehicle surrounding image providing device of Publication 1 and the driving blind spot monitoring device of Publication 2 use a self-luminous display device (liquid crystal display device) as a display device that displays an image corresponding to the blind spot. Since such a self-luminous display device is configured in a planar shape, when it is arranged on a pillar in a vehicle interior, a sense of incongruity in design occurs.

  In particular, the A pillar in front of the vehicle (the pillar that supports the front window) is an important part in the appearance of the vehicle and has various shapes depending on the vehicle type, grade, and the like. Also, regarding the inside of the A pillar, in order to improve the relationship with the external shape of the A pillar and the internal interior, it is inconvenient in design to arrange the liquid crystal display device as a planar shape. It will be.

In addition, when a self-luminous display device such as a liquid crystal display device is arranged in the passenger compartment, it plays a role of supplementing the blind spot for the driver, but for other passengers, an image not related to the inside of the pillar is displayed. It will be displayed, causing a sense of incongruity. Although the image displayed to the passenger is an image outside the vehicle, it is an image that is not continuous with the scenery outside the vehicle compartment, so that some people may feel uncomfortable. Furthermore, when the display device is in the off state, that is, in the non-display state, a black screen remains in the vehicle interior, which disturbs the design of the vehicle interior or makes it a very unified design. It becomes difficult.

  In addition, it is conceivable to use a projection type projector device instead of the self-luminous display device. In this case, however, it is necessary to provide a screen (usually white) with good reflection characteristics inside the pillar. Therefore, a sense of incongruity in design remains. In the projector device, although it is possible to project an image even if the inside of the pillar is a curved surface, when a captured image is projected onto a curved surface, the projected image is distorted by the curved surface, and the projected image It is necessary to perform a deformation process in consideration of the curved surface in advance. For passengers other than the driver, unnecessary images are displayed as in the self-luminous display device, and a sense of incongruity occurs.

  In order to solve the above-described problems, a see-through display device according to the present invention is provided on an imaging unit that images a portion hidden by a shielding member at an observation position, and on the surface of the shielding member that faces the observation position. Holographic optical element, and a projector unit that projects the image captured by the imaging unit onto the holographic optical element, wherein the holographic optical element displays the image projected by the projector unit as the observation position. It is characterized by diffracting in the direction of.

  Furthermore, in the see-through display device of the present invention, the shielding member is a pillar portion of a vehicle.

  Furthermore, in the see-through display device of the present invention, the surface of the shielding member is a curved surface, and the holographic optical element is disposed along the curved surface.

  Further, in the see-through display device of the present invention, the holographic optical element is recorded with reference light and object light in a state of a curved surface substantially the same as the shielding member.

  Furthermore, in the see-through display device of the present invention, the holographic optical element has an optical magnification function.

  According to the present invention, according to the present invention, it is not necessary to install a self-luminous display device, a screen, or the like that obstructs the design of the interior of the vehicle, and excellent transmission of the holographic optical element 20 is achieved. By utilizing the characteristics, it is possible to provide the driver with an image behind the shielding member without disturbing the design of the passenger compartment, and to improve the safety of driving the vehicle.

  Since the holographic optical element 20 has excellent angle selectivity, the holographic optical element 20 is set so that the diffraction angle of the holographic optical element 20 faces the observation position of the driver (observer) in advance. It is possible to suppress the uncomfortable feeling in the vehicle interior without providing unnecessary images to other passengers while providing images only for the vehicle.

Furthermore, by creating the holographic optical element 20 in a state substantially the same as the shape of the shielding member to be arranged (recording interference fringes), even if the shielding member has a curved surface, it is possible for the observer. Thus, it is possible to provide an image without distortion due to a curved surface, and it is possible to reduce a burden such as distortion removal processing in consideration of the curved surface shape.

The figure which shows the see-through display apparatus which concerns on embodiment of this invention. The figure which shows the see-through display apparatus which concerns on embodiment of this invention. The figure which shows the holographic optical element used by embodiment of this invention. The figure which shows the see-through display apparatus which concerns on embodiment of this invention. The figure which shows the control structure of the see-through display apparatus which concerns on embodiment of this invention. 1 is a diagram showing a projector device according to an embodiment of the present invention. The figure for demonstrating recording and reproduction | regeneration of the holographic optical element used by embodiment of this invention.

  FIG. 1 is a view showing a see-through display device according to an embodiment of the present invention, and shows a state of looking forward from the inside of a vehicle. This embodiment is applied to the two left and right A-pillar portions that serve as a forward shielding member for the driver. The present invention is not limited to this embodiment, and may be applied to other pillar parts of the vehicle such as other B pillar parts and C pillar parts. However, it may be applied.

  The see-through display devices arranged on the left and right are respectively projector devices 10R, 10L (projector units), pillar cameras (imaging units) 17R, 17L, holographic optical elements 20R, 20L, and pillar cameras 17R, 17L (not shown). And a control unit that processes the video imaged in step S10 and supplies the processed video image to the projector devices 10R and 10L.

  Here, the see-through display device arranged on the right side will be described. The configuration of the left see-through display device is the same. When the driver, who is an observer, sits on the pillar portion 22R, the holographic optical element 20R is arranged in a predetermined direction, inside the predetermined range of the pillar portion 22R, that is, in a direction facing the driver. The holographic optical element 20R is a film-like member and is attached to the inside of the pillar portion 22R. Since the holographic optical element 20R is a member having excellent transparency, when it is attached to the pillar portion 22R, the color inside the pillar portion 22R can be transmitted and visually recognized. Therefore, the conventional self-luminous display Compared with providing a device or providing a white screen, the design of the vehicle interior is not disturbed.

  In order to easily attach the holographic optical element 20R to the inside of the pillar portion 22R, the inner shape of the pillar portion 22R may be made flat. However, since the holographic optical element 20R does not form an image on its own, even if the pillar portion 22R is a curved surface, recording is performed in consideration of the curved surface, and pasting is performed along the curved surface. Thus, even when the inner shape of the pillar portion 22R is a curved surface, it is possible to flexibly cope with it. As described above, by adopting the holographic optical element 20R, the shape of the pillar portion 22R is not limited to a plane, and the width of the design in the vehicle compartment can be increased.

The projector device 10R projects an image captured by the pillar camera 17R onto the holographic optical element 20R disposed inside the pillar portion 22R. At this time, it is conceivable to project the captured video as it is. However, it is preferable to cut out a necessary range from the captured video, and perform a transformation process or the like by the control unit if necessary. These processes can be adjusted according to the position of the eye that changes depending on the physique and seating position of the driver, that is, the observation position, thereby projecting an image having a sense of unity with the outside scene. The observation position may be detected by detecting the driver's face with a camera or by detecting the seat adjustment position and the seating situation with a sensor.

  FIG. 2 shows a see-through display device according to an embodiment of the present invention, which is a cross section in the vertical direction of the see-through display device arranged on the left side. The pillar camera 17R images the imaging range 1 including a portion hidden by the pillar portion 22R. The holographic optical element 20R is disposed inside the pillar portion 22R, that is, on the side facing the observer, and the observer can visually recognize the image projected by the projector device 10R. In the present embodiment, since the holographic optical element 20R is used, it is possible to form a far image instead of the position of the holographic optical element 20R. Therefore, the observer can visually recognize the portion hidden by the pillar portion 22R at the same focal length as when viewing the outside scene, and can suppress frequent movement of the focus.

  FIG. 3 is a diagram for explaining a holographic optical element used in the embodiment of the present invention. The holographic optical element 20 has high transparency, and extraneous light passes through the holographic optical element 20 with almost no loss. Therefore, when the holographic optical element 20 is attached to a member, the color of the member is transmitted as it is and can be observed. By utilizing the excellent transparency of the holographic optical element 20 in this way, the color of the shielding member can be observed as it is even when the holographic optical element 20 is attached to a shielding member such as a pillar portion. The design can be improved.

  The holographic optical element 20 has excellent angle selectivity that diffracts incident light (reproduced light) emitted from a predetermined direction in a predetermined direction. It is also possible to provide a lens function (optical magnification function) by manufacturing the holographic optical element 20 so that the diffracted light is diffracted toward the condensing point. In the present embodiment, by utilizing the excellent angle selectivity of the holographic optical element 20, the image projected by the projector device 10 can be observed at a preset observation position, and at other positions, The video can be invisible. In particular, in the passenger compartment, only the driver can observe the image of the portion hidden by the shielding object, and it is possible to prevent the other passengers from feeling uncomfortable due to the image.

  FIG. 4 is a view showing a see-through display device according to the embodiment of the present invention, and is a horizontal sectional view in the embodiment of FIG. In the see-through display device arranged on the right side in the figure, the incident light 1 emitted from the projector device 10R is diffracted in a predetermined direction by the holographic optical element 20R, and is an observation position that is the viewpoint position of the driver (observer). Is incident as diffracted light 1, and the image by the projector device 10R is visually recognized. Since the holographic optical element 20R has excellent angle selectivity, there is almost no visibility other than the observation position. Therefore, passengers such as the passenger seat cannot view the image projected inside the pillar portion 22R, and can realize the interior without a sense of incongruity.

  On the other hand, the see-through display device arranged on the left side is also the same, and the incident light 2 emitted from the projector device 10L is diffracted in a predetermined direction by the holographic optical element 20L, and the viewpoint position of the driver (observer). Is incident on the observation position as diffracted light 2, and the viewer visually recognizes the image by the projector device 10L. Since the pillar portion 22L located on the left side is close to the passenger sitting in the passenger seat, the effect of not visually recognizing the image projected on the pillar portion 22L is very high.

FIG. 5 is a diagram showing a control configuration of the see-through display device according to the embodiment of the present invention. In the present embodiment, the left and right see-through display devices are controlled independently. The control unit 30 has functions of a first video processing unit 31 that controls the right see-through display device and a second video processing unit 32 that controls the left see-through display device. The control unit 30 includes various storage devices such as a CPU, a GPU, and a RAM, and executes the processing of each video processing unit, for example, in a time division manner.

  In addition, vehicle control information such as the speed of the vehicle and the turning angle of the steering wheel, and vehicle information such as vehicle position information using GPS may be used for controlling the see-through display device. By operating the projector device 10 only in a necessary situation, it is possible to reduce the uncomfortable feeling of mismatch between the outside scene and the projected image. As a situation where the projector device 10 is operated, it is conceivable that the vehicle is traveling at a low speed, passing through an intersection, or traveling on a curve. Furthermore, only the necessary projector device may be operated. For example, when the steering wheel is turned to the right on the right curve during normal driving or the situation where the vehicle turns to the right is determined based on the vehicle position information, the driver is careful by operating the right projector device 10R. It is possible to secure a sufficient field of view in the direction in which to pay.

  By forming the display image at this time in the distance, the amount of viewpoint movement with respect to when viewing the front field of view may be reduced. In addition, for example, when the situation of entering the intersection is determined based on the vehicle position information, the left and right projector devices 10R, 10L are operated, and the pillars on both sides are transmitted to ensure a sufficient field of view for checking the safety on the left and right. It becomes possible to do. By forming the display image at this time in the vicinity, the amount of viewpoint movement when checking the left and right safety may be reduced. Further, the imaging distance may be determined in accordance with an object to be noted that approaches the intersection detected by interlocking with the vehicle periphery monitoring device.

  Furthermore, the control unit 30 employs an image drawing engine that forms video based on vehicle information in addition to video from various cameras, and outputs video based on vehicle information to the projector device 10 together with video from various cameras. You may comprise. Examples of images based on vehicle information include speedometers based on vehicle speed (vehicle control information), guidance directions using vehicle position information, and other objects that should be watched close to intersections detected by interlocking with vehicle periphery monitoring devices. Alert display etc. that can be noticed can be adopted.

  FIG. 6 is a diagram showing a projector apparatus according to an embodiment of the present invention. In the present embodiment, a laser is used as a light source, and a liquid crystal display element is used in an image forming unit that forms an image. The laser light source 11 is a light source device including a laser semiconductor 112, a diverging optical system 111, and the like, and the output light radiated from the laser semiconductor 112 is aligned in a predetermined irradiation cross-sectional shape by the diverging optical system 111. Output to the outside.

  The output light output from the laser light source 11 is adjusted to a necessary area as a backlight by the beam expander 12 and then irradiated to the back of the image forming unit 13. In the present embodiment, a liquid crystal display unit using a liquid crystal display element 131 is employed as the image forming unit 13. The output light of the laser light source 11 is adjusted by the diffusion plate 132 so that the intensity distribution is uniform, and then the image formed on the liquid crystal display element 131 is irradiated from behind and projected through the projection optical system 14. Form an image.

  In the present embodiment, the projector having the above-described configuration is described as an example. However, the light source may be an LED or other self-luminous element, and LCOS, DLP, or other image devices may be used for the image forming unit. A display using a self-luminous element such as an EL element or an FE element may be used instead of the light source + image forming unit.

  The observer observes this projection image through the holographic optical element 20. This is made possible by the polarization function of the holographic optical system 20, but by providing the holographic optical element 20 with a lens function (optical magnification function), a large image can be provided to the observer. In addition, the projection optical system 14 in the projector apparatus 10 can be downsized, and the projector apparatus 10 itself can be downsized.

  FIG. 7 is a diagram for explaining the recording and reproducing states of the holographic optical element used in the embodiment of the present invention. FIG. 7A shows the recording state, and FIG. b) shows a state during reproduction.

  In the present embodiment, the recording is performed on the holographic optical element 20 in consideration of the arrangement on a curved member such as the pillar portion 22. As shown in FIG. 7A, the holographic optical element 20 performs recording in a state where the holographic optical element 20 is maintained in substantially the same shape as the shape of the member to be disposed (attached). The holographic optical element 20 has a reference beam and an object beam in a state where the holographic optical element 20 is disposed on a transparent member having substantially the same shape as the disposed member, or in a state where the holographic optical element 20 is supported in approximately the same shape as the disposed member. And interference fringes of both lights are recorded inside.

  FIG. 7B shows a state at the time of reproduction. The holographic optical element 20 on which interference fringes are recorded is disposed on the curved surface 22a of the pillar portion 22 as in the present embodiment, for example. When the reproduction light is irradiated from the angle at which the reference light source is located at the time of recording, the light is diffracted by the holographic optical element 20. This diffracted light is observed by the observer so as to be positioned in the object light source at the time of recording. In the present embodiment, the projector device 10 is used as a reproduction light source, and an observer can display an image projected by the projector device 10 without distortion due to the curved surface 22a regardless of the shape in which the holographic optical element 20 is disposed. It becomes possible to observe in a state.

  As described above, the embodiments of the present invention have been described. According to the present invention, it is not necessary to install a self-luminous display device, a screen, or the like that obstructs the design of the vehicle interior, and the holographic optics. By utilizing the excellent permeability of the element 20, it is possible to provide the driver with an image behind the shielding member without disturbing the design of the passenger compartment, and to improve the safety of driving the vehicle. .

  Since the holographic optical element 20 has excellent angle selectivity, the holographic optical element 20 is set so that the diffraction angle of the holographic optical element 20 faces the observation position of the driver (observer) in advance. It is possible to suppress the uncomfortable feeling in the vehicle interior without providing unnecessary images to other passengers while providing images only for the vehicle.

  Furthermore, by creating the holographic optical element 20 in a state substantially the same as the shape of the shielding member to be arranged (recording interference fringes), even if the shielding member has a curved surface, it is possible for the observer. Thus, it is possible to provide an image without distortion due to a curved surface, and it is possible to reduce a burden such as distortion removal processing in consideration of the curved surface shape.

  Note that the present invention is not limited to these embodiments, and embodiments configured by appropriately combining the configurations of the respective embodiments also fall within the scope of the present invention.

DESCRIPTION OF SYMBOLS 10R, 10L ... Projector apparatus, 11 ... Laser light source, 111 ... Divergence optical system, 112 ... Laser semiconductor, 12 ... Beam expander, 13 ... Image formation part, 131 ... LCD, 132 ... Diffusing plate, 14 ... Projection optical system, DESCRIPTION OF SYMBOLS 15 ... Concave mirror, 17R, 17L ... Pillar camera (imaging part), 20R, 20L ... Holographic optical element, 22R, 22L ... Pillar part, 21 ... Front window, 30 ... Control part, 31 ... 1st image processing part, 32 ... Second video processing unit

Claims (5)

An imaging unit for imaging a portion hidden by the shielding member at the observation position;
A holographic optical element disposed on the surface of the shielding member and facing the observation position;
A projector unit that projects the image captured by the imaging unit onto the holographic optical element;
The see-through display device, wherein the holographic optical element diffracts an image projected by the projector unit in a direction of the observation position. The see-through display device according to claim 1, wherein the shielding member is a pillar portion of a vehicle. The see-through display device according to claim 1, wherein a surface of the shielding member is a curved surface, and the holographic optical element is disposed along the curved surface. The see-through display device according to claim 3, wherein the holographic optical element is recorded with reference light and object light in a state of a curved surface substantially the same as the shielding member. The see-through display device according to any one of claims 1 to 4, wherein the holographic optical element has an optical enlargement function.

Images