WO2017073249A1

WO2017073249A1 - Vehicle window display device

Info

Publication number: WO2017073249A1
Application number: PCT/JP2016/079323
Authority: WO
Inventors: 増田　剛; 重之渡邉; 新竹田; 彰仁堀川; 政昭中林; 裕介仲田; 遠藤　修
Original assignee: 株式会社小糸製作所
Priority date: 2015-10-27
Filing date: 2016-10-03
Publication date: 2017-05-04
Also published as: JPWO2017073249A1

Abstract

The present invention estimates display on the windows of a vehicle and carries out display in a manner suitable for a passenger. This vehicle window display device is arranged in a vehicle interior and comprises an image projection unit that projects an image on at least the front window and the side windows of the vehicle. The image projection unit carries out projection in which an image that is for use within the vehicle and that is to be displayed to a vehicle passenger is displayed in a state in which it is possible for the vehicle passenger to view the exterior via the front window and the side windows. In other words, the function of offering external visibility to a passenger is maintained in the windows while various types of information display intended for the passenger are carried out using the front and side windows of the vehicle.

Description

Vehicle window display device

The present invention relates to the technical field of a vehicle window display device that performs display using a window of a vehicle.

JP, 2015-164828, A

The patent document 1 discloses a vehicular lamp in which the degree of freedom of color of laser irradiation is enhanced and a driver can easily draw a line, a mark or the like that can easily recognize the road condition. In this case, a figure can be drawn on a road surface or the like by a light source capable of changing the color of the irradiation light.

By the way, in the vehicle, the window is a relatively large area, and various information can be presented by displaying on the window.
Therefore, the present invention assumes display in a window of a vehicle and aims to execute display appropriate for the occupant.

A vehicle window display device according to the present invention includes an image projection unit disposed in a vehicle compartment of a vehicle and projecting an image on at least a front window and a side window of the vehicle, wherein the image projection unit And performing projection for displaying an in-vehicle image to be displayed to a vehicle occupant in a state in which outward visual recognition is possible via the side window.
That is, various displays are performed using the front window and the side window of the vehicle. In this case, the in-vehicle image is projected in a state in which the vehicle exterior visualizing function as a window is maintained.

In the above-described vehicle window display device, it is conceivable to display an external image for display on the outside of the vehicle with an image content different from the in-vehicle image on the outer surface side of the window of the vehicle.
For example, the in-vehicle image and the out-vehicle image as different images are projected using the front window and the side window of the vehicle.

In the above-described vehicle window display device, it is conceivable to display information across the front window and at least one side window.
That is, the image is projected in a state where the front window and the right side window, or the front window and the left side window, or the front window and the left and right side windows are regarded as one screen.

In the above-described vehicle window display device, it is conceivable to perform image display in the entire circumferential direction of the vehicle, including the rear window of the vehicle, as the external image for the vehicle.
Information is displayed using the front window, the left and right side windows, and the rear window as a screen in the entire surrounding direction.

The above-described vehicle window display device includes a laser light output unit that outputs a laser beam as illumination to the outside of the vehicle, and a light emission drive unit having a laser light source and a drive circuit for the laser light source. The laser light output from the laser light source is supplied by a light guide to perform light output, and the image projection unit performs projection using the laser light output from the laser light source and supplied by a light guide. Is considered.
That is, it has a function as a vehicle lamp as illumination to the outside of the vehicle, and uses laser light from a laser light source common to illumination and projection.

According to the present invention, it is possible to realize various types of information display for the occupant using the window of the vehicle while maintaining the exterior visibility function of the occupant by the front and side windows. By using a wide area such as the front and side windows of the vehicle as a screen, the information presentation capability can be enhanced.

1 is a perspective view of a vehicle equipped with a vehicle window display device according to an embodiment of the present invention. It is an explanatory view of composition of a roof module of an embodiment. It is a block diagram of composition of an important section of an embodiment. It is explanatory drawing of the light distribution of the surrounding illumination part of embodiment, and the to-be-photographed object direction of an imaging unit. It is explanatory drawing of the laser beam supply to the surrounding illumination part of embodiment. It is a flowchart of color control of the illumination light of embodiment. It is explanatory drawing of the projection direction of the projector of embodiment. It is explanatory drawing of the image for in-vehicle projected on the front window of embodiment. It is explanatory drawing of the image for the vehicles exterior projected on the front window of embodiment. It is explanatory drawing of the window structure of embodiment. It is explanatory drawing of the display operation | movement of the inside of a vehicle of embodiment, and the exterior. It is explanatory drawing in the case of arrange | positioning the projector for the vehicles of embodiment. It is explanatory drawing of the area | region setting of the window of embodiment. It is explanatory drawing of the turn signal of embodiment. It is explanatory drawing of the other turn signal of embodiment. It is explanatory drawing of the other turn signal of embodiment.

<Vehicle configuration>
Hereinafter, embodiments will be described with reference to the drawings. In the embodiment, it is assumed that a roof module having a function as a vehicle lamp is mounted on a vehicle. The embodiment described below is only an example for realizing the present invention. The example of composition applicable to the present invention is not limited to the following explanation, but can be considered variously.

An embodiment of the vehicle 90 will be described with reference to FIGS. 1 and 2A. FIG. 1 is a perspective view of a vehicle 90, and FIG. 2A is an explanatory view showing the roof module 1 in a plan view. The shape, structure, and the like of the vehicle 90 described below are merely examples.
The vehicle 90 is a four-wheeled automobile having a function of traveling as a fully automatic driving or a partially automatic driving, or a function of assisting the driver's driving with a driving support function.

The passenger compartment of the vehicle 90 is a space surrounded by the front window 91F, the left side window 91LS, and the right side window 91RS and the rear window 91RR (see FIG. 7) which do not appear in FIG. In other words, the passenger compartment is a space in which approximately 360 ° of the surroundings for the passenger is a window 91 (referred to as “window 91” when referring to each window generically).
In FIG. 1, the front window 91F and the left side window 91LS, the front window 91F and the right side window 91RS, the rear window 91RR and the left side window 91LS, and the rear window 91RR and the right side window 91RS respectively , Corner portion 95. The corner portion 95 may be transparent or translucent, or may be opaque.

A roof module 1 is provided at the top of the vehicle 90. The roof module 1 forms a roof of the vehicle 90 and has a configuration for realizing various functions including a lamp function.
A laser light engine 2 having a laser light source is built in a substantially central portion of the roof module 1.
A headlight portion 3 is provided on the vehicle front side of the roof module 1. As the headlight unit 3, a high beam output unit 3H, a low beam output unit 3L, and a spot beam output unit 3S are provided. The high beam output unit 3H outputs illumination light having a far light distribution, and the low beam output unit 3L outputs illumination light having a near light distribution. The spot beam output unit 3S outputs illumination light for spot irradiation on the front side.

Although not shown in FIG. 1, a rear light portion 4 is provided on the vehicle rear side of the roof module 1. The rear light unit 4 is provided with, for example, a rear beam output unit 4H, a brake lamp unit, a back lamp unit, and the like.
The illumination configuration of the rear light unit 4 may be, for example, the same configuration as the headlight unit 3.

As shown to FIG. 1, FIG. 2A, the surrounding illumination part 5 is formed in the side part of the roof module 1 over substantially the perimeter. In FIG. 2A, the ambient illumination unit 5 is indicated by a broken line.
A large number of light output portions 51 are arranged in the ambient illumination portion 5, which enables illumination in a 360 ° direction around the vehicle 90. The surrounding illumination unit 5 is disposed to perform illumination of, for example, about 10 m or less in all directions around the vehicle 90.
FIG. 2B schematically shows a part of the ambient illumination unit 5 in an enlarged manner. The light output units 51 arranged in a large number in the circumferential direction each have an R (red) laser light output unit 5R, a G (green) laser light output unit 5G, and a B (blue) laser light output unit 5B. That is, each light output unit 51 can perform illumination in various color expressions, external notification, and the like by performing R, G, and B light output.

Moreover, as shown to FIG. 2B, the monitoring sensor unit 7 is arrange | positioned with the light output part 51 as the ambient illumination part 5. FIG. The monitoring sensor unit 7 is, for example, an imaging unit provided with a camera. As shown in FIG. 2A, in order to capture an image in the circumferential direction of the roof module 1, the vehicle front right, the vehicle front left, the right front, the right rear, the left rear, the left front, the left rear, the vehicle rear Eight are arranged as the right side and the vehicle rear left side. In this case, the angle of view in the horizontal direction of the camera in each monitoring sensor unit 7 is about 50 degrees, and imaging in the entire circumferential direction can be performed by eight monitoring sensor units 7.

Although FIG. 2B shows an example in which the visible light camera 7a and the far infrared light camera 7b are provided as one monitoring sensor unit 7, this is an example.
By providing at least a camera including the visible light camera 7 a as the monitoring sensor unit 7, it is possible to recognize the surrounding environment by an image and to recognize a person, an object, and their colors. By providing the far-infrared light camera 7b, it becomes suitable for recognition of a heat source such as a person or an animal.
Further, with regard to the camera, by mounting a so-called left and right stereo camera, it becomes possible to obtain distance information to the object using the principle of triangulation.
Furthermore, as the monitoring sensor unit 7, a near infrared camera may be provided. Further, as the monitoring sensor unit 7, a camera may not be provided, or a laser sensor or a radar sensor may be provided in addition to the camera.

The headlight portion 3, the rear light portion 4 and the surrounding illumination portion 5 provided in the roof module 1 respectively output laser light as illumination light. In the case of the present embodiment, the headlight unit 3, the rear light unit 4, and the surrounding illumination unit 5 do not have their own laser light source, for example, a laser diode etc., but a laser generated by the laser light engine 2. Light is used.
That is, the laser beam generated by the laser light engine 2 is guided and output to each of the high beam output unit 3H, the low beam output unit 3L, and the spot beam output unit 3S of the headlight unit 3 by the optical fiber 6 as a light guide. .
Similarly, laser light generated by the laser light engine 2 is guided by the optical fiber 6 to the rear beam output unit 4H of the rear light unit 4, a brake lamp unit (not shown), a back lamp unit, etc.
Further, the laser light generated by the laser light engine 2 is also led to each light output unit 51 of the surrounding illumination unit 5 by the optical fiber 6 and output.

The optical fiber 6 is provided in three systems corresponding to each of the R laser light, the G laser light, and the B laser light. By exposing a part of the optical fiber 6 of the three systems to the upper surface or the side surface of the roof module 1 as shown in FIGS. 1 and 2, the optical fiber 6 (R, G, B transmitted by the optical fiber 6 Each light is made to be a part of the appearance design of the roof module 1.

The configuration in which laser light generated by the laser light engine 2 is used as the headlight unit 3, the rear light unit 4, and the surrounding illumination unit 5 is an example.
Each of the headlight unit 3, the rear light unit 4, and the surrounding illumination unit 5 may be uniquely provided with a light source such as a laser diode or a light emitting diode (LED).
The headlight unit 3, the rear light unit 4 and a part of the surrounding illumination unit 5 may use laser light generated by the laser light engine 2 and a part may use a unique light source.

<Control configuration>
FIG. 3 shows the internal configuration of the roof module 1 and the configuration of the vehicle 90 associated with the operation of the roof module 1.
An ECU (electronic control unit) 92 is a microcomputer that performs various controls in the vehicle 90. The ECU 92 performs, for example, travel control of the vehicle 90, automatic operation control, drive support control, electrical system device control, and the like.
A battery 93 is a battery in the vehicle 90, and supplies operating power supply voltages for the traveling system, the electrical system, the control system, and other components.

The front window 91F, the left side window 91LS, the right side window 91RS, and the rear window 91RR are windows around the passenger compartment and also have a function as a screen for displaying an in-vehicle image and an out-vehicle image as described later. In the case of this example, the ECU 92 can perform variable transmittance control with respect to each window 91 (91F, 91RS, 91LS, 91RR).
The transmittance of each window 91 can be uniformly changed by the ECU 92 as a whole window, or the transmittance can be set to be different for each region in the window. The ECU 92 controls the transmittance of each window 91 based on, for example, information from the control unit 20 of the roof module 1. The control unit 20 may control the transmittance of each window 91 directly instead of the ECU 92.

As shown in FIGS. 1 and 2, the roof module 1 is provided with a laser light engine 2, a headlight 3, a rear light 4, a surrounding illumination 5, an optical fiber 6, and a monitoring sensor unit 7. As shown in FIG. 3, an image projection unit 8 is provided.

The laser light engine 2 of the roof module 1 is provided with a control unit 20, a power supply circuit unit 21, a laser light source unit 22, a drive circuit 23, and an analysis unit 24.
The control unit 20 is configured by a microcomputer, and performs control of an illumination operation by the roof module 1, an operation related to captured image processing for monitoring the periphery of the vehicle 90, a display operation, and the like. Further, the control unit 20 can acquire vehicle information or perform a processing request (for example, the above-described transmittance control and the like) to the ECU 92 through communication with the ECU 92. The control unit 20 can also provide the ECU 92 with surrounding information obtained by the monitoring sensor unit 7.

Communication between the control unit 20 and the ECU 92 is applicable to short-distance wireless communication, wired communication, infrared communication, and various other communication methods. Considering that the roof module 1 is disposed on the upper surface of each window 91, it is assumed that the ECU 92 is disposed below the vehicle (below the window 91). In the case where the window 91 is formed over substantially the entire circumference as in this example, in order to enable communication between the control unit 20 and the ECU 92 by wire, it becomes a part of the window 91 or a boundary of each window 91 It is conceivable to form a transparent transmission path in the corner portion 95 and to use it as a communication path.

The power supply circuit unit 21 receives power supply from the battery 93 and generates an operating power supply voltage required for each part of the roof module 1. That is, the power supply voltage necessary for each of the control unit 20, the drive circuit 23, the analysis unit 24, the headlight unit 3, the rear light unit 4, the surrounding illumination unit 5, the monitoring sensor unit 7, and the image projection unit 8 is generated. Supply. Of course, depending on the configuration of the headlight unit 3, the rear light unit 4, and the surrounding illumination unit 5, the power supply circuit unit 21 may supply a power supply voltage thereto.
It is conceivable that power supply from the battery 93 to the power supply circuit unit 21 is wireless power supply. Alternatively, power may be supplied by forming a transparent feeding path in a part of the window 91 or in the corner portion 95.

It is also conceivable to dispose a solar panel on the top surface of the roof module 1 and use the power generated by the solar panel as the operating power of the roof module 1.
In that case, the power supply circuit unit 21 has a storage unit that stores the charge generated in the solar panel, and uses the power supply voltage from the storage unit to generate a necessary power supply voltage for each unit and supply it to each unit. be able to. In this case, the power supplied from the battery 93 may be used in combination with the power from the storage unit, or the power supplied from the battery 93 may not be required.

The laser light source unit 22 is provided with a laser light source such as a laser diode, for example, and outputs laser light. Here, R laser light, G laser light, and B laser light are respectively output by three laser light sources. The RGB laser beams are sent to the surrounding illumination unit 5, the headlight unit 3 and the rear light unit 4 by the optical fiber 6, respectively.
The drive circuit 23 is a circuit that drives each of the RGB laser light sources of the laser light source unit 22. For example, it has a current supply circuit for the laser diode, a current stabilization circuit, a protection circuit, and the like. The drive circuit 23 executes the laser light output from the laser light source unit 22 according to the instruction of the control unit 20.

The analysis unit 24 is, for example, an image analysis unit, and cameras of the eight monitoring sensor units 7 that perform imaging for monitoring the periphery of the vehicle 90 as described above (visible light camera 7a, far infrared light camera 7b) The captured image data from are input and image analysis is performed on each. In this case, the analysis unit 24 analyzes the captured image from the visible light camera 7a of each monitoring sensor unit 7 to recognize surrounding people, or surrounding objects such as buildings, road conditions, traffic lights, signs, A guardrail, an obstacle, a leading vehicle, an oncoming vehicle, etc. can be recognized. In addition, weather, sunshine direction, etc. can also be recognized. Further, the analysis unit 24 can analyze the image by the far infrared light camera 7 b to recognize the temperature distribution around it, and can use this to assist the recognition by the visible light camera 7 a.
When a laser sensor or a radar sensor is provided in the monitoring sensor unit 7, the analysis unit 24 analyzes detection signals of these sensors and obtains various information.
The control unit 20 can perform various controls based on the recognition information of the surrounding environment by the image analysis of the analysis unit 24 and the detection signal analysis.

The roof module 1 is provided with an image projection unit 8. The image projection unit 8 has, for example, six projectors 8a to 8f. The projectors 8a to 8f are arranged such that an image can be projected onto each window 91 from the bottom side of the roof module 1, for example.
The RGB laser light from the laser output unit 22 is used as a projection light source of the projectors 8a to 8f. For this reason, laser light of RGB is supplied to each of the projectors 8a to 8f by the optical fiber 6.
The operation of each of the projectors 8a to 8f is controlled by the control unit 20. That is, the control unit 20 instructs the projection operation and the display content.
The projectors 8a to 8f may be provided with independent projection light sources. The projectors 8a to 8f may be disposed in the vehicle independently of the roof module 1.

<Lighting and monitoring>
The illumination and monitoring by the headlight unit 3, the rear light unit 4, and the surrounding illumination unit 5 will be described.
The headlight portion 3 is provided on the roof module 1. Therefore, the illumination illuminates the front with the optical axis angle to the road surface being deeper from above the vehicle 90 than in the prior art. Thus, the visibility of the road surface by the occupant can be enhanced by adopting a configuration in which irradiation is performed relatively from above.
The rear light portion 4 is also provided to the roof module 1 and emits light relatively from above, so the visibility of the road surface behind can be enhanced.

Next, in the surrounding illumination unit 5, as described in FIG. 2, the light output units 51 are arranged around the roof module 1, so that illumination of 360 degrees around the vehicle 90 is enabled.
The light distribution in the vertical direction of each light output unit 51 is below the horizontal direction of the roof module 1.
For example, although the horizontal direction of the roof module 1 is shown by the alternate long and short dash line H in FIG. 4A, the light emission direction of the light output unit 51 disposed in the surrounding illumination unit 5 is, for example, the range of the angle θ1 indicated by the broken line Is set as. For example, it is set to illuminate around 10 m with such a light distribution.

Such light distribution realizes glare-free for people who are far away. Moreover, it is made for the person who exists in the vicinity of the vehicle 90 not to look straight at the light from the surrounding illumination part 5 unconsciously. However, when the position of the eye is low in a child or the like, there is a possibility that they may look unconsciously. Therefore, when it is recognized that a person is present according to the surrounding environment monitoring, it may be considered to stop the light output from the light output unit 51 directed to the person or change the light distribution .
In addition, the illumination of the ambient lighting unit 5 has the function of making the vehicle 90 itself an infrastructure at that location and brightening the surroundings. The presence of a large number of vehicles 90 in a city area etc. can create a bright environment even at night.
In addition, it is also assumed that the road surface is drawn by the color light source of the surrounding illumination unit 5 to present information to various people in the surrounding area and perform various types of notification.

In the present embodiment, the surrounding illumination unit 5 illuminates the periphery from above the vehicle 90 as the periphery of the roof module 1, but the surrounding illumination unit 5 may be provided around the bottom of the vehicle body . That is, the light output unit 51 arranged as the ambient illumination unit 5 is not limited to being provided in the roof module 1.
Moreover, the surrounding illumination part 5 does not necessarily need to perform illumination with respect to the 360-degree direction all around. For example, illumination may be performed only on the side, only on the side and the rear, only on the left side, or only on the right side. In addition, illumination in the direction of 300 degrees, 250 degrees, etc. may be performed almost all around.

An example of a method for supplying laser light to the light output unit 51 (R laser light output unit 5R, G laser light output unit 5G, B laser light output unit 5B) of the ambient illumination unit 5 will be described with reference to FIG.
FIG. 5 shows the R, G, and

B laser diodes

22R, 22G, and 22B in the laser light source unit 22 of the laser light engine 2. The emitted light of each of the

laser diodes

22R, 22G, and 22B is irradiated to the rotary reflection plate 75. The rotary reflection plate 75 is rotationally driven about the axis J.
Here, although the rotary reflection plate 75 is shown as a flat plate-like double-sided mirror, it may be replaced with a polygon mirror which is a polyhedral mirror in place of the rotary reflection plate 75.

A collimator lens CL and an optical fiber 6 are disposed around the rotary reflection plate 75. The laser light collimated by the collimator lens CL enters the optical fiber 6 from the incident end 6a.
Here, three optical fibers 6 corresponding to one set of three collimator lenses CL correspond to one light output unit 51 in the ambient illumination unit 5.

For example, when the rotary reflection plate 75 is in a solid line state, each of the R, G, and B laser beams reflected by the rotary reflection plate 75 has a set (three) of collimator lenses CL, as indicated by a solid line. Are introduced into one set (three) of optical fibers 6. The three optical fibers 6 supply laser light to the respective laser light output sections (5R, 5G, 5B) of one light output section 51 in the surrounding illumination section 5.
When the rotary reflection plate 75 is in a broken line state, each of the R, G, and B laser beams reflected by the rotary reflection plate 75 is separated by a set of collimator lenses CL, as shown by the broken line. It is introduced into the optical fiber 6. The three optical fibers 6 supply laser light to the respective laser light output sections (5R, 5G, 5B) of another light output section 51 in the surrounding illumination section 5.
Furthermore, when the rotary reflecting plate 75 is in the state of the alternate long and short dash line, each of the R, G, and B laser beams reflected by the rotary reflecting plate 75 is a set of (three) collimators as shown by the alternate long and short dash line. It is introduced into one set (three) of optical fibers 6 by the lens CL. The three optical fibers 6 supply laser light to the respective laser light output sections (5R, 5G, 5B) of another light output section 51 in the surrounding illumination section 5.

Therefore, ambient illumination is achieved by rotating the rotary reflector 75 at high speed while outputting the respective R, G, B laser beams from the R, G,

B laser diodes

22 R, 22 B in the laser light source unit 22. Laser light can be distributed to each light output unit 51 of the unit 5. Thus, illumination in the direction of 360 degrees can be realized without each light output unit 51 of the surrounding illumination unit 5 being provided with a light source element such as a laser diode.
Also, by turning on / off laser irradiation to the rotary reflector 75 in synchronization with the rotational position of the rotary reflector 75, illumination may be performed only in a specific direction or illumination may be turned off only in a specific direction. it can.
Further, by controlling the light intensity of each of the R, G, and B laser beams to be irradiated to the rotary reflecting plate 75, the color of the illumination light of the surrounding illumination unit 5 can be changed.
In addition, the illumination light to the specific direction of the surrounding illumination unit 5 is controlled by controlling the light intensity of each of the R, G, and B laser beams to be irradiated to the rotary reflector 75 in synchronization with the rotational position of the rotary reflector 75. You can also change the color of

In addition, although schematically shown in FIG. 5, the emitted laser beams of the

laser diodes

22R, 22G, and 22B are directly irradiated to the rotary reflecting plate 75, but in actuality through the necessary optical system. It only needs to be irradiated.
For example, the emitted laser beams of the

laser diodes

22R, 22G, and 22B are also incident on the other optical fibers 6 supplied to the headlight portion 3 and the rear light portion 4. Accordingly, the emitted laser beams of the

laser diodes

22R, 22G, 22B are split by an optical element such as a beam splitter, and a part is irradiated to the rotary reflector 75 as shown in FIG. do it.
Of course, the

laser diodes

22R, 22G, 22B may be dedicated laser diodes for supplying light to the ambient illumination unit 5.

Next, the monitoring sensor unit 7 will be described. Depending on the monitoring by the monitoring sensor unit 7, surrounding people or objects can be recognized as described above. When the visible light camera 7a and the far infrared light camera 7b are provided as the monitoring sensor unit 7, the human recognition accuracy can be enhanced. In the image captured by the visible light camera 7a, a person can be recognized by a method such as pattern matching. However, it is a person by determining the temperature of the target portion using the image captured by the far infrared light camera 7b. Can more accurately recognize The same is true for animals.
Also, in view of safety, it is also important to monitor the vicinity of the vehicle 90. For example, as for the monitoring sensor unit 7 disposed at the rear of the vehicle 90, as shown in FIG. 4B, for example, the range θ2 below the horizontal direction (dotted dotted line H) of the roof module 1 is the vertical angle of view. Deploy. In this manner, the children HM and the like behind the vehicle 90 can always be recognized.
By adopting such a configuration, the monitoring sensor unit 7 realizes improvement in safety.

In the present embodiment, the illumination of the ambient illumination unit 5 is also used to improve the monitoring function.
When imaging is performed by the monitoring sensor unit 7, the clarity of the contour of the image changes depending on the degree of illumination. As a result, the object recognition accuracy including the human changes. Therefore, in order to further improve the image recognition accuracy, the color of the illumination light by the ambient illumination unit 5 is changed according to the surrounding objects.
Each light output unit 51 in the ambient illumination unit 5 includes R, G, and B laser light output units (5R, 5G, 5B), and thus can output illumination light of various colors. .
Further, as described above, by changing the laser light intensity supplied to the specific laser light output unit (5R, 5G, 5B), it is possible to irradiate the illumination light of the specific color only in the specific direction.
Even when each light output unit 51 has a light source such as an LED or a laser diode, it is possible to output illumination light of various colors by arranging LEDs as R, G, and B light sources, respectively. It goes without saying that it is possible.

Specifically, in order to improve the monitoring function, illumination is performed in accordance with the color of the detected object. Therefore, the control unit 20 performs the color control process shown in FIG. 6 on the illumination of the surrounding illumination unit 5.
At step S101, the control unit 20 monitors whether or not any object is detected by the analysis unit 24 in a certain direction. When an object is detected, the control unit 20 extracts color data of the object in step S102. Specifically, the information of the color making up the detected object is acquired from the analysis unit 24.
At step S103, the control unit 20 determines the main color from the acquired color data. For example, the dominant color in the detection object, the color with the largest ratio, and the like are set as the primary color.

In step S104, the control unit 20 performs control such that illumination of the determined main color is output from the detection direction of the object.
Specifically, first, information on the direction of the detected object (the direction seen from the vehicle body) is acquired from the analysis unit 24, and the light output unit 51 that illuminates the direction is specified. Then, the respective intensities of the R, G, and B laser beams supplied to the light output unit 51 are controlled so that the output light from the light output unit 51 becomes the main color.
By this process, for example, when a person wearing a red dress is detected as an object, red illumination is performed toward the person. When a yellow object is detected, yellow illumination is performed toward the object.
By performing illumination according to such a main color, the contour of the object becomes clear on the image captured by the monitoring sensor unit 7. As a result, the analysis unit 24 can accurately determine the contour of the object, and can accurately identify what the object is by pattern matching or the like.
The control unit 20 acquires the object identification result by the analysis unit 24 in step S105. Then, the process branches in step S106 depending on whether the detected object is a person or not. In the case of a person, processing for the person is performed, and in the case of other than the person, processing for the object is performed.

As described above, by irradiating illumination light of a color according to the detection object to the detection object, it is possible to improve the recognition accuracy as external environment recognition.
In addition, illumination of the color according to the to-be-detected body becomes what is easy to recognize also on a person's vision. For example, when the pedestrian wears a blue dress, the illumination of the blue light increases the visibility of the pedestrian for the driver. This can improve safety.
In addition, when the environment recognition accuracy is improved, for example, when a person is recognized, the surrounding illumination unit 5 is turned off, the illumination in the direction in which the person is present, or the illumination light intensity is reduced. More sophisticated control is possible, such as preventing people from feeling dazzling.

<Window display>
Image display in each window 91 (front window 91F, left side window 91LS, right side window 91RS, rear window 91RR) will be described.
Each window 91 is configured as a panel capable of transmittance control, and functions as a window through which the occupant can usually visually recognize the surroundings by being in the total transmission state.
Furthermore, in each window 91, an image can be projected from the image projection unit 8 and the transmittance of the projected portion can be reduced to display an occupant in the vehicle compartment (display of an image for in-vehicle use). Further, in each window 91, an image can be projected from the image projection unit 8 and the transmittance of the projected portion can be increased to perform display for a person outside the vehicle (display of the image for the outside of the vehicle).

The projectors 8a to 8f in the image projection unit 8 are arranged as shown in FIG. 7, for example, to project an image. Each of the projectors 8a to 8f is disposed, for example, on the bottom side of the roof module 1 so as to obtain a projection direction as illustrated.
The arrangement position of the projector 8a is set so as to project an image on the entire front window 91F. The arrangement position of the projector 8 b is set so as to project an image on the entire rear window 91 RR. The arrangement position of the projector 8c is set so as to project an image on a range substantially on the front half side of the right side window 91RS. The arrangement position of the projector 8d is set so as to project an image on a range substantially on the vehicle rear side half of the right side window 91RS. The arrangement position of the projector 8e is set so as to project an image on a substantially half of the front side of the left side window 91LS. The arrangement position of the projector 8 f is set so as to project an image on a range substantially on the rear side of the left side window 91 LS.
In the image projection unit 8, by arranging the projectors 8a to 8f in this manner, various images can be displayed on all the windows 91.
Each of the projectors 8a to 8f may project an independent image, or may project an image for each part so that one continuous image is formed in an adjacent window.

FIG. 8 shows a state in which the in-vehicle image 100 is displayed on the front window 91F by the projector 8a. Most of the front window 91F is in a through state (a state of transmissivity that is regarded as substantially transparent), and the occupant can view the scenery in front of the vehicle. In this state, the transmittance of part of the front window 91F is lowered, and the projection image of the projector 8a is displayed on that part. For example, a traveling speed, a rotation speed, a shift position, a traveling distance, a time, a traveling mode, and the like are displayed as the in-vehicle image 100.

When fully automatic driving is assumed, it is not necessary for the occupant to always have the windows 91 (particularly, the front window 91F) in a through state. Therefore, as the in-vehicle image 100, the transmittance of each window 91 may be lowered to perform projection like a video theater.
In addition, one in-vehicle image 100 with a large screen may be displayed across the adjacent windows 91, for example, the front window 91F and the left and right side windows (91LS, 91RS). Of course, the image may be projected as the four windows 91 as a 360 degree screen. Such display across a plurality of windows 91 is possible by setting of projection images by the projectors 8a to 8f. That is, one image may be divided in the horizontal direction and projected from each of the projectors 8a to 8f.

Various other display contents of the in-vehicle image 100 using each window 91 as a screen are conceivable.
As the in-vehicle image 100, for example, a map image, a navigation image, a message image regarding a vehicle state, a notification of the surrounding situation, an alert image or characters, various video contents, an enlarged image of a display screen of an information processing apparatus such as a portable terminal, a website An image etc. are assumed.

FIG. 9 shows an example in which the car exterior image 101 is displayed on the front window 91F and the left side window 91LS by the

projectors

8a, 8e, 8f, for example.
The front window 91F and the left side window 91LS have a structure in which the projected image can be viewed from the outside.
In the example of FIG. 9, the image which recommends passing ahead to the person who is going to cross the road is displayed using the front window 91F and the left side window 91LS. In particular, by treating the front window 91F and the left side window 91LS as one large screen and displaying them across images, the visibility to the outside and the notification capability are expanded.

Various other display contents of the car external image 101 using each window 91 as a screen are conceivable.
As the image 101 for external vehicles, notification information of presence or absence of the passenger in the vehicle 90, display during traveling / service / delivery etc., a message to surrounding pedestrians, etc., a message to a leading vehicle, a following vehicle, etc. An alert, an image prompting a person outside the vehicle to get on, etc. are assumed.
The in-vehicle image 100 and the in-vehicle image 101 can be simultaneously projected.

An example of a method of displaying an image on the inner surface side and the outer surface side of the window 91 by the projectors 8a to 8f installed in the vehicle will be described.
10A and 10B schematically show the structure of the window 91. FIG. As shown in FIG. 10A, for example, the window 91 has a structure in which it is divided into a large number of linear regions by a dividing line in the horizontal direction. There are three types of areas to be divided: mirror area 150, transmission area 151, and diffusion area 152. The window 91 is formed such that the set of the mirror area 150, the transmission area 151, and the diffusion area 152 is continuous in the vertical direction.
The vertical width of each region (150, 151, 152) may be, for example, one to several lines in the frame of the image to be projected, or several tens of lines, or more lines. . This may be set according to the vertical resolution of the image or the image visibility. In the explanation, the vertical width of each area is equal to x lines of the image.

The mirror area 150 is an area in which the mirror 160 is formed. The mirror 160 reflects downward the light incident from the vehicle interior direction.
The transmissive region 151 is a region through which light is normally transmitted at high transmittance.
The diffusion region 152 is a region in which the diffusion plate 161 is provided.

In this case, as shown in FIG. 10B, the light 170 that has entered the mirror area 150 from the inside of the vehicle is reflected by the mirror 160, passes through the transmission area 151 from the top to the bottom, and reaches the diffusion plate 161. The light diffusion plate 161 is disposed to be inclined as shown in the figure, so that the light 170 is diffused outward by the diffusion plate 161. In this state, an image by the light 170 is viewed from the outside of the window 91.
In addition, light 171 from the outside of the vehicle reaches the vehicle interior through transmission region 151. Therefore, the passenger can see the scene outside the vehicle.
Further, the light 172 that has entered the diffusion region 152 from the inside of the vehicle is projected to the diffusion plate 161 and diffused. In this state, the image by the light 172 is viewed from the inside of the window 91.

That is, the projectors 8a to 8f may emit the in-vehicle image 100 and the in-vehicle image 101 as projection light as follows.
In the frame data of the in-vehicle image 100, the first x line of the frame is blank (pixel data of gradation zero), the next x line is also blank, and the pixel data constituting the image is arranged in the next x line. Such data arrangement is repeated in the vertical direction to form each frame data. Then, projection is performed based on the frame data. Then, the projection light which comprises an image is projected on the spreading | diffusion area | region 152, and the image visual recognition by a passenger | crew is attained.
The frame data of the car external image 101 arranges pixel data constituting the image in the first x line of the frame, the next x line is blank, and the next x line is also blank. Such data arrangement is repeated in the vertical direction to form each frame data. Then, projection is performed based on the frame data. Then, the projection light which comprises an image is projected on the mirror area | region 150, and the image visual recognition from the outside is attained.
When the in-vehicle image 100 and the in-vehicle image 101 are simultaneously displayed on the front and back of the window, the in-vehicle image data and the out-vehicle image data are combined. That is, the frame data of the composite image arranges the pixel data forming the car exterior image 101 in the first x line of the frame, the next x line is blank, and the next x line is pixel data forming the car interior image 100 Deploy. This may be repeated in the vertical direction to form and project frame data.

In the case of the above method, the projection positions of the projectors 8a to 8f must be precisely aligned with the position of the area (150, 151, 152) of the window 91. Therefore, a camera capable of recognizing an image display state on the window 91, a light quantity sensor, etc. is provided in the car, and in the state where the in-car image 100 is projected, the in-car image 100 is displayed well. It is desirable that automatic adjustment of the position be performed. In the case of the above configuration, if the in-vehicle image 100 is appropriately displayed as the positional relationship, appropriate projection of the in-vehicle image 101 is performed.

Another method for displaying an image inside and outside the window 91 will be described with reference to FIGS.
FIG. 11A shows an example in which the projector 8 out is arranged outside the vehicle, for example, at the edge of the ceiling 181 by the roof module 1 in addition to the arrangement of the projector 8 in (for example, projectors 8 a to 8 f) inside the vehicle.
The window 91 has a two-layer structure, with the glass portion 183 on the outside of the vehicle and the liquid crystal shutter portion 182 on the inside of the vehicle. The liquid crystal shutter portion 182 is a layer whose transmittance is made variable by a voltage applied to both end electrodes of the enclosed liquid crystal.
By doing this, the projector 8in projects the in-vehicle image 100, and the projector 8out projects the vehicle external image 101. The transmittance of the liquid crystal shutter unit 182 may be lowered in the image projection portion by the projectors 8 in and 8 out. That is, the control unit 20 requests the ECU 92 to perform transmittance control according to each of the area on which the external image 101 is projected and the area on which the in-vehicle image 100 is projected as the area on each window 91. Control the transmittance. Then, the image projection unit 8 is instructed to project an image on each area. In this way, the in-vehicle image 100 and the in-vehicle image 101 can be appropriately displayed.

An example of the arrangement position of the projector 8out outside the vehicle is shown in FIG. For example, ten projectors 8 out are arranged as the projectors 8 g to 8 p. For example,

projectors

8g, 8h, 8i that project to the front window 91F,

projectors

8j, 8k, 8l that project to the rear window 91RR,

projectors

8m, 8n that project to the right side window 91RS, to the left side window 91LS The projectors 8o and 8p for projecting the light source 90 can be used to display the vehicle 90 in the entire circumferential direction.
When the projector 8 out is provided as described above, the road surface can be drawn by the projector 8 out. In the figure, the

projectors

8m and 8n are shown by broken lines when projecting onto the road surface, but by changing the projection direction in this way and displaying various images on the road surface, notification to people outside the vehicle is given. Etc. can be done. For example, guidance for getting on and off is displayed on the road surface.

FIG. 11B is yet another structural example. The window 91 has a three-layer structure, and a transmissive OLED (Organic Electro-Luminescence Display) portion 184, a glass portion 183, and a liquid crystal shutter portion 182 are provided from the outside of the vehicle. In this case, the in-vehicle image 100 is projected by the projector 8 in (for example, the projectors 8a to 8f), and the transmission-type OLED unit 184 displays the in-vehicle image 101. Images can be displayed inside and outside the vehicle even with such a structure. In addition, since the transmission of the window 91 is secured by using the transmissive OLED section 184, the visibility of the occupant outside can be maintained.

Although various window structures, display devices (projectors, OLEDs) and the like have been described so far, various other image display methods can be considered using the window 91 inside and outside the vehicle.
In addition, the example of the structure of the window 91 up to this point may be applied to the entire window 91, for example, as the display area 190 indicated by the hatched portion in FIG. 13A. As a result, the degree of freedom in image display can be improved and the screen can be enlarged.
Further, as shown in FIG. 13B, in the window 91, the center may be a transmissive region 191, and the display region 190 may be a peripheral portion of the window 91. Alternatively, as shown in FIG. 13C, a belt-shaped display area 190 may be formed only at the top and bottom of the window 91, and the center in the top-bottom direction may be the transmission area 191.
In these cases, the transmissive region 191 is, for example, a simple glass region, which is always a region with high transmittance and is not used for display. By providing the transmissive region 191, it is possible to obtain a region that always ensures complete visibility of the exterior of the occupant.

<Turn signal>
Subsequently, the turn signal function will be described.
Each window 91 also functions as a light output unit as a display of the external image 101. That is, the window 91 can also be used as a lamp. As an example, an example in which the turn signal function is realized using the window 91 will be described.
FIG. 14 shows an example in which a turn signal image 101T is displayed as the image 101 for the outside of a vehicle using image projection by the projectors 8a to 8f.

For example, FIG. 14 shows a turn signal when turning left. A sequential turn signal is expressed by the display transition as in FIG. 14A → FIG. 14B → FIG. 14C → FIG. 14A. That is, the light emission position of the front window 91F, which is the light output portion at the front of the vehicle body, and the light emission position of the light output unit (front side of the left side window 91LS) in front of the vehicle body left side face both toward the left front corner 95FL of the vehicle 90 So, the light moves. Also, the light emission position of the light output portion (rear window 91RR) at the rear of the vehicle body and the light emission position of the light output portion at the rear of the left side surface of the vehicle body (rear side of the left side window 91LS) are directed to the left rear corner portion 95RL of the vehicle 90 The light moves to For example, the display is such that the light wave is pushed toward each of the left front corner portion 95FL and the left rear corner portion 95RL.
Although not shown, the turn signal at the time of turning right similarly emits light from the light emission position of the front window 91F, which is the light output portion at the front of the vehicle body, and light emission from the light output portion at the front of the vehicle right side (front side of the right side window 91RS) The light moves so that the positions are both directed to the right front corner 95FR (see FIG. 5) of the vehicle 90. In addition, the light emission position of the light output portion (rear window 91RR) at the rear of the vehicle body and the light emission position of the light output portion at the rear of the right side surface of the vehicle body (rear side of the right side window 91RS) are both directed to the right rear corner portion 95RR of the vehicle 90 The light moves to

By moving the light emitting portion (light output position) using the large display surface of the window 91, it is possible to realize a turn signal having high visibility and a high degree of impression.
In particular, focusing on the corner portion 95, the corner portions 95FL and 95RL are visually recognized to blink in the case of a left turn, and the corner portions 95FR and 95RR are visually perceived to blink in the case of a right turn. By the blinking at the vehicle corner, the viewer can usually recognize it as a turn signal.
Also, as the sequential turn, the upper end position of the light emitting end becomes higher as it approaches the corner portion 95. This enhances the alerting function as a turn signal.

Note that, for example, a turn signal in which light sequentially moves toward a corner portion of a vehicle body is also possible by the lamp configuration in the vehicle 90A as shown in FIG. 15A.
A vehicle 90A in FIG. 15A has turnlights 110L and 110R at the rear of the vehicle, and also has a turnlight 111R at the rear side of the vehicle (the left side is the same although not shown).
Then, in the case of a right turn, the turn lights 110R and 111R perform sequential lighting such that light travels toward the corner portion 95RR. For example, the turn lights 110R and 111R have four divided lighting portions, and are lighted in order from the lighting portion farther from the corner portion 95RR as shown in FIG. 15B → FIG. 15C → FIG. 15D → FIG. By such lighting, a turn signal can be displayed such that light travels to the corner portion 95RR.

Furthermore, a similar sequential turn signal is also possible by the lamp configuration in the vehicle 90B as shown in FIG. 16A.
A vehicle 90B in FIG. 16A has turn

lights

112L and 112R in the vicinity of the headlight 113 at the front of the vehicle, and also has a turnlight 111L at the front side of the vehicle (the right side is not shown, but is the same).
Then, in the case of left turn, the turn lights 112L and 111L perform sequential lighting such that light travels toward the corner portion 95FL. For example, the turn lights 112L and 111L have four divisions of lighting parts, and as shown in FIG. 16B → FIG. 16C → FIG. 16D → FIG. By such lighting, a turn signal can be displayed such that light travels to the corner portion 95FL.
The shape of the lamp is set such that the upper end position of the light emitting end becomes higher toward the corner portion 95 as a sequential turn in both of the examples of FIGS. This enhances the alerting function as a turn signal.

<Summary>
Although the embodiment has been described above, the roof module 1 of the embodiment has a function as a vehicle window display device.
That is, the roof module 1 includes the image projection unit 8 which is disposed in the vehicle interior of the vehicle and projects an image on at least the front window 91F and the side windows 91RS and 91LS of the vehicle. A projection for displaying the in-vehicle image 100 to be displayed to the vehicle occupant is performed in a state where the outward visual recognition is possible via the window 91F and the side windows 91RS and 91LS.
Thereby, various information displays for the occupant can be realized using the window 91 of the vehicle. By using a wide area such as the window 91 as a screen, the information presentation capability is also high. Further, the function of the window 91 is not impeded by not disturbing the occupant's outward visibility.

In the embodiment, on the outer surface side of the window 91 of the vehicle 90, the display of the outside-vehicle image 101 for displaying outside the vehicle with image contents different from the in-vehicle image 100 is further performed.
As a result, not only various information displays for the occupants but also information displays for persons outside the vehicle can be realized using the window 91 of the vehicle 90.

In the embodiment, information is displayed across the front window 91F and at least one side window (91RS or 91LS) (for example, FIG. 9).
That is, the image is projected in a state where the front window 91F and the right side window 91RS, or the front window 91F and the left side window 91LS, or the front window 91F and the left and right side windows 91RS and 91LS are regarded as one screen.
This makes it possible to display information using the window 91 of the vehicle 90 as a screen of a large size, and can improve the information presentation capability.

In the embodiment, it is possible to perform image display in the entire circumferential direction of the vehicle 90 as the vehicle external image 101, including the rear window 91RR of the vehicle (see FIG. 7).
That is, information is displayed using the front window 91F, the left and right side windows 91RS and 91LS, and the rear window 91RR as screens in the entire circumferential direction. As a result, various information can be displayed on the front, rear, left, and right of the vehicle as the image 101 for the external use of the vehicle.
Of course, with regard to the in-vehicle image 100, it is also possible to perform image display in the entire circumferential direction such that the passenger views a 360 ° screen.

In the embodiment, a laser light output unit (headlight unit 3, rear light unit 4, surrounding illumination unit 5) that outputs laser light as illumination to the outside of the vehicle, laser light source unit 22, and drive circuit 23 of the laser light source And a light emission drive unit (laser light engine 2). In the laser light output unit, the laser light output from the laser light source unit 22 is supplied by the optical fiber 6 which is a light guide, and light output is performed. In this case, the projectors 8a to 8f of the image projection unit 8 also perform projection using the laser light output from the laser light source unit 22 and supplied by the optical fiber 6 (see FIG. 3).
That is, the roof module 1 has a function as a vehicle lamp as illumination to the outside of the vehicle, and uses laser light from the laser light source unit 22 common to illumination and projection. As a result, the roof module 1 becomes an image projection apparatus having a function as a vehicle lamp, and by sharing the laser light source, the configuration can be made more efficient.
In addition, as a light emission drive part (laser light engine 2), light sources other than laser light sources, such as LED, may be used, and several different types of light sources may be used.

In the embodiment, the control unit 20 controls the projection image and the projection position by the image projection unit 8, and the control unit 20 controls the projection position of the in-vehicle image 100 and the outside image 101 in the window 91 The notification output to the ECU 92) is performed.
For example, the ECU 92 is configured to be able to control the transmittance of the front window 91F, the side windows 91RS and 91LS, and the rear window 91RR for each position (see FIG. 3). In this case, the control unit 20 controls the transmittance of the window 91 according to the projected positions of the in-vehicle image 100 and the out-vehicle image 101 by notifying the ECU 92 of the projected positions of the in-vehicle image 100 and the out-vehicle image 101. It is possible to execute Therefore, the control unit 20 can project / display the in-vehicle image 100 and the in-vehicle image 101 using any area of the window 91. This also improves the ability to present information.

Further, the display of the turn signal image 101T is also executed as the external image 101 (see FIG. 14). That is, by displaying the turn signal image 101T showing the turn direction by making either the left or right prominent by the window display, the degree of impression or the visibility is higher as various images or dynamic images. Turn signal light can be generated.
Further, focusing on the corner portion 95, the turn signal display shown in FIG. 14 is a display operation in which the corner portion 95 blinks. That is, by indicating the turn direction by blinking either of the left and right corner portions, the recognition as a turn signal can be enhanced.

DESCRIPTION OF SYMBOLS 1 ... Roof module, 2 ... Laser light engine, 3 ... Headlight part, 4 ... Rear light part, 5 ... Ambient illumination part, 6 ... Optical fiber, 7: ... Monitoring sensor unit, 8 ... Image projection part, 20 ... Control part , 21: power supply circuit unit, 22: laser light source unit, 23: drive circuit, 24: analysis unit, 91: window, 91 F: front window, 91 RS: right side window, 91 LS: left side window, 91 RR: rear window

Claims

An image projection unit disposed in a vehicle compartment of the vehicle and projecting an image on at least a front window and a side window of the vehicle,
The image window projection device performs projection for displaying an in-vehicle image to be displayed to a vehicle occupant in a state in which the vehicle occupant can view outward through the front window and the side window.
The vehicle window display device according to claim 1, further comprising displaying on the outer surface side of a window of the vehicle an external image for display that is different from the in-vehicle image and for displaying outside the vehicle.
The vehicle window display device according to claim 1 or 2, wherein information is displayed across the front window and at least one side window.
The vehicle window display device according to any one of claims 1 to 3, wherein an image display is performed in the entire circumferential direction of the vehicle, including a rear window of the vehicle, as the vehicle exterior image.
A laser light output unit that outputs laser light as illumination to the outside of the vehicle;
And a light emission drive unit having a laser light source and a drive circuit for the laser light source,
In the laser light output unit, the laser light output from the laser light source is supplied by a light guide to perform light output.
The vehicle window display device according to any one of claims 1 to 4, wherein the image projection unit performs projection using a laser beam output from the laser light source and supplied by a light guide.