WO2021020080A1

WO2021020080A1 - Vehicular display system

Info

Publication number: WO2021020080A1
Application number: PCT/JP2020/027051
Authority: WO
Inventors: 彩香元辻; 和也本橋
Original assignee: 株式会社小糸製作所
Priority date: 2019-07-26
Filing date: 2020-07-10
Publication date: 2021-02-04
Also published as: JP7267141B2; JP2021020523A

Abstract

Provided is a vehicular display system that uses a display device effectively and contributes to safe and smooth travel in a vehicle by displaying different messages to different target parties. The vehicular display system comprises a display means, a detection means that detects a target party present in the vicinity of a vehicle, and a control means that controls the display means. The display means includes a light field display (1) capable of displaying a different image in each of a plurality of directions outside the vehicle. The detection means includes a camera (2) and a target party detecting unit (31) that detects a target party from a captured image. The control means (3) includes a setting unit (32) (a target party setting unit (34), an image setting unit (35)) and a display control unit (33) that perform control for displaying an image corresponding to the detected target party in the direction of the target party.

Description

Vehicle display system

The present invention relates to a vehicle display system equipped with a display device equipped on a vehicle such as an automobile and displaying a message to a target person such as another vehicle or a pedestrian.

For safe and smooth driving of automobiles, it is preferable to communicate with the occupants of other vehicles, especially drivers and pedestrians (hereinafter referred to as target persons), and their own vehicles. Patent Document 1 proposes a technique of arranging a display device (display device) on the vehicle body of the own vehicle and displaying the state of the own vehicle, for example, the traveling direction and the deceleration state of the own vehicle on the display device. The subject can detect the state of the vehicle by visually recognizing this display device, which is effective in preventing accidents.

JP-A-2017-140929

Patent Document 1 can display the state of the own vehicle and the message of the own vehicle to the target person, but the display is unique and does not specify the target person. Therefore, depending on the display form on the display device, the target person who visually recognizes the display may feel annoyed or misunderstood, and the display device cannot be effectively used.

For example, when a message "Please proceed" is displayed to a pedestrian trying to cross a pedestrian crossing, the driver of another vehicle sees this display and overtakes his / her own vehicle to come into contact with the pedestrian. Will happen. Also, even if you want to display the message "Be careful" for pedestrians whose vehicle is turning right and the message "Please proceed" for pedestrians on the other side, one display. The device cannot display such different messages at the same time, and the display device cannot be effectively used.

An object of the present invention is to provide a display system for a vehicle that can contribute to the safe and smooth running of a vehicle by effectively using the display device by displaying a suitable message to each of different subjects. ..

The vehicle display system of the present invention corresponds to a detection means for detecting a target person existing around the vehicle, a display means capable of displaying different images in a plurality of directions outside the vehicle, and the detected target person. The control means for controlling the display of the image to be displayed toward the target person is provided. Here, the display means is composed of a light field display.

In the vehicle display system of the present invention, the display means is arranged on at least a part of the vehicle body of the vehicle, and the detection means is configured to detect a target person who exists at a position where the display means can be visually recognized. For example, the detection means includes a camera that images the surroundings of the vehicle, a means that analyzes the captured image to detect the target person, and the control means sets the target person setting means that sets the target person to be displayed. An image setting means for setting an image corresponding to the target person is provided.

According to the present invention, it is possible to display a suitable message for each of different subjects with one display device, to make effective use of the display device and to contribute to the safe and smooth running of the vehicle. it can.

(A) External perspective view and (b) Schematic sectional view of LFD of an automobile equipped with the display system of the first embodiment of the present invention. Block configuration diagram of the display system. The schematic diagram of the image which detects a subject. The schematic plan view which shows the display of LFD and the positional relationship of a subject. The schematic diagram of the message image visually recognized by each subject. The plan view of the automobile equipped with the display system of Embodiment 2. Schematic side view of display form 1. The schematic diagram of the message image in display form 1. Schematic plan view of display form 2. The schematic diagram of the message image in the display form 2. Schematic side view of display form 3. Schematic side view of display form 4.

(Embodiment 1)
Next, an embodiment of the present invention will be described with reference to the drawings. FIG. 1A is a schematic perspective view of an automobile equipped with the display system according to the first embodiment of the present invention as viewed from the front left. A front light field display (hereinafter referred to as F-LFD) 1 is arranged as a display device on the front portion of the vehicle body of the automobile CAR. The FLFD1 is a display device in which, when displaying on a display surface, the images visually recognized differ depending on the direction in which the display surface is viewed, in this case, the horizontal direction. Therefore, it is possible to display different images in different directions such as the front direction of the automobile, the right front direction of the automobile, and the left front direction of the automobile.

As shown in FIG. 1 (b), the F-LFD1 multiplex-displays different images on the display surface of the display panel 11 such as a liquid crystal panel or an organic EL panel, and displays different images on the display surface of the display panel 11. It is configured as a lens array type LFD in which each image is imaged in different directions by the microlenses 12 arranged in the above. For example, by displaying the images a, b, and c in pixel units, each image a, b, and c is configured to be observed from different directions.

Further, a front camera (hereinafter referred to as an F camera) 2 is arranged at a position facing the front window of the automobile CAR, and it is possible to take an image of a target person existing in the front region of the automobile CAR. There is. The F camera 2 is composed of a digital camera and outputs an captured image signal. Here, the target person is another vehicle such as a car or a bicycle or a pedestrian, but in the case of another vehicle, a person (occupant) who can visually recognize the F-LFD1 is the target person.

FIG. 2 is a block configuration diagram of the display system of the first embodiment, and includes an LFD control device 3 that controls the display of the F-LFD 1 based on an image signal captured by the F camera 2. The LFD control device 3 sets a target person detection unit 31 that detects a target person based on an captured image signal, and a target person and an image that displays an appropriate message image (design, character, etc.) from the detected target person. It is configured to include a setting unit 32 to be set and a display control unit 33 to display the set message image on the F-LFD1.

The target person detection unit 31 detects the target person by detecting other vehicles and pedestrians existing in the image captured by the F camera 2 by image analysis. In this detection, the position of the target person, that is, the direction and distance when viewed from the own vehicle is detected. It is also possible to detect the behavior of the target person, particularly the moving direction and the moving speed, by detecting the target person over time.

The setting unit 32 sets a target person setting unit 34 for setting a target person to be displayed as a message image among the target persons detected by the target person detection unit 31, and a message image to be displayed for the set target person. The image setting unit 35 for setting is provided. Further, in order to acquire reference information when executing these settings, the setting unit 32 includes a vehicle speed sensor Sv that detects the vehicle speed of the own vehicle, a steering sensor Ss that detects the traveling direction of the own vehicle, and the own vehicle. A navigation device Sn including GPS for detecting the current position is connected.

Further, the setting unit 32 is provided with a memory 36 for storing a message image to be displayed. The message image to be stored includes a preset standard image and a free image arbitrarily created by the occupant of the own vehicle. Further, a communication unit 37 is connected to the setting unit 32, and the communication unit 37 transmits from these external communication stations or mobile terminals when, for example, is wirelessly connected to an external communication station or mobile terminal (not shown). It is also possible to store the incoming message image in the memory 36. The mobile terminal also includes a mobile phone owned by the occupant of the own vehicle. Further, the mobile terminal of the occupant may be connected by wire.

The target person setting unit 34 refers to the detected position, moving direction, and moving speed of the target person, and the moving direction and moving speed of the own vehicle obtained from the vehicle speed sensor Sv, the steering sensor Ss, and the navigation device Sn. Estimate the relative positional relationship between the vehicle and the subject in a short time from the present. On top of that, it is necessary to extract the subjects who approach the own vehicle after a short period of time or who may collide, and the subjects who do not pose a danger even when the own vehicle travels, and then display the display. Set the target person.

The image setting unit 35 sets a preferable message image for each of the set target persons. This message image identifies an image stored in the memory 36. Alternatively, a message image transmitted from the outside using the communication in the communication unit 37, for example, a message image input by the occupant of the own vehicle with a mobile phone and stored in the memory may be specified. Then, the set target person and the specified message image are made to have a one-to-one correspondence.

The display control unit 33 drives the FLFD1 so that the message images set by the image setting unit 35 can be visually recognized from the corresponding target directions. The set message image may be the same message image for a plurality of target persons, or may be a different message image for each target person.

Here, the setting of the target person in the target person setting unit 34 and the setting of the message image in the image setting unit 35 can be manually set. For example, an occupant such as a driver of an automobile operates an input device (not shown) provided in the LFD control device 3 while checking an image captured by the F camera 2 on a monitor equipped in the automobile CAR. The target person may be set. Further, an image list is displayed on the monitor, and the corresponding message image may be specified from this image list. Alternatively, the input device may be operated to identify the message image created by the occupant.

An example of the display form on the F-LFD1 by the LFD control device 3 having the above configuration will be described. FIG. 3 is an image taken by the F camera 2, and it is assumed that the automobile (hereinafter, own vehicle) CAR is trying to go straight through an intersection without a traffic light. The target person detection unit 31 of the LFD control device 3 acquires an image captured by the F camera 2, analyzes the image, and serves as the target person in the image captured by the preceding vehicle C1 and the oncoming vehicle C2, 4 people. Pedestrians M1 to M4 are detected.

In the setting unit 32, the target person setting unit 34 detects the directions and distances of the detected target persons C1, C2, M1 to M4 from their own vehicles, and further, the target person C1 is obtained from the images acquired over time. , C2, M1 to M4, that is, the moving direction and the moving speed are detected. Further, in parallel with this, the target person setting unit 34 detects the traveling state of the own vehicle CAR from the information obtained from the vehicle speed sensor Sv, the steering sensor Ss, and the navigation device Sn. Then, from the detected running status of the own vehicle CAR and the detected directions, distances, and behaviors of the target persons C1, C2, and M1 to M4, the own vehicle CAR and the target persons C1, C2, M1 to M4 after a short period of time. Estimate the positional relationship of. As a result, a target person who is highly related to the running of the own vehicle CAR and preferably displays a message image on the F-LFD1 is set. Here, a pedestrian M1 trying to cross the pedestrian crossing on the right side of the intersection, a pedestrian M3 trying to cross the pedestrian crossing immediately before, and an oncoming vehicle C2 are set.

In response to this, the image setting unit 35 sets a message image to be displayed for the set target person. In this setting, a message image stored in the memory 36 or a message image appropriately created by the occupant of the own vehicle is set. Then, the set target person and the set message image are associated with each other on a one-to-one basis. For example, it is conceivable to simulate various traffic conditions in advance, prepare preferable message images for each, and store them in the memory 36.

The display control unit 33 displays the three set message images on the FLFD1. At this time, by utilizing the characteristics of the LFD, when the set target persons M1, M3, and C2 visually recognize the F-LFD1 from their respective directions, the corresponding message image is controlled so as to be visually recognized.

Here, when the display directions of the message images a, b, and c in the F-LFD1 shown in FIG. 1B correspond to each other, the message image a "goes straight", the message image b "stops", and the message. Each message image of "pedestrian" is displayed on the display panel 11 as the image c. Each of the message images a, b, and c is deflected in different directions due to refraction by the microlens 12 and is imaged.

As a result, as shown in the schematic plan view of FIG. 4, the "go straight" of the message image a is deflected diagonally to the left and imaged, and the "stop" of the message image b is deflected diagonally to the right. The image is formed, and the "pedestrian" in the message image c is formed in the front straight direction.

By performing such a display on the F-LFD1, as shown in the schematic diagram in FIG. 5, the pedestrian M1 in front of the left can visually recognize the F-LFD1 from the right direction as shown in FIG. 5 (a). Therefore, the message image a of "go straight" can be visually recognized. The pedestrian M1 can cross the pedestrian crossing with peace of mind.

From the pedestrian M3 on the right front, the F-LFD1 is visually recognized from the left as shown in FIG. 5 (b), so that the message image b of "stop" can be visually recognized. Since the pedestrian M3 recognizes that the vehicle CAR will stop, he / she will cross the pedestrian crossing with confidence that it is safe at least for the vehicle CAR.

Since the F-LFD1 is visually recognized from the front direction by the occupant of the oncoming vehicle C2 as shown in FIG. 5C, the message image c of "pedestrian is present" can be visually recognized. The occupant of the oncoming vehicle C2 detects a pedestrian, recognizes that the pedestrian M3 crosses the pedestrian crossing in front of the own vehicle, and takes an appropriate response, for example, pauses to ensure the safety of the pedestrian M3.

In this way, by displaying suitable message images for the subjects in different directions in the F-LFD1, the pedestrian M1 on the left front does not pay excessive attention to the own vehicle and is stressed. You can cross the pedestrian crossing without feeling. The pedestrian M3 on the right front knows that his vehicle will stop and can safely cross the pedestrian crossing while paying the minimum necessary attention. The occupant of the oncoming vehicle C3 can confirm the crossing pedestrian M3 and pause to ensure the safety of the pedestrian. By displaying suitable message images for each of the different target persons in this way, it is possible to realize safe and smooth running of the vehicle by effectively utilizing the FLFD1.

(Embodiment 2)
FIG. 6 is a schematic plan view of an automobile CAR equipped with the display system of the second embodiment. A rear LFD (hereinafter, B-LFD) 1B is arranged at the rear portion of the vehicle body of the automobile, and a left side LFD (hereinafter, L-LFD) 1L is arranged at the left side portion of the vehicle body of the automobile. Further, a right side LFD (hereinafter, R-LFD) 1R is arranged on the right side of the vehicle body. As in the first embodiment, the F-LFD1F is arranged at the front portion of the vehicle body.

On the other hand, an omnidirectional camera 2A that captures the surrounding area of the own vehicle is mounted on the roof of the automobile CAR. Alternatively, although not shown, the left side camera is installed in the left side mirror of the automobile, the right side camera is installed in the right side mirror, and these cameras are used to image the left and right side or rear areas of the vehicle. It may be. In particular, it is preferable to image the area that becomes the blind spot of the driver.

These LFD1B, 1R, 1L and the camera 2A are connected to the same LFD control device 3 as shown in FIG. 2, and other vehicles and pedestrians existing around the own vehicle based on the image captured by the camera 2A. Etc. are detected, and a message image is displayed on each of the LFD1B, 1R, and 1L based on this detection. Needless to say, the message image may be displayed on the F-LFD1F as well.

In the display system of the second embodiment, since the target person existing around the automobile CAR can visually recognize any of the LFD1B, 1L, 1R, and 1F, it is possible to display in various forms. Further, in the second embodiment, it is not always necessary to provide LFDs on all the front, rear, left and right side surfaces of the vehicle body of the automobile CAR, and the LFDs may be provided only in preferable parts depending on the vehicle type, design, and the like. A few examples of display modes in the display system of the second embodiment will be described.

(Display form 1)
FIG. 7 is a schematic view illustrating a display mode 1 using L-LFD1L. The automobile CAR is a route bus, and the target person detection unit 31 of the LFD control device 3 shown in FIG. 2 detects the target person at the stop, here passengers M11 and M12, from the image captured by the equipped camera 2A. To do. This route bus CAR is a right-hand drive vehicle, and the passenger M11 at the stop is located in a blind spot that is difficult for the driver to see. It is possible to detect M11.

When the bus CAR stops at the stop, the target person setting unit 34 sets two passengers M11 and M12 in the front-rear direction of the bus as the target person. Further, the image setting unit 35 sets message images for the front and rear passengers M11 and M12. Here, the message image a of "Please board from the front" is set for the passenger M11 behind the bus stop, and the message image b of "Please board from here" is set for the passenger M12 in front. .. Then, the display control unit 33 makes the set message images a and b correspond to each target person, and then executes the display on the L-LFD1L.

In this display with L-LFD1l, the message image a of "Please board from the front" can be visually recognized from the diagonally right direction with respect to the display surface of L-LFD1L, and "Get on from here" from the diagonally left direction. The message image b of "Please" can be visually recognized. Therefore, as shown in FIG. 8A, the rear passenger M11 can visually recognize the message image a of "Please board from the front" from the display of L-LFD1L, and the front passenger M12 is as shown in FIG. 8B. In addition, the message image b of "Please board from here" can be visually recognized from the display of L-LFD1L. As a result, the front passenger M12 gets on the bus from the front entrance, and the rear passenger M11 moves forward toward the front entrance to get on the bus, which enables the passengers to get on and off smoothly and quickly. It is possible to shorten the stop time of.

(Display form 2)
FIG. 9 is a schematic plan view illustrating a display mode 2 using B-LFD1B. The automobile CAR is traveling on a two-lane road, and the following vehicle CAR1 is traveling behind the traveling lane of the own vehicle CAR, and the overtaking vehicle CAR2 is traveling diagonally to the right rear of the right lane. At this time, in the LFD display control device 3 shown in FIG. 2, the target person detection unit 31 detects the following vehicle CAR1 and the overtaking vehicle CAR2 from the image captured by the camera 2A.

The driver of the own vehicle CAR tries to decelerate in order to facilitate overtaking of the overtaking vehicle CAR2. The target person setting unit 34 sets the following vehicle CAR1 and the overtaking vehicle CAR2 as the target person in response to the driver's operation and the change in the traveling condition of the own vehicle. The image setting unit 35 sets a message image for the two set vehicles. Here, the message image c of "decelerate" is set for the following vehicle CAR1, and the message image a of "please go ahead" is set for the overtaking vehicle CAR2. Then, the display control unit 33 makes the set message images a and c correspond to each target person, and then executes the display on the B-LFD1B.

In the display on the B-LFD1B, the message image c of "decelerate" can be visually recognized from the front direction with respect to the display surface of the B-LFD1B, and the message image a of "please go ahead" can be visually recognized from the diagonal right direction. .. Therefore, as shown in FIG. 10A, the following vehicle CAR1 can visually recognize the message image c of "decelerate" from the display of B-LFD1B, and the overtaking vehicle CAR2 "please go first" from the same display of B-LFD1B. Message image a can be visually recognized. As a result, the following vehicle CAR1 can be decelerated to prevent a rear-end collision, and the overtaking vehicle CAR2 can be easily overtaken without forcibly accelerating, and safe and smooth running is ensured.

(Display form 3)
In the above embodiments and display embodiments, different message images are displayed in different directions in the horizontal direction (horizontal direction) in the LFD, but they are different in the different directions in the vertical direction (vertical direction). A message image may be displayed.

As shown in FIG. 11, when displaying on the B-LFD1B of the automobile CAR, the angle θ11 for visually recognizing the B-LFD1B from the following vehicle CAR11 at a distant distance behind and the following vehicle CAR12 to B at a short distance behind -The angle θ12 for visually recognizing LFD1B changes. In this way, since the angle at which the B-LFD1B is visually recognized changes according to the difference in the distance of the following vehicle or the change in the distance, the display is changed according to the change in the angle. In this example, by making the message image visually recognizable from the angle θ11 direction different from the message image visible from the angle θ12 direction, different messages can be displayed in response to the change in the inter-vehicle distance from the following vehicle.

For example, although not shown, "inter-vehicle distance OK" is displayed as a message image when viewed from the angle θ11 direction, and "inter-vehicle distance caution" is displayed as a message image when viewed from the angle θ12 direction. Just do it. As a result, the following vehicle C11 operates while maintaining the current inter-vehicle distance, and the following vehicle C12 decelerates in order to increase the inter-vehicle distance, so that safe and smooth running can be realized.

(Display form 4)
Although the above-described first and second embodiments have been described when there are a plurality of subjects, in the display system of the present invention, one moving body (human) whose angle with respect to the LFD changes with time is targeted. It is applicable even if it is set. It can also be used for purposes other than traffic safety, such as advertising.

For example, as shown in FIG. 12, when a female pedestrian M21 walking with the left side of the automobile CAR from the rear to the front is set as the target person, an advertisement image is displayed on the L-LFD1L provided in the automobile CAR. indicate. When the pedestrian M21 is in the diagonally rearward region of the automobile CAR and visually recognizes the L-LFD1L from diagonally rearward, the character image of "K cosmetics" can be visually recognized. When the pedestrian M21 moves to the diagonally lateral position of the automobile CAR, the "photographic image" of the product is made visible. When the pedestrian M21 moves to the position right next to the car CAR, the character image of the price "¥ 1000" can be visually recognized. As described above, in addition to the purpose of traffic safety, a plurality of different images can be displayed to the target person with one LFD, and the display system can be effectively used.

In the LFD display form of the first and second embodiments, the message image to be displayed shows an example of characters, but it may be a picture or a photograph as shown in FIG. Further, the image is not limited to a still image and may be a moving image.

In the present invention, the size of the image to be displayed may be appropriately changed according to the distance between the LFD and the subject. For example, when the subject is far away, the image size is increased, and as the distance is reduced, the image size is decreased. Alternatively, the brightness of the image to be displayed may be changed according to the distance of the target person. Furthermore, in the case of a full-color LFD, the color may be changed as appropriate.

Further, in the embodiment, a plurality of images are displayed in different directions at the same time, but when the direction of the target person with respect to the LFD changes, that is, when the angular position with respect to the front of the LFD changes, this change is dealt with. Display control may be performed so that the viewing angle of the displayed image changes. Alternatively, the image displayed to the target person who is stopped at a predetermined position with respect to the LFD may be changed over time. In this way, when a plurality of target persons are viewing the LFD, it is possible to display an image that changes sequentially for each target person.

This international application claims priority based on Japanese Patent Application No. 2019-137346, which is a Japanese patent application filed on July 26, 2019, and is a Japanese patent application, Japanese Patent Application No. 2019-137346. The entire contents of the issue will be incorporated into this international application.

The above description of a particular embodiment of the present invention is presented for illustration purposes. They are not intended to be exhaustive or to limit the invention in its entirety. It is self-evident to those skilled in the art that numerous modifications and changes are possible in the light of the above description.

1 LFD (light field display: display means)
2,2A camera (detection means)
3 LFD control device 11 Display panel 12 Microlens 31 Subject detection unit (detection means)
32 Setting unit (control means)
33 Display control unit (control means)
34 Target person setting unit (control means)
35 Image setting unit (control means)
36 Memory 37 Communication unit Sv Vehicle speed sensor Ss Steering sensor Sn Navigation device M *, C * Target person

Claims

A detection means for detecting a target person existing around the vehicle, a display means capable of displaying different images in a plurality of directions outside the vehicle, and an image corresponding to the detected target person in the direction of the target person. A display system for a vehicle, which comprises a control means for controlling the display toward the vehicle.
The vehicle display system according to claim 1, wherein the display means includes a light field display.
The vehicle display system according to claim 2, wherein the display means is arranged on at least a part of the vehicle body of the vehicle, and the detection means detects a target person who exists at a position where the display means can be visually recognized.
The detection means includes a camera that images the surroundings of the vehicle, a means that analyzes the captured image to detect a target person, and the control means sets a target person setting means that sets a target person to be displayed. The vehicle display system according to claim 2 or 3, further comprising an image setting means for setting an image corresponding to the target person.
The detection means detects a target person existing around the vehicle, the control means sets a target person to be displayed from the target person, and displays a set image toward the set target person. The vehicle display system according to claim 4, wherein the display means is controlled as described above.
5. The control means controls the display means so as to set a plurality of target persons and images corresponding to each target person, and display the set plurality of images toward the corresponding target persons. Display system for vehicles described in.
The vehicle according to any one of claims 1 to 6, wherein the detecting means detects a distance to a target person or a direction in which the target person is present, and the control means changes a display form according to the detected distance or direction. Display system for.