JP7074900B1 - Blind spot display device, blind spot display system, blind spot display method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a blind spot display device or the like capable of displaying a state of a road which is a blind spot without installing a device for data transmission in the vicinity of a road having a blind spot. SOLUTION: The blind spot display device of the present invention is a server information acquisition means for acquiring storage destination server information of blind spot data related to a blind spot embedded in a mark around a road having a blind spot, and from a server based on the storage destination server information. It includes a blind spot data receiving means for receiving blind spot data and a blind spot display means for displaying blind spot data received by the receiving unit. [Selection diagram] Fig. 1

Description

The present disclosure relates to a blind spot display device and the like for displaying blind spot information on roads around a self-propelled person.

There are blind spots due to buildings and fences on roads and intersections such as urban areas and residential areas. As a method of confirming a vehicle or a person from a blind spot, there is a method of visually confirming with a curved mirror or a method of confirming with a camera at the tip of the vehicle.

However, this method is dangerous because it requires the vehicle to approach the blind spot for visual or camera confirmation. In addition, there are roads with a width of about one vehicle, such as mountainous areas and narrow alleys, and vehicles cannot pass each other in that section. In this case, there is a sign to notify the driver that the road is narrow, but it is not possible to know whether or not there is a vehicle traveling toward the driver from the direction of travel, so drive carefully. It is necessary and burdens the driver.

Therefore, there is known an intersection situation confirmation system that installs a camera near a road where a blind spot such as an intersection exists, takes a picture of the road that becomes a blind spot from a car, and sends an image to a car trying to pass through the intersection by wireless communication. There is.

Patent Document 1 describes an example of an in-vehicle device that receives and displays a blind spot image from an image pickup device installed near an intersection. Patent Document 2 describes driving support at an intersection, in which wireless communication is performed between a roadside unit having a limited communication area centered on the intersection and an on-board unit provided in a vehicle that has entered the communication area of the roadside unit. The system is disclosed. Patent Document 3 includes a transmitting means for wirelessly transmitting a video signal from a photographing means and a receiving means equipped on the moving body for receiving the video signal from the transmitting means, and the moving body wirelessly transmits the video from the transmitting means. An image transmission device that is automatically received by a mobile receiving means when it enters the signal receiving range is disclosed.

Japanese Unexamined Patent Publication No. 2010-055157 Japanese Unexamined Patent Publication No. 2009-199532 Japanese Unexamined Patent Publication No. 2001-155297

However, in the invention described in the above-mentioned Patent Documents 1 to 3, it is necessary to install a device for transmitting data such as an image pickup device, a roadside machine, or a transmission means in the vicinity of a road having a blind spot.

An example of an object of the present disclosure is to provide a blind spot display device or the like that can display the condition of a road that becomes a blind spot without installing a device for data transmission in the vicinity of a road having a blind spot.

The blind spot display device according to one aspect of the present disclosure is a server information acquisition means for acquiring blind spot data storage destination server information embedded in a mark around a road having a blind spot, and a server based on the storage destination server information. It includes a blind spot data receiving means for receiving blind spot data and a blind spot display means for displaying blind spot data received by the blind spot data receiving means.

The blind spot display system according to one aspect of the present disclosure includes the above-mentioned blind spot display device, a storage means for storing blind spot data to be delivered to the blind spot display device, and a data processing means for privacy processing of blind spot data stored in the storage means. It is equipped with a server including.

In the blind spot data display method according to one aspect of the present disclosure, in the blind spot display method for displaying blind spot information of the road around the own vehicle, the storage destination server information of the blind spot data related to the blind spot embedded in the mark of the peripheral road is acquired. The blind spot data is received from the server based on the storage destination server information, and the received blind spot data is displayed.

The program in one aspect of the present disclosure causes a computer to acquire storage destination server information of blind spot data related to blind spots embedded in a mark around a road having a blind spot, and blind spot data from the storage destination server based on the storage destination server information. Is received and the process of displaying the blind spot data is executed.

One example of the effect of the present invention is that the condition of a road that becomes a blind spot can be displayed without installing a device for transmitting data near the road that has a blind spot.

FIG. 1 is a block diagram showing a configuration of a blind spot display device according to the first embodiment. FIG. 2 is a diagram showing a hardware configuration in which the blind spot display device according to the first embodiment is realized by a computer device and its peripheral devices. FIG. 3A is a diagram showing an example of reading a mark near an intersection by the server information acquisition unit in the first embodiment. FIG. 3B is a diagram showing an example of reading a mark in front of a curve by the server information acquisition unit in the first embodiment. FIG. 4A is a diagram showing an example displayed on the blind spot display device near the intersection in the first embodiment. FIG. 4B is a diagram showing an example displayed on the blind spot display device in front of the curve in the first embodiment. FIG. 5 is a flowchart showing the operation of the blind spot display device according to the first embodiment. FIG. 6 is a block diagram showing the configuration of the second embodiment. FIG. 7 is a flowchart showing the operation of the second embodiment.

Next, the embodiment will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration of a blind spot display device 100 according to the first embodiment. Referring to FIG. 1, the blind spot display device 100 includes a server information acquisition unit 101, a blind spot data receiving unit 102, and a blind spot display unit 103. Next, the configuration of the blind spot display device 100 in the first embodiment will be described in detail.

FIG. 2 is a diagram showing an example of a hardware configuration in which the blind spot display device 100 according to the first embodiment of the present disclosure is realized by a computer device 500 including a processor. As shown in FIG. 2, the blind spot display device 100 stores a memory such as a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, and a hard disk for storing a program 504. It includes a device 505, a communication I / F (Interface) 508 for network connection, and an input / output interface 511 for inputting / outputting data. Further, the blind spot display device 100 is connected to the input device 509 and the output device 510 via the bus 512.

The CPU 501 operates an operating system to control the entire blind spot display device 100 according to the first embodiment of the present invention. Further, the CPU 501 reads a program or data into a memory from a recording medium 506 mounted on, for example, a drive device 507. Further, the CPU 501 functions as a part of the server information acquisition unit 101, the blind spot data receiving unit 102, and the blind spot display unit 103 in the first embodiment, and is processed or processed in the flowchart shown in FIG. 5 to be described later based on the program. Execute the instruction.

The recording medium 506 is, for example, an optical disk, a flexible disk, a magnetic optical disk, an external hard disk, a semiconductor memory, or the like. A part of the recording medium of the memory device is a non-volatile storage device, in which the program is recorded. The program may also be downloaded from an external computer (not shown) connected to the communication network.

The input device 509 is realized by, for example, a mouse, a keyboard, a built-in key button, or the like, and is used for an input operation. The input device 509 is not limited to a mouse, a keyboard, and a built-in key button, and may be, for example, a touch panel. Further, the input device 509 is realized by a shooting device such as a camera or a video camera like the server information acquisition unit 101 in the first embodiment, detects the mark 1 around the road, and is embedded in the mark 1. It is used to capture the information that is being used. The output device 510 is realized, for example, in a display and is used to confirm the output.

As described above, the first embodiment shown in FIG. 1 is realized by the computer hardware shown in FIG. However, the means for realizing each part of the blind spot display device 100 of FIG. 1 is not limited to the configuration described above. Further, the blind spot display device 100 may be realized by one physically coupled device, or may be realized by a plurality of physically separated devices connected by wire or wirelessly. good. For example, the input device 509 and the output device 510 may be connected to the computer device 500 via a network.

In FIG. 1, the server information acquisition unit 101 is, for example, a photographing device such as a camera or a video camera having sensitivity in the visible light region to the infrared region, and is a wearable worn by a device mounted on a vehicle or a driver. It is installed in devices and the like. The server information acquisition unit 101 detects the mark 1 around the road such as a sign on the road or around the road, reads and analyzes the mark 1, and stores the blind spot data related to the blind spot embedded in the mark 1. To get. The mark 1 is a three-dimensional code such as a barcode, a two-dimensional code, an AR (Augmented Reality) or an MR (Mixed Reality) code, and the blind spot data storage destination server information is, for example, a blind spot. This is the IP (internet protocol) address of the server 300 in which the data is stored. The server 300 stores blind spot data relating to a road condition with a blind spot that exists ahead of the mark 1 when viewed from the traveling direction of the own vehicle. The server information acquisition unit 101 outputs the acquired storage destination server information to the blind spot data reception unit 102.

FIG. 3 is a diagram showing an example when the server information acquisition unit 101 according to the present embodiment reads a mark 1 around a road having a blind spot. FIG. 3A is an explanatory diagram when reading the mark 1 near the intersection. As shown in FIG. 3A, at the intersection, the area of B1 becomes a blind spot, and the driver cannot confirm the existence of a vehicle stopped in the area of B1 or a pedestrian crossing a pedestrian crossing. The mark 1 is, for example, near the display of a pedestrian crossing drawn on the road, and when the camera installed in front of the vehicle detects the mark 1, the storage destination server information embedded in the mark 1 by the camera. To get. FIG. 3B is an explanatory diagram when reading the mark 1 near the curve. As shown in FIG. 3B, in front of the curve, the area of B2 becomes a blind spot, and the driver cannot confirm the existence of a vehicle approaching from the opposite lane. The mark 1 is, for example, on the sign of the curve in front of the curve, and when the camera mounted on the smartphone owned by the driver detects the mark 1, the storage destination server information embedded in the mark 1 by the camera. To get. When the camera has sensitivity in the infrared region, the mark 1 can be detected and the storage destination server information embedded in the mark 1 can be acquired even if the surrounding road is dark at night or the like.

The blind spot data receiving unit 102 accesses the IP address or the like based on the storage destination server information of the blind spot data input from the blind spot data receiving unit 102. Next, the blind spot data receiving unit 102 downloads the blind spot data from the accessed server 300 and receives it. The blind spot data receiving unit 102 transmits the received data to the blind spot display unit 103. When the blind spot data receiving unit 102 includes image information as blind spot data, the blind spot data receiving unit 102 also transmits information regarding the position of the blind spot as viewed from the traveling direction of the own vehicle to the blind spot display unit 103.

The blind spot display unit 103 displays the blind spot data input from the blind spot data receiving unit 102. The blind spot display unit 103 is a display of a car navigation system of the own vehicle, a meter capable of digitally displaying, a display audio, a windshield, a side mirror, a rear-view mirror, and a display of a mobile terminal such as a driver's smartphone or tablet. The blind spot display unit 103 displays information on the road condition such as the road shape in the area that becomes the blind spot from the driver and the presence or absence of a vehicle. When character information is input, the blind spot display unit 103 displays character information indicating the existence of a blind spot or the presence or absence of a vehicle, and outputs voice based on the input character information. When blind spot data including image information is input as blind spot data, an image of the road condition in the blind spot region as seen from the traveling direction of the own vehicle is displayed. When blind spot data including a three-dimensional image such as an AR or MR image is input as blind spot data, the blind spot image is superimposed and displayed together with the peripheral image of the own vehicle as seen from the traveling direction of the own vehicle.

FIG. 4 is a diagram showing an example when the blind spot display unit 103 according to the present embodiment displays a blind spot image together with a peripheral image of the own vehicle. FIG. 4A is an example of displaying a blind spot image together with an image near an intersection in FIG. 3A. As shown in FIG. 4A, at the intersection in FIG. 3A, the motorcycle stopped on the road on the right side when viewed from the driver becomes a blind spot of the building, and the driver cannot confirm the motorcycle. In addition, the car and pedestrian on the left side of the driver become blind spots in the building, and the driver cannot see the car and pedestrian. In this case, the motorcycles, cars, and pedestrians hidden in the shadows of the left and right buildings are displayed together with the buildings in the direction in which they actually exist when viewed from the traveling direction of the own vehicle. In FIG. 4A, the motorcycle, the car, and the pedestrian hidden in the shadow of the building may be three-dimensionally displayed in the foreground so as to overlap the building. Alternatively, motorcycles, cars, and pedestrians hidden in the shadow of the building may be displayed so as not to overlap the building, as long as the driver can easily confirm it.

FIG. 4B is an example in FIG. 3B when displaying a blind spot image together with an image near a curve that can be seen by the driver. As shown in FIG. 4B, in front of the curve in FIG. 3A, the driver cannot confirm the existence of a vehicle approaching the own vehicle from the opposite lane due to a blind spot of a tree at the end of the curved road. In this case, a car that cannot be confirmed in the shadow of the tree is displayed in front of the tree. Also in FIG. 4B, the car in the opposite lane may be displayed three-dimensionally so as to overlap the tree, or may be displayed so as not to overlap the tree.

The operation of the blind spot display device 100 configured as described above will be described with reference to the flowchart of FIG.

FIG. 5 is a flowchart showing an outline of the operation of the blind spot display device 100 in the first embodiment. The process according to this flowchart may be executed based on the program control by the processor described above.

As shown in FIG. 5, first, the server information acquisition unit 101 acquires the storage destination server information of the blind spot data related to the blind spot embedded in the mark 1 of the surrounding road, and outputs it to the blind spot data receiving unit 102 (step S101). ..

Next, the blind spot data receiving unit 102 receives the blind spot data from the server 300 based on the input storage destination server information, and outputs the blind spot data to the blind spot display unit 103 (step S102).

Next, the blind spot display unit 103 displays the input blind spot data (step S103).

With the above, the blind spot display device 100 ends the operation of displaying the blind spot data.

Next, the effect of the first embodiment of the present disclosure will be described. The blind spot display device 100 in the present embodiment described above can provide a blind spot display device or the like that can display the state of a road that becomes a blind spot without installing a device for data transmission around the blind spot road. The reason is that the server information acquisition unit 101 of the blind spot display device 100 acquires the storage destination server information by reading the mark 1 around the road, and receives the blind spot data from the server 300 based on the acquired storage destination server information. Because.

Further, in the first embodiment of the present disclosure, since the mark 1 around the blind spot road is read by a vehicle traveling around the blind spot road, a terminal owned by the driver, or the like, the location of the blind spot road near the vehicle and the direction of the vehicle. Accurate blind spot data can be received and displayed without making a mistake. As a method of specifying the position and traveling direction of the vehicle, there is a method by GPS (Global Positioning System), but GPS cannot accurately position the position and orientation of the vehicle in the mountains or in a tunnel, and cannot acquire accurate blind spot data. There was a possibility.

Further, in the first embodiment of the present disclosure, when blind spot data including a three-dimensional image such as an AR image or MR image is input as blind spot data, the blind spot image is displayed together with the peripheral image of the own vehicle. Therefore, the blind spot information can be transmitted to the driver who requires an instant judgment in a state where it is easy to visually grasp.

[Second Embodiment]
Next, the second embodiment of the present disclosure will be described in detail with reference to the drawings. Hereinafter, the description of the content overlapping with the above description will be omitted to the extent that the description of the present embodiment is not unclear.

FIG. 6 is a block diagram showing a configuration of the blind spot display system 10 according to the second embodiment of the present disclosure. Referring to FIG. 6, the blind spot display system 10 in the present embodiment includes a blind spot photographing device 200 and a server 300 in addition to those in the first embodiment.

The blind spot photographing device 200 transmits the imaging unit 201 that captures the blind spot data to be stored in the server 300, the compression processing unit 202 that compresses the captured blind spot data to send to the server 300, and the compressed blind spot data. The communication unit 203 is provided. In the blind spot photographing device 200, a photographing device such as a camera or a video camera photographs the area of the road that becomes the blind spot from the driver in advance, and outputs the information to the compression processing unit 202 together with the location information of the road in the blind spot. Each time the blind spot photographing device 200 photographs a road that becomes a blind spot, the compression processing unit 202 performs compression processing for distributing the photographed blind spot data to the server 300, and outputs the compressed processing unit 202 to the communication unit 203. The communication unit 203 transmits the compressed blind spot data to the server 300 together with the location information of the road in the blind spot.

The server 300 includes a storage unit 301 that stores blind spot data delivered to the blind spot display device 100, and a data processing unit 302 that privacy-processes the blind spot data stored in the storage unit 301. The storage unit 301 stores and stores the blind spot data received from the communication unit 203 of the blind spot photographing device 200 for each road location of the blind spot data for a certain period of time. The data processing unit 302 has a function of applying a mosaic to the vehicle number and the human face in the image of the blind spot data for privacy protection for the blind spot data stored in the storage unit 301. Further, the data processing unit 302 has a function of displaying an animation of a person or a vehicle and a function of converting it into an avatar for privacy protection. The data processing unit 302 stores the processed blind spot data on the distribution unit 303. When the server 300 accesses the IP address embedded in the mark 1 around the road, the server 300 distributes the processed blind spot data stored in the distribution unit 303 to the blind spot data receiving unit 102 that has accessed the IP address. .. Since the operations and functions of the server information acquisition unit 101, the blind spot data receiving unit 102, and the blind spot display unit 103 of the blind spot display device 100 in the second embodiment are the same as those in the first embodiment, detailed description thereof will be omitted. ..

As described above, each component in each embodiment of the present disclosure is realized not only by hardware but also by a computer device and firmware based on program control, as in the computer device shown in FIG. be able to.

Next, the operation of the blind spot display system 10 will be described with reference to the flowchart shown in FIG. The process according to this flowchart may also be executed based on the program control by the CPU described above.

FIG. 7 is a flowchart showing an outline of the operation of the blind spot data display in the blind spot display system 10 in the second embodiment.

As shown in FIG. 7, first, the photographing unit 201 of the blind spot photographing apparatus 200 photographs the blind spot image, and outputs the blind spot data to the compression processing unit 202 (step S201).

Next, the compression processing unit 202 compresses the input blind spot data and outputs it to the communication unit 203 (step S202).

Next, the communication unit 203 transmits the input compressed blind spot data to the storage unit 301 of the server 300 (step S203).

Next, the data processing unit 302 of the server 300 performs privacy processing on the received blind spot data and outputs it to the distribution unit 303 (step S204).

Next, when the distribution unit 303 reads the mark 1 and detects that the IP address of the server 300 has been accessed, the distribution unit 303 distributes the privacy-processed blind spot data to the blind spot display device 100 (step S205).

Finally, the blind spot display device 100 displays the received blind spot data on the blind spot display unit 103 (step S206). Since the steps performed by the blind spot display device 100 until the blind spot data is displayed on the blind spot display unit 103 are the same as those in the first embodiment, the details will be omitted.

With the above, the blind spot display system 10 ends the operation of displaying the blind spot image.

Although the present invention has been described above with reference to each embodiment, the present invention is not limited to the above-described embodiment. Various modifications that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.

For example, a plurality of operations are described in order in the form of a flowchart, but the order of description does not limit the order in which the plurality of operations are executed. Therefore, when each embodiment is implemented, the order of the plurality of operations can be changed within a range that does not hinder the content. In the second embodiment, the data processing unit 302 of the server 300 performs privacy processing of the blind spot data, but it is realized by the blind spot photographing device 200 or another configuration instead of the data processing unit 302 in the server 300. May be good.

Next, the effect of the second embodiment of the present disclosure will be described. The blind spot display system 10 in the second embodiment described above stores images in the storage unit 301 of the server 300 for a certain period of time. Therefore, in the second embodiment, accidents and incidents in the blind spot can be recorded as records, and these records can be viewed after the accident.

The present disclosure can be applied to a blind spot display device or the like that can display the condition of a road that is a blind spot.

1 Mark 10 Blind spot display system 100 Blind spot display device 101 Server information acquisition unit 102 Blind spot data reception unit 103 Blind spot display unit 200 Blind spot imaging device 201 Imaging unit 202 Compression processing unit 300 Server 301 Storage unit 302 Data processing unit

Claims (9)

A server information acquisition means for acquiring storage destination server information of blind spot data related to the blind spot, which is embedded in a mark around a road having a blind spot.
A blind spot data receiving means for receiving the blind spot data from the server based on the storage destination server information,
A blind spot display means for displaying blind spot data received by the blind spot data receiving means, and a blind spot display means.
Blind spot display device including. The blind spot display device according to claim 1, wherein the blind spot data receiving means receives blind spot data including an image of the blind spot, and the blind spot display means displays a blind spot image based on the blind spot data. The blind spot display device according to claim 2, wherein the blind spot display means displays the blind spot image in a direction that actually exists when viewed from the traveling direction of the own vehicle based on the blind spot data. The blind spot display device according to claim 2 or 3, wherein the blind spot display means superimposes and displays the blind spot image together with a peripheral image of the own vehicle based on the blind spot data. The blind spot display device according to any one of claims 1 to 4,
A server including a storage means for storing blind spot data to be distributed to the blind spot display device, and a data processing means for privacy processing of blind spot data stored in the storage means.
Blind spot display system with. In the system according to claim 5,
A blind spot display system further comprising a blind spot photographing device for capturing a blind spot image for storage in the server. The blind spot display system according to claim 6, wherein the blind spot photographing device includes a compression processing means for compressing the captured blind spot image for sending to the server. In the blind spot display method that displays the blind spot information of the road around the own vehicle,
Acquires the storage destination server information of the blind spot data related to the blind spot information embedded in the mark of the surrounding road, and obtains the server information.
Based on the storage destination server information, blind spot data is received from the server,
A blind spot display method for displaying the received blind spot data. Acquire the storage destination server information of the blind spot data related to the blind spot embedded in the mark around the road with the blind spot.
The blind spot data is received from the storage destination server based on the storage destination server information, and the blind spot data is received.
A program that causes a computer to perform a process of displaying the blind spot data.

Images