JP2022124504A - Dead angle display device, dead angle display system, dead angle display method, and computer program - Google Patents

Abstract

To provide a dead angle display device or the like capable of displaying a state of a road to be a dead angle without arranging a data transmission device close to the road having the dead angle.SOLUTION: A dead angle display device includes: server information acquisition means for acquiring storage destination server information of dead angle data related to a dead angle embedded in a mark in the periphery of a road having the dead angle; dead angle data reception means for receiving the dead angle data from the server based on the storage destination server information; and dead angle display means for displaying the dead angle data received by a reception section.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a blind spot display device or the like that displays blind spot information on roads surrounding a self-runner.

Roads and intersections in urban areas and residential areas have blind spots due to buildings and fences. As a method of confirming a vehicle or a person from a blind spot, there is a method of visually confirming with a curved mirror or a method of confirming with a camera at the front end of the vehicle.

However, this method is dangerous because it requires the vehicle to approach the blind spot for visual or camera confirmation. In addition, there are roads such as mountainous areas and narrow alleys that are about the width of one vehicle, and vehicles cannot pass each other in that section. In this case, there is a sign to notify the driver that the road is narrow, but it is not possible to know whether there is a vehicle traveling toward the driver from the direction of travel, so drive carefully. It is necessary and becomes a burden on the driver.

Therefore, there is known an intersection situation confirmation system in which a camera is installed near a road where there is a blind spot such as an intersection, the road that is the blind spot is photographed from a vehicle, and the image is sent to the vehicle that is going to pass through the intersection by wireless communication. there is

Patent Literature 1 describes an example of an in-vehicle device that receives and displays a blind spot image from an imaging device installed near an intersection. In Patent Document 2, a roadside unit having a limited communication area centered on an intersection and an on-vehicle unit installed in a vehicle that has entered the communication area of the roadside unit perform wireless communication to assist driving at an intersection. A system is disclosed. In Patent Document 3, a transmitting means for wirelessly transmitting a video signal from a photographing means and a receiving means equipped on a mobile body for receiving the video signal from the transmitting means are provided. An image transmission apparatus is disclosed in which receiving means of a moving object automatically receives when it enters a signal receiving range.

JP 2010-055157 A JP 2009-199532 A Japanese Patent Application Laid-Open No. 2001-155297

However, the inventions described in Patent Documents 1 to 3 above require installation of a device for data transmission, such as an imaging device, a roadside device, or a transmission means, near a road with a blind spot.

An example of an object of the present disclosure is to provide a blind spot display device or the like that can display the situation of a road with a blind spot without installing a device for data transmission near the road with the blind spot.

A blind spot display device according to one aspect of the present disclosure includes server information acquisition means for acquiring storage destination server information of blind spot data related to blind spots embedded in marks around a road with a blind spot, and based on the storage destination server information, from a server. Blind spot data receiving means for receiving blind spot data, and blind spot display means for displaying the blind spot data received by the blind spot data receiving means.

A blind spot display system according to an aspect of the present disclosure includes the blind spot display device described above, storage means for storing blind spot data to be distributed to the blind spot display device, data processing means for privacy-processing the blind spot data stored in the storage means, a server comprising:

A blind spot data display method according to one aspect of the present disclosure is a blind spot display method for displaying blind spot information about roads surrounding an own vehicle, in which server information for storing blind spot data relating to blind spots embedded in marks of surrounding roads is obtained, Based on the storage destination server information, the blind spot data is received from the server and the received blind spot data is displayed.

A program according to one aspect of the present disclosure causes a computer to acquire storage destination server information of blind spot data relating to blind spots embedded in marks around roads with blind spots, and blind spot data is stored from the storage destination server based on the storage destination server information. is received and processed to display blind spot data.

One example of the effect of the present invention is that it is possible to display the conditions of roads with blind spots without installing a device for transmitting data near the roads with blind spots.

FIG. 1 is a block diagram showing the configuration of the blind spot display device according to the first embodiment. FIG. 2 is a diagram showing a hardware configuration in which the blind spot display device according to the first embodiment is realized by a computer device and its peripheral devices. FIG. 3A is a diagram showing an example when a mark is read near an intersection by a server information acquisition unit according to the first embodiment. FIG. 3B is a diagram showing an example when a mark is read before a curve by the server information acquisition unit according to the first embodiment. FIG. 4A is a diagram showing an example displayed on the blind spot display device near the intersection in the first embodiment. FIG. 4B is a diagram showing an example displayed on the blind spot display device before the curve in the first embodiment. FIG. 5 is a flow chart showing the operation of the blind spot display device in the first embodiment. FIG. 6 is a block diagram showing the configuration of the second embodiment. FIG. 7 is a flow chart showing the operation of the second embodiment.

Next, embodiments will be described in detail with reference to the drawings.

[First embodiment]
FIG. 1 is a block diagram showing the configuration of a blind spot display device 100 according to the first embodiment. Referring to FIG. 1 , blind spot display device 100 includes server information acquisition section 101 , blind spot data receiving section 102 , and blind spot display section 103 . Next, the configuration of the blind spot display device 100 according to the first embodiment will be described in detail.

FIG. 2 is a diagram showing an example of a hardware configuration in which the blind spot display device 100 according to the first embodiment of the present disclosure is realized by a computer device 500 including a processor. As shown in FIG. 2 , the blind spot display device 100 includes memories such as a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, and a hard disk storing a program 504. It includes a device 505, a communication I/F (Interface) 508 for network connection, and an input/output interface 511 for inputting/outputting data. Blind spot display device 100 is also connected to input device 509 and output device 510 via bus 512 .

The CPU 501 operates the operating system and controls the entire blind spot display device 100 according to the first embodiment of the present invention. Also, the CPU 501 reads programs and data from a recording medium 506 mounted in a drive device 507 or the like to a memory. Further, the CPU 501 functions as part of the server information acquisition unit 101, the blind spot data receiving unit 102, and the blind spot display unit 103 in the first embodiment, and performs processing or processing in the flowchart shown in FIG. execute the command.

The recording medium 506 is, for example, an optical disk, a flexible disk, a magneto-optical disk, an external hard disk, or a semiconductor memory. A recording medium of a part of the storage device is a non-volatile storage device, in which programs are recorded. Alternatively, the program may be downloaded from an external computer (not shown) connected to a communication network.

The input device 509 is implemented by, for example, a mouse, keyboard, built-in key buttons, etc., and is used for input operations. The input device 509 is not limited to a mouse, keyboard, or built-in key buttons, and may be a touch panel, for example. Also, the input device 509 is realized by a photographing device such as a camera or a video camera, like the server information acquisition unit 101 in the first embodiment, detects the marks 1 around the road, and embeds the information into the marks 1. used to capture information The output device 510 is implemented by, for example, a display and used to confirm the output.

As described above, the first embodiment shown in FIG. 1 is implemented by the computer hardware shown in FIG. However, the implementation means of each unit included in the blind spot display device 100 of FIG. 1 is not limited to the configuration described above. In addition, the blind spot display device 100 may be realized by one device that is physically combined, or may be realized by two or more physically separated devices connected by wire or wirelessly. good. For example, input device 509 and output device 510 may be connected to computer device 500 via a network.

In FIG. 1, the server information acquisition unit 101 is, for example, a photographing device such as a camera or a video camera having sensitivity in the visible light region to the infrared region, and is a device mounted on a vehicle or a wearable device worn by the driver. installed in devices. The server information acquisition unit 101 detects a mark 1 near the road, such as a sign on or near the road, and reads and analyzes the mark 1 to obtain server information about the blind spot data embedded in the mark 1. to get The mark 1 is, for example, a barcode, two-dimensional code, AR (Augmented Reality), MR (Mixed Reality) code, or other three-dimensional code. This is the IP (internet protocol) address of the server 300 where the data is stored. The server 300 stores blind spot data relating to a road condition with a blind spot ahead of the mark 1 when viewed from the traveling direction of the own vehicle. The server information acquisition unit 101 outputs the acquired storage destination server information to the blind spot data reception unit 102 .

FIG. 3 is a diagram showing an example when the server information acquisition unit 101 according to this embodiment reads the marks 1 around the road with blind spots. FIG. 3A is an explanatory diagram for reading the mark 1 near the intersection. As shown in FIG. 3A, at an intersection, the area B1 is a blind spot, and the driver cannot confirm the presence of a vehicle stopped in the area B1 or a pedestrian crossing the pedestrian crossing. Mark 1 is, for example, near the display of a pedestrian crossing drawn on the road, and when a camera installed in front of the vehicle detects Mark 1, the camera detects the storage destination server information embedded in Mark 1. to get FIG. 3B is an explanatory diagram when reading the mark 1 near the curve. As shown in FIG. 3B, the area B2 is a blind spot before the curve, and the driver cannot confirm the presence of vehicles approaching from the opposite lane. Mark 1 is, for example, on a curve sign before a curve, and when the camera mounted on the smartphone carried by the driver detects Mark 1, the camera detects the storage destination server information embedded in Mark 1. to get If the camera has sensitivity in the infrared region, it is possible to detect the mark 1 and obtain the storage destination server information embedded in the mark 1 even if the surrounding road is dark at night or the like.

The blind spot data receiving unit 102 accesses the IP address or the like based on the blind spot data storage destination server information input from the blind spot data receiving unit 102 . Next, the blind spot data receiving unit 102 downloads and receives the blind spot data from the accessed server 300 . Blind spot data receiving unit 102 transmits the received data to blind spot display unit 103 . When the blind spot data includes image information, the blind spot data receiving unit 102 also transmits information about the position of the blind spot viewed from the traveling direction of the host vehicle to the blind spot display unit 103 .

Blind spot display unit 103 displays the blind spot data input from blind spot data receiving unit 102 . The blind spot display unit 103 is a display of a car navigation system of the own vehicle, a meter capable of digital display, a display audio, a windshield, a side mirror, a rearview mirror, and a display of a mobile terminal such as a driver's smartphone or tablet. The blind spot display unit 103 displays road condition information such as the shape of the road in a blind spot from the driver and the presence or absence of vehicles. When text information is input as blind spot data, the blind spot display unit 103 displays the text information indicating the existence of a blind spot and the presence or absence of a vehicle, or outputs a sound based on the input text information. When blind spot data including image information is input as blind spot data, an image of road conditions in the blind spot area viewed from the traveling direction of the vehicle is displayed. When blind spot data including a three-dimensional image such as an AR or MR image is input as the blind spot data, the blind spot image is superimposed and displayed together with the surrounding image of the vehicle viewed from the traveling direction of the vehicle.

FIG. 4 is a diagram showing an example when the blind spot display unit 103 according to the present embodiment displays the blind spot image together with the peripheral image of the own vehicle. FIG. 4A is an example of displaying a blind spot image together with an image near the intersection in FIG. 3A. As shown in FIG. 4A, at the intersection in FIG. 3A, the motorcycle stopped on the road on the right side of the driver is a blind spot of the building, and the driver cannot see the motorcycle. In addition, the vehicle and the pedestrian present on the left side of the driver are blind spots of the building, and the driver cannot confirm the vehicle and the pedestrian. In this case, motorcycles, cars, and pedestrians hidden behind the left and right buildings are displayed together with the buildings in the direction in which they actually exist when viewed from the traveling direction of the own vehicle. In FIG. 4A, the motorcycles, cars, and pedestrians hidden behind the building may be three-dimensionally displayed in front so as to overlap the building. Alternatively, bikes, cars, and pedestrians hidden in the shadows of buildings may be displayed so as not to overlap the buildings, as long as the driver can easily confirm them.

FIG. 4B is an example of displaying a blind spot image together with an image near a curve that can be seen from the driver in FIG. 3B. As shown in FIG. 4B, before the curve in FIG. 3A, there is a blind spot in the tree at the edge of the curved road, and the driver cannot confirm the presence of a vehicle coming toward the vehicle from the opposite lane. In this case, the car that cannot be seen in the shadow of the tree is displayed in front of the tree. In FIG. 4B as well, the cars in the opposite lane may be three-dimensionally displayed so as to overlap the trees, or may be displayed so as not to overlap the trees.

The operation of the blind spot display device 100 configured as described above will be described with reference to the flowchart of FIG.

FIG. 5 is a flow chart showing an overview of the operation of the blind spot display device 100 in the first embodiment. Note that the processing according to this flowchart may be executed based on program control by the processor described above.

As shown in FIG. 5, first, the server information acquisition unit 101 acquires the server information on the blind spot data storage location embedded in the surrounding road mark 1, and outputs the information to the blind spot data reception unit 102 (step S101). .

Next, the blind spot data receiving unit 102 receives blind spot data from the server 300 based on the input storage destination server information, and outputs the blind spot data to the blind spot display unit 103 (step S102).

Next, the blind spot display unit 103 displays the input blind spot data (step S103).

With this, the blind spot display device 100 ends the blind spot data display operation.

Next, effects of the first embodiment of the present disclosure will be described. The blind spot display device 100 according to the present embodiment described above can provide a blind spot display device or the like that can display the situation of a road that is a blind spot without installing a device for data transmission around the blind spot road. The reason is that the server information acquisition unit 101 of the blind spot display device 100 acquires the storage destination server information by reading the marks 1 around the road, and receives the blind spot data from the server 300 based on the acquired storage destination server information. It is from.

In addition, in the first embodiment of the present disclosure, since the mark 1 around the blind spot road is read by a terminal or the like possessed by a vehicle traveling around the blind spot road or the driver, the location of the blind spot road near the vehicle and the direction of the vehicle are detected. Accurate blind spot data can be received and displayed without error. GPS (Global Positioning System) is one method of identifying the position and direction of travel of a vehicle, but GPS cannot accurately measure the position and orientation of a vehicle in mountains or tunnels, and cannot acquire accurate blind spot data. It was possible.

Further, in the first embodiment of the present disclosure, when blind spot data including a three-dimensional image such as an AR image or an MR image is input as blind spot data, the blind spot image is displayed together with the peripheral image of the vehicle. Therefore, the blind spot information can be communicated in a visually easy-to-grasp manner to the driver who needs to make a quick decision.

[Second embodiment]
Next, a second embodiment of the present disclosure will be described in detail with reference to the drawings. In the following, descriptions of contents overlapping with the above description will be omitted as long as the description of the present embodiment is not unclear.

FIG. 6 is a block diagram showing the configuration of the blind spot display system 10 according to the second embodiment of the present disclosure. Referring to FIG. 6, the blind spot display system 10 in this embodiment includes a blind spot imaging device 200 and a server 300 in addition to those of the first embodiment.

The blind spot photographing device 200 includes a photographing unit 201 for photographing blind spot data for storage in the server 300, a compressing unit 202 for compressing the photographed blind spot data for sending to the server 300, and transmitting the compressed blind spot data. A communication unit 203 is provided. In the blind spot photographing device 200, a photographing device such as a camera or a video camera preliminarily photographs the blind spot road area from the driver, and outputs the image to the compression processing unit 202 together with the location information of the blind spot road. The compression processing unit 202 compresses the captured blind spot data for delivery to the server 300 and outputs the captured blind spot data to the communication unit 203 every time the blind spot capturing device 200 captures an image of a road that is a blind spot. The communication unit 203 transmits the compressed blind spot data to the server 300 together with location information of the blind spot road.

The server 300 includes a storage unit 301 that stores blind spot data to be distributed to the blind spot display device 100 and a data processing unit 302 that processes the blind spot data stored in the storage unit 301 for privacy. The storage unit 301 accumulates and stores the blind spot data received from the communication unit 203 of the blind spot imaging device 200 for each road location of the blind spot data for a certain period of time. The data processing unit 302 has a function of applying a mosaic to the vehicle number and the face of a person in the image of the blind spot data stored in the storage unit 301 in order to protect privacy. Further, the data processing unit 302 has a function of displaying animations of people and vehicles and a function of converting them into avatars in order to protect privacy. The data processing unit 302 saves the processed blind spot data on the distribution unit 303 . When the IP address embedded in the mark 1 around the road is accessed, the server 300 distributes the processed blind spot data stored in the distributing part 303 to the blind spot data receiving part 102 that accessed the IP address. . Since the operations and functions of the server information acquisition unit 101, the blind spot data receiving unit 102, and the blind spot display unit 103 of the blind spot display device 100 in the second embodiment are the same as those in the first embodiment, detailed description will be omitted. .

As with the computer device shown in FIG. 2, each component in each embodiment of the present disclosure described above is realized not only by hardware, but also by a computer device and firmware based on program control. be able to.

Next, the operation of the blind spot display system 10 will be described with reference to the flowchart shown in FIG. Note that the processing according to this flowchart may also be executed based on the program control by the CPU described above.

FIG. 7 is a flow chart showing an overview of the blind spot data display operation in the blind spot display system 10 according to the second embodiment.

As shown in FIG. 7, the imaging unit 201 of the blind spot imaging device 200 first captures a blind spot image and outputs the blind spot data to the compression processing unit 202 (step S201).

Next, the compression processing unit 202 compresses the input blind spot data and outputs it to the communication unit 203 (step S202).

Next, the communication unit 203 transmits the input compressed blind spot data to the storage unit 301 of the server 300 (step S203).

Next, the data processing unit 302 of the server 300 performs privacy processing on the received blind spot data and outputs it to the distribution unit 303 (step S204).

Next, when the blind spot display device 100 reads the mark 1 and detects that the IP address of the server 300 is accessed, the distribution unit 303 distributes the privacy-processed blind spot data to the blind spot display device 100 (step S205).

Finally, the blind spot display device 100 displays the received blind spot data on the blind spot display section 103 (step S206). Note that the steps performed by the blind spot display device 100 until the blind spot data is displayed on the blind spot display unit 103 are the same as those in the first embodiment, so the details are omitted.

With this, the blind spot display system 10 ends the blind spot image display operation.

Although the present invention has been described with reference to each embodiment, the present invention is not limited to the above embodiments. Various changes can be made to the configuration and details of the present invention within the scope of the present invention that can be understood by those skilled in the art.

For example, although the operations are described in order in the form of a flowchart, the order of description does not limit the order in which the operations are performed. Therefore, when implementing each embodiment, the order of the plurality of operations can be changed within a range that does not interfere with the content. In the second embodiment, the data processing unit 302 of the server 300 processes the blind spot data for privacy. good too.

Next, effects of the second embodiment of the present disclosure will be described. The blind spot display system 10 according to the second embodiment described above accumulates images for a certain period of time in the storage unit 301 of the server 300 . Therefore, in the second embodiment, it is possible to record the accidents and incidents in the blind spot, and to browse these records after the accident.

INDUSTRIAL APPLICABILITY The present disclosure can be applied to blind spot display devices and the like that can display road conditions that are blind spots.

1 mark 10 blind spot display system 100 blind spot display device 101 server information acquisition unit 102 blind spot data receiving unit 103 blind spot display unit 200 blind spot imaging device 201 imaging unit 202 compression processing unit 300 server 301 storage unit 302 data processing unit

Claims (9)

Server information acquisition means for acquiring server information about a blind spot data storage location embedded in a mark around a road with a blind spot;
Blind spot data receiving means for receiving the blind spot data from a server based on the storage destination server information;
blind spot display means for displaying the blind spot data received by the blind spot data receiving means;
including a blind spot indicator. 2. The blind spot display device according to claim 1, wherein said blind spot data receiving means receives blind spot data including a photographed image of said blind spot, and said blind spot display means displays a blind spot image based on said blind spot data. 3. The blind spot display device according to claim 2, wherein the blind spot display means displays the blind spot image in the direction in which the blind spot actually exists when viewed from the traveling direction of the vehicle based on the blind spot data. 4. The blind spot display device according to claim 2, wherein said blind spot display means superimposes and displays said blind spot image with a peripheral image of said vehicle based on said blind spot data. A blind spot display device according to any one of claims 1 to 4;
a server including storage means for storing blind spot data to be distributed to the blind spot display device; and data processing means for privacy-processing the blind spot data stored in the storage means;
Blind spot indication system with. 6. The system of claim 5, wherein
A blind spot display system, further comprising a blind spot imaging device that captures a blind spot image for storage in the server. 7. The blind spot display system according to claim 6, wherein said blind spot photographing device includes compression processing means for performing compression processing for sending said photographed blind spot image to said server. In a blind spot display method for displaying blind spot information on roads surrounding a vehicle,
Acquiring blind spot data storage destination server information related to the blind spot information embedded in the mark of the surrounding road;
receiving blind spot data from the server based on the storage destination server information;
A blind spot display method for displaying the received blind spot data. Acquiring server information for storing blind spot data related to the blind spot embedded in the marks around the road with the blind spot,
receiving the blind spot data from the storage destination server based on the storage destination server information;
A program that causes a computer to execute a process of displaying the blind spot data.

Images