WO2021161742A1

WO2021161742A1 - Traffic risk reduction system, information processing device, and sensor

Info

Publication number: WO2021161742A1
Application number: PCT/JP2021/001721
Authority: WO
Inventors: 裕太山内; 紘平瀬川; 隆之堀; 憲一海老沢; 寛樹中谷; 嘉生鎌倉
Original assignee: ソフトバンク株式会社
Priority date: 2020-02-10
Filing date: 2021-01-19
Publication date: 2021-08-19
Also published as: JP2021128387A; JP7038152B2

Abstract

An information processing device according to the present application has a determination unit and a provision unit. The determination unit determines information reported by a sensor to a moving body in the vicinity of the sensor, on the basis of an installation position of the sensor at which information can be reported to the moving body. The provision unit provides the information determined by the determination unit to the sensor.

Description

Traffic risk reduction system, information processing equipment and sensors

The present invention relates to a traffic risk reduction system, an information processing device and a sensor.

In recent years, with the development of autonomous driving technology, autonomous vehicles are becoming widespread. For example, a technique for changing the color of a moving body frame and a moving body prediction bar according to the degree of danger is known.

International Publication No. 2018/08824

However, with the above-mentioned conventional technology, it is not always possible to notify the moving body of appropriate notification contents according to the situation around the moving body. For example, in the above-mentioned prior art, the colors of the moving body frame and the moving body prediction bar are merely changed according to the degree of danger, and appropriate information or the like can be notified to the moving body in order to avoid an accident. Not always possible.

The present application has been made in view of the above, and provides a traffic risk reduction system, an information processing device, and a sensor capable of notifying a moving body of appropriate notification contents according to the surrounding conditions of the moving body. The purpose is to do.

The information processing device according to the present application includes a determination unit that determines information to be notified by the sensor to a moving body in the vicinity of the sensor based on the installation position of a sensor capable of transmitting information to the moving body, and the determination unit. It is characterized by having a providing unit that provides the information determined by the above sensor to the sensor.

According to one aspect of the embodiment, there is an effect that an appropriate notification content according to the situation around the moving body can be notified to the moving body.

FIG. 1 is a diagram showing an example of processing executed by the information processing apparatus 100 according to the embodiment. FIG. 2 is a diagram showing a configuration example of the information processing device according to the embodiment. FIG. 3 is a diagram showing an example of the position information storage unit according to the embodiment. FIG. 4 is a diagram showing an example of the surveillance camera image storage unit according to the embodiment. FIG. 5 is a diagram showing an example of the installation position storage unit according to the embodiment. FIG. 6 is a diagram showing a configuration example of the surveillance camera according to the embodiment. FIG. 7 is a diagram showing an example of a destination storage unit according to the embodiment. FIG. 8 is a flowchart showing an example of a flow of specific processing executed by the information processing apparatus according to the embodiment. FIG. 9 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device.

Hereinafter, a mode for implementing the traffic risk reduction system, the information processing device, and the sensor according to the present application (hereinafter, referred to as “form”) will be described in detail with reference to the drawings. The traffic risk reduction system, information processing device, and sensor according to the present application are not limited by this embodiment. In addition, each embodiment can be appropriately combined as long as the processing contents do not contradict each other. Further, in each of the following embodiments, the same parts are designated by the same reference numerals, and duplicate description is omitted.

[1. Idea background]
With the development of autonomous driving technology in recent years, autonomous vehicles are becoming widespread, but there is a point that the maintenance of the transportation system is not sufficient. For example, in the process in which autonomous vehicles are becoming widespread, there is a process in which autonomous vehicles and manual vehicles, which are vehicles driven by drivers, coexist. In this case, it is difficult to prevent a traffic accident caused by a manual vehicle even if only the autonomous vehicle travels according to the traffic rules. Therefore, it is necessary to control the self-driving car with high accuracy in consideration of the running of the manual car.

However, the driving technology of self-driving cars is not always sufficient. For example, an autonomous vehicle has a photographing device such as a camera, and by photographing the surroundings of the autonomous vehicle, the traveling is controlled based on the surrounding environment and the situation. In this case, the self-driving car may not be able to recognize the side environment and the situation when traveling at a predetermined speed or higher. For example, when the self-driving car travels at a high speed, the image of the camera that captures the side surface may flow, and other vehicles or objects may not be recognized. In this case, it becomes difficult for the self-driving car to acquire information from the side surface, so that the risk of a traffic accident from the side surface increases. In this way, the issue was how to obtain information from the side regarding the driving technology of the autonomous driving vehicle.

Therefore, in the present embodiment, a technology for supporting the running of an autonomous vehicle is provided. In the present embodiment, the information from the side of the autonomous driving vehicle is complemented by utilizing the information acquired from an external device such as a sensor. As a result, the present embodiment makes it possible to control the autonomous driving vehicle with high accuracy.

[2. An example of processing indicated by an information processing device]
An example of the processing executed by the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of processing executed by the information processing apparatus 100 according to the embodiment.

As shown in FIG. 1, the traffic risk reduction system 1 includes automobiles CA1, 11 and 12 (hereinafter, may be collectively referred to as automobile 10) and a plurality of surveillance cameras 21 to 24 (hereinafter, surveillance cameras 20). (May be generically referred to) and the information processing apparatus 100. The automobile 10, the surveillance camera 20, and the information processing device 100 are connected via a wireless network (not shown). The traffic risk reduction system 1 shown in FIG. 1 may include an arbitrary number of automobiles 10 and an arbitrary number of surveillance cameras 20. Further, the processes described below may be realized by executing each process in parallel or in cooperation with a plurality of information processing devices 100.

The automobile 10 according to the embodiment is a connected vehicle that communicates with various other devices via a wireless network. Further, the automobile 10 executes communication by an in-vehicle device such as a communication module incorporated in the automobile 10. For example, the in-vehicle device incorporated in each automobile 10 uses a GPS (Global Positioning System) sensor or the like to determine the current position of the in-vehicle device, that is, the current position of the automobile at predetermined intervals (for example, once or more per second). It has a function to detect, and more specific examples are a car navigation system, a drive recorder, and the like. Then, the in-vehicle device generates position information indicating the detected current position, and obtains such position information and an automobile ID (Identifier) for identifying the automobile 10 on which the in-vehicle device is mounted via a wireless network or the like. , The location information is transmitted to the location information providing device PIS (see, for example, FIG. 2) that manages the location information.

The surveillance camera 20 according to the embodiment is a surveillance camera having a function of being able to communicate with various other devices via a wireless network. For example, the surveillance camera 20 is fixedly installed on a traffic signal or a pillar to which a traffic signal is attached. In addition, the surveillance camera 20 constantly or at a predetermined time interval (for example, 30 times per second) acquires an image including a landscape or the like taken from a predetermined angle. Then, the surveillance camera 20 transmits the image captured by the surveillance camera to the surveillance camera image providing device FIS via a wireless network or the like.

Here, the surveillance camera 20 not only functions as a camera, but also uses various information processing, various communications via a network, and various communications using proximity communication technology such as wireless LAN and Bluetooth (registered trademark). It is a smart surveillance camera that has the function of performing. The surveillance camera 20 may be composed of, for example, a surveillance camera that captures a still image or a moving image, and a surveillance camera server for performing various communications via information processing and a network. Such a surveillance camera 20 has a function of directly or indirectly distributing various types of information using proximity communication technology. For example, the surveillance camera 20 has a function of notifying various information to the automobile 10 located in the vicinity.

The surveillance camera image providing device FIS according to the embodiment is realized by, for example, a server device or a cloud system. Specifically, the surveillance camera image providing device FIS constantly acquires an image taken by the surveillance camera 20 (hereinafter, referred to as a surveillance camera image). Then, the surveillance camera image providing device FIS receives an image acquisition request from the information processing device 100 and provides the surveillance camera image to the information processing device 100.

The information processing device 100 according to the embodiment is realized by, for example, a server device or a cloud system. Hereinafter, an example of the specific processing by the information processing apparatus 100 will be described along the flow with reference to FIG.

In the example of FIG. 1, a vehicle CA1 that is not a connected vehicle that runs dangerously (hereinafter, may be referred to as a non-connected vehicle CA1) and

vehicles

11 and 12 are traveling around an intersection. Then, it is assumed that the non-connected vehicle CA1 and the automobile 12 are likely to have a traffic accident from the surveillance camera image taken by the surveillance camera 20. For example, in the example shown in FIG. 1, the automobile CA1 meanders at a speed exceeding a predetermined speed, and as a result of invading the intersection SP1 due to ignoring a signal or the like, the automobile 12 and the automobile CA1 may collide with each other. do.

In this case, it is conceivable that the surveillance camera 20 alerts the

automobiles

11 and 12 regarding a traffic accident. However, when the same notification such as "Please stop" is given to the

automobiles

11 and 12 traveling near the intersection, not only the automobile 12 but also the automobile 11 traveling behind the automobile 12 is stopped. There is a risk of doing it. In such a case, another automobile traveling further behind the automobile 11 may collide with the automobile 11. Therefore, the information processing device 100 determines the information to be notified to the automobile 10 by each surveillance camera 20 according to the installation position of each surveillance camera 20, and provides the determined information to each surveillance camera 20.

First, as shown in FIG. 1, each surveillance camera 20 transmits the captured surveillance camera image to the surveillance camera image providing device FIS (step S1). Then, the information processing device 100 acquires the surveillance camera images taken by each surveillance camera 20 (step S2). Then, the information processing device 100 analyzes the image of the surveillance camera image and estimates the area where a traffic accident may occur as a dangerous area (step S3).

For example, in the information processing apparatus 100, the surveillance camera image captured by the surveillance camera 24 captures the vehicle CA1 traveling at a speed significantly exceeding the legal speed, and the surveillance camera image captured by the surveillance camera 23 captures the vehicle. When the automobile 12 located in the blind spot of the CA1 is photographed, it is estimated that there is a high possibility that the automobile CA1 and the automobile 12 will cause a traffic accident at the intersection SP1. Then, the information processing device 100 sets the intersection SP1 as the danger zone SP1. For such estimation processing, various estimation techniques for estimating the possibility of a future traffic accident from various images can be adopted.

In this way, when it is estimated that a traffic accident is likely to occur at the intersection SP1, the information processing device 100 notifies each surveillance camera 20 based on the distance from the danger zone SP1 to each surveillance camera 20. The information is determined (step S4). More specifically, as the information to be notified for each surveillance camera 20, the information processing device 100 includes information indicating the danger zone SP1, the time until the accident occurs, or the information indicating the action for avoiding the accident. Generate information that is one or a combination of these.

For example, the information processing device 100 provides information indicating the danger zone SP1 and the time until an accident occurs, such as "there is a risk of a traffic accident occurring at an intersection SP1 after X seconds" as information to be notified to the

surveillance cameras

22 and 23. Generate information that indicates. Further, the information processing device 100 generates information indicating an action for avoiding an accident such as "let's stop" as information to be notified to the surveillance camera 23 closest to the intersection SP1. Further, the information processing device 100 generates information different from that of the surveillance camera 23, such as "let's decelerate", as information to be notified to the surveillance camera 22 which is some distance from the intersection SP1.

Here, the information processing device 100 does not have to generate information for notifying the surveillance camera 21 whose distance from the intersection SP1 is longer than that of the surveillance camera 22. Further, for example, the information processing apparatus 100 may generate information for the surveillance camera 22 that does not include the time until an accident occurs, such as "there is a risk of an accident occurring at the intersection SP1". That is, the information processing device 100 performs information indicating the dangerous area SP1, the time until the accident occurs, or an action for avoiding the accident according to the distance from the intersection SP1 which is the dangerous area to each surveillance camera 20. Each of the indicated information is generated as information for notifying a message that has been changed as appropriate.

Then, the information processing device 100 provides each surveillance camera 20 with information of the content determined for each surveillance camera 20 (step S5). When such information is received, each surveillance camera 20 notifies the automobile 10 traveling in the vicinity of the information received from the information processing device 100.

For example, the surveillance camera 23 notifies the nearby automobile 12 of information such as "There is a risk of an accident occurring at an intersection after X seconds. Let's stop", and the surveillance camera 22 notifies the nearby automobile 11 "X seconds". Later, we will notify you of information such as "There is a risk of an accident at an intersection. Let's slow down." That is, each surveillance camera 20 notifies the nearby automobile 10 of different information according to the distance from the dangerous area.

In the above-mentioned example, for example, the surveillance camera 20 uses various proximity communication technologies to notify surrounding automobiles of information, but the embodiment is not limited to this. For example, the surveillance camera 20 may specify the automobile 10 to which the information is notified and notify the identified automobile 10 of the information by using various specific technologies described later.

Further, when the automobile 10 receives various notifications from the surveillance camera 20, the automobile 10 may receive an operation by the operator based on the notified information, and performs operation control such as automatically decelerating or stopping, for example. You may. Further, for example, the automobile 10 may travel by controlling the driving operation so as to move to a position away from the danger zone SP1.

As described above, the information processing device 100 according to the embodiment refers to the automobile 10 which is highly likely to be involved in a traffic accident with the non-connected vehicle CA1 which runs dangerously from the surveillance camera image taken by the surveillance camera 20. We will provide a solution for cases where you want to call attention to traffic accidents. Conventionally, the destination of the automobile 10 cannot be specified only by the surveillance camera image taken by the surveillance camera 20. In response to this problem, the information processing device 100 estimates a dangerous area where a traffic accident is likely to occur from the image taken by the surveillance camera 20, and each surveillance camera is determined according to the distance from the estimated dangerous area. Determine the information to be notified to 20. Then, the information processing device 100 provides the information determined for each surveillance camera 20 to each surveillance camera 20. As a result of such processing, the information processing apparatus 100 can change the content of the warning regarding the dangerous vehicle notified to the vehicle 10 according to the distance between the danger region SP1 and the surveillance camera 20.

As a result, the automobile 10 can perform various driving controls based on the information notified by the information processing device 100. For example, the automobile 10 is controlled to decelerate below a predetermined speed or to stop by gradually decelerating based on the information indicating the alert regarding the unconnected vehicle CA1 notified by the information processing device 100. It can be performed. As a result, the automobile 10 performs various driving controls according to various traffic conditions, dangerous situations, and the like, so that it is possible to realize more safe driving. Therefore, the automobile 10 can realize appropriate traveling based on the information notified by the information processing device 100 even when the side environment and the situation cannot be recognized.

[3. Information processing device configuration]
Next, the configuration of the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the information processing device 100 according to the embodiment. As shown in FIG. 2, the information processing device 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

(About communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 110 transmits / receives information between the surveillance camera 20, the surveillance camera image providing device FIS, and the position information providing device PIS via the wireless network. For example, in the example shown in FIG. 2, the position information providing device PIS has a position information storage unit PIM showing a history of position information indicating a position measured by an in-vehicle device of each automobile 10. Further, the surveillance camera image providing device FIS has a surveillance camera image storage unit FIM showing a history of images taken by each surveillance camera 20. The communication unit 110 may acquire the surveillance camera image registered in the surveillance camera image storage unit FIM, or may acquire the position information registered in the position information storage unit PIM.

In the example shown in FIG. 2, an example in which the surveillance camera image storage unit FIM and the position information storage unit PIM are provided outside the information processing device 100 has been described, but the embodiment is not limited to this. No. For example, the information processing device 100 may acquire the surveillance camera image storage unit FIM and the position information storage unit PIM from the surveillance camera image providing device FIS and the position information providing device PIS and store them in the storage unit 120.

(About location information storage PIM)
Subsequently, an example of the information registered in the position information storage unit PIM will be described. For example, FIG. 3 is a diagram showing an example of a position information storage unit according to an embodiment. In the example shown in FIG. 3, the position information storage unit PIM has items such as "moving body ID", "position information", and "time information".

The "mobile ID" is an identifier that identifies the automobile 10. The "position information" is the position information of the automobile 10 associated with the "moving body ID". The "time information" is information regarding the time of the position information acquired by the automobile ID associated with the "moving body ID".

For example, in the example shown in FIG. 3, the position information storage unit PIM is located at a position indicating the position information "LO1" at the time indicated by the time information "DA1" from the vehicle indicated by the mobile ID "MO1". Indicates that the location information to that effect has been acquired. In the example shown in FIG. 3, the position information is represented by an abstract code such as "LO1", but in reality, information indicating the latitude and longitude measured by GPS or the like is registered. Further, although the time information is represented by an abstract code such as "DA1", in reality, a numerical value or the like indicating the date and time is registered.

(About surveillance camera image storage FIM)
Subsequently, an example of the information registered in the surveillance camera image storage unit FIM will be described. FIG. 4 is a diagram showing an example of the surveillance camera image storage unit according to the embodiment. In the example shown in FIG. 4, the surveillance camera image storage unit FIM has items such as “camera ID”, “image”, and “time information”.

The "camera ID" is an identifier that identifies the surveillance camera 20. The "image" is an image associated with the "camera ID". The "time information" is information regarding the time of the image taken by the surveillance camera 20 associated with the "camera ID".

For example, in FIG. 4, it is registered in the surveillance camera image storage unit FIM that the image indicated by the image “FIM1” was taken by the surveillance camera 20 indicated by the camera ID “SC1” at the time indicated by the time information “DA1”. ing. In the example shown in FIG. 4, the surveillance camera image and the time information are represented by abstract codes such as "FIM1" and "DA1", but the surveillance camera image and the time information have a specific file format related to the image and the time information. , A numerical value indicating the date and time, or the like.

(About storage unit 120)
Returning to FIG. 2, the explanation will be continued. The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. The storage unit 120 has an installation position storage unit 121.

(About the installation position storage unit 121)
The installation position storage unit 121 according to the embodiment stores information indicating the position where each surveillance camera 20 is installed. For example, FIG. 5 is a diagram showing an example of information registered in the installation position storage unit 121 according to the embodiment. As shown in FIG. 5, the installation position storage unit 121 has items such as “camera ID” and “installation position information”. Here, the "installation position information" is information indicating the installation position of the surveillance camera indicated by the "camera ID".

For example, FIG. 5 shows that the installation position of the surveillance camera 20 indicated by the camera ID “SC1” is “SCP1”. In the example shown in FIG. 5, the installation position of the surveillance camera 20 is represented by an abstract code such as "SCP1", but in reality, the latitude and longitude indicating the installation position of the surveillance camera 20 are registered. It will be.

(About control unit 130)
Returning to FIG. 2, the explanation will be continued. The control unit 130 is a controller, and for example, various programs stored in a storage device inside the information processing device 100 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like store the RAM in a work area. It is realized by executing as. Further, the control unit 130 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 2, the control unit 130 includes an acquisition unit 131, an estimation unit 132, a determination unit 133, and a provision unit 134, and realizes or executes an information processing function or operation described below. .. The internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 2, and may be another configuration as long as it is a configuration for performing information processing described later. Further, the connection relationship of each processing unit included in the control unit 130 is not limited to the connection relationship shown in FIG. 2, and may be another connection relationship.

(About acquisition unit 131)
The acquisition unit 131 acquires various types of information. Specifically, the acquisition unit 131 acquires a surveillance camera image taken by the surveillance camera 20. To give a more specific example, the acquisition unit 131 acquires various surveillance camera images registered in the surveillance camera image storage unit FIM from the surveillance camera image providing device FIS.

(About estimation unit 132)
The estimation unit 132 refers to the surveillance camera image taken by the surveillance camera and estimates the dangerous area where an accident is likely to occur. Hereinafter, an example of the process of estimating the dangerous area will be described.

For example, when the estimation unit 132 acquires the surveillance camera image acquired from the surveillance camera image storage unit FIM, the estimation unit 132 detects a moving object such as a vehicle 10 included in the surveillance camera image. Here, the estimation unit 132 may detect a non-connected vehicle in addition to the connected vehicle. Then, the estimation unit 132 generates behavior information indicating the behavior of the detected moving body. For example, the estimation unit 132 estimates which route the moving body is traveling in what mode according to the installation position of each surveillance camera 20. In addition, the estimation unit 132 may estimate how a single moving body is traveling from the identity of the license plates of the automobiles photographed by a plurality of surveillance cameras. Further, the estimation unit 132 may estimate the moving speed of the moving body based on the installation position of the surveillance camera and the time zone in which each monitoring camera photographed the moving body. In addition to these, the estimation unit 132 may estimate the traveling mode of the moving body by using various arbitrary image analysis techniques.

Then, the estimation unit 132 estimates the dangerous area where an accident is likely to occur based on the behavior information of each moving body. For example, the estimation unit 132 sets a region in which the possibility of collision of the moving bodies exceeds a predetermined threshold value as a dangerous area when each moving body moves according to the behavior indicated by the behavior information. In addition, the estimation unit 132 estimates the time until an accident occurs from the behavior information of each moving body. Even if the estimation unit 132 estimates the color of the traffic light and the traffic jam situation from the surveillance camera image and adds the estimated color of the traffic light and the traffic jam information to estimate the region where the moving body is likely to collide. good.

Further, the estimation unit 132 uses, for example, the behavior information of the moving body that collided in a certain area, the traffic congestion situation in the surroundings until the collision occurs, the color of the traffic light, and the like as a positive example, and the behavior information of the moving body that did not collide. A model for estimating a dangerous area may be trained by letting a predetermined model learn the characteristics of the positive example and the negative example by taking the surrounding congestion situation, the color of a traffic light, and the like as negative examples. Then, the estimation unit 132 may estimate whether or not there is a high possibility that the moving body collides with each other in each region by using such a model. In addition to these, the estimation unit 132 may use various arbitrary methods to estimate the region where an accident is likely to occur.

(About decision unit 133)
When the danger area is estimated by the estimation unit 132, the determination unit 133 determines the information to be notified to each surveillance camera 20 based on the distance from the danger area to each surveillance camera 20. For example, the determination unit 133 refers to the installation position storage unit 121 and calculates the distance between the danger area estimated by the estimation unit 132 and each surveillance camera 20. Then, the determination unit 133 selects the surveillance camera 20 whose calculated distance is within a predetermined range as the information providing target. For example, the determination unit 133 may target a surveillance camera within a radius of 50 meters from the danger zone as an information providing target. Further, the determination unit 133 may select a surveillance camera to be provided with information according to the average speed of the vehicle at the installation position of the surveillance camera 20 and the moving direction.

Then, the determination unit 133 determines the information to be notified from the surveillance camera 20 targeted for information provision according to the distance between the surveillance camera 20 targeted for information provision and the dangerous area. For example, the determination unit 133 provides information indicating a dangerous area, a time until an accident can occur, information for causing the automobile 10 to avoid an accident, and the like according to the distance between the surveillance camera 20 and the dangerous area. Generate changed information. For example, the determination unit 133 changes "information for avoiding an accident" such as "stop", "decelerate", and "be careful" according to the distance from the dangerous area. May be good. Further, the determination unit 133 may change the information indicating the dangerous area and the time until an accident may occur according to the distance from the dangerous area.

(About the provider 134)
The providing unit 134 provides the information determined by the determining unit 133 to each surveillance camera 20. For example, the providing unit 134 provides the information determined by the determining unit 133 for each surveillance camera 20 to each surveillance camera 20.

[4. Surveillance camera configuration]
Next, the configuration of the surveillance camera 20 according to the embodiment will be described with reference to FIG. FIG. 6 is a diagram showing a configuration example of the surveillance camera according to the embodiment. As shown in FIG. 6, the surveillance camera 20 includes a communication unit 210, a storage unit 220, a camera 230, and a control unit 240.

(About communication unit 210)
The communication unit 210 is realized by, for example, a NIC or the like. Then, the communication unit 210 transmits / receives information between the information processing device 100, the surveillance camera image providing device FIS, and the position information providing device PIS via the wireless network. For example, the communication unit 210 transmits the surveillance camera image taken by the surveillance camera 20 to the surveillance camera image providing device FIS. In addition, the communication unit 210 acquires position information indicating the position of each automobile from the position information providing device PIS.

(About storage 220)
The storage unit 220 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. Further, in the example shown in FIG. 6, the storage unit 220 has a destination storage unit 221.

(About destination storage unit 221)
Here, FIG. 7 shows an example of the destination storage unit 221 according to the embodiment. FIG. 7 is a diagram showing an example of a destination storage unit according to the embodiment. In the example shown in FIG. 7, the destination storage unit 221 has items such as "vehicle ID" and "destination". The “destination” is a destination associated with the automobile 10, and is, for example, an e-mail address or the like.

For example, in FIG. 7, the destination storage unit 221 indicates that the destination of the automobile indicated by the automobile ID “MO1” is “AD1”. In FIG. 7, the destination is represented by an abstract code such as "AD1", but in reality, various information for indicating the notification destination such as an e-mail address and an IP address is registered.

(About camera 230)
Returning to FIG. 6, the description will be continued. The camera 230 is an imaging device for capturing an image. For example, the camera 230 is composed of an image sensor such as a CCD (Charged-coupled devices) sensor or a CMOS (Complementary metal-oxide-semiconductor) sensor. The camera 230 may be installed so as to capture a predetermined area at a predetermined angle, or may capture an image while appropriately moving the gazing point, for example. Further, in the example shown in FIG. 6, the camera 230 is mounted on the surveillance camera 20, but for example, the surveillance camera 20 includes a surveillance camera operating as the camera 230, a communication unit 210, a storage unit 220, and a storage unit 220. It may be configured by a surveillance camera server that operates as a control unit 240.

(About control unit 240)
The control unit 240 is a controller, and is realized by, for example, a CPU, an MPU, or the like executing various programs stored in a storage device inside the surveillance camera 20 using the RAM as a work area. Further, the control unit 240 is a controller, and is realized by, for example, an integrated circuit such as an ASIC or FPGA.

As shown in FIG. 6, the control unit 240 has a reception unit 241, a detection unit 242, a specific unit 243, and a notification unit 244, and realizes or executes an information processing function or operation described below. .. The internal configuration of the control unit 240 is not limited to the configuration shown in FIG. 6, and may be another configuration as long as it is a configuration for performing information processing described later. Further, the connection relationship of each processing unit included in the control unit 240 is not limited to the connection relationship shown in FIG. 6, and may be another connection relationship.

(About reception desk 241)
The reception unit 241 receives the information notified by the surveillance camera 20 which is the information determined by the information processing device 100 according to the installation position of the surveillance camera 20. For example, the reception unit 241 receives information such as "There is a risk of an accident occurring at an intersection after X seconds. Let's stop." In the following description, the information received by the reception unit 241 may be collectively referred to as "notification information".

(About detection unit 242 and specific unit 243)
The detection unit 242 detects a vehicle for which information is to be notified. For example, the detection unit 242 uses the camera 230 to capture a surveillance camera image. Then, the detection unit 242 transmits the captured surveillance camera image to the surveillance camera image providing device FIS.

Further, when the reception unit 241 receives the notification information, the detection unit 242 analyzes the image of the surveillance camera image and detects the vehicle to be notified. For example, the detection unit 242 may detect a vehicle photographed by a surveillance camera as a notification target. Further, for example, the detection unit 242 may acquire information indicating a dangerous area from the information processing device 100 and detect a vehicle moving in the direction of the acquired dangerous area as a notification target.

Here, the surveillance camera 20 may broadcast notification information to a moving object located nearby. On the other hand, when the distance from the moving body is large, the moving body may not be able to receive the notification information even if the notification information is broadcast. Therefore, the surveillance camera 20 uses the identification unit 243 to specify the destination of the automobile to be notified of the notification information.

The method of specifying such a destination will be described below. In the following description, the vehicle 10 photographed by the surveillance camera 20 and to be notified is described as the target vehicle. For example, the specific unit 243 estimates the position of the target vehicle by using the surveillance camera 20. Then, the identification unit 243 identifies the destination of the target vehicle by associating the vehicle 10 that has acquired the position information indicating the position corresponding to the estimated position with the target vehicle.

For example, it is assumed that the longitude and latitude corresponding to the four corners, the center, etc. of the angle of view of the surveillance camera 20 are known. In such a case, if the surveillance camera image captured by the surveillance camera 20 is divided into square-shaped sections, each section corresponds to an individual latitude and longitude range. As a result, it is presumed that the imaged object captured in the surveillance camera image captured by the surveillance camera 20 is located within the range of latitude and longitude corresponding to the section including the image in the surveillance camera image.

Therefore, the identification unit 243 identifies the section including the image of the target vehicle in the surveillance camera image, and estimates that the target vehicle is located in the range of latitude and longitude corresponding to the specified section. Then, the information processing device 100 specifies the position information indicating the position included in the range of latitude and longitude corresponding to the specified section, and the vehicle 10 equipped with the in-vehicle device that is the source of the specified position information and the target. Link with a car. Then, the identification unit 243 specifies the destination of the notification to the target vehicle by using the association result.

For example, the specific unit 243 estimates the range of latitude and longitude where the target vehicle is located from each section of the surveillance camera. Then, the identification unit 243 specifies the position information included in the range of the estimated latitude and longitude from the position information registered in the position information storage unit PIM. The specifying unit 243 may specify only the position information acquired within a predetermined period (for example, several seconds) from the processing time. Then, the specific unit 243 acquires the vehicle ID associated with the specified position information (that is, the vehicle ID of the vehicle 10 that is the source of the position information) from the position information storage unit PIM.

Subsequently, the identification unit 243 refers to the destination storage unit 221 and specifies the destination associated with the acquired vehicle ID. Then, the specific unit 243 notifies the notification unit 244 of the specified destination.

(About notification unit 244)
The notification unit 244 notifies the mobile body of the notification information received by the reception unit 241. For example, the notification unit 244 transmits the notification information received by the reception unit 241 to the destination received from the specific unit 243 via various networks. As a result of such processing, the notification unit 244 can transmit the notification information to the automobile 10 photographed by the surveillance camera.

[5. Processing procedure]
Next, the procedure of the specific processing executed by the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 8 is a flowchart showing an example of a flow of specific processing executed by the information processing apparatus 100 according to the embodiment.

As shown in FIG. 8, the information processing apparatus 100 acquires each surveillance camera image (step S101) and estimates the behavior of the moving object from the acquired surveillance camera image (step S102). Then, the information processing device 100 determines whether or not there is an area where a traffic accident is likely to occur, that is, a dangerous area (step S103). Here, the information processing apparatus 100 executes step S101 when the dangerous area does not exist (step S103: No).

On the other hand, when the dangerous area exists (step S103: Yes), the information processing device 100 determines different information according to the distance from the dangerous area as the information notified by each surveillance camera 20 (step S104). Then, the information processing device 100 notifies each surveillance camera 20 of the determined information (step S105).

[6. Modification example]
The information processing device 100 described above may be implemented in various different forms other than the above-described embodiment. Therefore, another embodiment of the information processing apparatus 100 will be described below.

[6-1. About decision processing based on proximity information of surveillance cameras]
In the above-described example, the information processing apparatus 100 determines the content of the information notified by each surveillance camera 20 according to the distance between the danger zone SP1 and each surveillance camera 20. However, the embodiment is not limited to this.

For example, the information processing device 100 may determine the content of the information notified by the surveillance camera 20 based on the information around the surveillance camera 20 in addition to the position information. For example, the information processing device 100 estimates the state of the road located in the vicinity of the surveillance camera 21 from the surveillance camera image taken by the surveillance camera 21. To give a specific example, the information processing device 100 estimates whether or not there is a traffic jam on a road located in the vicinity of the surveillance camera 21, the average moving speed of an automobile, and the like.

Then, for example, when the average moving speed of the automobile exceeds a predetermined threshold value or the number of lanes is equal to or less than a predetermined threshold value, the information processing device 100 causes an action for avoiding an accident to be performed early. Therefore, even if the distance between the surveillance camera 21 and the danger zone SP1 is equal to or greater than a predetermined distance, the notification information calling for the vehicle to make an emergency stop may be determined. Further, in the information processing device 100, for example, when a traffic jam occurs, the possibility that the automobile is involved in an accident is low, so that the distance between the surveillance camera 21 and the danger zone SP1 is equal to or less than a predetermined distance. Even so, notification information such as "There is a possibility of an accident in a traffic jam. Please be careful." May be decided.

In addition to the above-mentioned information, for example, the information processing device 100 includes the number of bicycles and pedestrians located around the surveillance camera 20, and the traffic rules around the surveillance camera 20 (for example, the upper limit of speed). , Notification information is provided based on the information located around the various surveillance cameras 20, such as whether or not there is a stopped vehicle, whether or not public transportation such as a bus is located, whether or not there is a store, and the status of the store. May be generated. The situation around the surveillance camera 21 may be estimated from, for example, the surveillance camera image taken by the surveillance camera 21, but another one located adjacent to the surveillance camera 21 or on the opposite side across the road. It may be estimated from the surveillance camera image taken by the surveillance camera 20 or the like, that is, the surveillance camera image taken by another surveillance camera 20, and is acquired by various sensors such as a Doppler sensor in addition to the surveillance camera image. It may be estimated from the information.

[6-2. About specifying the destination]
In the above-mentioned example, the surveillance camera 20 notifies the photographed automobile 10 of the notification information. Specifically, the surveillance camera 20 estimates the position where the target vehicle is located from the section of the surveillance camera image in which the image is captured, and identifies the vehicle 10 that is the source of the position information corresponding to the estimated position. , The notification information was transmitted with the specified destination of the vehicle 10 as the destination of the target vehicle.

However, the embodiment is not limited to this. The surveillance camera 20 may make a notification using a temporal destination instead of the permanent destination of the automobile 10 as described above. More specifically, the surveillance camera 20 gives a notification using a destination given according to the traveling mode of the automobile 10, such as the position and speed at which each automobile 10 travels, the traveling direction (direction), and the like. You may. For example, the surveillance camera 20 may notify the notification information by using the Destination Layer-2 ID of LTE (Long Term Evolution).

The destination identification process using the Destination Layer-2 ID will be explained. In such a specific process, for example, the road on which the automobile 10 travels is divided into a plurality of areas, and different Layer-2 IDs are assigned to each area in advance. For example, on the road photographed by the surveillance camera 21, Layer-2 ID "001" is assigned to the lane heading toward the danger zone SP1, and the road away from the danger zone SP1 on the road photographed by the surveillance camera 21. Layer-2 ID "002" is assigned to the lane heading in the direction.

Here, the Layer-2 ID is not only the road photographed by the surveillance camera 21 and the road located near the surveillance camera 21, but also the road not photographed by the surveillance camera 21 (road in the blind spot). It is also given to roads located away from the surveillance camera 21. That is, in the specific process using the Destination Layer-2 ID, a different Layer-2 ID is assigned to each combination of the area in which the vehicle 10 travels and the direction in which the vehicle 10 travels.

When such a Layer-2 ID is given, the in-vehicle device of each automobile 10 appropriately changes its own destination Layer-2 ID according to the traveling position. For example, the in-vehicle device of the automobile 10 traveling in the lane to which the Layer-2 ID "001" is assigned was broadcast to the Layer-2 ID "001" among the information broadcast to each automobile 10. Only the information is processed by the higher processing layer, and the information destined for other Layer-2 IDs is discarded. Further, the in-vehicle device of the automobile 10 traveling in the lane to which the Layer-2 ID "002" is assigned was broadcast to the Layer-2 ID "002" among the information broadcast to each automobile 10. Only the information is processed by the higher processing layer, and the information destined for another Layer-2 ID is discarded.

Therefore, when it is estimated that an accident occurs in the dangerous area SP1, the surveillance camera 21 identifies the Layer-2 ID of the vehicle heading for the dangerous area SP1. For example, the surveillance camera 21 identifies the Layer-2 ID "001" assigned to the lane heading toward the danger zone SP1. In addition to this, the surveillance camera 21 identifies the lane in which the vehicle heading for the danger zone SP1 travels and the Layer-2 ID assigned to the lane located within a predetermined range from the danger zone SP1. The surveillance camera 21 may change the distance between the lane to be notified and the danger zone SP1 according to the time until the accident occurs.

Then, the surveillance camera 21 broadcasts the notification information received from the information processing device 100 to the specified Layer-2 ID as the destination. As a result of such processing, the surveillance camera 21 transmits notification information to the automobiles 10 located within a predetermined range from the danger zone SP1 among the automobiles 10 and heading toward the danger zone SP1. can do.

Note that the surveillance camera 21 may specify a different destination according to the content of the event specified from the surveillance camera image. For example, the surveillance camera 21 has different Layer-2 IDs depending on whether it is estimated that the automobile CA1 and the automobile 12 collide with each other in the dangerous area SP1 and the automobile 11 and the bicycle collide with each other in the dangerous area SP1. May be selected as the destination. Further, the surveillance camera 21 may change the destination Layer-2 ID according to the time until the accident occurs, the traveling speed of the automobile 10 which is likely to be involved in the accident, and the like.

Further, the surveillance camera 21 may detect or estimate an arbitrary event by various image analysis techniques, and perform the above-described processing with the region where the detected or estimated event occurs as the danger region SP1. For example, when a fire is occurring in a building facing the road, the surveillance camera 21 sets the road facing the building facing the fire as the danger zone SP1 and travels in the direction toward the danger zone SP1. The automobile 10 may be notified of the notification information.

Further, the surveillance camera 21 may change the destination Layer-2 ID according to other information. For example, the in-vehicle device of each automobile 10 includes the size such as the size and weight of the automobile, the number and gender of the users actually riding, the attributes such as the age, the attributes of the automobile, the weather in the traveling area, and the surrounding pedestrians. Change the Layer-2 ID as appropriate according to various driving modes such as the presence or absence of. On the other hand, the surveillance camera 21 determines the traveling mode of the automobile 10 to be notified according to the content of the detected event and the area where the event has occurred, and may use the Layer-2 ID corresponding to the determined traveling mode as the destination. good.

When executing such a process, for example, the surveillance camera 21 holds a list associated with the Layer-2 ID according to the driving mode of the automobile 10 to be notified for each content of the event that can be detected. You just have to do it. Using such a list, the surveillance camera 21 becomes a notification destination according to the content of the detected event (for example, whether an accident occurs, a fire occurs, the speed or type of the vehicle involved in the accident, etc.). It is possible to specify a destination that fluctuates temporally, which is the destination of the automobile 10.

[6-3. Mobile]
In the above embodiment, the automobile has been described as an example, but the present invention may be applied to any moving body instead of the automobile. For example, the moving body is a bicycle, a drone, a bus, a train, or the like. Further, the moving body may be a vehicle in which a non-connected vehicle becomes a connected vehicle by mounting a communication device, an information processing device, or the like attached later, or an autonomous driving vehicle or the like. That is, the connected vehicle only needs to have a detection function for detecting the current position and a communication function for transmitting the detected position information indicating the current position to the information processing device 100, and realizes automatic driving. Whether or not it is a possible vehicle is a concept that does not matter.

[6-4. camera〕
In the above embodiment, the surveillance camera has been described as an example, but the surveillance camera may be any camera. For example, the camera may be a depth camera, an infrared camera, or the like. Further, the information processing device 100 may be, for example, an infrared sensor or various radio wave sensors, in addition to a camera that acquires an image in which various pixels or image regions correspond to positions in the real world. The information processing device 100 appropriately determines the notification information to be notified from the various sensors to each moving body according to the distance between the various sensors and the danger region SP1 to appropriately notify each moving body. can do.

Further, in the above-mentioned example, as the surveillance camera 20, a smart surveillance camera having various shooting functions and a function capable of performing various information processing and information notification has been described as an example. Here, the surveillance camera 20 may be realized by, for example, a small server device including a camera fixed to the roadside. That is, the process of "transmitting information by the surveillance camera 20" is a concept including transmission of information by the surveillance camera 20, a small server device linked with the surveillance camera 20, or a small server having a camera.

Further, in the above-described example, the surveillance camera 20 has notified the notification information received from the information processing device 100, but the embodiment is not limited to this. For example, the information processing device 100 estimates the danger area SP1 based on the surveillance camera image, and notifies each surveillance camera 20 of the estimated danger area SP1. In such a case, each surveillance camera 20 determines the notification information according to the positional relationship between the notified danger area SP1 and the position where the own device is installed, and notifies the vehicle 10 of the determined notification information. You may. When having such a function, the control unit 240 of the surveillance camera 20 further includes, for example, the determination unit 133 shown in FIG.

In this way, the surveillance camera 20 may autonomously determine the notification information in cooperation with the information processing device 100 and notify each vehicle of the determined information. Further, for example, the surveillance camera 20 may estimate the danger region SP1 from the surveillance camera image and notify the estimated danger region SP1 to another surveillance camera 20 in the same manner as the information processing device 100. In such a case, the surveillance camera 20 can determine and notify the notification information only by the surveillance camera 20 without having the information processing device 100.

[6-5. Notification information according to the positional relationship]
In the above-described example, the information processing device 100 and the surveillance camera 20 determine the notification information to be notified from the surveillance camera 20 according to the distance between the danger region SP1 and the surveillance camera 20. However, the embodiment is not limited to this.

For example, the information processing device 100 (and the surveillance camera 2, the same applies hereinafter) includes the number of intersections existing between the front of the surveillance camera 20 and the danger zone SP1, and the distance between the front of the surveillance camera 20 and the danger zone SP1. Notification according to the number of left or right turns at the intersection, the average travel time from the front of the surveillance camera 20 to the dangerous area SP1, the number of crosswalks existing from the front of the surveillance camera 20 to the dangerous area SP1, etc. Information may be determined. Further, the information processing device 100 determines the notification information according to whether or not there is a traffic jam between the front of the surveillance camera 20 and the dangerous area SP1, the average traffic volume, the number of pedestrians, and the like. You may.

Further, the information processing device 100 determines whether or not the surveillance camera 20 is installed near the intersection, the shooting direction of the surveillance camera 20, the presence or absence of bicycles and the number of pedestrians in the vicinity of the surveillance camera 20, and the vicinity of the surveillance camera 20. Notification information may be determined according to the event or the like that occurred in. That is, the information processing device 100 may determine the notification information based on arbitrary information, at least as long as the notification information is determined according to the installation position of the sensor.
[6-6. In-vehicle device]
In the above embodiment, the vehicle-mounted device has been described as an example, but the vehicle-mounted device may be applied to any terminal device instead of the vehicle-mounted device. Specifically, the terminal device may be a terminal device or the like used by a user who accesses content such as a web page displayed on a browser or content for an application. For example, the terminal device may be a desktop PC (Personal Computer), a notebook PC, a tablet terminal, a mobile phone, a PDA (Personal Digital Assistant), a smart watch, a wearable device, or the like. ..

[6-7. location information〕
In the above embodiment, the in-vehicle device uses GPS to detect the current position. However, the embodiment is not limited to this. Although the in-vehicle device has been described by taking information as an example, it may be applied to any position information instead of GPS information. For example, the in-vehicle device may estimate or acquire the current position of the automobile 10 by using the position information of the base station communicating with the vehicle or the radio wave of WiFi (registered trademark) (Wireless Fidelity).

[6-8. Attributes of self-driving cars]
In the above embodiment, the surveillance camera 20 transmits the notification information to the various automobiles 10, but the acquisition process is not limited to the above. For example, it is assumed that the position information providing device PIS stores the attribute information related to the attributes of the automobile 10 and the GPS information in association with each other. In this case, the surveillance camera 20 may acquire the attribute information related to the attributes of the automobile 10 from the position information providing device PS together with the GPS information of the automobile 10.

For example, the surveillance camera 20 positions, as attribute information of the automobile 10, information on the type of vehicle, information on speed, information on the number of times of braking, information on driving operation, information on running time, information on the number of times of opening and closing the door, and the like. It may be acquired from the information providing device PIS. Then, the surveillance camera 20 links the target vehicle and the vehicle 10 based on the position of the target vehicle estimated from the image, the position indicated by the position information acquired from the vehicle 10, and the attribute information of the vehicle 10. You may.

For example, the surveillance camera 20 estimates the attributes related to the movement of the target vehicle from the image. Further, in another example, the surveillance camera 20 estimates the attribute of the target vehicle to which the notification information is transmitted from the detected event content. Then, in the information processing device 100, the estimated attribute and the attribute indicated by the attribute information of the automobile 10 match or are similar, and the position indicated by the position information of the target automobile and the position information acquired from the automobile 10 indicate. When the positions are the same or similar, the destination of the vehicle 10 may be the destination of the target vehicle.

[6-9. Emergency vehicle]
In the above embodiment, the information processing device 100 has described an example of a process of determining whether or not the non-connected vehicle CA1 is a vehicle having a high possibility of causing a traffic accident from an image, but the information processing device 100 is not limited to the above determination process. .. Specifically, the information processing device 100 may determine whether or not the non-connected vehicle CA1 included in the image is an emergency vehicle such as an ambulance.

For example, the information processing device 100 analyzes an image by a conventional technique such as image analysis to determine whether or not the unconnected vehicle CA1 included in the image is an emergency vehicle based on the vehicle type, license plate, vehicle outer shape, and the like. You may judge. In this way, the information processing apparatus 100 can determine the unconnected vehicle CA1 that is characteristic in various situations according to various situations.

Then, for example, when the ambulance carries a suddenly ill person and heads for the hospital, the information processing device 100 may cause each surveillance camera 20 to notify that the automobile 10 does not interfere with the ambulance. For example, the information processing device 100 may set the intersection through which the ambulance passes as the danger zone SP1 and determine the notification information to be notified from each surveillance camera 20 according to the positional relationship between the danger zone SP1 and each surveillance camera 20. ..

[6-10. Dangerous acts other than automobiles]
In the above embodiment, the information processing device 100 estimates the collision between the automobile 10 and the automobile CA1, but the embodiment is not limited to this. For example, the information processing device 100 identifies a bicycle, a child, an animal, or the like from an image acquired from the surveillance camera 20 by using a conventional technique such as image analysis. Further, the information processing device 100 identifies a vehicle in which a bicycle, a child, an animal, or the like is presumed to exist in the blind spot as a target vehicle from the image acquired from the surveillance camera 20. In such a case, the information processing device 100 estimates whether or not there is a risk of collision between the target vehicle and a bicycle, a child, an animal, or the like, and if there is a risk of collision, a position where there is a risk of collision. And the area may be the danger area SP1.

In this way, the information processing device 100 according to the embodiment causes the surveillance camera 20 to notify the automobile that may collide with various notification information even when a bicycle, a child, an animal, or the like jumps out. Can be done.

Conventionally, even if the automobile 10 has an in-vehicle camera, the bicycle, children, animals, etc. other than the automobile may enter a blind spot that cannot be grasped by the in-vehicle camera, and the in-vehicle camera may not be able to recognize the bicycle, children, animals, etc. rice field. In this case, if a bicycle, a child, an animal, or the like jumps out of the blind spot of the automobile 10, a traffic accident will be encountered. In response to this problem, the information processing device 100 can specify the destination of the target vehicle even when a bicycle, a child, an animal, or the like jumps out. As a result, the automobile 10 can prevent a traffic accident.

[6-11. Violating vehicle]
Further, the information processing device 100 may identify a vehicle that violates the stop prohibition based on the surveillance camera image taken by the surveillance camera 20, and may set the position or region of the specified vehicle as the danger region SP1. Further, the information processing device 100 may set the position or area of a taxi, an autonomous vehicle, a bus, or the like on which the user is getting on and off as the danger area SP1. In such a case, the information processing device 100 can reduce the possibility that another automobile 10 collides with the automobile 10 stopped on the road or a continuous billiard accident occurs.

Further, the information processing device 100 may provide the police or the like with information regarding a claim for a fine or the like for a vehicle that is a violation of the prohibition of parking after a predetermined period of time. For example, the information processing device 100 may provide information such as a license plate of a photographed automobile. Further, the information processing device 100 may store a flag in a predetermined storage unit, such as a dangerous vehicle that repeats the violation, in association with the vehicle ID of the vehicle that violates the stop prohibition.

Note that the above modification can be applied to a vehicle that violates any kind of vehicle instead of a vehicle that violates the parking prohibition. For example, the information processing device 100 identifies a vehicle that violates the overtaking prohibition based on the surveillance camera image taken by the surveillance camera 20. Further, the information processing device 100 may set the position or region of the specified automobile, which violates the overtaking prohibition, as the danger zone SP1.

[6-12. Notification content]
In the above embodiment, the surveillance camera 20 may notify any information. For example, the information processing device 100 uses the information processing device 100 as information notified from the surveillance camera 20 such as the license plate of a dangerous driving vehicle that may cause an accident, the type of vehicle, the outer shape of the vehicle, the color of the vehicle, and the like. Includes features, estimated vehicle speed, vehicle position information, and so on. Further, the notification information may include control information or the like for causing the notification destination automobile 10 to automatically drive to avoid an accident.

[6-13. Notification mode]
In the above embodiment, the surveillance camera 20 may transmit notification information in any mode. For example, the surveillance camera 20 may notify the notification information acquired only by the automobile 10, or may notify the passengers of the automobile 10 of the notification information in an understandable manner. Further, the information processing device 100 may have the surveillance camera 20 in the vicinity of the vehicle 10 which is a violation of the stop prohibition notify the vehicle 10 which is a violation of the stop prohibition to stop the violation of the stop prohibition. ..

[6-14. About the danger zone]
Here, the information processing device 100 may set an arbitrary position as a dangerous area. For example, the information processing device 100 determines whether or not the automobile 10 is a dangerous automobile based on whether or not the automobile 10 captured in the surveillance camera image satisfies a predetermined condition. For example, in the information processing device 100, when the photographed automobile 10 travels by a predetermined driving operation, travels at a speed equal to or higher than a predetermined threshold value, or violates a traffic rule more than a predetermined number of times. If it is at least one of them, it is determined that the vehicle is dangerous.

Note that the information processing device 100 may determine the automobile 10 as a dangerous automobile when the automobile 10 repeats meandering driving. That is, in the surveillance camera image acquired from the surveillance camera 20, the information processing device 100 has a predetermined driving operation in which the non-connected vehicle CA1 is likely to cause a traffic accident when the unconnected vehicle CA1 repeats meandering operation. The non-connected vehicle CA1 is determined to be a dangerous vehicle because the vehicle is traveling on the vehicle.

On the other hand, in the surveillance camera image acquired from the surveillance camera 20, the information processing device 100 is unlikely to cause a traffic accident when the non-connected vehicle CA1 is traveling in compliance with the traffic rules. Since the vehicle is traveling by a predetermined driving operation, the non-connected vehicle CA1 is not determined to be a dangerous vehicle.

Further, for example, when the non-connected vehicle CA1 is traveling at a speed equal to or higher than the legal speed in the surveillance camera image acquired from the surveillance camera 21, the information processing device 100 determines that the non-connected vehicle CA1 is a dangerous vehicle. When the unconnected vehicle CA1 is traveling at a speed lower than the legal speed, it is not necessary to determine the unconnected vehicle CA1 as a dangerous vehicle.

Further, for example, it is assumed that the license plate of the non-connected vehicle CA1 is specified by using the conventional technology such as image analysis technology for the surveillance camera image including the unconnected vehicle CA1. In this case, the information processing device 100 acquires a violation history of violating the traffic rule of the non-connected vehicle CA1 associated with the license plate, and if it violates the traffic rule more than a predetermined number of times, the non-connected vehicle CA1 may be determined as a dangerous vehicle. On the other hand, the information processing apparatus 100 does not have to determine the unconnected vehicle CA1 as a dangerous vehicle when the unconnected vehicle CA1 violates the traffic rule less than a predetermined number of times.

Further, the information processing device 100 may determine whether or not another vehicle different from the dangerous vehicle is likely to be involved in a traffic accident. For example, in the information processing device 100, the positional relationship between the surveillance camera 24 in which a dangerous vehicle is photographed and the surveillance camera 21 in which another vehicle 11 is photographed is known, and the distance between the surveillance camera 21 and the surveillance camera 24 is known. Is less than the prescribed distance. In this case, the information processing device 100 may determine that the dangerous vehicle and the vehicle 11 are less than a predetermined distance, so that the vehicle 11 is a target vehicle with a high possibility of being involved in a traffic accident.

The information processing device 100 involves a vehicle 10 whose image is included in the same surveillance camera image as the dangerous vehicle and another vehicle 10 photographed by the same surveillance camera 20 as the dangerous vehicle within a predetermined time in a traffic accident. It may be determined that the target vehicle has a high possibility. Further, the above-mentioned processing may be executed by, for example, the estimation unit 132 shown in FIG. 2, and for example, the information processing apparatus 100 further adds a functional configuration (for example, a determination unit) for performing the above-mentioned various determinations. You may have.

[7. Other embodiments]
In addition, other embodiments will be described. In the above-described embodiment, the surveillance camera 20 identifies the destination of the notification destination vehicle 10 by using the position information and the Layer-2 ID. In another embodiment, the surveillance camera 20 shows an example of a process of identifying the destination of the automobile 10 based on the license plate of the automobile 10 captured in the surveillance camera image.

In another embodiment, it is assumed that the license plate of the automobile 10 and the destination of the automobile 10 are associated and stored in the storage unit of the surveillance camera 20. In this case, the surveillance camera 20 identifies the license plate of the photographed automobile 10 by analyzing the license plate of the photographed automobile 10 by using a conventional technique such as image analysis when the automobile 10 having a high possibility of being involved in a traffic accident is photographed. do. Then, the surveillance camera 20 may specify the destination associated with the license plate of the specified automobile 10 from the storage unit and transmit the notification information to the specified destination.

As described above, the information processing device 100 according to the other embodiment is a solution for notifying various information from the surveillance camera image taken by the surveillance camera 20 to the automobile 10 to which the notification information is notified. Provide a method. For example, the information processing device 100 corresponds to the license plate when it is determined that the license plate of the automobile 10 identified by analyzing the surveillance camera image and the license plate of the automobile 10 stored in the storage unit match. The destination of the automobile 10 attached and stored is specified. Thereby, the information processing apparatus 100 can identify an appropriate moving body.

Further, the relationship between the embodiment and other embodiments will be described below. The surveillance camera 20 according to the embodiment exerts an advantageous effect when the license plate of the automobile 10 cannot be identified from the image due to the relationship between the surveillance camera 20 and the automobile 10. For example, the information processing device 100 according to the embodiment can change the content of the warning regarding the dangerous vehicle notified to the vehicle 10 according to the distance between the danger region SP1 and the surveillance camera 20. As described above, the information processing apparatus 100 according to the embodiment can notify the automobile 10 of suitable contents regarding the alerting via the surveillance camera 20 even when the license plate of the automobile 10 cannot be specified. That is, the information processing apparatus 100 according to the embodiment can provide information that supplements the processing performed by the information processing apparatus 100 according to the other embodiment.

[8. Hardware configuration]
Further, the in-vehicle device of the automobile 10 according to the above-described embodiment, the surveillance camera 20, the surveillance camera image providing device FIS, the position information providing device PIS, and the information processing device 100 are driven by, for example, a computer 1000 having a configuration as shown in FIG. It will be realized. Hereinafter, the information processing apparatus 100 will be described as an example. FIG. 9 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the information processing device 100. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, an HDD (Hard Disk Drive) 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F). ) Has 1700.

The CPU 1100 operates based on the program stored in the ROM 1300 or the HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores a program executed by the CPU 1100, data used by such a program, and the like. The communication interface 1500 receives data from another device via the network N and sends it to the CPU 1100, and the CPU 1100 transmits the data generated by the CPU 1100 via the network N to the other device.

The CPU 1100 controls an output device such as a display or a printer and an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. Further, the CPU 1100 outputs the data generated via the input / output interface 1600 to the output device.

The media interface 1700 reads the program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. And so on.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the function of the control unit 130 by executing the program loaded on the RAM 1200. Further, the data in the storage unit 120 is stored in the HDD 1400. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be acquired from another device via the network N.

[9. others〕
Further, among the processes described in the above-described embodiments and modifications, all or part of the processes described as being automatically performed may be manually performed, or may be described as being manually performed. It is also possible to automatically perform all or part of the processed processing by a known method. In addition, the processing procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically dispersed / physically distributed in any unit according to various loads and usage conditions. Can be integrated and configured. For example, the information processing device 100, the surveillance camera image providing device FIS, and the position information providing device PIS may be integrated into one information processing device. In this case, the information processing device acquires the position information from the automobile 10 and the image taken from the surveillance camera 20.

Further, the above-described embodiments and modifications can be appropriately combined as long as the processing contents do not contradict each other.

Also, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the providing unit can be read as a providing means or a providing circuit.

[10. effect〕
As described above, the information processing apparatus 100 according to the embodiment includes a determination unit 133 and a providing unit 134. The determination unit 133 determines the information that the sensor notifies the moving body in the vicinity of the sensor based on the installation position of the sensor that can notify the moving body of the information. The providing unit 134 provides the information determined by the determining unit 133 to the sensor.

As described above, the information processing apparatus 100 according to the embodiment provides the sensor with information that the sensor determined based on the installation position of the sensor capable of notifying the moving body notifies the moving body in the vicinity of the sensor. Therefore, it is possible to notify the moving body of appropriate notification contents according to the situation around the moving body.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 determines the information notified by the sensor for each sensor, and the providing unit 134 provides the information notified by the sensor for each sensor.

As a result, the information processing device 100 according to the embodiment determines the information to be notified by the sensor for each sensor, and provides the information to be notified by the sensor for each sensor. Notification contents can be notified to the moving body.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 determines the information to be notified by the sensor based on the distance from the position determined based on the information acquired by the other sensor to the sensor.

As a result, the information processing device 100 according to the embodiment determines the information to be notified by the sensor based on the distance from the position determined based on the information acquired by the other sensor to the sensor, and thus is around the moving body. It is possible to notify the moving body of the appropriate notification content according to the situation of.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 determines the information to be notified by the sensor as a predetermined position based on the distance from the position where an accident may occur to the sensor.

As a result, the information processing device 100 according to the embodiment determines the information notified by the sensor based on the distance from the position where an accident may occur to the sensor as a predetermined position, so that the information processing device 100 determines the information to be notified by the sensor. Appropriate notification contents can be notified to the moving body.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 uses the information that the sensor notifies the information indicating the position where the accident may occur.

As a result, the information processing device 100 according to the embodiment uses the information indicating the position where an accident can occur as the information notified by the sensor, and therefore provides the moving body with appropriate notification contents according to the surrounding conditions of the moving body. Can be notified.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 uses information indicating the time until an accident can occur as information notified by the sensor.

As a result, the information processing device 100 according to the embodiment uses the information indicating the time until an accident can occur as the information notified by the sensor, so that the moving body receives appropriate notification contents according to the situation around the moving body. Can be notified to.

Further, in the information processing device 100 according to the embodiment, the determination unit 133 uses the information that the sensor notifies the information for causing the moving body to avoid an accident.

As a result, the information processing device 100 according to the embodiment uses information for the sensor to notify the moving body of information for avoiding an accident, so that the moving body is provided with appropriate notification contents according to the surrounding conditions of the moving body. Can be notified.

Further, in the information processing device 100 according to the embodiment, the determination unit 133 determines the information to be notified by the sensor as a sensor based on the installation position of the sensor capable of notifying the information to the surrounding moving body.

As a result, the information processing device 100 according to the embodiment determines the information to be notified by the sensor based on the installation position of the sensor capable of notifying the information to the surrounding moving body as a sensor, so that the situation around the moving body is determined. It is possible to notify the moving body of the appropriate notification content according to the above.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 determines the information to be notified by the sensor based on the installation position of the sensor and the information in the vicinity of the sensor acquired by the sensor.

As a result, the information processing device 100 according to the embodiment determines the information to be notified by the sensor based on the installation position of the sensor and the information in the vicinity of the sensor acquired by the sensor. Appropriate notification contents can be notified to the moving body.

Further, in the information processing device 100 according to the embodiment, the determination unit 133 is a monitoring camera capable of photographing the surrounding situation as a sensor, and an installation position of the monitoring camera capable of notifying a moving body of predetermined information. Based on, the information to be notified by the surveillance camera is determined.

As a result, the information processing device 100 according to the embodiment is a surveillance camera capable of photographing the surrounding situation as a sensor, and is based on the installation position of the surveillance camera capable of notifying the moving body of predetermined information. Since the information to be notified by the surveillance camera is determined, it is possible to notify the moving body of appropriate notification contents according to the situation around the moving body.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 determines based on the distance from each surveillance camera from the position where an accident is predicted to occur from the image taken by any of the surveillance cameras. Each surveillance camera determines the information to be notified to surrounding moving objects.

As a result, in the information processing apparatus 100 according to the embodiment, each surveillance camera can be moved based on the distance from the position where an accident is predicted to occur from the image taken by any of the surveillance cameras to each surveillance camera. In order to determine the information to be notified to the surrounding moving body, it is possible to notify the moving body of the appropriate notification content according to the situation around the moving body.

Further, in the information processing device 100 according to the embodiment, the determination unit 133 uses the information notified by the surveillance camera as the surveillance camera based on the installation position of the surveillance camera that notifies the photographed moving body of predetermined information. To determine.

As a result, the information processing device 100 according to the embodiment determines the information to be notified by the surveillance camera as the surveillance camera based on the installation position of the surveillance camera that notifies the photographed moving body of predetermined information. , It is possible to notify the moving body of appropriate notification contents according to the surrounding situation of the moving body.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133 is a sensor for installing a sensor that notifies information to a moving body located in an area corresponding to the event when a predetermined event is detected. Determines the information that the sensor notifies based on.

As a result, the information processing device 100 according to the embodiment is based on the installation position of the sensor that notifies the moving body located in the area corresponding to the event when a predetermined event is detected as the sensor. Since the information to be notified by the sensor is determined, it is possible to notify the moving body of appropriate notification contents according to the situation around the moving body.

Further, in the information processing device 100 according to the embodiment, the determination unit 133 uses information to be notified by the sensor, which is different for each area where the moving body is located.

As a result, the information processing device 100 according to the embodiment uses information that is different for each region where the moving body is located as information to be notified by the sensor, so that the moving body receives appropriate notification content according to the situation around the moving body. Can be notified to.

Further, in the information processing apparatus 100 according to the embodiment, the determination unit 133, as a sensor, installs a sensor that notifies information to a moving body that is moving in a direction corresponding to the event in an area corresponding to the event. Determines the information that the sensor notifies based on.

As a result, the information processing apparatus 100 according to the embodiment, as a sensor, is based on the installation position of the sensor that notifies information to the moving body that is moving in the direction corresponding to the event in the area corresponding to the event. Since the information to be notified by the sensor is determined, it is possible to notify the moving body of appropriate notification contents according to the situation around the moving body.

Further, the sensor according to the embodiment has a detection unit 242, a reception unit 241 and a notification unit 244. The detection unit 242 detects predetermined information. The reception unit 241 receives the information to be notified from the information processing device 100 that determines the information to be notified to the sensor according to the installation position of the sensor. The notification unit 244 notifies the surrounding mobile body of the information received by the reception unit 241.

As described above, the sensor according to the embodiment receives the information to be notified from the information processing device 100 that determines the information to be notified to the sensor according to the installation position of the sensor, and the received information is transmitted to the surrounding moving body. Since the notification is made, it is possible to notify the moving body of appropriate notification contents according to the situation around the moving body.

Further, in the sensor according to the embodiment, when a predetermined event is detected, the notification unit 244 notifies the moving body located in the area corresponding to the event of the information received from the information processing device 100.

As described above, when a predetermined event is detected, the sensor according to the embodiment notifies the moving body located in the area corresponding to the event of the information received from the information processing device 100, so that the moving body. It is possible to notify the moving body of the appropriate notification content according to the surrounding situation of.

Further, in the sensor according to the embodiment, the notification unit 244 notifies different information for each area where the moving body is located.

As described above, since the sensor according to the embodiment notifies different information for each area where the moving body is located, it is possible to notify the moving body of appropriate notification contents according to the situation around the moving body. ..

Further, in the sensor according to the embodiment, the notification unit 244 notifies the moving body moving in the direction corresponding to the event in the area corresponding to the event.

As described above, since the sensor according to the embodiment notifies the moving body moving in the direction corresponding to the event in the area corresponding to the event, it is appropriate according to the situation around the moving body. The content of the notification can be notified to the moving body.

Further, in the sensor according to the embodiment, the notification unit 244 notifies different information for each direction in which the moving body is moving.

In this way, since the sensor according to the embodiment notifies different information for each direction in which the moving body is moving, it is necessary to notify the moving body of appropriate notification contents according to the situation around the moving body. Can be done.

Further, in the sensor according to the embodiment, the notification unit 244 notifies the information to the moving body located in the area corresponding to the event and the moving mode satisfies a predetermined condition.

As described above, the sensor according to the embodiment is a moving body located in the area corresponding to the event, and the information is notified to the moving body whose movement mode satisfies a predetermined condition. Therefore, the situation around the moving body. It is possible to notify the moving body of the appropriate notification content according to the above.

Further, the traffic risk reduction system 1 according to the embodiment includes an information processing device 100 and a sensor. The determination unit 133 of the information processing device 100 determines the information that the sensor notifies the moving body in the vicinity of the sensor based on the installation position of the sensor. The providing unit 134 of the information processing device 100 provides the information determined by the determining unit 133 to the sensor. The detection unit 242 of the sensor detects predetermined information. The reception unit 241 of the sensor receives information from the information processing device 100. The notification unit 244 of the sensor notifies the surrounding mobile body of the information received by the reception unit 241.

In this way, the traffic risk reduction system 1 according to the embodiment can notify the moving body of appropriate notification contents according to the situation around the moving body.

Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to practice the present invention in other improved forms.

N network 1 Traffic

risk reduction system

10, 11, 12

Automobiles

20, 21, 22, 23, 24 Surveillance camera 210 Communication unit 220 Storage unit 221 Destination storage unit 230 Camera 240 Control unit 241 Reception unit 242 Detection unit 243 Specific unit 244 Notification Unit 100 Information processing device 110 Communication unit 120 Storage unit 121 Installation position storage unit 130 Control unit 131 Acquisition unit 132 Estimating unit 133 Determining unit 134 Providing unit PIS Position information providing device PIM Position information storage unit FIS Surveillance camera Image providing device FIM Surveillance camera Image storage

Claims

A determination unit that determines the information that the sensor notifies the moving body in the vicinity of the sensor based on the installation position of the sensor that can notify the moving body.
An information processing device having a providing unit that provides information determined by the determining unit to the sensor.
The decision unit
For each sensor, determine the information to be notified by the sensor,
The providing part
The information processing device according to claim 1, wherein the information notified by the sensor is provided for each sensor.
The decision unit
The information processing apparatus according to claim 1, wherein the information to be notified by the sensor is determined based on the distance from the position determined based on the information acquired by the other sensor to the sensor.
The decision unit
The information processing apparatus according to claim 3, wherein the information processing device according to claim 3 is characterized in that the information to be notified by the sensor is determined based on the distance from the position where an accident can occur to the sensor as the position.
The decision unit
The information processing apparatus according to claim 4, wherein the information indicating the position where the accident can occur is the information notified by the sensor.
The decision unit
The information processing apparatus according to claim 4, wherein the information indicating the time until the accident can occur is the information notified by the sensor.
The decision unit
The information processing device according to claim 4, wherein the information for causing the moving body to avoid the accident is information notified by the sensor.
The decision unit
The information processing device according to claim 4, wherein the sensor determines the information to be notified by the sensor based on the installation position of the sensor capable of notifying the surrounding moving body of the information.
The decision unit
The information processing apparatus according to claim 1, wherein the information to be notified by the sensor is determined based on the installation position of the sensor and the information in the vicinity of the sensor acquired by the sensor.
The decision unit
As the sensor, it is a surveillance camera capable of photographing the surrounding situation, and the information to be notified by the surveillance camera is determined based on the installation position of the surveillance camera capable of notifying the moving body of predetermined information. The information processing apparatus according to claim 1.
The decision unit
Based on the distance to each surveillance camera from the position where an accident is predicted to occur from the image taken by one of the surveillance cameras, each surveillance camera determines the information to be notified to surrounding moving objects. The information processing apparatus according to claim 10.
The decision unit
The information according to claim 10, wherein as the surveillance camera, the information to be notified by the surveillance camera is determined based on the installation position of the surveillance camera that notifies the captured moving object of predetermined information. Processing equipment.
The decision unit
When a predetermined event is detected as the sensor, the information to be notified by the sensor is determined based on the installation position of the sensor that notifies the moving body located in the area corresponding to the event. The information processing apparatus according to claim 1.
The decision unit
The information processing device according to claim 13, wherein information different for each region where the moving body is located is used as information notified by the sensor.
The decision unit
As the sensor, the information to be notified by the sensor is determined based on the installation position of the sensor that notifies the moving body moving in the direction corresponding to the event in the area corresponding to the event. 13. The information processing apparatus according to claim 13.
The decision unit
The information processing device according to claim 15, wherein information different depending on the direction in which the moving body is moving is used as information notified by the sensor.
The decision unit
When a predetermined event is detected as the sensor, the sensor is installed at a position where a moving body located in an area corresponding to the event is notified of information to a moving body whose movement mode satisfies a predetermined condition. The information processing apparatus according to claim 13, wherein the information to be notified by the sensor is determined based on the information processing apparatus.
A detection unit that detects predetermined information, a reception unit that receives information to be notified from an information processing device that determines information to be notified to the sensor according to the installation position of the sensor, and a reception unit.
A sensor having a notification unit for notifying surrounding moving objects of information received by the reception unit.
The notification unit
The sensor according to claim 18, wherein when a predetermined event is detected, the moving body located in the area corresponding to the event is notified of the information received from the information processing apparatus.
The notification unit
The sensor according to claim 19, wherein different information is notified for each region where the moving body is located.
The notification unit
The sensor according to claim 19, wherein information is notified to a moving body moving in a direction corresponding to the event in a region corresponding to the event.
The notification unit
The sensor according to claim 21, wherein different information is notified for each direction in which the moving body is moving.
The notification unit
The sensor according to claim 19, wherein the sensor is located in a region corresponding to the event and notifies information to the moving body whose movement mode satisfies a predetermined condition.
It is a traffic risk reduction system that has an information processing device and a sensor.
The information processing device
A determination unit that determines information that the sensor notifies a moving body in the vicinity of the sensor based on the installation position of the sensor.
It has a providing unit that provides the information determined by the determining unit to the sensor, and has a providing unit.
The sensor is
A detection unit that detects predetermined information, a reception unit that receives information from the information processing device, and
A traffic risk reduction system characterized by having a notification unit that notifies surrounding moving objects of information received by the reception unit.