WO2021161741A1

WO2021161741A1 - Information processing device, method, and recording medium, and traffic risk reduction device

Info

Publication number: WO2021161741A1
Application number: PCT/JP2021/001719
Authority: WO
Inventors: 裕太山内; 紘平瀬川; 隆之堀; 憲一海老沢; 寛樹中谷; 嘉生鎌倉
Original assignee: ソフトバンク株式会社
Priority date: 2020-02-10
Filing date: 2021-01-19
Publication date: 2021-08-19
Also published as: JP7106588B2; JP2021128386A

Abstract

This information processing device of the present application has an association unit. The association unit executes an association process that associates a subject automobile included in an image captured by a surveillance camera with an automobile for which position information corresponding to the position of the subject automobile estimated based on that image has been acquired.

Description

Information processing equipment, methods and recording media, and traffic risk reduction equipment

The present invention relates to an information processing device, a method and a recording medium, and a traffic risk reducing device.

In recent years, with the development of autonomous driving technology, autonomous vehicles are becoming widespread. For example, when the preceding vehicle is identified based on the captured image by the camera, all the connected vehicles are ordered based on the position information included in the basic safety message, and the connected vehicles are ordered, the preceding vehicle is the connected vehicle. If it turns out, a technique for identifying the preceding vehicle is known based on the basic safety message sent from each remote vehicle.

Japanese Unexamined Patent Publication No. 2018-206395

However, with the above-mentioned conventional technique, it is not always possible to suitably identify a moving body. For example, in the above-mentioned prior art, when the connected vehicles are ordered, if the preceding vehicle is found to be the connected vehicle, the preceding vehicle is specified based on the basic safety message transmitted from each remote vehicle. It is not always possible to identify the vehicle for which information needs to be transmitted to avoid an accident.

The present application has been made in view of the above, and an object of the present application is to provide an information processing device, a method and a recording medium capable of preferably identifying a moving body, and a traffic risk reduction device.

The information processing device according to the present application links the target vehicle included in the image taken by the surveillance camera with the vehicle whose position information is acquired and the position of the target vehicle estimated based on the image. It is characterized by having a linking portion for executing processing.

According to one aspect of the embodiment, there is an effect that the moving body can be preferably specified.

FIG. 1 is a diagram showing an example of a linking process executed by the information processing apparatus according to the embodiment. FIG. 2 is a diagram showing a specific example of the linking process executed by the information processing apparatus according to the embodiment. FIG. 3 is a diagram showing a configuration example of the information processing device according to the embodiment. FIG. 4 is a diagram showing an example of an image information storage unit according to an embodiment. FIG. 5 is a diagram showing an example of the position information storage unit according to the embodiment. FIG. 6 is a diagram showing an example of a destination storage unit according to the embodiment. FIG. 7 is a flowchart showing an example of the flow of the linking process executed by the information processing apparatus according to the embodiment. FIG. 8 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device.

Hereinafter, the information processing apparatus, method and recording medium according to the present application, and the embodiment for implementing the traffic risk reduction apparatus (hereinafter referred to as "embodiment") will be described in detail with reference to the drawings. The information processing device, method and recording medium, and the traffic risk reduction device according to the present application are not limited by this embodiment. In addition, each embodiment can be appropriately combined as long as the processing contents do not contradict each other. Further, in each of the following embodiments, the same parts are designated by the same reference numerals, and duplicate description is omitted.

[1. Idea background]
With the development of autonomous driving technology in recent years, autonomous vehicles are becoming widespread, but there is a point that the maintenance of the transportation system is not sufficient. For example, in the process in which autonomous vehicles are becoming widespread, there is a process in which autonomous vehicles and manual vehicles, which are vehicles driven by drivers, coexist. In this case, it is difficult to prevent a traffic accident caused by a manual vehicle even if only the autonomous vehicle travels according to the traffic rules. Therefore, it is necessary to control the self-driving car with high accuracy in consideration of the running of the manual car.

However, the driving technology of self-driving cars is not always sufficient. For example, an autonomous vehicle has a photographing device such as a camera, and by photographing the surroundings of the autonomous vehicle, the traveling is controlled based on the surrounding environment and the situation. In this case, the self-driving car may not be able to recognize the side environment and the situation when traveling at a predetermined speed or higher. For example, when the self-driving car travels at a high speed, the image of the camera that captures the side surface may flow, and other vehicles or objects may not be recognized. In this case, it becomes difficult for the self-driving car to acquire information from the side surface, so that the risk of a traffic accident from the side surface increases. In this way, the issue was how to obtain information from the side regarding the driving technology of the autonomous driving vehicle.

Therefore, in the present embodiment, a technology for supporting the running of an autonomous vehicle is provided. In the present embodiment, the information from the side of the autonomous driving vehicle is complemented by utilizing the information acquired from an external device such as a surveillance camera. As a result, the present embodiment makes it possible to control the autonomous driving vehicle with high accuracy.

[2. An example of linking processing indicated by an information processing device]
An example of the linking process executed by the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of a linking process executed by the information processing apparatus 100 according to the embodiment.

As shown in FIG. 1, the information processing system 1 includes an automobile 10, a surveillance camera 20, an image information providing device IS, a position information providing device PS, and an information processing device 100. The automobile 10, the surveillance camera 20, the image information providing device IS, the position information providing device PS, and the information processing device 100 are connected via a wireless network (not shown). The information processing system 1 shown in FIG. 1 includes a plurality of automobiles 10, a plurality of surveillance cameras 20, a plurality of image information providing devices IS, a plurality of position information providing devices PS, and a plurality of units. Information processing device 100 may be included.

The automobile 10 according to the embodiment is a connected vehicle that communicates with various other devices via a wireless network. Further, the automobile 10 executes communication by an in-vehicle device such as a communication module incorporated in the automobile 10. For example, the in-vehicle device incorporated in each automobile 10 uses a GPS (Global Positioning System) sensor or the like to determine the current position of the in-vehicle device, that is, the current position of the automobile at predetermined intervals (for example, once or more per second). It has a function to detect, and more specific examples are a car navigation system, a drive recorder, and the like.

Then, the in-vehicle device generates position information indicating the detected current position, and obtains such position information and an automobile ID (Identifier) for identifying the automobile 10 on which the in-vehicle device is mounted via a wireless network or the like. It is transmitted to the position information providing device PS. In the following, each of the different automobiles will be referred to as an automobile 1N, and when the automobile 1N is not particularly distinguished, it will be referred to as an automobile 10.

The surveillance camera 20 according to the embodiment is a surveillance camera having a function of being able to communicate with various other devices via a wireless network. For example, the surveillance camera 20 is fixedly installed on a traffic signal or a pillar to which a traffic signal is attached. In addition, the surveillance camera 20 acquires an image including a landscape or the like taken from a predetermined angle. In the following, each of the different surveillance cameras will be referred to as a surveillance camera 2N, and when the surveillance camera 2N is not particularly distinguished, it will be referred to as a surveillance camera 20.

The image information providing device IS according to the embodiment is realized by, for example, a server device or a cloud system. Specifically, the image information providing device IS constantly acquires an image taken by the surveillance camera 20. Then, the image information providing device IS receives an image acquisition request from the information processing device 100 and provides the image to the information processing device 100.

The location information providing device PS according to the embodiment is realized by, for example, a server device or a cloud system. Specifically, the position information providing device PS acquires the position information and the vehicle ID at predetermined intervals from the vehicle-mounted device mounted on the vehicle 10. Then, the position information providing device PS provides the position information and the automobile ID to the information processing device 100 in response to the request from the information processing device 100.

The information processing device 100 according to the embodiment is realized by, for example, a server device or a cloud system. Specifically, the information processing device 100 associates the target vehicle included in the image taken by the surveillance camera with the vehicle in which the position of the target vehicle estimated based on the image and the corresponding position information have been acquired. Execute the linking process.

Hereinafter, an example of the linking process by the information processing apparatus 100 will be described along the flow with reference to FIG.

In the example of FIG. 1, a vehicle CA1 that is not a connected vehicle that travels dangerously (hereinafter, may be referred to as a non-connected vehicle CA1) and

vehicles

11 and 12 that are connected vehicles are located at an intersection. .. Further, it is assumed that the information processing device 100 manages the vehicle ID that identifies the

automobiles

11 and 12 in association with the contact information.

Here, as a result of analyzing the image taken by the surveillance camera 20, the non-connected vehicle CA1 is traveling significantly exceeding the legal speed, and there is a possibility that the non-connected vehicle CA1 collides with the automobile 11 and the automobile 12. Is presumed to be high. That is, in the example shown in FIG. 1, it is assumed that the surveillance cameras 20 have detected that the

automobiles

11 and 12 are likely to have a traffic accident.

In such a case, the surveillance camera 20 wants to alert the

automobiles

11 and 12 regarding a traffic accident, but the photographed automobile 10 is the

automobiles

11 and 12 only with the image taken by the surveillance camera 20. It is difficult to identify the existence and it is difficult to transmit. In other words, when a car 10 that is likely to be involved in an accident is reflected in the surveillance camera 20, even if you want to send some kind of alert to the car 10, you need to know the destination of the car 10. Is difficult. In response to this problem, in the present embodiment, the destination of the automobile 10 photographed by the surveillance camera 20 is specified by the following procedure.

First, as shown in FIG. 1, the information processing device 100 acquires images taken by the surveillance camera 21 and the surveillance camera 22 from the image information providing device IS, and also obtains GPS information of the

automobiles

11 and 12 and the like. The position information acquired from the in-vehicle device 10 is acquired from the position information providing device PS (step S1).

For example, in the example of FIG. 1, the information processing device 100 acquires an image taken by the surveillance camera 21 including the non-connected vehicle CA1 from the image information providing device IS. Further, in the example of FIG. 1, the information processing device 100 is an image taken by a surveillance camera 22 installed at a position opposite to the surveillance camera 21 across the intersection, and includes an automobile 11 and an automobile 12. Is acquired from the image information providing device IS. The information processing device 100 may acquire position information and images in any order.

Then, the information processing device 100 is an object estimated from the image based on the matching result between the position of the automobile 10 specified from the image taken by the surveillance camera 20 and the position indicated by the position information acquired from the in-vehicle device. The automobile and the automobile 10 are associated with each other so that the destination associated with the target automobile can be specified (step S2). The target vehicle referred to here refers to the vehicle 10 to be linked by the linking process.

Here, the linking process for linking the target vehicle estimated from the image and the vehicle 10 will be described with reference to FIG. FIG. 2 is a diagram showing a specific example of the linking process executed by the information processing apparatus 100 according to the embodiment. The process shown in FIG. 2 corresponds to step S2 shown in FIG.

In the example of FIG. 2, it is assumed that the longitude and latitude corresponding to the four corners, the center, and the like at the angle of view of the surveillance camera 22 are known. In such a case, if the image IM1 captured by the surveillance camera 22 is divided into square-shaped sections, each section of the image IM1 corresponds to an individual latitude and longitude range. As a result, it is presumed that the imaged object captured by the image IM1 captured by the surveillance camera 22 is located within the range of latitude and longitude corresponding to the section including the image in the image IM1. Therefore, the information processing device 100 identifies a section including the image of the target vehicle 11 in the image IM1, and estimates that the target vehicle 11 is located in the range of latitude and longitude corresponding to the specified section. Then, the information processing device 100 specifies position information indicating a position included in the range of latitude and longitude corresponding to the specified section, and the automobile 10 (for example, an automobile 10) equipped with an in-vehicle device that is a source of the specified position information. The automobile 11) and the target automobile 11 are linked. For example, the information processing device 100 assigns the vehicle ID of the vehicle 11 to the target vehicle 11. In FIG. 2, for the sake of simplicity, each section of the image IM1 is a square of the same size, but the screen of the surveillance camera 20 is actually divided so as to correspond to the latitude and longitude in the real world. In this case, each section does not always have the same size, and the shape of each section does not necessarily have a square shape, depending on the shooting angle of the surveillance camera 20 and the like.

Similarly, the information processing device 100 specifies a section including the target vehicle 12 in the image IM1, and sets the range of latitude and longitude corresponding to the specified section as the range where the target vehicle 12 is located. Then, the information processing device 100 specifies the position information indicating the position included in the latitude and longitude range where the target vehicle 12 is located, and the vehicle 12 equipped with the vehicle-mounted device that is the source of the specified position information. It is associated with the target vehicle 12. For example, the information processing device 100 assigns the vehicle ID of the vehicle 12 to the target vehicle 12.

Then, the information processing device 100 specifies the transmission destination for the

target vehicles

11 and 12 by using the association result. For example, the information processing device 100 identifies a vehicle ID assigned to the target vehicle 11 (that is, the vehicle ID of the vehicle 11 associated with the target vehicle 11). Then, the information processing device 100 specifies the destination associated with the specified vehicle ID as the destination of the target vehicle 11. Similarly, the information processing device 100 identifies the vehicle ID assigned to the target vehicle 12 (that is, the vehicle ID of the vehicle 12 associated with the target vehicle 12), and assigns a destination associated with the specified vehicle ID. It is specified as the destination of the target vehicle 12. As a result of such processing, the information processing apparatus 100 can specify an appropriate destination of information when transmitting information to the automobile 10 photographed by various surveillance cameras.

Return to Fig. 1 and continue the explanation. The information processing device 100 transmits the information of the alert regarding the unconnected vehicle CA1 to the associated automobiles 11 and 12 (step S3). As a result of such processing, the automobile 10 will perform various driving controls based on the transmitted information indicating the alert regarding the unconnected vehicle CA1. For example, the automobile 10 may be decelerated below a predetermined speed or may be stopped by gradually decelerating based on the information indicating the alert regarding the unconnected vehicle CA1.

Further, for example, the automobile 10 may travel so as to avoid the non-connected vehicle CA1 based on the information indicating the warning regarding the unconnected vehicle CA1. For example, the automobile 10 may travel by controlling the driving operation so as to move to a position away from the unconnected vehicle CA1.

As described above, the information processing device 100 according to the embodiment refers to the automobile 10 which is highly likely to be involved in a traffic accident with the non-connected vehicle CA1 which performs dangerous traveling from the image taken by the surveillance camera 20. Provide a solution when you want to call attention to a traffic accident. Conventionally, the destination of the automobile 10 cannot be specified only by the image taken by the surveillance camera 20. In response to this problem, the information processing device 100 was photographed by the surveillance camera 20 based on the matching result between the position estimated from the image captured by the surveillance camera 20 and the position acquired by the in-vehicle device of each automobile 10. The target vehicle and each actual vehicle 10 are linked. By performing such processing, the information processing apparatus 100 can specify the destination of the target vehicle and transmit, for example, danger information such as a traffic accident caused by the unconnected vehicle CA1 to the vehicle 10.

As a result of the above-mentioned processing, the automobile 10 can perform various driving controls based on the information transmitted by the information processing device 100. For example, the automobile 10 is controlled to decelerate below a predetermined speed or to stop by gradually decelerating based on the information indicating the alert regarding the unconnected vehicle CA1 transmitted by the information processing device 100. It can be performed. As a result, the automobile 10 performs various driving controls according to various traffic conditions, dangerous situations, and the like, so that it is possible to realize more safe driving. Therefore, the automobile 10 can realize appropriate traveling based on the information transmitted by the information processing device 100 even when the side environment and the situation cannot be recognized.

[3. Information processing device configuration]
Next, the configuration of the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the information processing device 100 according to the embodiment. As shown in FIG. 3, the information processing device 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

(About communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 110 transmits / receives information between the automobile 10, the surveillance camera 20, the image information providing device IS, and the position information providing device PS via the wireless network. More specifically, the communication unit 110 acquires the information registered in the image information storage unit ISM of the image information providing device IS and the information registered in the position information storage unit PSM of the position information providing device PS. do.

In the example shown in FIG. 3, an example in which the image information storage unit ISM and the position information storage unit PSM are provided outside the information processing apparatus 100 has been described, but the embodiment is not limited to this. .. For example, the information processing device 100 may acquire the image information storage unit ISM and the position information storage unit PSM from the image information providing device IS and the position information providing device PS and store them in the storage unit 120.

(About image information storage unit ISM)
Here, FIG. 4 shows an example of the image information storage unit ISM according to the embodiment. FIG. 4 is a diagram showing an example of an image information storage unit according to an embodiment. In the example shown in FIG. 4, the image information storage unit ISM has items such as "camera ID", "image", and "time information".

The "camera ID" is an identifier that identifies the surveillance camera 20. The "image" is an image associated with the "camera ID". The "time information" is information regarding the time of the image taken by the surveillance camera 20 associated with the "camera ID".

For example, in FIG. 4, the image of "SE1" identified by the camera ID is "IM1" and the time information is "DA1". In the example shown in FIG. 4, the image or the like is represented by an abstract code such as "IM1", but the image or the like may have a specific file format, a specific numerical value, or the like.

(About location information storage PSM)
Subsequently, FIG. 5 shows an example of the position information storage unit PSM according to the embodiment. FIG. 5 is a diagram showing an example of the position information storage unit according to the embodiment. In the example shown in FIG. 5, the position information storage unit PSM has items such as "vehicle ID", "position information", and "time information".

"Car ID" is an identifier that identifies the car 10. The "position information" is the position information of the automobile 10 associated with the "automobile ID". The "time information" is information regarding the time of the position information acquired by the vehicle ID associated with the "vehicle ID".

For example, in the example shown in FIG. 5, the position information storage unit PSM is located at a position indicating the position information "LO1" at the time indicated by the time information "DA1" from the automobile indicated by the automobile ID "MO1". Indicates that the location information of is acquired. In the example shown in FIG. 5, the position information and the like are represented by abstract codes such as "LO1", but in reality, the information indicating the latitude and longitude measured by GPS or the like and the date and time are displayed. The indicated numerical values are registered.

(About storage unit 120)
Returning to FIG. 3, the explanation will be continued. The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. The storage unit 120 has a destination storage unit 121.

(About the destination storage unit 121)
Here, FIG. 6 shows an example of the destination storage unit 121 according to the embodiment. FIG. 6 is a diagram showing an example of a destination storage unit according to the embodiment. In the example shown in FIG. 6, the destination storage unit 121 has items such as "vehicle ID" and "destination". The “destination” is a destination associated with the automobile 10, and is, for example, an e-mail address or the like.

For example, in FIG. 6, the destination storage unit 121 indicates that the destination of the automobile indicated by the automobile ID “MO1” is “AD1”. In FIG. 6, the destination is represented by an abstract code such as "AD1", but in reality, various information for indicating the destination such as an e-mail address and an IP address is registered.

(About control unit 130)
Returning to FIG. 3, the explanation will be continued. The control unit 130 is a controller, and for example, various programs (recorded on a recording medium) stored in a storage device inside the information processing device 100 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. (Corresponding to an example of the program to be executed) is realized by executing the RAM as a work area. Further, the control unit 130 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 3, the control unit 130 includes an acquisition unit 131, a determination unit 132, a linking unit 133, and a transmission unit 134, and realizes or executes an information processing function or operation described below. .. The internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 3, and may be another configuration as long as it is a configuration for performing information processing described later. Further, the connection relationship of each processing unit included in the control unit 130 is not limited to the connection relationship shown in FIG. 3, and may be another connection relationship.

(About acquisition unit 131)
The acquisition unit 131 acquires various types of information. Specifically, the acquisition unit 131 acquires the position information indicating the position of the automobile 10 acquired by the automobile 10 and the image of the automobile taken by the surveillance camera 20. To give a more specific example, the acquisition unit 131 acquires various information registered in the image information storage unit ISM from the image information providing device IS, and from the position information providing device PS to the position information storage unit PSM. Acquire various registered information.

For example, the acquisition unit 131 acquires an image taken by the surveillance camera 20 including the non-connected vehicle CA1 traveling at a speed significantly exceeding the legal speed from the image information providing device IS. Further, for example, the acquisition unit 131 acquires an image including the automobile 11 and the automobile 12 taken by the surveillance camera 20 from the image information providing device IS. Then, the acquisition unit 131 registers various acquired information in the storage unit 120.

(About judgment unit 132)
The determination unit 132 determines whether or not the vehicle 10 photographed by the surveillance camera 20 is a dangerous vehicle with a high possibility of causing a traffic accident. For example, when the determination unit 132 receives the image acquired from the image information storage unit ISM, the determination unit 132 determines whether the vehicle 10 is a dangerous vehicle based on whether or not the photographed vehicle 10 satisfies a predetermined condition. Judge whether or not.

For example, the determination unit 132 determines at least when the photographed automobile 10 travels by a predetermined driving operation, travels at a speed equal to or higher than a predetermined threshold value, or violates a traffic rule more than a predetermined number of times. If any one of them is used, it is determined that the vehicle is dangerous.

The determination unit 132 may determine the automobile 10 as a dangerous automobile when the automobile 10 repeats meandering driving. That is, in the image acquired from the surveillance camera 21, the determination unit 132 travels in a predetermined driving operation that is likely to cause a traffic accident when the non-connected vehicle CA1 repeats meandering operation. Therefore, the non-connected vehicle CA1 is determined to be a dangerous vehicle.

On the other hand, in the image acquired from the surveillance camera 21, the determination unit 132 determines that the non-connected vehicle CA1 is less likely to cause a traffic accident when the non-connected vehicle CA1 is traveling in compliance with the traffic rules. Since the vehicle is driven by operation, the non-connected vehicle CA1 is not determined to be a dangerous vehicle.

Further, for example, when the unconnected vehicle CA1 is traveling at a speed equal to or higher than the legal speed in the image acquired from the surveillance camera 21, the determination unit 132 determines the non-connected vehicle CA1 as a dangerous vehicle and determines that the non-connected vehicle CA1 is a dangerous vehicle. When the CA1 is traveling at a speed lower than the legal speed, it is not necessary to determine the unconnected vehicle CA1 as a dangerous vehicle.

Further, for example, it is assumed that the license plate of the non-connected vehicle CA1 is specified by using a conventional technique such as an image analysis technique for an image including the unconnected vehicle CA1. In this case, the determination unit 132 acquires the violation history of violating the traffic rule of the non-connected vehicle CA1 associated with the license plate, and if it violates the traffic rule more than a predetermined number of times, the non-connected vehicle CA1 May be determined as a dangerous vehicle. On the other hand, if the unconnected vehicle CA1 violates the traffic rule less than a predetermined number of times, the determination unit 132 may not determine the non-connected vehicle CA1 as a dangerous moving vehicle.

Further, the determination unit 132 determines whether or not the target vehicle included in the image is a vehicle that is likely to be involved in a traffic accident. For example, if the determination unit 132 determines that any of the automobiles 10 having an image included in the image is a dangerous moving object, the determination unit 132 is another automobile 10 having an image included in the image and may be involved in a traffic accident. The other expensive vehicle 10 is determined to be the target vehicle.

For example, the positional relationship between the surveillance camera 21 in which a dangerous vehicle is photographed and the surveillance camera 22 in which another vehicle 10 is photographed is known, and the distance between the surveillance camera 21 and the surveillance camera 22 is less than a predetermined distance. Suppose there is. In this case, the determination unit 132 determines that the dangerous vehicle and the vehicle 10 are less than a predetermined distance, so that the vehicle 10 whose image includes the image is a target vehicle with a high possibility of being involved in a traffic accident. In addition, the determination unit 132 may be involved in a traffic accident with a vehicle 10 whose image is included in the same image as the dangerous vehicle or another vehicle 10 photographed by the same surveillance camera 20 as the dangerous vehicle within a predetermined time. It may be determined that the vehicle is a high target vehicle.

(About the tying part 133)
The linking unit 133 executes a linking process of linking the target vehicle included in the image taken by the surveillance camera with the vehicle for which the position of the target vehicle estimated based on the image and the corresponding position information have been acquired. Specifically, the linking unit 133 sets the target vehicle and the vehicle 10 when the position information of the target vehicle estimated from the image and the position information acquired by the in-vehicle device of the vehicle 10 satisfy a predetermined condition. Link. Here, the predetermined condition is, for example, substantially the same.

For example, the above-mentioned predetermined conditions are various conditions as to whether or not the automobile photographed by the surveillance camera 20 and the automobile that is the source of the position information are regarded as the same automobile. For example, the linking portion 133 is included in the range of latitude and longitude corresponding to the automobile in which the image was taken in the image and the section in which the image was taken in the image (hereinafter, may be referred to as a range of positions). It may be associated with an automobile that is a source of position information indicating a position.

Note that the linking unit 133 may grasp in advance the correspondence between the range projected by the surveillance camera 20 and the range of positions in the real world. For example, the linking unit 133 estimates the position of the target vehicle in the real world based on the position of the portion corresponding to the target vehicle with respect to the entire image. Further, the linking unit 133 may grasp in advance the correspondence between the coordinates of the four corners or the coordinates of the center of the range projected by the surveillance camera 20 and the position in the real world. For example, the linking unit 133 estimates the position of the target vehicle in the real world based on the relative positional relationship between the coordinates and the portion corresponding to the target vehicle in the image. Further, when each section of the image is associated with, for example, the latitude and longitude corresponding to the center of each section instead of the range of the position, the linking part 133 may execute the following processing. For example, the linking unit 133 is a vehicle in which the image is taken in the image and a vehicle that is a source of position information indicating a position included in a predetermined range from the latitude and longitude corresponding to the section in which the image is taken. May be linked.

Hereinafter, the target vehicle is the vehicle 10 in which the image is taken. In this case, the linking portion 133 has the same latitude and longitude as the position information of the vehicle determined based on the position of the image of the target vehicle in the image and the position information acquired from the vehicle 11, or the latitude and longitude. When the difference between the two is equal to or less than a predetermined threshold, or the distance between the positions indicated by the position information is equal to or less than a predetermined threshold, the target vehicle and the vehicle 10 may be linked.

That is, the linking portion 133 estimates the identity of the automobile photographed in the image and each connected vehicle based on the position that can be estimated from the image and the position indicated by the GPS information, and is estimated to be the same. By linking the car and the connected vehicle, information can be transmitted to the car captured in the image.

Note that the linking unit 133 may be linked based on the same date and time when the surveillance camera 20 acquired the image and the date and time when the in-vehicle device acquired the position. For example, in the linking unit 133, the position of the target vehicle 11 estimated from the image and the position acquired by the vehicle-mounted device of the vehicle 11 are within a predetermined range, and the date and time when the image was taken and the vehicle-mounted device of the vehicle 11 When the date and time when the position is acquired falls within the same time (for example, within a few seconds), the target vehicle 11 and the vehicle 11 may be linked.

(About transmitter 134)
The transmission unit 134 transmits various information based on the association result. Specifically, the transmission unit 134 transmits information to be transmitted to the target vehicle to the vehicle associated with the target vehicle by the linking unit 133.

For example, the transmission unit 134 identifies the target vehicle to be transmitted from the image, and specifies the vehicle ID of the vehicle associated with the specified target vehicle. Then, the transmission unit 134 performs various transmissions with the destination associated with the specified vehicle ID as the destination of the target vehicle. For example, the transmission unit 134 may transmit information on the characteristics of the vehicle such as the color and shape of the vehicle that is a dangerous moving body and the name of the vehicle model. In addition, the transmission unit 134 may transmit information regarding the speed of the vehicle that is a dangerous moving object. Further, the transmission unit 134 may transmit the position of the vehicle which is a dangerous moving body estimated from the image.

For example, it is assumed that the linking unit 133 links the target vehicle 11 photographed in the image IM1 with the vehicle 11 identified by the vehicle ID "MO1". In such a case, the transmission unit 134 specifies the destination "AD1" of the vehicle 11 associated with the target vehicle 11 from the destination storage unit 121 as the destination of the target vehicle 11. Then, the transmission unit 134 performs various transmissions with the destination "AD1" as the destination of the target vehicle 11. For example, the transmission unit 134 transmits that the unconnected vehicle CA1 is a dangerous mobile body. As a result of such processing, the target vehicle 11 can perform various driving controls based on the information indicating the warning regarding the unconnected vehicle CA1 transmitted by the transmission unit 134.

[4. Processing procedure]
Next, the procedure of the linking process executed by the information processing apparatus 100 according to the embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example of the flow of the linking process executed by the information processing apparatus 100 according to the embodiment.

As shown in FIG. 7, the acquisition unit 131 acquires an image from the image information providing device IS and GPS information from the position information providing device PS (step S101). Then, the linking portion 133 is a target vehicle included in the image based on a matching result between the position of the vehicle 10 specified from the image taken by the surveillance camera 20 and the position indicated by the position information acquired from the in-vehicle device. It is associated with the automobile 10 (step S102). Then, the transmission unit 134 uses the destination of the automobile 10 as the destination of the target automobile to transmit the information for calling attention regarding the automobile CA1 (step S103).

[5. Modification example]
The information processing device 100 described above may be implemented in various different forms other than the above-described embodiment. Therefore, another embodiment of the information processing apparatus 100 will be described below.

[5-1. Mobile]
In the above embodiment, the automobile has been described as an example, but the present invention may be applied to any moving body instead of the automobile. For example, the moving body is a bicycle, a drone, a bus, a train, or the like. Further, the moving body may be a vehicle in which a non-connected vehicle becomes a connected vehicle by mounting a communication device, an information processing device, or the like attached later, or an autonomous driving vehicle or the like. That is, the connected vehicle only needs to have a detection function for detecting the current position and a communication function for transmitting the detected position information indicating the current position to the information processing device 100, and realizes automatic driving. Whether or not it is a possible vehicle is a concept that does not matter.

[5-2. Surveillance camera〕
In the above embodiment, the surveillance camera has been described as an example, but the surveillance camera may be any camera. For example, a surveillance camera is typically a camera installed outside the vehicle. For example, the surveillance camera may be a camera fixed to the roadside or a camera fixed to a building. Further, for example, the surveillance camera may be a camera mounted on a drone parked above the intersection. As described above, the surveillance camera in the present embodiment may be any camera as long as it can grasp the correspondence relationship between the image captured by the camera and the position information in the real world. Further, the camera may be a depth camera, an infrared camera, or the like. Further, the information processing device 100 is a distance to a target vehicle measured by, for example, an infrared sensor or various radio wave sensors, in addition to a camera that acquires an image in which various pixels and image regions correspond to positions in the real world. Then, the position of the target vehicle may be estimated from the position and orientation in which the sensor is installed, and the vehicle for which the GPS information corresponding to the estimated position has been acquired may be associated with the target vehicle.

[5-3. In-vehicle device]
In the above embodiment, the vehicle-mounted device has been described as an example, but the vehicle-mounted device may be applied to any terminal device instead of the vehicle-mounted device. Specifically, the terminal device may be a terminal device or the like used by a user who accesses content such as a web page displayed on a browser or content for an application. For example, the terminal device may be a desktop PC (Personal Computer), a notebook PC, a tablet terminal, a mobile phone, a PDA (Personal Digital Assistant), a smart watch, a wearable device, or the like. ..

[5-4. location information〕
In the above embodiment, the in-vehicle device uses GPS to detect the current position. However, the embodiment is not limited to this. Although the in-vehicle device has been described by taking information as an example, it may be applied to any position information instead of GPS information. For example, the in-vehicle device may estimate or acquire the current position of the automobile 10 by using the position information of the base station communicating with the vehicle or the radio wave of WiFi (registered trademark) (Wireless Fidelity).

[5-5. Acquisition process Attributes of self-driving cars]
In the above embodiment, the information processing device 100 has described an example of the acquisition process of acquiring the GPS information of the automobile 10 from the position information providing device PS, but the information processing device 100 is not limited to the above acquisition process. For example, it is assumed that the position information providing device PS stores the attribute information related to the attributes of the automobile 10 and the GPS information in association with each other. In this case, the information processing device 100 may acquire the attribute information related to the attributes of the automobile 10 from the position information providing device PS together with the GPS information of the automobile 10.

For example, the information processing device 100 provides, as attribute information of the automobile 10, information on the type of vehicle, information on speed, information on the number of times of braking, information on driving operation, information on running time, information on the number of times of opening and closing the door, and the like. It may be acquired from the position information providing device PS. Then, the information processing device 100 links the target vehicle and the vehicle 10 based on the position of the target vehicle estimated from the image, the position indicated by the position information acquired from the vehicle 10, and the attribute information of the vehicle 10. You may attach it.

For example, the information processing device 100 estimates the attributes related to the movement of the target vehicle from the image. Then, in the information processing device 100, the estimated attribute and the attribute indicated by the attribute information of the automobile 10 match or are similar, and the position indicated by the position information of the target automobile and the position information acquired from the automobile 10 indicate. When the positions are the same or similar, the target vehicle and the vehicle 10 may be linked. As a result, the information processing device 100 can perform the linking process with high accuracy.

[5-6. Judgment processing Emergency vehicle]
In the above embodiment, the information processing device 100 has described an example of the determination process for determining whether or not the non-connected vehicle CA1 is a vehicle having a high possibility of causing a traffic accident from the image, but the present invention is limited to the above determination process. Not done. Specifically, the information processing device 100 may determine whether or not the non-connected vehicle CA1 included in the image is an emergency vehicle such as an ambulance.

For example, the information processing device 100 analyzes an image by a conventional technique such as image analysis to determine whether or not the unconnected vehicle CA1 included in the image is an emergency vehicle based on the vehicle type, license plate, vehicle outer shape, and the like. You may judge. In this way, the information processing apparatus 100 can determine the unconnected vehicle CA1 that is characteristic in various situations according to various situations. Thereby, for example, when the ambulance carries a suddenly ill person and heads for the hospital, the information processing device 100 can perform transmission so that the automobile 10 does not interfere with the ambulance.

[5-7. Linking process (1) Multiple images]
In the above embodiment, the information processing device 100 links the target vehicle included in the image taken by the surveillance camera 20 with the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired. Although an example of the linking process for executing the linking process to be attached has been described, the present invention is not limited to the above-mentioned linking process. For example, the information processing apparatus 100 is estimated by combining information in which the first image is divided into sections corresponding to latitude and longitude and information in which the second image is divided into sections corresponding to latitude and longitude. If the latitude and longitude of the target vehicle and the GPS information acquired from the vehicle 10 satisfy a predetermined condition, the target vehicle and the vehicle 10 may be linked.

The specific processing will be described below. The information processing device 100 uses a conventional technique such as image analysis to identify a first target vehicle identified from an image acquired from the surveillance camera 21 and a second target vehicle identified from an image acquired from the surveillance camera 22. It is determined that the target vehicle is the same as the target vehicle. For example, the information processing device 100 relates to the characteristics of the target vehicle such as the license plate, the type of vehicle, the outer shape of the vehicle, and the color of the vehicle by performing image analysis of the images acquired from the surveillance camera 21 and the surveillance camera 22. Extract information. As a result, the information processing device 100 is identified from the first target vehicle identified from the image acquired from the surveillance camera 21 and the image acquired from the surveillance camera 22 based on the information regarding the characteristics of the target vehicle. It is determined that the second target vehicle is the same.

Then, when the image acquired from the surveillance camera 21 is divided into mass-shaped sections and each section of the image corresponds to an individual latitude and longitude range, the information processing device 100 acquires the image from the surveillance camera 21. The section including the image of the first target vehicle is specified in the image, and it is estimated that the first target vehicle is located in the range of latitude and longitude corresponding to the specified section.

Similarly, the information processing device 100 divides the image acquired from the surveillance camera 22 into mass-shaped sections, and when each section of the image corresponds to an individual latitude and longitude range, the information processing device 100 starts from the surveillance camera 22. The section including the image of the second target vehicle is specified in the acquired image, and it is estimated that the second target vehicle is located in the range of latitude and longitude corresponding to the specified section.

Further, the information processing device 100 has a range of latitude and longitude indicating the position of the first target vehicle specified from the image acquired from the surveillance camera 21, and a second specified from the image acquired from the surveillance camera 22. Corresponds to the range of latitude and longitude indicated by the position of the target vehicle. For example, when the range of each latitude and longitude is the same or similar, the information processing apparatus 100 sets the range of either latitude and longitude as the range of latitude and longitude indicated by the target vehicle.

Then, the information processing device 100 acquires the GPS information of the automobile 10. Then, the information processing device 100 specifies the position information indicating the position included in the latitude and longitude range of the target vehicle, and the vehicle 10 equipped with the in-vehicle device that is the source of the specified position information and the target vehicle. You may tie it.

As described above, the information processing apparatus 100 according to the embodiment provides information in which the first image is divided into sections corresponding to latitude and longitude and information in which the second image is divided into sections corresponding to latitude and longitude. Since the target vehicle and the vehicle are linked from the position information regarding the latitude and longitude of the target vehicle determined by the combination and the position information of the vehicle, the accuracy of the linking process can be improved.

[5-8. Linking processing (2) Dangerous acts other than automobiles]
In the above embodiment, the information processing device 100 links the target vehicle included in the image taken by the surveillance camera 20 with the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired. Although an example of the linking process for executing the linking process to be attached has been described, the present invention is not limited to the above-mentioned linking process. For example, it is assumed that the distance between the bicycle, the child, the animal, or the like and the target vehicle is less than a predetermined distance. In this case, the information processing device 100 identifies a bicycle, a child, an animal, or the like from an image acquired from the surveillance camera 21 by using a conventional technique such as image analysis. In this case, the information processing device 100 identifies a vehicle in which a bicycle, a child, an animal, or the like is presumed to exist in the blind spot from the image acquired from the surveillance camera 22 as the target vehicle, and is associated with the specified target vehicle. The destination of the vehicle 10 is specified as the destination of the target vehicle.

In this way, the information processing device 100 according to the embodiment can prevent a traffic accident by specifying the destination of the target vehicle even when a bicycle, a child, an animal, or the like jumps out. Conventionally, even if the automobile 10 has an in-vehicle camera, the bicycle, children, animals, etc. other than the automobile may enter a blind spot that cannot be grasped by the in-vehicle camera, and the in-vehicle camera may not be able to recognize the bicycle, children, animals, etc. rice field. In this case, if a bicycle, a child, an animal, or the like jumps out of the blind spot of the automobile 10, a traffic accident will be encountered. In response to this problem, the information processing device 100 can specify the destination of the target vehicle even when a bicycle, a child, an animal, or the like jumps out. As a result, the automobile 10 can prevent a traffic accident.

[5-9. Linking process (3) Violating vehicle]
In the above embodiment, the information processing device 100 links the target vehicle included in the image taken by the surveillance camera 20 with the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired. Although an example of the linking process for executing the linking process to be attached has been described, the present invention is not limited to the above-mentioned linking process. For example, the information processing device 100 identifies a vehicle that violates the stop prohibition based on an image taken by the surveillance camera 20. Further, the information processing device 100 targets the specified automobile 10 and is a vehicle that violates the stop prohibition, and by performing the above-mentioned linking process, the vehicle ID of the vehicle that violates the stop prohibition and the destination. May be specified.

Then, the information processing device 100 may provide information regarding a claim for a fine or the like to the police or the like after a predetermined period from the specified automobile ID. Further, the information processing device 100 may store a flag in a predetermined storage unit, such as a dangerous vehicle that repeats violations, in association with the specified vehicle ID. When performing such processing, the information processing apparatus 100 does not have to perform transmission using the association result.

Note that the above modification can be applied to a vehicle that violates any kind of vehicle instead of a vehicle that violates the parking prohibition. For example, the information processing device 100 identifies a vehicle that violates the overtaking prohibition based on an image taken by the surveillance camera 20. Further, the information processing device 100 identifies the vehicle ID and the destination of the specified vehicle that violates the overtaking prohibition by performing the linking process on the vehicle that violates the overtaking prohibition. May be good.

[5-10. Linking process (4) Linking process based on a predetermined landscape]
In the above embodiment, the information processing device 100 links the target vehicle included in the image taken by the surveillance camera 20 with the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired. Although an example of the linking process for executing the linking process to be attached has been described, the present invention is not limited to the above-mentioned linking process. Specifically, when the information processing apparatus 100 grasps the position of a predetermined landmark included in the image in the real world in advance, the relative of the landmark and the portion corresponding to the target vehicle in the image. The position of the target vehicle in the real world may be estimated based on the positional relationship. Further, the information processing apparatus 100 may link the target vehicle and the vehicle 10 when the estimated position of the target vehicle and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition.

For example, the information processing device 100 detects that the image includes the "AA tower". Then, when the information processing device 100 grasps the position information of the "AA tower" in the real world, it is based on the relative positional relationship between the "AA tower" and the portion corresponding to the target vehicle in the image. Then, the position of the target vehicle in the real world is estimated. As landmarks, for example, buildings, mountains or signs can be used.

[5-11. Linking process (5) Always linking]
In the above embodiment, when the target vehicle and the unconnected vehicle CA1 are less than a predetermined distance, the information processing device 100 determines the target vehicle in the image taken by the surveillance camera 20 and the position of the target vehicle based on the image. Although an example of the linking process for associating the automobile 10 from which the corresponding position information has been acquired has been described, the present invention is not limited to the above-mentioned linking process. For example, the information processing device 100 is not limited to the case where the target vehicle and the unconnected vehicle CA1 are less than a predetermined distance, and the latitude and longitude indicating the position of the target vehicle estimated from the image taken by the surveillance camera 20. The automobile 10 from which the GPS information included in the range has been acquired, the target automobile, and the automobile 10 may be always associated with each other. As a result, the information processing device 100 can quickly identify an appropriate destination in advance, so that it is possible to prevent a traffic accident or the like.

[5-12. Linking process (6) Using the appearance of the car]
In the above embodiment, the information processing device 100 links the target vehicle included in the image taken by the surveillance camera 20 with the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired. Although an example of the linking process for executing the linking process to be attached has been described, the present invention is not limited to the above-mentioned linking process. For example, in the example of FIG. 1, it is assumed that a plurality of automobiles (automobiles 11 and 12) are reflected in the angle of view of the surveillance camera 22. The car 11 is a car having a pink body (hereinafter, may be simply referred to as a pink car 11), and the car 12 is a car having a green body (hereinafter, simply referred to as a green car 12). In some cases). Further, it is assumed that only the pink car 11 is likely to be involved in an accident, and the green car 12 is unlikely to be involved in an accident. In this case, it is assumed that the information processing device 100 wants to selectively transmit information only to the pink automobile 11 among the plurality of automobiles (automobiles 11 and 12) reflected by the surveillance camera 22.

According to this modification, the information processing device 100 can access the appearance feature storage unit that stores the identifier of the car and the appearance feature of the car in association with each other. The information processing device 100 grasps in advance the range of position information in the real world corresponding to the range captured by the surveillance camera 20. The information processing device 100 searches for an automobile from the position information storage unit PSM using the range as a query. In the situation shown in FIG. 1, since two cars are shown in the angle of view of the surveillance camera 22, if the two cars are connected to each other, the identifiers of the two cars should be obtained as the search result. Is. Here, the information processing device 100 further searches the above-mentioned appearance feature storage unit by using the obtained identifiers of the two automobiles and the appearance feature of "pink" as a query. As a result, the information processing device 100 can obtain the identifier of the automobile 11 which exists at the angle of view of the surveillance camera 22 and is a pink car. The information processing device 100 may transmit warning information or the like to be transmitted to the pink automobile 11 to the destination corresponding to the identifier of the automobile 11.

As described above, according to the present modification, the information processing apparatus 100 identifies the target vehicle by using the appearance feature storage unit without further dividing the image captured by the surveillance camera 22. Alternatively, the destination can be obtained.

[5-13. Transmission process (1) Transmission content]
In the above embodiment, the information processing device 100 may transmit any information as information indicating a warning regarding the unconnected vehicle. For example, information indicating a warning regarding a non-connected vehicle includes the characteristics of the non-connected vehicle such as the license plate, the type of the vehicle, the outer shape of the vehicle, the color of the vehicle, the estimated operating speed of the unconnected vehicle, and the unconnected vehicle. Includes location information, etc. In addition, the information indicating the warning regarding the non-connected vehicle includes the control information regarding the traveling of the automobile 10. What kind of control information is transmitted to the automobile 10 is determined by analyzing the image captured by the surveillance camera 20.

[5-14. Transmission process (2) Transmission mode]
In the above embodiment, the mode of transmitting the information indicating the alert regarding the unconnected vehicle may be any mode. For example, the transmission mode may be a notification mode acquired only by the automobile 10. Further, the transmission mode may be a mode that can be understood by the driver of the automobile 10 and the passengers.

[5-15. Transmission processing (3) Violating vehicle]
In the above embodiment, the information processing apparatus 100 has described an example of a transmission process for transmitting information indicating a warning regarding a non-connected vehicle, but the information processing device 100 is not limited to the above transmission process. For example, the information processing device 100 stops the vehicle stop prohibition violation when the vehicle ID or the destination of the vehicle 10 which is the vehicle stop prohibition violation is specified by performing the linking process on the vehicle 10 which is the vehicle stop prohibition violation. You may send the content to that effect to the automobile 10.

Note that the above modification can be applied to the automobile 10 that violates any kind of violation instead of the automobile 10 that is a violation of the prohibition of stopping. For example, the information processing device 100 stops the overtaking prohibition violation when the automobile ID of the automobile 10 which is the overtaking prohibition violation and the destination are specified by performing the linking process on the automobile 10 which is the overtaking prohibition violation. You may send the content to that effect to the automobile 10.

[6. Other embodiments]
In addition, other embodiments will be described. In the above-described embodiment, the target vehicle included in the image taken by the surveillance camera 20 by the information processing device 100 and the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired are obtained. An example of the process of executing the linking process has been described. In another embodiment, the information processing device 100 (an example of a traffic risk reduction device) is based on the license plate of the vehicle 10 included in the image when the image includes the vehicle 10 which is likely to be involved in a traffic accident. An example of the process for identifying the automobile 10 will be shown.

In another embodiment, it is assumed that the license plate of the automobile 10 and the destination of the automobile 10 are associated and stored in the storage unit. In this case, when the image includes the automobile 10 that is likely to be involved in a traffic accident, the information processing device 100 identifies the automobile 10 based on the license plate of the automobile 10 included in the image.

For example, the information processing device 100 is a license plate of an automobile 10 identified by analyzing an image using a conventional technique such as image analysis when the image includes an automobile 10 having a high possibility of being involved in a traffic accident. And whether or not the license plate of the automobile 10 stored in the storage unit matches. Then, when it is determined that the license plate of the automobile 10 identified by analyzing the image and the license plate of the automobile 10 stored in the storage unit match, the information processing apparatus 100 is associated with the license plate. The destination of the automobile 10 to be stored is specified.

As described above, the information processing device 100 according to the other embodiment wants to call attention to the traffic accident to the automobile 10 which is highly likely to be involved in the traffic accident from the image taken by the surveillance camera 20. Provide a solution for the case. For example, the information processing device 100 is associated with the license plate when it is determined that the license plate of the automobile 10 identified by analyzing the image and the license plate of the automobile 10 stored in the storage unit match. The destination of the automobile 10 to be stored is specified. Thereby, the information processing apparatus 100 can identify an appropriate moving body.

Further, the relationship between the embodiment and other embodiments will be described below. The information processing device 100 according to the embodiment exerts an advantageous effect when the license plate of the automobile 10 cannot be identified from the image due to the angle relationship between the surveillance camera 20 and the automobile 10. For example, the information processing device 100 according to the embodiment can specify the destination of the target vehicle by associating the target vehicle specified from the image captured by the surveillance camera 20 with the vehicle 10. In this way, the information processing device 100 according to the embodiment can specify the destination of the automobile 10 even when the license plate of the automobile 10 cannot be specified. That is, the information processing apparatus 100 according to the embodiment can provide information that supplements the processing performed by the information processing apparatus 100 according to the other embodiment.

[7. Hardware configuration]
Further, the in-vehicle device of the automobile 10, the surveillance camera 20, the image information providing device IS, the position information providing device PS, and the information processing device 100 according to the above-described embodiment are realized by, for example, a computer 1000 having a configuration as shown in FIG. Will be done. Hereinafter, the information processing apparatus 100 will be described as an example. FIG. 8 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the information processing device 100. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, an HDD (Hard Disk Drive) 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F). ) Has 1700.

The CPU 1100 operates based on the program stored in the ROM 1300 or the HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores a program executed by the CPU 1100, data used by such a program, and the like. The communication interface 1500 receives data from another device via the network N and sends it to the CPU 1100, and the CPU 1100 transmits the data generated by the CPU 1100 via the network N to the other device.

The CPU 1100 controls an output device such as a display or a printer and an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. Further, the CPU 1100 outputs the data generated via the input / output interface 1600 to the output device.

The media interface 1700 reads the program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. And so on.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the function of the control unit 130 by executing the program loaded on the RAM 1200. Further, the data in the storage unit 120 is stored in the HDD 1400. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be acquired from another device via the network N.

[8. others〕
Further, among the processes described in the above-described embodiments and modifications, all or part of the processes described as being automatically performed may be manually performed, or may be described as being manually performed. It is also possible to automatically perform all or part of the processed processing by a known method. In addition, the processing procedure, specific name, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

Further, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically dispersed / physically distributed in any unit according to various loads and usage conditions. Can be integrated and configured. For example, the information processing device 100, the image information providing device IS, and the position information providing device PS may be integrated into one information processing device. In this case, the information processing device acquires the position information from the automobile 10 and the image taken from the surveillance camera 20.

Further, the above-described embodiments and modifications can be appropriately combined as long as the processing contents do not contradict each other.

Also, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the tying portion can be read as a tying means or a tying circuit.

[9. effect〕
As described above, the information processing apparatus 100 according to the embodiment has a linking portion 133. The linking unit 133 executes a linking process of linking the target vehicle included in the image taken by the surveillance camera with the vehicle for which the position of the target vehicle estimated based on the image and the corresponding position information have been acquired. ..

As described above, the information processing device 100 according to the embodiment includes the target vehicle included in the image taken by the surveillance camera and the vehicle from which the position information corresponding to the position of the target vehicle estimated based on the image is acquired. Since the linking process for linking is executed, an appropriate moving body can be identified.

Further, in the information processing device 100 according to the embodiment, when the position of the target vehicle estimated from the image and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, the linking unit 133 satisfies the target vehicle. And the car.

As a result, the information processing apparatus 100 according to the embodiment sets the target vehicle and the vehicle when the position of the target vehicle estimated from the image and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition. Since it is linked, an appropriate moving body can be identified.

Further, in the information processing apparatus 100 according to the embodiment, the linking portion 133 grasps the correspondence relationship between the range projected by the surveillance camera and the range of the position in the real world, and the position of the portion corresponding to the target vehicle with respect to the entire image. Based on, the position of the target vehicle in the real world is estimated, and if the estimated position of the target vehicle and the position indicated by the position information obtained from the vehicle satisfy a predetermined condition, the target vehicle and the vehicle are linked. wear.

As a result, the information processing apparatus 100 according to the embodiment grasps the correspondence relationship between the range projected by the surveillance camera and the range of the position in the real world, and is based on the position of the portion corresponding to the target vehicle with respect to the entire image. If the position of the target vehicle in the real world is estimated and the estimated position of the target vehicle and the position indicated by the position information obtained from the vehicle satisfy the predetermined conditions, it is appropriate to link the target vehicle and the vehicle. Can identify moving objects.

Further, in the information processing apparatus 100 according to the embodiment, the linking unit 133 grasps the correspondence between the predetermined coordinates of the image projected by the surveillance camera and the position in the real world, and the coordinates in the image and the target vehicle are used. The position of the target vehicle in the real world is estimated based on the relative positional relationship with the corresponding part, and the estimated position of the target vehicle and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition. If it meets the requirements, the target vehicle and the vehicle are linked.

As a result, the information processing apparatus 100 according to the embodiment grasps the correspondence between the predetermined coordinates of the image projected by the surveillance camera and the position in the real world, and the coordinates and the portion corresponding to the target vehicle in the image. The position of the target vehicle in the real world is estimated based on the relative positional relationship of the target vehicle, and if the estimated position of the target vehicle and the position indicated by the position information obtained from the vehicle satisfy a predetermined condition, Since the target vehicle and the vehicle are linked, an appropriate moving body can be identified.

Further, in the information processing apparatus 100 according to the embodiment, the linking unit 133 grasps the position of the landmark included in the image projected by the surveillance camera in the real world, and corresponds to the landmark and the target vehicle in the image. The position of the target vehicle in the real world is estimated based on the relative positional relationship with the portion to be used, and the estimated position of the target vehicle and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition. In that case, the target vehicle and the vehicle are linked.

As a result, the information processing apparatus 100 according to the embodiment grasps the position of the landmark included in the image projected by the surveillance camera in the real world, and the portion corresponding to the landmark and the target vehicle in the image. The position of the target vehicle in the real world is estimated based on the relative positional relationship, and if the estimated position of the target vehicle and the position indicated by the position information obtained from the vehicle satisfy a predetermined condition, the target is targeted. Since the car is linked to the car, an appropriate moving body can be identified.

Further, in the information processing apparatus 100 according to the embodiment, the linking unit 133 has the latitude and longitude of the target vehicle estimated by dividing the image into sections corresponding to the latitude and longitude, and the position information acquired from the vehicle. If the indicated position satisfies a predetermined condition, the target vehicle and the vehicle are linked.

As a result, the information processing apparatus 100 according to the embodiment has the latitude and longitude of the target vehicle estimated by dividing the image into sections corresponding to the latitude and longitude, and the position indicated by the position information acquired from the vehicle. When a predetermined condition is satisfied, the target vehicle and the vehicle are linked, so that an appropriate moving body can be specified.

Further, in the information processing apparatus 100 according to the embodiment, the linking unit 133 divides the first image into sections corresponding to latitude and longitude and the second image into sections corresponding to latitude and longitude. When the latitude and longitude of the target vehicle estimated by combining the information and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, the target vehicle and the vehicle are linked.

As a result, the information processing apparatus 100 according to the embodiment combines the information in which the first image is divided into sections corresponding to latitude and longitude and the information in which the second image is divided into sections corresponding to latitude and longitude. If the latitude and longitude of the target vehicle estimated by the above and the position indicated by the position information obtained from the vehicle satisfy the predetermined conditions, the target vehicle and the vehicle are linked, and an appropriate moving object is specified. can do.

Further, in the information processing device 100 according to the embodiment, the linking unit 133 executes the linking process for the target vehicle when the target vehicle included in the image is a vehicle having a high possibility of causing a traffic accident.

As a result, the information processing device 100 according to the embodiment executes the linking process for the target vehicle when the target vehicle included in the image is a vehicle with a high possibility of causing a traffic accident, so that it is an appropriate moving body. Can be identified.

Further, in the information processing device 100 according to the embodiment, the linking unit 133 can access the storage unit that stores the position information acquired from the automobile in association with the identifier of the automobile, and the target automobile included in the image is a traffic. When the rule is violated, the linking process is executed for the target vehicle, and the identifier of the vehicle linked to the target vehicle is associated with the information that the target vehicle violates the traffic rule to other memories. Remember in the club.

As a result, the information processing device 100 according to the embodiment can access the storage unit that stores the position information acquired from the automobile and the identifier of the automobile in association with each other, and the target automobile included in the image violates the traffic rule. In this case, since the linking process is executed for the target vehicle, an appropriate moving body can be specified.

Further, in the information processing device 100 according to the embodiment, the linking unit 133 executes the linking process for the target vehicle when the vehicle included in the image is a vehicle with a high possibility of being involved in a traffic accident.

As a result, the information processing device 100 according to the embodiment executes an association process with respect to the target vehicle when the vehicle included in the image is a vehicle with a high possibility of being involved in a traffic accident, and thus is an appropriate moving body. Can be identified.

Further, the information processing device 100 according to the embodiment further includes a transmission unit 134 that transmits information to be transmitted to the target vehicle to the vehicle associated with the target vehicle by the linking unit 133.

As a result, the information processing device 100 according to the embodiment transmits information to be transmitted to the target vehicle to the vehicle associated with the target vehicle, so that appropriate information can be transmitted to the moving body. can.

Further, in the information processing device 100 according to the embodiment, the transmission unit 134 can access the storage unit that stores the position information acquired from the automobile in association with the identifier of the automobile, and for the automobile associated with the target automobile. Then, the destination of the vehicle is acquired based on the identifier of the vehicle, and the information to be transmitted to the target vehicle is transmitted to the destination.

As a result, the information processing device 100 according to the embodiment should acquire the destination of the vehicle based on the identifier of the vehicle for the vehicle associated with the target vehicle, and transmit the destination to the target vehicle. Since the information is transmitted, appropriate information can be transmitted to the moving body.

Further, in the information processing device 100 according to the embodiment, the transmission unit 134 transmits information indicating a warning to the driver of the target vehicle to the vehicle.

As a result, the information processing device 100 according to the embodiment transmits information indicating a warning to the driver of the target vehicle to the vehicle, so that appropriate information can be transmitted to the moving body.

Further, in the information processing device 100 according to the embodiment, the transmission unit 134 transmits information including control information regarding driving with respect to the target vehicle.

As a result, the information processing device 100 according to the embodiment transmits information including control information regarding traveling to the target vehicle, so that appropriate information can be transmitted to the moving body.

Further, in the information processing device 100 according to the embodiment, the linking unit 133 can access the storage unit that stores the position information acquired from the automobile in association with the identifier of the automobile, and further, the appearance characteristics of the automobile. The appearance feature storage unit that stores the vehicle's identifier in association with the vehicle is accessible, and the linking unit 133 is the range of the position in the real world corresponding to the range captured by the surveillance camera, and the appearance of the target vehicle reflected by the surveillance camera. Using the above feature as a search query, the storage unit and the appearance feature storage unit are searched, the identifier of the vehicle corresponding to the query is acquired, the destination of the vehicle is acquired based on the vehicle identifier, and the target is applied to the destination. It further includes a transmission unit that transmits information to be transmitted to the automobile.

As a result, the information processing device 100 according to the embodiment can access the storage unit that stores the position information acquired from the automobile and the identifier of the automobile in association with each other, and further, the appearance features of the automobile and the identifier of the automobile. The appearance feature storage unit that stores in association with is accessible, and the linking section 133 stores the range of the position in the real world corresponding to the range captured by the surveillance camera and the appearance feature of the target vehicle reflected by the surveillance camera. As a search query, the storage unit and the appearance feature storage unit are searched, the identifier of the vehicle corresponding to the query is acquired, the destination of the vehicle is acquired based on the identifier of the vehicle, and the destination is the target vehicle. Since the information to be transmitted is transmitted, appropriate information can be transmitted to the moving body.

Further, the traffic risk reduction device according to the embodiment can access the storage unit that stores the license plate and the destination of the automobile provided with the license plate in association with each other, and the image taken by the surveillance camera can be used for a traffic accident. If a car that is likely to be involved is included, the license plate of the car is identified from the image, and the destination of the car equipped with the license plate is identified and identified by searching the storage unit based on the identified license plate. The information to be transmitted to the automobile is transmitted to the destination, and the information to be transmitted is the information determined by analyzing the image captured by the surveillance camera. In this way, the traffic risk reduction device according to the embodiment can identify an appropriate moving body.

Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to practice the present invention in other improved forms.

N Network 1

Information processing system

10, 11, 12

Automobiles

20, 21, 22 Surveillance camera 100 Information processing device 110 Communication unit 120 Storage unit 121 Destination storage unit 130 Control unit 131 Acquisition unit 132 Judgment unit 133 Linked unit 134 Transmission unit ISM image Information storage unit PSM location information storage unit

Claims

It is equipped with a linking unit that executes a linking process that links the target vehicle included in the image taken by the surveillance camera with the vehicle for which the position of the target vehicle estimated based on the image and the corresponding position information have been acquired. An information processing device characterized by this.
The tying part is
A claim characterized in that, when the position of the target vehicle estimated from the image and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, the target vehicle and the vehicle are associated with each other. The information processing apparatus according to 1.
The tying part is
The correspondence between the range projected by the surveillance camera and the range of the position in the real world is grasped, and the position of the target vehicle in the real world is estimated based on the position of the portion corresponding to the target vehicle with respect to the entire image. However, when the estimated position of the target vehicle and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, claim 2 is characterized in that the target vehicle and the vehicle are linked. The information processing device described.
The tying part is
The correspondence between the predetermined coordinates of the image projected by the surveillance camera and the position in the real world is grasped, and based on the relative positional relationship between the coordinates and the portion corresponding to the target vehicle in the image. , The position of the target vehicle in the real world is estimated, and when the estimated position of the target vehicle and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, the target vehicle and the vehicle The information processing apparatus according to claim 2, wherein the information processing apparatus is associated with.
The tying part is
The position of the landmark included in the image projected by the surveillance camera in the real world is grasped, and the relative positional relationship between the landmark and the portion corresponding to the target vehicle in the image is used. When the position of the target vehicle in the real world is estimated and the estimated position of the target vehicle and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, the target vehicle and the vehicle are linked. The information processing apparatus according to claim 2, wherein the information processing apparatus is attached.
The tying part is
If the latitude and longitude of the target vehicle estimated by dividing the image into sections corresponding to the latitude and longitude and the position indicated by the position information acquired from the vehicle satisfy a predetermined condition, the target vehicle is concerned. The information processing device according to claim 1, wherein the automobile and the automobile are associated with each other.
The tying part is
The latitude and longitude of the target vehicle estimated by combining the information in which the first image is divided into sections corresponding to latitude and longitude and the information in which the second image is divided into sections corresponding to latitude and longitude. The information processing device according to claim 6, wherein when the position indicated by the position information acquired from the automobile satisfies a predetermined condition, the target automobile and the automobile are associated with each other.
The tying part is
The information processing device according to claim 1, wherein when the target vehicle included in the image is a vehicle having a high possibility of causing a traffic accident, the linking process is executed for the target vehicle.
The tying part is
When the storage unit that stores the position information acquired from the vehicle and the identifier of the vehicle in association with each other is accessible and the target vehicle included in the image violates the traffic rules, the target vehicle A claim characterized in that the linking process is executed and the identifier of the vehicle associated with the target vehicle is associated with the information that the target vehicle violates the traffic rule and stored in another storage unit. Item 1. The information processing apparatus according to item 1.
The tying part is
The information processing device according to claim 1, wherein when the vehicle included in the image is a vehicle that is likely to be involved in a traffic accident, the linking process is executed for the target vehicle.
A transmission unit for transmitting information to be transmitted to the target vehicle is further provided to the vehicle linked to the target vehicle by the linking unit.
The information processing apparatus according to claim 1.
The transmitter
It is possible to access the storage unit that stores the position information acquired from the automobile in association with the identifier of the automobile, and for the automobile associated with the target automobile, the destination of the automobile is acquired based on the identifier of the automobile. Then, the information to be transmitted to the target vehicle is transmitted to the destination.
The information processing apparatus according to claim 11.
The transmitter
The information processing device according to claim 11, wherein information indicating an alert to the driver of the target automobile is transmitted to the automobile.
The transmitter
The information processing device according to claim 11, further comprising transmitting information including control information related to traveling with respect to the target vehicle.
The tying part is
It is possible to access the storage unit that stores the position information acquired from the automobile and the identifier of the automobile in association with each other, and further, in the appearance feature storage unit that stores the appearance feature of the automobile and the identifier of the automobile in association with each other. It is accessible and
The tying part is
The storage unit and the appearance feature storage unit are searched using the range of the position in the real world corresponding to the range projected by the surveillance camera and the appearance feature of the target vehicle reflected by the surveillance camera as a search query, and the query is made. Get the identifier of the corresponding car, get the destination of the car based on the identifier of the car,
A transmission unit for transmitting information to be transmitted to the target vehicle to the destination is further provided.
The information processing apparatus according to claim 1.
It is possible to access the storage unit that stores the license plate and the destination of the vehicle equipped with the license plate in association with each other.
If the image taken by the surveillance camera contains a vehicle that is likely to be involved in a traffic accident, identify the license plate of the vehicle from the image and search the storage unit based on the identified license plate. Identify the destination of the vehicle equipped with the license plate, and transmit the information to be transmitted to the vehicle to the specified destination.
The information to be transmitted is information determined by analyzing an image captured by the surveillance camera, which is a traffic risk reduction device.
The way the computer does
Includes a linking process that executes a linking process that links the target vehicle included in the image taken by the surveillance camera with the vehicle for which the position of the target vehicle estimated based on the image and the corresponding position information have been acquired. A method characterized by that.
A computer performs a linking procedure that executes a linking process that links the target vehicle included in the image taken by the surveillance camera with the vehicle for which the position of the target vehicle estimated based on the image and the corresponding position information have been acquired. A recording medium characterized by recording a program to be executed by a computer.