JP2021163462A - Information processing method, information processing apparatus, and program - Google Patents

Abstract

To provide an information processing method for detecting an accident by efficiently using appropriate data out of data acquired from a vehicle, an information processing apparatus, and a program.SOLUTION: An information processing method causes one or more information processing apparatuses 20 to execute: acquiring one or more pieces of data from devices mounted on vehicles 10A, 10B, 10C; determining probability of accident on the basis of at least one piece of data out of the one or more pieces of data; selecting data to be transmitted out of the one or more pieces of data in accordance with the determined accident probability; and outputting the selected data to be transmitted to the other information processing apparatus 30.SELECTED DRAWING: Figure 1

Description

Disclosure techniques relate to information processing methods, information processing devices, and programs.

Conventionally, a system for detecting a vehicle accident using an acceleration sensor is known (see, for example, Patent Document 1). Further, in recent years, the number of devices such as sensors and devices mounted on vehicles has increased, and the number of data that can be acquired from vehicles has increased.

Japanese Unexamined Patent Publication No. 2008-117423

However, when detecting a vehicle accident using the data acquired from the vehicle, the number of data acquired from each device mounted on the vehicle is enormous, and the center for detecting the accident collects all the data. , In order to analyze, a large capacity storage and an infrastructure equipped with a machine with high processing performance are required. Therefore, a new mechanism for efficiently using data for accident detection is required.

The disclosure technology was made in view of the circumstances described above, and an object of the disclosure technology is to provide a mechanism for detecting an accident by efficiently using appropriate data among the data acquired from the vehicle.

In the information processing method, which is one aspect of the disclosure technology, one or more information processing devices acquire one or more data from each device mounted on the vehicle, and at least one of the one or more data is obtained. Based on the data, the possibility of an accident is determined, and according to the determined possibility of an accident,
A process is executed in which data to be transmitted is selected from the one or a plurality of data, and the selected data to be transmitted is output to another information processing apparatus.

According to the disclosed technology, it is possible to detect an accident by efficiently using appropriate data among the data acquired from the vehicle.

It is a figure for demonstrating the outline of the accident detection system of this disclosure. It is a figure which shows an example of the structure of the vehicle in embodiment. It is a figure which shows an example of the configuration of the accident detection server in an embodiment. It is a figure which shows an example of the outline of the accident detection which concerns on embodiment. It is a figure which shows an example of the data acquired by the vehicle which concerns on embodiment. It is a figure which shows an example of the certainty degree which concerns on embodiment. It is a figure which shows the classification example of the certainty degree concerning embodiment. It is a figure which shows the classification example of the scale of the accident which concerns on embodiment. It is a figure which shows the classification example of the type of the accident which concerns on embodiment. It is a figure which shows an example of the classification determination information which concerns on embodiment. It is a figure which shows the relationship between the position of the sensor which concerns on embodiment, and the position of an accident. It is a flowchart which shows an example of the processing of the vehicle which concerns on embodiment. It is a flowchart which shows an example of the process of the accident detection server which concerns on embodiment.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. The same elements are designated by the same reference numerals, and duplicate description will be omitted.

<System overview>
FIG. 1 is a diagram for explaining an outline of the accident detection system 1 of the present disclosure. In the example shown in FIG. 1, in the accident detection system 1, each vehicle 10A, 10B, 10C, a first information processing device 20, and a second information processing device 30 are connected via a network N.

Each vehicle 10A, 10B, 10C is referred to as a vehicle 10 when not individually distinguished. Vehicle 1
0 is a vehicle that includes a two-wheeled vehicle, an autonomous traveling vehicle, and the like, and can communicate with other devices via the network N. The vehicle is not limited to a connected car and a vehicle equipped with a drive recorder, and may have a function of transmitting data related to the vehicle.

The vehicle 10 is equipped with various devices such as devices and sensors. The device is, for example, a device that is retrofitted to a vehicle or the like, and includes a recording device such as an acceleration sensor, a microphone, a drive recorder, and a camera. The sensor is, for example, a sensor that is pre-installed in a vehicle.
Includes sensors that sense millimeter waves, lidar, sonar, infrared, airbags, tire pressure, and more. Each device mounted on the vehicle directly uses the communication function to directly receive information (hereinafter, also referred to as device data) acquired by each device at any time or when a predetermined state occurs. Alternatively, it is indirectly transmitted to the first information processing device 20.

The first information processing device 20 is, for example, a server that detects an accident, and determines whether or not a vehicle accident has occurred by receiving data acquired from the vehicle. Hereinafter, the first information processing device 2
0 is also referred to as an accident detection server. When the accident detection server 20 detects an accident based on the data acquired from the vehicle, the accident detection server 20 notifies the second information processing device 30 of a report on the accident.

The second information processing device 30 is, for example, an operator terminal of an insurance company, and is an accident detection server 2.
When the report is acquired from 0, the subsequent processing is executed based on the report contents.

Network N is, for example, the Internet, LAN, leased line, telephone line, corporate network, mobile communication network, Bluetooth (registered trademark), WiFi (registered trademark) (Wirele).
ss Fidelity), other communication lines, combinations thereof, etc. may be used, regardless of whether they are wired or wireless.

<Vehicle configuration example>
FIG. 2 is a diagram showing an example of the configuration of the vehicle 10 in the embodiment. As shown in FIG.
The vehicle 10 includes a communication interface 11, a storage unit 12, a processor 13, and each device 15.
And.

The communication interface 11 is a hardware module for connecting the vehicle 10 to the network N and communicating with other terminals and devices on the network N.

The storage unit 12 is a logical device provided by a storage area of a physical device made of, for example, a disk drive or a computer-readable recording medium such as a semiconductor memory (ROM, RAM, etc.). The storage unit 12 may be constructed by mapping a plurality of physical devices to one logical device, or may be constructed by mapping one physical device to a plurality of logical devices.

The storage unit 12 stores various programs including an operating system program and a driver program, and various data used during execution of these programs. Specifically, the storage unit 12 includes various programs P10 to be executed by the processor 13 and each device 1.
The device data D10 acquired from 5 and the condition information D12 including the conditions for data selection or accident determination according to the accident classification may be stored.

The processor 13 is composed of an arithmetic and logical operation unit (CPU or the like) that processes arithmetic operations, logical operations, bit operations, and various registers, and executes various programs stored in the storage unit 12 to execute each part of the vehicle 10. Is centrally controlled. Various registers are, for example,
Program counters, data registers, instruction registers, general-purpose registers, etc.

Further, the processor 13 realizes an accident detection function of detecting the occurrence of an accident and making a necessary report by executing the program P10. The functional units realized by the processor 13 executing the program P10 include an acquisition unit 131, a determination unit 132, and a selection unit 13.
3 and the output unit 134 are included.

The acquisition unit 131 acquires one or a plurality of data from each device 15 mounted on the vehicle 10. For example, the acquisition unit 131 is a device 1 such as an acceleration sensor, a camera, a microphone, and a vehicle sensor.
From 5, acceleration data, image (still image and / or moving image) data, audio data, millimeter wave data, infrared data, data indicating the activation of the airbag, longitude, latitude, data indicating the brake operation status, safe driving Data acquired from the support system, data related to the ACC power supply, etc. are acquired.

The determination unit 132 determines the possibility of an accident based on at least one of the one or a plurality of data acquired by the acquisition unit 131. For example, the determination unit 132 simply determines the possibility of an accident using predetermined data. As an example, the determination unit 132 uses acceleration data and voice data to determine that there is a possibility of an accident when each data exceeds a threshold value. Hereinafter, this determination is also referred to as an accident suspected transaction determination.

In addition, the determination unit 132 may determine the presence or absence of an accident according to the classification of the accident. For example, the determination unit 132 determines whether or not an accident included in a predetermined accident classification has occurred by using a part of the data acquired by the acquisition unit 131. As an example, when the determination unit 132 acquires data indicating the activation of the airbag, it determines that a major accident has occurred.

The classification of accidents includes a plurality of classifications such as large, medium, and small. The determination unit 132 holds a threshold value for each data, and may determine that an accident has occurred when the threshold value is exceeded. Further, the determination unit 132 may determine the classification of the accident according to the type of data exceeding the threshold value. The accident classification may include the classification of the scale of the accident and the classification of the type of accident.

The selection unit 133 determines the acquisition unit 131 according to the possibility of an accident determined by the determination unit 132.
Select the data to be transmitted from one or more data acquired by. For example, the selection unit 133 does not transmit all the data acquired by the acquisition unit 131 to the accident detection server 20, but is required by the accident detection server 20 according to the possibility of an accident (for example, certainty). Select the data that becomes. As an example, the selection unit 133 selects other data in addition to the data used for determining the possibility of an accident and transmits the data to the accident detection server 20.

Further, the selection unit 133 receives the acquisition unit 131 according to the classification of the accident determined by the determination unit 132.
The data to be transmitted may be selected from one or more data acquired by. For example, the selection unit 133 uses the accident detection server 20 to collect all the data acquired by the acquisition unit 131.
The data required by the accident detection server 20 is selected according to the accident classification (for example, the scale of the time and / or the type of accident), instead of transmitting to. In some cases, the selection unit 133 may select all the data.

The output unit 134 controls to output the data to be transmitted selected by the selection unit 133 to another information processing device (for example, the accident detection server 20). For example, the output unit 134 transmits the selected one or more data to the accident detection server 20 via the communication interface 11.

As a result, appropriate data can be transmitted to the server side according to the possibility of the accident or the classification of the accident determined on the vehicle side. In addition, by transmitting appropriate data to the server side, it is possible to avoid imposing a load on the communication band.

Further, the determination unit 132 may include estimating the location of the accident. In addition, the selection unit 13
3 may include selecting data to be transmitted from one or a plurality of data depending on the estimated location of the accident.

For example, depending on the accident classification, the determination unit 132 identifies which position of the vehicle the data used for determining the accident classification is the device of the vehicle, and the accident occurs at the location of the vehicle corresponding to the position of the specified device. May be determined to have occurred. In this case, the determination unit 132 may hold information on the position of the vehicle on which each device is mounted. In addition, the selection unit 133 may at least select data acquired from the device corresponding to the estimated vehicle location.

As a result, by estimating the location of the accident, the number of data to be transmitted to the server side can be further reduced, which can contribute to the reduction of the communication bandwidth load and the processing load on the server side. Further, also in the accident determination, the certainty of the accident determination can be improved by determining the accident using the estimated portion.

Further, the determination unit 132 may include determining the classification of a plurality of accidents in a stepwise manner. Further, the selection unit 133 may include changing the number of data to be transmitted according to the number of stages of the determined accident classification. For example, the determination unit 132 may divide the accident determination into a plurality of stages, and the selection unit 133 may select the number of data to be transmitted according to the determination stage.

As a result, the data transmitted from the vehicle side can be divided into multiple stages, and the server side can perform stepwise accident detection. Further, when the accident detection is confirmed at the initial stage by the stepwise accident detection, the server side can send a notification for stopping the data transmission to the vehicle side. Therefore, it is possible to contribute to reducing the processing load on both the vehicle side and the server side.

The determination unit 132 sets the first predetermined condition for the first accident for the first accident (for example, a large-scale accident) in which the vehicle included in the accident classification is difficult to drive, based on the first data in the one or a plurality of data. It may include determining whether or not the condition is satisfied in the first stage. At this time, the determination unit 132
Is the second data other than the first accident in which the second data in one or more data is included in the accident classification.
For an accident (for example, medium or small scale), it may be determined in the second stage whether or not the second predetermined condition regarding the second accident is satisfied.

For example, the first condition includes that there is data indicating the activation of the airbag, and the determination unit 132.
May determine a large-scale accident as the first step based on the activation of the airbag. Further, the first condition may include data indicating the operation of the safe driving support system. The second condition is, for example, that the sensor data of the accelerometer exceeds the threshold value.
The determination unit 132 may determine whether or not these conditions are satisfied as the second step, including the fact that the audio data data exceeds the threshold volume and the image data indicates a predetermined image.

As a result, by setting the accident judgment with high certainty to the first stage, it is not necessary to transmit data from the vehicle side to the server side after that, and the accident judgment with low certainty is set to the second stage or later. So, at this stage, the necessary data can be sent to the server side. Therefore, all the data acquired on the vehicle side can be efficiently transmitted instead of being transmitted to the server side for accident detection.

Further, when the determination unit 132 includes a plurality of accidents as the second accident to be determined in the second stage, the determination unit 132 may determine whether or not the predetermined conditions corresponding to each of the plurality of accidents in the second stage are satisfied.
For example, as the accident to be determined in the second stage, two types of accidents, a medium-scale accident and a small-scale accident, may be determined. In this case, the determination unit 132 determines the conditions for each of the medium-scale and small-scale accidents. It may be determined whether or not the condition is satisfied.

As a result, it is possible to increase the variation of accident detection and data transmission by increasing the number of stages according to the number of accident classifications. Furthermore, if the number of data to be transmitted increases as the number of stages increases, if an accident is detected in the initial stage, it can contribute to reducing the number of data to be transmitted, reducing the load on the communication band. It can contribute to reducing the processing load.

Further, the determination unit 132 may determine whether or not the conditions relating to the failure of various sensors are satisfied. Conditions related to the failure of various sensors include, for example, an abnormal value lasting for a predetermined time, or a signal from the sensor cannot be detected for a predetermined time. When the determination unit 132 determines the failure, the output unit 134 transmits the information indicating the failure to the accident detection server 20 via the communication interface 11.
It may be output to.

<Accident detection server configuration example>
FIG. 3 is a diagram showing an example of the configuration of the accident detection server 20 in the embodiment. As shown in FIG. 3, the accident detection server 20 includes a communication interface 21, a storage unit 22, and a processor 23.

The communication interface 21 is a hardware module for connecting the vehicle 10 to the network N and communicating with other terminals on the network N.

The storage unit 22 is a logical device provided by a storage area of a physical device made of, for example, a disk drive or a computer-readable recording medium such as a semiconductor memory (ROM, RAM, etc.). The storage unit 22 may be constructed by mapping a plurality of physical devices to one logical device, or may be constructed by mapping one physical device to a plurality of logical devices.

The storage unit 22 stores various programs including an operating system program and a driver program, and various data used during execution of these programs. Specifically, the storage unit 22 contains various programs P20 to be executed by the processor 23 and the vehicle 10.
The device data D20 acquired from the above, the condition information D22 used for accident detection, and the result information D24 including a report on accident detection are stored.

The processor 23 is composed of an arithmetic logic operation unit (CPU or the like) for processing arithmetic operations, logical operations, bit operations, and various registers, and executes various programs stored in the storage unit 22 to execute an accident detection server 20. Centrally control each part of. The various registers are, for example, a program counter, a data register, an instruction register, a general-purpose register, and the like.

Further, the processor 23 realizes an accident detection function of detecting the occurrence of an accident and making a necessary report by executing the program P20. The functional units realized by the processor 23 executing the program P20 include an acquisition unit 231, a determination unit 232, and an output unit 23.
7 and are included.

The acquisition unit 231 acquires at least one selected data from the vehicle 10 out of one or a plurality of data acquired from each device 15 mounted on the vehicle 10. For example, acquisition unit 2
31 acquires the data transmitted from the vehicle 10 via the communication interface 21.
At this time, since the selected data is transmitted from the vehicle 10 instead of transmitting all the data that can be acquired every time, the amount of memory on the server side can be reduced or the processing load can be reduced. Becomes possible.

The determination unit 232 is based on at least one data acquired by the acquisition unit 231.
Comprehensively determine the presence or absence of an accident. The determination unit 232 has an accident determination unit 234, an accident classification unit 235, and a certainty degree classification unit 236 in order to comprehensively determine an accident.

The accident determination unit 234 determines an accident based on a predetermined condition for comprehensively determining whether or not an accident has occurred, using the data acquired by the acquisition unit 231. For example, the accident determination unit 234 holds threshold values of various data, and may hold determination information for determining whether or not there is a possibility of an accident based on whether or not the various data exceed the threshold values. good. The determination information will be described later with reference to FIG.

When it is determined that there is a possibility of an accident, the accident classification unit 235 classifies the type of this accident. For example, the accident classification unit 235 may classify an accident by using the classification information included in the above-mentioned determination information or another classification information. Further, the accident classification unit 235 may classify the scale of the accident and the type of the accident.

The certainty classification unit 236 classifies the certainty regarding the determination of the accident. The degree of certainty for the accident judgment is classified according to the data that contributed to the accident judgment or the difference value from the threshold value. For example, the certainty classification unit 236 may classify the certainty by using the judgment information included in the above-mentioned judgment information or another judgment information.

The output unit 237 outputs a report including the classified results regarding the accident. For example, the output unit 237 acquires the judgment result and / or the classification result from the judgment unit 232, and indicates whether or not an accident has been detected, the degree of certainty of the accident that has occurred (classification), the scale of the accident that has occurred (classification), and the accident. Type (
Create and output a report that includes (classification). The output destination is, for example, a second information processing device (operator terminal) 30 or the like.

As a result, the server side can detect an accident based on appropriate data, and the processing load on the server side can be reduced. In addition, the purpose of detecting accidents varies depending on the business operator, and business needs can only be met by detecting "what kind of accident" according to the purpose, rather than detecting all accidents. I can answer. for example,
In the case of accident detection for the purpose of arranging a tow truck, it is necessary to detect a large-scale accident, and it is not necessary to detect a small-scale accident.

Next, comprehensive accident detection including efficiency improvement of accident detection will be described. In the following, an embodiment in which device failure information (fault data) is acquired from a vehicle based on data from a sensor and an accident is determined based on the failure information, and comprehensive accident detection including accident judgment based on the failure information. The embodiment in which the above is performed will be described.

Here, there are various methods for detecting an accident in the past, but a method for detecting an accident by comprehensively judging all of them has not been established. Here, the features of the data acquired from the vehicle 10 that can be used for accident detection are described below.
・ Acceleration: If the accident is larger than a certain scale, a corresponding impact will be generated and it is possible to detect it, but it is not suitable for detecting small accidents. ・ Video: By using AI (Artificial Intelligence) etc. Even minor accidents can be detected, but the range that can be detected is limited according to the field of view of the camera. Is difficult to be accurate due to the generation of various sounds ・ Vehicle data (airbags, etc.): Data for functions aimed at large-scale accidents and their activation results, unsuitable for detecting small-scale accidents ・ Millimeter-wave radar Etc: It is possible to measure the distance to surrounding objects and it may be possible to detect a collision with an object, but the direction of the sensor ・ The objects that can be detected are limited ・ Sensor failure information: Is it due to a collision or aged deterioration? Etc. cannot be specified. However, it contributes to improving accuracy by combining with other information.

In the present embodiment, at least one or more of the above-mentioned data is used to perform comprehensive accident detection on the vehicle side and / or the server side.

When the acquisition unit 231 of the accident detection server 20 determines a failure of a predetermined device based on at least one selected data among one or a plurality of data acquired from each device 15 mounted on the vehicle 10. , Acquire the failure information of the predetermined device from the vehicle 10.

For example, when the vehicle 10 cannot acquire the sensor data or continues to acquire the abnormal value for a predetermined time or longer, the vehicle 10 may detect the failure of the vehicle sensor and transmit the failure information to the accident detection server 20. Examples of vehicle sensors include millimeter wave sensors, rider sensors, sonar sensors, infrared sensors, airbag activation sensors, and sensors that inspect tire pressure.

The determination unit 232 may determine the accident based on the failure information. In this case, the output unit 237 outputs a report on the accident. For example, the determination unit 232 simply determines that the sensor has failure information as an accident, and the output unit 237 creates a report including the sensor determined to be a failure and, for example, a small-scale accident. And output. The output destination is, for example, the operator terminal 30 or the like.

As a result, it is possible to easily detect a vehicle accident on the vehicle side or the server side by using the failure information of the sensor. In addition, the detection result can be transmitted to the operator terminal 30 or the like of the insurance company, and the operator can perform subsequent accident processing according to the content of the report.

Further, the determination unit 232 may determine the accident of the vehicle 10 when the data acquired from the predetermined device in each device 15 is not acquired from the vehicle 10. Further, when data cannot be acquired from the predetermined device on the vehicle side, it may be determined as a failure and failure information including the failure may be transmitted to the accident detection server 20.

As a result, the accident detection server 20 can determine that some kind of accident has occurred at the position of the failed sensor that cannot output data.

The acquisition unit 231 may include acquiring predetermined data of one or a plurality of data from the vehicle 10, and the determination unit 232 may include determining an accident based on the predetermined data and failure information. .. For example, the determination unit 232 may determine an accident by comprehensively using the failure information and other data. At this time, the determination unit 232 may determine the accident classification based on the conditions under which the accident classification can be determined.

As a result, it is possible to comprehensively determine an accident (accident detection) by comprehensively using each data acquired from the vehicle 10. Conventionally, accident detection can be performed for each data, but in the present embodiment, accident detection can be performed based on various data including failure information acquired from the vehicle 10.

The predetermined data acquired from the vehicle 10 may include image data, audio data, acceleration data, latitude and / or longitude data, and sensor data acquired from the sensor of the vehicle 10. As a result, accident detection can be performed by comprehensively using the main data mounted on the vehicle 10.

The determination unit 232 holds a trained model learned by using one or a plurality of data at the time of an accident acquired from each device 15 as training data. In this case, the determination unit 232 may include determining an accident based on this learned model. The learning may be either learning with teacher data or learning without teacher data. For example, the determination unit 232 may output the possibility of an accident by inputting the acquired one or a plurality of acquired data into the function of the trained model.

As a result, it becomes possible to execute highly accurate accident detection processing by comprehensively using various data that can be acquired from the vehicle 10. The vehicle 10 to be detected is not limited to the connected car and the vehicle equipped with the drive recorder.

Further, as described above, the determination unit 232 may include classifying the accident by the accident classification unit 235 and classifying the certainty of the accident by the certainty classification unit 236 when the accident is determined. In this case, the output unit 237 may include outputting a report containing the classified results regarding the accident.

As a result, the result of the comprehensive judgment can be displayed as a report on the display device or transmitted to the operator terminal 30.

As described above, according to the vehicle 10 in the above-described embodiment, the accident suspected case is picked up based on the determination result of whether or not a certain condition is satisfied by using a plurality of types of data of the above-mentioned various data, and the suspicion is raised. A classification of certain accidents can be carried out. Further, the vehicle 10 extracts necessary data according to the classification of the suspected accident case and transmits the data to the server side, and the server side comprehensively determines whether or not the accident is based on the acquired data. The determination may be made.

Further, the accident detection system 1 can realize optimization of the amount of communication data and avoidance of delay in the response related to accident detection by sharing the processing on the vehicle side and the processing on the server side. In addition, the accident detection system 1 can utilize the acquired data to utilize the accident classification results according to the subsequent business and business purpose.

<Summary of accident detection>
FIG. 4 is a diagram showing an example of an outline of accident detection according to the embodiment. As shown in FIG. 4, accident detection is divided into a vehicle side and a server side. First, the outline of the processing on the vehicle side will be described. The vehicle side has a process of detecting an accident suspicion and a process of collecting and transmitting data.

The accident suspicion detection process includes a process of constantly monitoring the first predetermined data. For example, when the acquisition unit 131 acquires the acceleration data and the audio data, the determination unit 132 determines whether or not the acceleration data exceeds a predetermined value, and determines whether or not the audio data exceeds a predetermined volume (decibel). Judgment and detect sound in the frequency band. The purpose of this is for the vehicle 10 to constantly monitor the first predetermined data such as acceleration data and voice data to widely detect a transaction that seems to be an accident (accident suspicion transaction).

The accident suspicion detection process includes the process of collecting additional information and checking. For example, acquisition unit 131
Acquires the second predetermined data other than the first predetermined data used in the constant monitoring, and the determination unit 132 determines.
If there is a suspected accident transaction by continuous monitoring, the location of the failure is estimated using the second predetermined data. The second predetermined data is device failure information related to, for example, millimeter wave data, and if a device failure is determined, it is estimated that the mounting position of the device is the failure location. As a result, other information can be checked in order to confirm the reliability of the detected accident suspected transaction.

The data collection / transmission process includes a process for the selection unit 133 to collect information necessary for determining whether or not an accident has occurred on the server side. The selection unit 133 includes data (millimeter wave data, rider data, etc.) acquired from the vehicle sensor in addition to the first predetermined data and the second predetermined data.
Select. The output unit 134 transmits the selected data to the accident detection server 20.

Next, the outline of the processing on the server (center) side will be described. The server-side processing includes an accident comprehensive judgment processing, a certainty classification processing, and an accident classification processing.

The accident comprehensive determination process includes a process in which the acquisition unit 231 acquires the data transmitted from the vehicle side, the accident determination unit 234 comprehensively determines the acquired data, and performs an accident determination process.
The accident determination unit 234 may use artificial intelligence (AI), for example, to comprehensively determine an accident.

The certainty classification process includes a process in which the certainty classification unit 236 classifies the certainty based on the result of the comprehensive accident determination process. The certainty classification unit 236 contains data derived from the accident comprehensive judgment result (
For example, data exceeding the threshold value) is used to classify the certainty of the determined result. for example,
The certainty classification unit 236 classifies as follows.
Certainty 1: Accident probability 0%
Certainty 2: Accident probability 25%
Certainty 3: Accident probability 50%
Certainty 4: Accident probability 75%
Confidence 5: Accident probability 100%
The classification by the certainty classification unit 236 is not limited to the above example.

The accident classification process includes a process in which the accident classification unit 235 classifies accidents into a plurality of levels based on the accident comprehensive determination result. For example, the accident classification unit 235 classifies the scale of an accident and the type of accident.
(Scale of accident)
Level 1: Small-scale accident, self-propelled Level 2: Medium-scale accident, tow truck arrangement and possibility of injury Level 3: Large-scale matter, tow truck arrangement and possibility of injury (accident type)
Type 1: Person-to-vehicle type 2: Vehicle-to-vehicle (head-on collision, side collision, etc.)
Type 3: Single vehicle accident (off-road deviation, structure collision, etc.)
The classification by the accident classification unit 235 is not limited to the above example.

<Data example>
Next, the data used in the accident detection system 1 will be described with reference to FIGS. 5 to 10.
FIG. 5 is a diagram showing an example of data acquired by the vehicle 10 according to the embodiment. In the example shown in FIG. 5, the data acquired by the vehicle 10 is classified into three categories: device, vehicle, and equipment failure. The data shown in FIG. 5 may be stored in the storage unit 12 as device data D10. Further, the data marked with * shown in FIG. 5 is data that can be acquired, for example, when the vehicle 10 is a connected car.

The device data includes, for example, acceleration data acquired from an acceleration sensor, audio data acquired from a microphone, image data acquired from a camera, latitude and longitude data acquired from a position measuring instrument such as GPS. Of these, acceleration data and voice data are used as constant monitoring data and are used for determining an accident suspected transaction on the vehicle side.
Further, the device data is data to be transmitted to the accident detection server 20.

The vehicle data is data acquired from the vehicle sensor, and as an example, the airbag activation data acquired from the airbag sensor, the tire pressure data acquired from the tire pressure sensor, and the millimeter wave sensor are acquired. Millimeter wave data, rider data acquired from the rider, sonar data acquired from the sonar sensor, infrared data acquired from the infrared sensor, data indicating the brake operation status, data acquired from the safe driving support system, ACC power supply Contains data. Of these, the airbag activation data and the tire pressure data are used to determine the accident suspicion transaction on the vehicle side. Further, the vehicle data is data to be transmitted to the accident detection server 20.

The device failure information is information indicating whether or not the device has failed, and the data used for the determination are millimeter wave data acquired from the millimeter wave sensor, rider data acquired from the rider, and so on.
Sonar data acquired from the sonar sensor, infrared data acquired from the infrared sensor,
Data obtained from other devices. The determination unit 132 includes, as a condition for determining that the device has failed, for example, data is not acquired for a predetermined period, or abnormal value data exceeding a predetermined value continues for a predetermined period.

FIG. 6 is a diagram showing an example of the reliability of the data according to the embodiment. In the example shown in FIG. 6, reliability is given in association with each data. For example, the reliability of acceleration data is C (low reliability), the reliability of millimeter wave data is B (medium reliability), and the reliability of airbag activation data is A (high reliability). ).

The certainty classification unit 236 may classify the certainty of the accident determination result by using, for example, the data shown in FIG. 6 and using the reliability of the data that contributed to the determination result in the accident determination. For example, the certainty classification unit 236 classifies the certainty based on the data used for determining the accident and the classification condition of the certainty. Specific examples of the certainty classification conditions include conditions for classifying the certainty levels 1 to 5 according to the ratio of the reliability levels A, B, and C of the data used for determining the accident. For example, the certainty classification unit 236 classifies the data used for determining an accident into a certainty level 5 if there is at least one reliability level A, or the data reliability B and C have a large number of B. If it is, the certainty level is set to 3. note that,
The data shown in FIG. 6 may be stored in the storage unit 22 as the condition information D22.

FIG. 7 is a diagram showing a classification example of the degree of certainty according to the embodiment. In the example shown in FIG. 7, the following classification conditions are shown as described above.
Certainty 1: Accident probability 0%
Certainty 2: Accident probability 25%
Certainty 3: Accident probability 50%
Certainty 4: Accident probability 75%
Confidence 5: Accident probability 100%
The data shown in FIG. 7 may be stored in the storage unit 22 as the condition information D22.

FIG. 8 is a diagram showing a classification example of the scale of the accident according to the embodiment. In the example shown in FIG. 8, the following classification conditions are shown as described above.
Level 1: Small-scale accident, self-propelled Level 2: Medium-scale accident, tow truck arrangement and possibility of injury Level 3: Large-scale matter, tow truck arrangement and possibility of injury Note that the data shown in Fig. 8 is , The condition information D22 may be stored in the storage unit 22.

FIG. 9 is a diagram showing a classification example of accident types according to the embodiment. In the example shown in FIG. 9, the following classification conditions are shown as described above.
Type 1: Person-to-vehicle type 2: Vehicle-to-vehicle (head-on collision, side collision, etc.)
Type 3: Single vehicle accident (off-road deviation, structure collision, etc.)
The data shown in FIG. 9 may be stored in the storage unit 22 as the condition information D22.

FIG. 10 is a diagram showing an example of classification determination information according to the embodiment. The classification determination information (for example, the classification determination table) shown in FIG. 10 is used by the determination unit 232, and can perform comprehensive determination, classification of certainty, and classification of accidents. Further, the classification determination information may include classification information for classifying the degree of certainty and the scale of the accident, and determination information for determining the possibility of the accident.

For example, various data include acceleration data, voice data, image data, sensor zero distance data, distance data to a sensor object, failure information, and the like. If these data show an abnormality, it is "1", and if there is no abnormality, it is "0". In addition, if the movement judgment data can be moved, "
1 ”, if it cannot be moved, it is set to“ 0 ”, and the ACC power supply data is set to“ 1 ”if there is no abnormality in the ON / OFF of the power supply, and is set to“ 0 ”if there is an abnormality. Judgment unit 2 based on these values
32 classifies the degree of certainty, classifies the scale of the accident, and grasps the result of the accident comprehensive judgment based on the judgment reason. The classification determination table can be replaced with a trained model trained using raw data of various data using machine learning. That is, the determination unit 232 can output the certainty and the scale of the accident by inputting the input data from the acceleration data to the ACC power supply data into the trained model.

<Estimation of accident location>
FIG. 11 is a diagram showing the relationship between the position of the sensor and the accident position according to the embodiment. The region AR shown in FIG. 11 indicates a region detected by each sensor. Since each sensor can identify the position of the vehicle 10 mounted on the vehicle 10, for example, when the determination unit 132 cannot acquire data from the predetermined sensor, the determination unit 132 identifies the position of the vehicle 10 associated with the predetermined sensor and the position. It becomes possible to estimate the possibility of an accident in.

<Operation processing>
Next, the processing of the accident detection system 1 will be described. FIG. 12 shows the vehicle 1 according to the embodiment.
It is a flowchart which shows an example of the process of 0. In the example shown in FIG. 12, in step S102, the acquisition unit 131 acquires data from each device 15 mounted on the vehicle 10. The timing of acquisition may be the timing according to each device 15.

In step S104, the determination unit 132 determines the possibility of an accident based on at least one of the one or more data acquired by the acquisition unit 131. For example, the determination unit 132 determines whether or not there is an accident based on predetermined data. As an example, if the determination unit 132 acquires the activation signal of the airbag, it determines that there is a serious accident (for example, accident classification A). If it is determined that there is a serious accident (step S104-YES), the process proceeds to step S106, and if it is determined that there is no serious accident (step S104-NO), the process proceeds to step S108.

In step S106, the selection unit 133 selects data to be transmitted according to the possibility of an accident. For example, the selection unit 133 selects the activation signal of the airbag. At this time, the output unit 1
34 transmits the activation signal of the selected airbag to the accident detection server 20 via the communication interface 11.

In step S108, the determination unit 132 determines whether or not the acceleration data exceeds the threshold value. If the acceleration data exceeds the threshold value (step S108-YES), the process is step S11.
If the process proceeds to 0 and the acceleration data does not exceed the threshold value (step S108-NO), the process proceeds to step S112.

In step S110, the selection unit 133 determines the possibility of an accident (for example, the location of the accident).
The required data is selected, and the output unit 134 transfers the selected data to the communication interface 11.
It is transmitted to the accident detection server 20 via. For example, the selection unit 133 may specify the direction of the impact by using the data exceeding the threshold value in the acceleration data, and select the data corresponding to the direction.

In step S112, the determination unit 132 determines whether or not the voice data exceeds the threshold value.
If the voice data exceeds the threshold value (step S112-YES), the process proceeds to step S114, and if the voice data does not exceed the threshold value (step S112-NO), the process proceeds to step S.
Proceed to 116. The term “voice data exceeding the threshold value” includes, for example, that the volume exceeds the threshold value, or that the voice is frequency-converted and the power spectrum after frequency conversion exceeds the threshold value.

In step S114, the selection unit 133 determines the possibility of an accident (for example, the location of the accident).
The required data is selected, and the output unit 134 transfers the selected data to the communication interface 11.
It is transmitted to the accident detection server 20 via. For example, if the direction of the sound source can be estimated from the voice data, the selection unit 133 may select the data corresponding to the direction, perform voice recognition on the voice, and obtain the sound corresponding to the direction. If it is included, the data corresponding to that direction may be selected.

In step S116, the determination unit 132 determines whether or not the vehicle 10 is other than a connected car. If the vehicle 10 is not a connected car (step S116-YES), the process proceeds to step S118, and if the vehicle 10 is a connected car (step S116).
−NO), the process proceeds to step S120.

In step S118, the selection unit 133 determines the possibility of an accident (for example, the location of the accident).
The required data is selected, and the output unit 134 transfers the selected data to the communication interface 11.
It is transmitted to the accident detection server 20 via. For example, the selection unit 133 may select all the data related to the categories "device" and "vehicle" shown in FIG. 5 in order to make the server side determine the accident in detail.

In step S120, the acquisition unit 131 acquires the failure data of the device. In addition, acquisition unit 1
The timing of acquiring the failure data in 31 does not have to be this timing, and the acquisition unit 131 may acquire it at the timing of transmission from each device 15.

In step S122, the determination unit 132 determines whether or not there is failure data indicating a failure of the device. For example, the determination unit 132 may determine that the device has a failure when the abnormal value is measured many times during a predetermined period or the data is not acquired. If a failure is determined (step S22-YES), the process proceeds to step S124, and if no failure is determined (step S122-NO), the process proceeds to step S126.

In step S124, the selection unit 133 determines the possibility of an accident (for example, the location of the accident).
The required data is selected, and the output unit 134 transfers the selected data to the communication interface 11.
It is transmitted to the accident detection server 20 via. For example, the selection unit 133 may select the data corresponding to the position by using the position (failure site) of the device corresponding to the failure data.

In step S126, the determination unit 132 determines that there is no possibility of an accident. After that, the process returns to step S102, and the acquisition unit 131 acquires the next data.

Through the above processing, the vehicle 10 can efficiently use the data to perform accident determination (accident detection) by selecting and transmitting data for performing accident determination. Further, it is not necessary to transmit all the data acquired on the vehicle side every time, which can contribute to the reduction of the load of the communication band and the reduction of the processing load of the accident detection server 20.

FIG. 13 is a flowchart showing an example of processing of the accident detection server 20 according to the embodiment. In the example shown in FIG. 13, in step S202, the acquisition unit 231 acquires the data transmitted from the vehicle 10. The vehicle 10 appropriately selects the data to be transmitted, but may select all the data that can be acquired.

In step S204, the accident determination unit 234 makes a comprehensive accident determination using each of the acquired data. For example, the accident determination unit 234 holds each predetermined condition regarding the accident determination in response to various data, and makes a comprehensive accident determination based on the determination result for each acquired data. As an example, the accident determination unit 234 may perform a comprehensive accident determination using the classification determination information shown in FIG.

In step S206, the certainty classification unit 236 classifies the certainty regarding the accident determination based on each acquired data. For example, the certainty classification unit 236 may classify the certainty using the classification determination information shown in FIG.

In step S208, the accident classification unit 235 classifies the scale of the accident determined as an accident based on each acquired data. For example, the accident classification unit 235 may classify the scale of the accident by using the classification determination information shown in FIG.

In step S210, the accident classification unit 235 classifies the type of accident determined as an accident based on each acquired data. For example, the accident classification unit 235 classifies accident types based on acceleration data, images, voice data, and the like. For example, a collision location based on acceleration data,
The type of accident is classified according to whether a vehicle or a person is shown in the image, whether a predetermined word (for example, "collision") is uttered by voice, and the like.

In step S212, the determination unit 232 determines whether or not there was an accident based on the scale, certainty, and comprehensive determination of the accident classified. For example, the judgment unit 232 may determine that an accident has occurred regardless of the classification of the accident or the comprehensive judgment, and even if the certainty is low, the accident is possible depending on the result of the comprehensive judgment. It may be determined to be sexual.

In step S214, the output unit 237 outputs a report including the classified result. For example, the output unit 237 transmits a report to the operator terminal 30. Also, the report is
It may include at least one of the content of the overall judgment, the degree of certainty classified, the scale of the classified accident, and the type of the classified accident. After this, the process returns to step S202.

If the determination unit 232 determines in step S216 that no accident has occurred, the process returns to step S202.

Through the above processing, the accident detection server 20 can efficiently determine an accident using the data selected on the vehicle side. Further, since the accident detection server 20 does not need to store all the data that can be acquired on the vehicle side every time, the amount of memory can be reduced and the amount of data to be processed can be reduced, so that the processing load is reduced. can do. In addition, the accident detection server 20 can output the accident classification result and the like according to the subsequent business and business purpose by using the acquired data.

<Modification example>
Although the embodiment has been described in detail above, the embodiment is not limited to the above embodiment, and various modifications and changes other than the above embodiment can be made within the scope of the claims.

Each processing step included in the above-mentioned processing flow can be arbitrarily changed in order or executed in parallel within a range that does not cause a contradiction in the processing contents, and another step is added between each processing step. You may. Further, the steps described as one step for convenience can be executed by being divided into a plurality of steps, while those described as one step can be grasped as one step for convenience.

Further, each of the above-mentioned processes may be implemented as a program executed by a computer. This program is installed in a computer, stored in a computer-readable recording medium (for example, a non-temporary recording medium), and executed by a computer control unit (for example, a processor) to perform the above processing. May be realized.

1 ... Accident detection system 10 ... Vehicle 20 ... First information processing device (accident detection server)
30 ... Second information processing device (operator terminal)
11, 21 ... Communication interfaces 12, 22 ... Storage units 13, 23 ... Processor 15 ... Each device 131, 231 ... Acquisition unit 132, 232 ... Judgment unit 133 ... Selection unit 134, 237 ... Output unit 234 ... Accident judgment unit 235 ... Accident classification department 236 ... Confidence classification department

Claims (10)

One or more information processing devices
Acquire one or more data from each device mounted on the vehicle,
The possibility of an accident is determined based on at least one of the above-mentioned one or a plurality of data, and the possibility of an accident is determined.
Select the data to be transmitted from the one or more data according to the determined accident possibility, and select the data to be transmitted.
An information processing method for executing processing that outputs the selected data to be transmitted to another information processing device. Making the above judgment
Including estimating the location of the accident
The selection is
The information processing method according to claim 1, further comprising selecting data to be transmitted from the one or more data according to the estimated location of the accident. The above judgment is
Includes step-by-step determination of multiple accident classifications
The selection is
Including changing the number of data to be transmitted according to the number of stages of classification of the determined accident,
The information processing method according to claim 1 or 2. Making the above judgment
Whether or not the first data in the one or a plurality of data satisfies the first predetermined condition regarding the first accident for the first accident in which the vehicle is difficult to drive, which is included in the classification of the accident, first.
Judging in stages,
Whether or not the second data in the one or more data satisfies the second predetermined condition regarding the second accident for the second accident other than the first accident included in the classification of the accident, the second. Judging in stages,
3. The information processing method according to claim 3. Judgment in the second stage is
The information processing method according to claim 4, wherein the second accident includes a plurality of accidents and determines whether or not a predetermined condition corresponding to each of the plurality of accidents is satisfied. Acquire one or more data from each device mounted on the vehicle in one or more information processing devices,
The possibility of an accident is determined based on at least one of the above-mentioned one or a plurality of data, and the possibility of an accident is determined.
Select the data to be transmitted from the one or more data according to the determined accident possibility, and select the data to be transmitted.
A program that executes processing by outputting the selected data to be transmitted to another information processing device. An acquisition unit that acquires one or more data from each device mounted on the vehicle,
A determination unit that determines the possibility of an accident based on at least one of the above-mentioned one or a plurality of data.
A selection unit that selects data to be transmitted from the one or more data according to the determined accident possibility, and a selection unit.
An information processing device including an output unit that outputs the selected data to be transmitted to another information processing device. One or more information processing devices
Of the one or more data acquired from each device mounted on the vehicle, at least one selected data is acquired from the vehicle.
Based on at least one of the above data, the presence or absence of an accident is determined.
If it is determined that there is the accident, the accident is classified and
Classify the degree of certainty regarding the judgment of the accident,
An information processing method that executes processing that outputs a report containing the classified results for the accident. For one or more information processing devices
Of the one or more data acquired from each device mounted on the vehicle, at least one selected data is acquired from the vehicle.
Based on at least one of the above data, the presence or absence of an accident is determined.
If it is determined that there is the accident, the accident is classified and
Determine the degree of certainty regarding the determination of the accident,
A program that executes processing that outputs a report containing the classified results for the accident. The presence or absence of an accident is determined based on the acquisition unit that acquires at least one selected data from each device mounted on the vehicle and the at least one data. Accident judgment unit and accident classification unit that classifies the accident when it is determined that there is the accident,
The certainty classification unit that classifies the certainty regarding the judgment of the accident,
An information processing device including an output unit that outputs a report including classified results regarding the accident.

Images