JP6755374B1 - Programs, information processing methods, and information processing equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program, an information processing method, and an information processing device for objectively analyzing the situation of an autonomous vehicle. SOLUTION: In an information processing system 1, a control server 10 as an information processing device has first data on control of an autonomous traveling vehicle transmitted from an autonomous traveling vehicle A10 and control of the autonomous traveling vehicle transmitted from the control system. The second data regarding the roadside system and the third data regarding the roadside system transmitted from the roadside system A20 are received, and autonomous driving is performed based on the comparison result of at least two data among the first data, the second data, and the third data. Detects a vehicle abnormality and sends information indicating the abnormality to another information processing device. [Selection diagram] Fig. 1

Description

The present invention relates to programs, information processing methods, and information processing devices.

In recent years, a system for controlling automobile operation using a traffic control device has been developed. For example, the traffic control device stores accident information in advance, and based on this accident information, associates the position on the road where the occurrence of danger is predicted with the content of the danger and the degree of danger indicating the degree of danger. The risk information is transmitted to the in-vehicle device (for example, Patent Document 1).

JP-A-2019-114100

In the future, it is expected that the number of autonomous vehicles traveling on general roads will increase as autonomous vehicles become more practical. When this autonomous vehicle travels based on instructions from the control system, it can objectively detect abnormalities in this autonomous vehicle, and when an accident occurs, it can grasp the accident situation based on objective facts. It is important to properly analyze insurance payments.

The disclosed technology has been made in view of the circumstances described above, and an object of the present disclosure technology is to provide a program, an information processing method, and an information processing device capable of objectively analyzing the situation of an autonomous vehicle. Let it be one.

The program, which is one aspect of the disclosed technology, provides the information processing device with the first data regarding the control of the autonomous traveling vehicle transmitted from the autonomous traveling vehicle and the second data regarding the control of the autonomous traveling vehicle transmitted from the control system. The data and the third data about the roadside system transmitted from the roadside system are received, and the said based on the comparison result of at least two data among the first data, the second data, and the third data. An abnormality of the autonomous traveling vehicle is detected, and information indicating the abnormality is transmitted to another information processing device to execute a process.

According to the present invention, the situation of an autonomous vehicle can be objectively analyzed.

It is a figure which shows the schematic structure of the information processing system which concerns on embodiment. It is a figure which shows the schematic structure of the control server which concerns on embodiment. It is a figure which shows an example of the 1st data which concerns on embodiment. It is a figure which shows an example of the 2nd data which concerns on embodiment. It is a figure which shows an example of the 3rd data which concerns on embodiment. It is a figure which shows the schematic structure of the relay server which concerns on embodiment. It is a figure which shows an example of the accident response data which concerns on embodiment. It is a figure which shows the schematic structure of the insurance server which concerns on embodiment. It is a figure which shows an example of the determination data of the negligence rate which concerns on embodiment. It is a figure which shows the schematic structure of the operator terminal which concerns on embodiment. It is a flowchart which shows an example of the display process which concerns on the abnormality detection which concerns on embodiment. It is a flowchart which shows an example of the post-stage processing about abnormality detection which concerns on embodiment. It is a flowchart which shows an example of the relief arrangement process after the abnormality detection which concerns on embodiment. It is a figure which shows an example of the screen displayed on the operator terminal which concerns on embodiment.

Hereinafter, embodiments of the disclosed technology will be described in detail with reference to the drawings. The same elements are designated by the same reference numerals, and duplicate description will be omitted. In addition, the following embodiments are examples for explaining the disclosed technology, and the present invention is not intended to be limited to the embodiments thereof. Furthermore, the present invention can be modified in various ways as long as it does not deviate from the gist thereof.

Embodiment (1) Configuration of Embodiment FIG. 1 is a diagram showing a schematic configuration of an information processing system 1 according to an embodiment of the present disclosure technology. The information processing system 1 according to the present embodiment is a system including a control system that manages the running of the autonomous traveling vehicle A10, an insurance system in a non-life insurance company, and a roadside system A20 that manages a roadside machine and the like. The autonomous driving vehicle A10 is, for example, one of automobiles, and includes vehicles capable of autonomous driving such as buses, taxis, and passenger cars. Here, the insurance handled by the insurance system will be described as automobile insurance, but it goes without saying that the disclosed technology can also be applied to other types of non-life insurance.

As shown in FIG. 1, the information processing system 1 includes a control server 10, a relay server 20, an insurance server 30, and an operator terminal 40. The control server 10, the relay server 20, the insurance server 30, and the operator terminal 40 are connected to each other via the communication network N. Although only one operator terminal 40 is shown in FIG. 1, a plurality of operator terminals 40 may be provided. Further, in FIG. 1, the control server 10, the relay server 20, and the insurance server 30 are shown one by one, but these servers may be configured by one hardware, and each server may be configured by a plurality of servers. It may be configured by hardware. The operator may be referred to as the user.

The communication network N includes a communication network capable of transmitting and receiving information to and from the control server 10, the relay server 20, the insurance server 30, and the operator terminal 40. Communication network N is, for example, the Internet, LAN, leased line, telephone line, corporate network, mobile communication network, Bluetooth (registered trademark), WiFi (registered trademark) (Wireless Fidelity), other communication lines, and combinations thereof. It does not matter whether it is wired or wireless.

Each of the control server 10, the relay server 20, and the insurance server 30 is composed of, for example, a computer having computing power, and cooperates with other servers and the operator terminal 40 by executing a predetermined program. Through this cooperation, each server detects an abnormality in the autonomous vehicle A10 and an abnormality in the roadside system A20, and after a car accident occurs, reports the accident, grasps the situation of the accident, and handles the accident such as determining the error rate. Realize a server function that processes information about. Here, a car accident includes a contact between a car and another object, and the other object is, for example, an object such as a car, a bicycle, a motorcycle, a person, an animal, a utility pole, or a wall. Further, the abnormality of the roadside system A20 includes, for example, a fall of the roadside system, but is not limited to this.

FIG. 2 is a diagram showing a schematic configuration of the control server 10 according to the embodiment. The control server 10 acquires various device data (also referred to as "first data") from a device such as the autonomous vehicle A10 and device data (also referred to as "third data") acquired from the roadside system A20. However, it is an information processing device that controls the autonomous traveling vehicle A10 so that it can travel safely. For example, the control server 10 transmits a control signal based on the first data and / or the third data to the autonomous driving vehicle A10. The control server 10 may acquire various data included in the first data from the plurality of autonomous traveling vehicles A10.

Here, the device such as the autonomous traveling vehicle A10 acquires a GPS sensor or the like for acquiring position information, a speed sensor for detecting traveling speed, an acceleration sensor for detecting acceleration, a first camera for acquiring external image data, and an in-vehicle camera. It includes at least one of a second camera, various sensor information, an in-vehicle sensor that acquires vehicle operation information for operating the vehicle, and the like. In addition, this device acquires information at any time by various sensors. A device such as the autonomous vehicle A10 uses a communication function to control the first data acquired by each sensor at any time or when an abnormal situation such as a change in acceleration exceeding a predetermined value occurs. Send to.

The roadside system A20 is installed on the roadside and acquires information on the road on which the autonomous vehicle A10 travels, signal conditions, and the like. The roadside system A20 has, for example, a camera capable of capturing a peripheral image and a sensor capable of measuring the speed and acceleration of a vehicle traveling in the peripheral area.

As shown in FIG. 2, the control server 10 includes a communication interface 11, a storage unit 12, and a processor 13.

The communication interface 11 is a hardware module for connecting the control server 10 to the communication network N and communicating with other terminals on the communication network N. The communication interface 11 is, for example, a modulation / demodulation device such as an ISDN modem, an ADSL modem, a cable modem, an optical modem, or a soft modem.

The storage unit 12 is a logical device provided by a storage area of a physical device made of a computer-readable recording medium such as a disk drive or a semiconductor memory (ROM, RAM, etc.). The storage unit 12 may be constructed by mapping a plurality of physical devices to one logical device, or may be constructed by mapping one physical device to a plurality of logical devices.

The storage unit 12 stores various programs including an operating system program and a driver program, and various data used during execution of these programs. Specifically, the storage unit 12 transmits various programs P10 to be executed by the processor 13, the first data D10 acquired from the autonomous traveling vehicle A10, and the autonomous traveling vehicle A10 to control the autonomous traveling vehicle A10. The second data D12 and the third data D14 acquired from the roadside system A20 are stored.

FIG. 3 is a diagram showing an example of the first data according to the embodiment. In the example shown in FIG. 3, the first data includes position information, speed data, acceleration data, vehicle exterior video data, vehicle interior video data, sensor information, vehicle operation information, time information, and the like. The first data shown in FIG. 3 is data at a certain time point, and the storage unit 12 holds the first data for a predetermined period, and when the first data for a predetermined period is stored, the latest first data is stored. The oldest first data is erased in order to store the data.

The position information includes, for example, latitude and longitude information (x1, y1) at which the autonomous driving vehicle A20 is located at the time (t10) indicated by the time information. The speed data includes, for example, data (vd10) indicating the speed of the autonomous driving vehicle A20 measured at the time (t10) indicated by the time information. The acceleration data includes, for example, data (ad10) indicating the acceleration of the autonomous driving vehicle A20 measured at the time (t10) indicated by the time information.

The vehicle-outside video data includes, for example, video data (md10) in which the outside of the autonomous driving vehicle A20 is photographed during the period including the time (t10) indicated by the time information. The in-vehicle video data includes, for example, video data (md12) in which the inside of the autonomous driving vehicle A20 is photographed during a period including the time (t10) indicated by the time information.

The vehicle exterior video data and the vehicle interior video data include video data taken by a drive recorder. These video data may be video data taken by a drive recorder installed in the device of the party involved in the accident. The video data may be obtained directly from the device of the party involved in the accident, or may be obtained from a drive recorder device system operated by a private service provider. Further, the video data taken by the drive recorder installed in the device traveling around the accident occurrence point at the time of the accident may be acquired from the drive recorder device system.

The sensor information includes, for example, the sensed information (data such as room temperature and sound: sd10, sd12, ...) In the time (t10) indicated by the time information. The vehicle operation information includes, for example, information used for operating and controlling the autonomous traveling vehicle A20 at the time (t10) indicated by the time information (information for controlling the traveling of the vehicle: cd10, cd12, ...). The time information includes, for example, the time (t10) at which the first data was measured.

FIG. 4 is a diagram showing an example of the second data according to the embodiment. In the example shown in FIG. 4, the second data includes control system operation information, vehicle information, insurance information, and the like. The control system operation information includes information (cd30, cd32, ...) For controlling the autonomous traveling vehicle A10 specified by the vehicle information. For example, the control system operation information is a signal that permits forward movement when the display of the signal is a green light. The storage unit 12 holds the control system operation information for a predetermined period, and when the control system operation information for a predetermined period is stored, the oldest control system operation is stored in order to store the latest control system operation information. The information is erased.

The vehicle information includes information for identifying the autonomous traveling vehicle A10. For example, the vehicle information includes vehicle identification information called VIN (Vehicle Identification Number). The control server 10 stores the second data for each autonomous vehicle A10 to be controlled.

The insurance information includes information (abc000 ...) Indicates insurance insured on the autonomous driving vehicle A10 indicated by the vehicle information. For example, insurance information includes a security number, a case number, a policyholder name, contact information, and the like.

FIG. 5 is a diagram showing an example of the third data according to the embodiment. In the example shown in FIG. 5, the third data includes roadside system operation information, roadside video data, acceleration data, speed data, time information, and the like. The third data shown in FIG. 4 is data at a certain time point, and the storage unit 12 holds the second data for a predetermined period, and when the second data for a predetermined period is stored, the latest third data is stored. The oldest third data is erased to store the data.

The roadside system operation information includes, for example, a signal (cd20) that controls the display (lighting color) of the roadside unit (signal) at the time (t20) indicated by the time information. The roadside video data is, for example, video data of the time (t20) indicated by the time information, and video data (md20) including a vehicle traveling on the road around the roadside machine taken by a camera provided on the roadside machine. Including. The speed data includes, for example, data (vd20) indicating the speed of the autonomous driving vehicle A20 measured at the time (t20) indicated by the time information. The acceleration data includes, for example, data (ad20) indicating the acceleration of the autonomous driving vehicle A20 measured at the time (t20) indicated by the time information. The time information includes, for example, the time (t20) at which the third data was measured.

The data and data structures shown in FIGS. 3 to 5 are examples, and for example, a predetermined period may be different for each item included in each data of the first data to the third data, and the data is stored. The number of data may be different.

Returning to FIG. 2, the processor 13 includes one or a plurality of arithmetic and logical operation units (CPU, etc.) and various registers for processing arithmetic operations, logical operations, bit operations, and the like, and various programs stored in the storage unit 12. Is executed to centrally control each part of the control server 10. The various registers are, for example, a program counter, a data register, an instruction register, a general-purpose register, and the like. Further, the processor 13 realizes a function of outputting a control signal for controlling the traveling of the autonomous traveling vehicle A10 by executing the program P10. The functional unit that is functioned by the processor 13 executing the program P10 includes the indicator unit 131.

The instruction unit 131 transmits a control signal for controlling the traveling of the autonomous traveling vehicle A10 to the autonomous traveling vehicle A10 via the communication interface 11 based on the first data and / or the third data. For example, the instruction unit 131 outputs a control signal for advancing to the autonomous driving vehicle A10 if it is a green light according to the indication of the roadside machine. Further, the instruction unit 131 outputs a control signal for controlling the speed of the autonomous traveling vehicle A10 to the autonomous traveling vehicle A10 based on the speed data and / or the acceleration data. As a result, it becomes possible to control the traveling of the autonomous traveling vehicle A10 by transmitting a control signal from the control system. Further, the instruction unit 131 may transmit a control signal corresponding to the instruction signal input by the operator of the control system to the autonomous traveling vehicle A10.

FIG. 6 is a diagram showing a schematic configuration of the relay server 20 according to the embodiment. The relay server 20 is an information processing device that receives data from the control server 10 and, if necessary, receives data from the roadside system A20 or the autonomous driving vehicle A10, and objectively analyzes the situation of the autonomous driving vehicle A10. Is. For example, the relay server 20 receives the first data and the second data, filters them so as to extract necessary data, and detects an abnormality in the autonomous driving vehicle A10 using the filtered data. In addition, the relay server 20 uses the filtered data to objectively grasp the accident situation, determine an emergency vehicle request, and transmit necessary data to the insurance company.

Further, the relay server 20 may acquire data on the autonomous driving vehicle A10 in which an abnormality has been detected or has caused an accident, and may also acquire information exemplified below.
(A) Road information such as sign information and speed limit information: Obtained from a road information system operated by a private company.
(B) Map information: Obtained from a map information system operated by a private company.
(C) Weather information: Obtained from a weather information system operated by a private or public institution.
(D) Contact history information: When the party to the accident is a policyholder of the company's insurance, the past contact history is acquired from the damage service system.

As shown in FIG. 6, the relay server 20 includes a communication interface 21, a storage unit 22, and a processor 23. The hardware configurations of the communication interface 21, the storage unit 22, and the processor 23 are the same as those of the communication interface 11, the storage unit 12, and the processor 13 described above.

The storage unit 22 stores various programs P20 to be executed by the processor 23, and accident response data D20 including data acquired from the control server 10 and, if necessary, the autonomous driving vehicle A10 or the roadside system A20. The accident response data D20 includes data acquired via the communication interface 21 and extracted by the extraction unit 231. For example, the accident response data D20 is data obtained by extracting the data used for accident response from the first data, the second data, and the third data by the extraction unit 231.

FIG. 7 is a diagram showing an example of accident response data according to the embodiment. In the example shown in FIG. 7, an example of data used for abnormality detection will be described, but the present invention is not limited to this, and acceleration at the time of an accident, map information, video data, or the like may be stored.

In the example shown in FIG. 7, the data included in the first data includes the target speed information (25 km / h), the signal recognition information (blue), and the like, and the data included in the second data includes the target speed information (25 km / h). h), signal information (blue) and the like are included, and as the data included in the third data, speed information (20 km / h), signal information (red) and the like are included.

Returning to FIG. 6, the processor 23 objectively detects an abnormality in the autonomous driving vehicle A10 based on various acquired information by executing the program P20, or when an accident occurs, based on the objective facts. It realizes the function of grasping the accident situation and appropriately analyzing the insurance payment. The functional unit realized by the processor 23 executing the program P20 includes an extraction unit 231, a detection unit 232, a determination unit 233, and a request unit 234.

When the extraction unit 231 acquires the first data, the second data, and the third data from the control server 10, for example, the extraction unit 231 extracts the data necessary for the accident response. The data to be extracted may be set in advance, for example, data used for abnormality detection, data used for analyzing an accident when an accident occurs, and the like.

The detection unit 232 detects an abnormality related to the autonomous driving vehicle A10 based on the comparison result of at least two data out of the first data, the second data, and the third data. For example, the detection unit 232 compares the target speed of the control server 10 with the target speed of the autonomous driving vehicle A10, and the color of the signal recognized by the autonomous driving vehicle A10 based on the external video data and the like, and the control system and the roadside system. Compare with the color of the signal acquired from A20. When a discrepancy occurs by this comparison, an abnormality of the autonomous driving vehicle A10 is detected. Further, if the predetermined data in the first data is equal to or more than the threshold value, the detection unit 232 may determine that it is abnormal.

As a result, data from various viewpoints such as the first data regarding the control of the autonomous driving vehicle A10, the second data for controlling the autonomous driving vehicle A10 from the control system, and the third data acquired from the roadside system A20 can be obtained. By using this, it becomes possible to objectively detect an abnormality related to the autonomous driving vehicle A10.

When an abnormality is detected by the detection unit 232, the transmission unit of the communication interface 21 transmits information indicating this abnormality to another information processing device (for example, the insurance server 30). The information indicating the abnormality may include inconsistent information. As a result, it is possible to grasp what kind of abnormality has occurred in the autonomous driving vehicle A10 at the transmission destination of the abnormality information.

Further, in the detection unit 232, the comparison result between the first data received via the control system or received from the autonomous driving vehicle A10 and any of the second data and the third data is the first abnormal condition. If the condition is satisfied, an abnormality related to the autonomous traveling vehicle A10 may be detected. For example, the detection unit 232 may compare the vehicle speed data for control acquired from the autonomous driving vehicle A10 with the vehicle speed data for control instructed by the control system or the actually measured vehicle speed data acquired from the roadside system A20. .. Other data to be compared include signal color, stop or start of movement, indication of movement route, detection result of obstacle in front, and the like. The first abnormal condition can be changed depending on the data to be compared, but includes that both data do not match, are not within a predetermined range, or the predetermined data is equal to or more than a threshold value.

As a result, it is possible to detect whether or not there is an abnormality in the autonomous traveling vehicle A10 by comparing the data transmitted from the autonomous traveling vehicle A10 with reference to the data. Further, by comparing the control system data (speed, brake, steering, etc.) of the autonomous traveling vehicle A10 with reference to the reference, it is possible to detect whether or not there is an abnormality in the control system of the autonomous traveling vehicle A10.

Further, the detection unit 232 may detect an abnormality related to the autonomous driving vehicle A10 when the comparison result between the second data and the third data satisfies the second abnormality condition. For example, the detection unit 232 may compare the color of the signal determined by the control system at a certain time point with the color of the signal controlled by the roadside system A20. Other data to be compared may include movement route instructions and detection results of obstacles in front. The second abnormal condition can be changed depending on the data to be compared, but includes that both data do not match, are not within a predetermined range, or the predetermined data is equal to or more than a threshold value.

As a result, if there is a discrepancy between the data of the control system and the roadside system, the reliability of the control signal from the control system will be low, so if there is an abnormality in the autonomous vehicle A10, the control system will be responsible. It is possible to detect the possibility that there is.

The determination unit 233 determines the responsibility for the detected abnormality based on at least two data in which the abnormality is detected. For example, if the control vehicle speed data notified by the control system and the actually measured vehicle speed data measured by the autonomous driving vehicle A10 are different from each other, the determination unit 233 determines that there is a high possibility that the autonomous driving vehicle A10 has an abnormality. .. Further, when the color of the signal used by the control system for control and the color of the signal acquired from the roadside system A20 are different, the determination unit 233 determines that there is a high possibility that the control system has an abnormality. For example, the responsibility may be determined based on the combination of data determined to be abnormal and the value of those data.

The determination result is transmitted to the control server 10 via the transmission unit of the communication interface 21 and displayed on the display device in the control system, or is transmitted to the insurance server 30 via the transmission unit of the communication interface 21 in the insurance system. It is displayed on the display device of.

This makes it possible to estimate the responsibility for the cause of an abnormality or accident by analyzing which factor caused the data mismatch, etc., based on objective data from various perspectives. Become.

Further, the detection unit 232 controls to transmit the data (insurance data) used by the insurance company to the insurance server 30 via the transmission unit of the communication interface 21. For example, the insurance data is control data included in the first data or the second data, and is measured in the control data used for the first control of the autonomous driving vehicle A10 and the first control of the autonomous driving vehicle A10. Includes actual measurement data. The first control includes, for example, control of traveling in the city. The insurance data is not limited to the above example, and may include data used for determining the error rate and the like.

As a result, for example, by transmitting the vehicle speed data for controlling the autonomous driving vehicle A10 and the measured vehicle speed data, it can be determined whether the autonomous driving vehicle A10 is traveling appropriately based on the control data. , The insurance company will be able to understand it. An example of insurance data will be described in detail with reference to FIG.

Further, the detection unit 232 may detect an abnormality when any of the first data, the second data, and the data included in the third data is equal to or more than the threshold value and shows an abnormal value. For example, if the acceleration data is equal to or higher than the threshold value, there is a possibility of a collision and an accident may have occurred.

Further, when the requesting unit 234 determines that the autonomous traveling vehicle A10 cannot travel by using the first data or the like, the requesting unit 234 requests to arrange a vehicle (for example, a tow truck or a tow truck) for moving the autonomous traveling vehicle A10. Control to send to other information processing devices. For example, the requesting unit 234 determines that the driver is not in a driving situation based on predetermined conditions related to towing arrangement, for example, in-vehicle video data, determines that communication from an in-vehicle device is cut off, or determines from acceleration data. If it is determined that the impact has exceeded the value, a tow truck will be requested to be arranged.

At this time, the requesting unit 234 may send a request for arranging a tow truck to the insurance server 30 or directly notify the tow truck company. At this time, if the position information of the autonomous driving vehicle A10 can be acquired by the GPS function, the map data, the position information of the roadside machine, or the like, the position information may also be transmitted.

As a result, based on the objective data, it is possible to determine whether or not the autonomous traveling vehicle A10 needs to be towed, and request and confirm the arrangement of the towing vehicle on the system side. In addition to arranging the tow vehicle, the requesting unit 234 may arrange an ambulance when the injured person is recognized based on the in-vehicle video data or the like.

FIG. 8 is a diagram showing a schematic configuration of the insurance server 30 according to the embodiment. The insurance server 30 is an information processing device that acquires insurance data transmitted by the relay server 20 and performs processing related to insurance based on the acquired data.

As shown in FIG. 8, the insurance server 30 includes a communication interface 31, a storage unit 32, and a processor 33. The hardware configurations of the communication interface 31, the storage unit 32, and the processor 23 are the same as those of the communication interface 11, the storage unit 12, and the processor 13 described above.

The storage unit 32 stores various programs P30 to be executed by the processor 33 and accident-related data D30. The accident-related data D30 includes, for example, data used for determining the accident error rate, data for determining the claimant, data for analyzing the accident, and the like.

By executing the program P30, the processor 33 realizes a function of determining an error rate or the like based on the accident-related data D30. The functional unit realized by the processor 33 executing the program P30 includes a negligence determination unit 331, a claimant determination unit 332, an accident analysis unit 333, and a display control unit 334.

The negligence determination unit 331 collates the own vehicle behavior data and the opponent vehicle behavior data described later, which are included in the accident-related data D30, with the ratio reference data, and identifies the corresponding case law (accident classification). The negligence determination unit 331 determines the basic negligence rate based on the identified case law, and corrects the basic negligence rate according to the command based on the user operation made on the operator terminal 40.

The claimant determination unit 332 determines the insurance claimant based on the moving images and a plurality of data captured by the external and internal imaging devices mounted on the autonomous driving vehicle A10. For example, the face of a passenger is recognized from the video data in the vehicle to determine the claimant.

When an accident occurs, the accident analysis unit 333 grasps the situation of the accident and analyzes the cause of the accident based on the accident-related data D30.

The display control unit 334 controls the operator terminal 40 to display an accident information screen including a determination result by the negligence determination unit 331. The accident information screen includes, for example, basic accident information, image information, operation information, and a list of mismatched data (see, for example, FIG. 14).

As a result, according to the insurance server 30, it is possible to make an efficient and highly fair determination regarding insurance based on various data acquired at the time of abnormality detection or accident occurrence. Further, according to the insurance server 30, since the determination regarding insurance is visualized, the operator can efficiently and easily confirm the basis of the processing related to insurance.

FIG. 9 is a diagram showing an example of determination data of the error rate according to the embodiment. The error rate determination data shown in FIG. 9 stores each data as a determination item for determining an accident situation, for each category such as own vehicle behavior, road condition, accident situation, and opponent vehicle behavior. Each determination item is associated with a data source of information related to the determination item (for example, device data such as acceleration information / GPS information, map information, video data taken by a drive recorder, etc.). The determination item is an item necessary for determining the error rate or an item that can affect the determination of the error rate.

The negligence determination unit 331 may grasp the information on the driving behavior of the own vehicle at the time of the accident based on the acquired various data, and save the grasped information as the own vehicle behavior data. As a specific example, the negligence determination unit 331 has road information, map information, and weather information around the accident occurrence point based on the data acquired from the device (own vehicle) driven by the policyholder of the company's insurance in the first data. By also referring to the contact history, the accident situation such as the driving trajectory and speed information of the own vehicle can be grasped.

The negligence determination unit 331 extracts the driving locus of the own vehicle based on the first data acquired from the own vehicle. The negligence determination unit 331 may specify the behavior of the own vehicle, the impact location, and the like by visualizing the waveform data of the acceleration in the own vehicle as a graph based on the first data. The negligence determination unit 331 may visualize the driving locus by performing matching processing on the road information and the map information around the accident occurrence point and displaying the extracted driving locus in an overlapping manner.

The negligence determination unit 331 may grasp the information on the driving behavior of the partner vehicle and the information on the surrounding environment based on the acquired various data, and save the grasped information as the partner vehicle. As a specific example, the negligence determination unit 331 performs object recognition processing, depth measurement processing, etc. on the video data captured in the own vehicle among the video data, and collates it with the own vehicle behavior data to match the video data of the other vehicle. Estimate the speed. Further, the negligence determination unit 331 may acquire information such as a signal state at the time of an accident from the data or video data from the roadside system A20.

The negligence determination unit 331 may perform display control for visualizing and displaying the driving behavior of the own vehicle, the driving behavior of the other vehicle, and the surrounding environment on the operator terminal 40.

Further, although not shown, the accident-related data D30 may include ratio reference data and past case data. The ratio standard data is based on the standard of the negligence ratio based on the case law, such as "Criteria for certifying the negligence offset rate in civil traffic proceedings" (called "Case Times (registered trademark)") issued by Judgment Times Co., Ltd. It is a database. In addition, the past case data is a database of the error rates in the past cases.

FIG. 10 is a diagram showing a schematic configuration of an operator terminal 40 according to an embodiment. The operator terminal 40 is a terminal used by an operator who receives a report of an abnormality or an accident or processes insurance or the like, and is composed of a personal computer (PC), a notebook PC, a tablet terminal, or the like.

As shown in FIG. 10, the operator terminal 40 is an information processing device including a communication interface 41, a display unit 42, an operation input unit 43, an output unit 44, a storage unit 45, and a processor 46. In the present embodiment, the operator terminal 40 is used as a display device for displaying a predetermined screen based on the information received from the relay server 20 and the insurance server 30, and also requests the relay server 20 and the insurance server 30. It is used as an operation input device for inputting commands and the like.

The communication interface 41 is a hardware module for connecting the operator terminal 40 to the communication network N and communicating with other terminals on the communication network N. The communication interface 41 is, for example, a modulation / demodulation device such as an ISDN modem, an ADSL modem, a cable modem, an optical modem, or a soft modem.

The display unit 42 is composed of a display device such as a liquid crystal display or an organic EL display.

The operation input unit 43 is an input device such as a keyboard, various operation buttons, a touch panel provided on the display unit 42, and a pointing device such as a mouse.

The output unit 44 is an output device such as a printer or a speaker.

The storage unit 45 is, for example, a logical device provided by a storage area of a physical device. The physical device is, for example, a computer-readable recording medium such as a disk drive or semiconductor memory (ROM, RAM, etc.). The storage unit 45 may be constructed by mapping a plurality of physical devices to one logical device, or may be constructed by mapping one physical device to a plurality of logical devices. Further, the storage unit 45 may be a USB memory, an SD (registered trademark) card, or the like.

The storage unit 45 stores an operating system program, a driver program, various data, and the like. Specifically, the storage unit 45 communicates with the relay server 20 and the insurance server 30 by causing the processor 46 to execute the program P40, and displays the information transmitted from these servers on the display unit 42 in a predetermined format. To store.

The processor 46 includes one or a plurality of arithmetic and logical operation units (CPU and the like) and various registers that process arithmetic operations, logical operations, bit operations, and the like. Further, the processor 46 centrally controls each part of the operator terminal 40 by executing various programs stored in the storage unit 45. The various registers are, for example, a program counter, a data register, an instruction register, a general-purpose register, and the like. The functional unit realized by the processor 46 executing the program P40 includes a display control unit 461 that displays information transmitted from the relay server 20 and the insurance server 30 on the display unit 42 in a predetermined format.

Further, when the user performs an operation using the operation input unit 43, the processor 46 outputs a command corresponding to the user operation to each unit of the operator terminal 40 to execute the process. Further, when the operator terminal 40 is accessing the relay server 20 or the insurance server 30 and a user operation is performed on the screen transmitted from the relay server 20 or the insurance server 30, the processor 46 is the user. A signal representing an instruction corresponding to the operation is transmitted to the relay server 20 or the insurance server 30 to request execution of the instruction.

(2) Operation processing of the embodiment FIG. 11 is a flowchart showing an example of display processing related to abnormality detection according to the embodiment. When the data (first to third data) is transmitted from each system, the processor 23 of the relay server 20 acquires these data (step S102). For example, the relay server 20 receives vehicle operation information (including recognition information such as signals and obstacles, control information such as vehicle speed target value, operation information such as vehicle speed and acceleration), and control system log information (including operation information such as vehicle speed and acceleration) from the control server 10. Information (including control information instructed to the autonomous vehicle A10), information (including signal information) from the roadside system A20, and video data outside or inside the vehicle are acquired.

The detection unit 232 of the relay server 20 performs an abnormality detection process by analyzing each acquired data (step S104). For example, the detection unit 232 detects an abnormality related to the autonomous driving vehicle A10 based on a comparison result of at least two data out of the first data, the second data, and the third data. The information indicating the abnormality is transmitted to the control server 10 and / or the insurance server 30 together with the data used for the abnormality detection, for example.

The detection unit 232 may detect an abnormality by detecting an abnormal value or non-operation of data included in at least one of the first data, the second data, and the third data. For example, if the impact from a predetermined direction exceeds the threshold value, or if it is determined that there is an injured person based on the in-vehicle video data, the detection unit 232 detects that there is a possibility of an accident.

When the display control unit 334 of the insurance server 30 acquires information indicating an abnormality regarding the autonomous driving vehicle A10, it controls the display so that it is displayed on the display device (step S106). Further, even when the control server 10 acquires information indicating an abnormality, this information is controlled to be displayed on the display device in the control system. The display control unit 334 makes it possible to display the acquired data selected by the operator, and when the data is set to be important, the data having the highest importance is displayed first. Control to be done.

The storage unit 22 of the relay server 20 stores the accident response data D20 within a predetermined period including the time when an abnormality is detected in a memory that is permanently stored (step S108). These data will be saved later for use as materials for proof of accidents and anomalies.

FIG. 12 is a flowchart showing an example of post-stage processing related to abnormality detection according to the embodiment. When the data (first to third data) is transmitted from each system, the processor 23 of the relay server 20 acquires these data (step S202). Step S202 is the same as step S102.

The detection unit 232 of the relay server 20 determines whether or not an abnormality has been detected by analyzing each of the acquired data (step S204). For example, the detection unit 232 receives at least two data out of the first data, the second data, and the third data when the acceleration data included in the first data exceeds the threshold value or when an alert is acquired from the control system. When a discrepancy occurs in the comparison results of the above, an abnormality related to the autonomous traveling vehicle A10 is detected.

The communication interface 21 of the relay server 20 transmits information indicating an abnormality to the control server 10 and / or the insurance server 30 together with the data used for detecting the abnormality, for example. The insurance server 30 transfers information indicating an abnormality to the operator terminal 40 and notifies the operator terminal 40 of the possibility of an accident (step S206).

The operator terminal 40 inquires the control system of the occurrence of an accident by the operator, confirms whether or not an accident has occurred, and inputs the confirmation result (step S208). When an operation such as an accident is performed by the operator (step S208-YES), the process proceeds to step S210, and when an operation indicating that an accident or the like has not occurred is performed (step S208-NO), the process is performed. Is finished.

When the occurrence of an accident or the like is confirmed, the insurance server 30 acquires various data (first data, second data, third data) before and after the occurrence of the abnormality from the relay server 20 (step S210). Note that the relay server 20 may automatically transmit various data before and after the occurrence of an abnormality.

The insurance server 30 uses various acquired data to determine whether or not to arrange an emergency vehicle, and if it is determined to be necessary, controls the company that manages the emergency vehicle to arrange an emergency vehicle. (Step S212). This process will be described in detail with reference to FIG.

The insurance server 30 uses the acquired various data to execute an accident situation analysis process such as determining the error rate or determining the cause of the accident (step S214). At this time, the display control unit 334 of the insurance server 30 or the display control unit 461 of the operator terminal 40 uses a user interface for objectively grasping the situation such as an accident. This user interface will be described in detail with reference to FIG.

The insurance server 30 stores the accident-related data D30 used for the accident analysis in a permanent memory so that it can be submitted as evidence (step S216). As a result, when an abnormality is detected on the relay server 20 side, the subsequent processing can be smoothly executed by appropriately linking data with the insurance server 30 of the insurance company.

FIG. 13 is a flowchart showing an example of the rescue arrangement process after the abnormality detection according to the embodiment. It is assumed that the detection unit 232 of the relay server 20 detects an abnormality by analyzing each of the acquired data (step S302).

The request unit 234 of the relay server 20 acquires predetermined device data (first to third data) (step S304). The predetermined device data is preset with data used for determining relief arrangements, such as in-vehicle and out-of-vehicle video data and control system data for the autonomous driving vehicle A10. After step S304, the process branches.

The requesting unit 234 of the relay server 20 determines whether or not there is an injured person based on, for example, in-vehicle video data (step S306). For example, the requesting unit 234 extracts a person from the video data and extracts whether or not blood is flowing from the person by using image recognition. If there is an injured person (step S306-YES), the process proceeds to step S310, and if there is no injured person (step S306-NO), the process ends. Regarding the detection of an injured person or the like, the passenger may have fallen or bloodshed or the like may be learned by machine learning from the in-vehicle video data.

The requesting unit 234 of the relay server 20 determines whether or not the vehicle can travel based on, for example, external video data and control system data of the autonomous driving vehicle A10 (step S308). For example, the requesting unit 24 extracts a vehicle failure from the video data and detects that the vehicle control system data is inactive. If it is determined that the vehicle cannot travel (requires a tow truck) (step S308-YES), the process proceeds to step S310, and if it is determined that the vehicle can travel (no wrecker required) (step S308-NO), the process ends. The requesting unit 234 may check the position of the own vehicle and surrounding obstacles from the external video data, 3D map data, GPS data, etc. regarding the necessity of the tow truck, and determine whether or not the vehicle can travel. .. Further, the requesting unit 234 can also determine whether or not the autonomous driving system can be operated from the operation information of the autonomous driving vehicle A10.

The communication interface 21 of the relay server 20 notifies the insurance server 30 of the insurance company system about the possibility of relief based on the detection result of the request unit 234 (step S310).

The insurance server 30 transfers the detection result indicating the possibility of relief to the operator terminal 40, and notifies the operator terminal 40 of the detection result. The operator terminal 40 causes the control system to confirm the situation by the operator, confirms the need for relief, and causes the operator terminal 40 to input the confirmation result (step S312). If the operator performs an operation that requires help (step S321-YES), the process proceeds to step S314, and if an operation that does not require help is performed (step S321-NO), the process ends. ..

The operator terminal 40 processes to arrange relief for an ambulance or a tow truck according to the operation of the operator (step S314). If YES is determined in the process of step S306 or step S308, the process may be performed so as to automatically arrange for relief. For example, the requesting unit 234 can automatically arrange for relief by registering a predetermined telephone number and contact information. In addition, automatic relief arrangements may be made by the insurance company. For example, in the process of step S310, the insurance server 30 that received the report may process so as to automatically arrange relief. As a result, relief arrangements can be made smoothly, and the processing efficiency of the entire system can be improved.

(3) User Interface of the Embodiment FIG. 14 is a diagram showing an example of a screen displayed on the operator terminal 40 according to the embodiment. In the example shown in FIG. 14, the screen M10 has a basic information display area m10, an outside image display area m12, an inside image display area m14, a sensor position confirmation display area m16, an operation information display area m18, and a graph switching area. It includes m20, a first graph display area m22, a second graph display area m24, and a mismatched data display area m26.

The basic information display area m10 is a display area showing basic information of an accident, and displays a securities number, a case number, a contractor's name, contact information, and the like. These data can be obtained from the insurance data included in the second data.

The vehicle exterior image display area m12 is an area for displaying a part of the vehicle exterior video data included in the first data and still image data. The in-vehicle image display area m14 is an area for displaying a part of the in-vehicle image data included in the first data and the still image data.

The still image data displayed in the area m12 and the area m14 may be one still image data of the video data. In this case, when the operation input unit 43 detects that the operator presses in the area, the display control unit 461 displays and reproduces this image in another window or another screen at the same position. It may be controlled to.

The sensor position confirmation display area m16 is a display area indicating which sensor information of the autonomous driving vehicle A10 is the operation information displayed in the operation information display area m18. In the area m16, a bird's-eye view of the vehicle body is displayed, and sensors provided in each part and data that can be acquired from the sensors are displayed. As a result, it is possible to visually grasp at which position the sensor has an abnormality.

Further, in the area m16, the operation information displayed in the operation information display area m18 may be highlighted. In the example shown in FIG. 14, the emphasized portion is surrounded by a frame, but characters, colors, and the like may be used to clarify the position of the sensor from which the data displayed in the area m18 has been acquired. .. The display control unit 461 of the operator terminal 40 specifies a portion to be emphasized in the area m18 based on the data acquired as an abnormality from the relay server 20, and emphasizes the identified portion for display control. ..

Further, the position or data of the sensor in the area m16 can be selected by the operator, and when the operator presses the position of the sensor to be displayed, the operation input unit 43 that detects this operation is the sensor of the operation position. Alternatively, a signal for specifying data is output to the display control unit 461. The display control unit 461 identifies the sensor or data based on this signal, and controls so that the identified data is displayed in the operation information display area m18.

The operation information display area m18 is an area in which the acquired operation information is displayed. For example, presence / absence of abnormal parts, examples of cognitive information (position, signal, other traffic, etc.), examples of judgment / operation (speed, brake, steering, etc.), examples of display (blinker, brake, etc.), An example of a control instruction (other) is displayed in this area m18. As described above, the operator can change the display of the data in the area m18 by selecting the sensor or the data in the area m16. As a result, the operator can objectively and easily grasp the situation such as an accident while appropriately selecting the sensor and data to be confirmed.

The graph switching area m20 is, for example, an area for clarifying what is the main body of the graph displayed at the lower part of the area m18. In the example shown in FIG. 14, the control center (control system), the automobile (autonomous traveling vehicle A10), and the roadside system can be switched.

When the operator selects a certain tab, the operation input unit 43 recognizes the tab and outputs the recognition result to the display control unit 461. The display control unit 461 controls to display a graph of data related to the tab based on the recognition result. This makes it possible to switch graphs for each category.

The first graph display area m22 and the second graph display area m24 are areas in which graphs of data related to the category selected by the switching area m20 are displayed. In the example shown in FIG. 14, two graphs relating to the operation information acquired by the control center are displayed. However, the number of graphs displayed is not limited to two, and may be one or three or more.

In the example shown in FIG. 14, a graph showing the distance to the obstacle is displayed in the first graph display area m22, and the control data (target value) shown by the dotted line and the solid line are displayed in the second graph display area m24. Both the actual measurement data (measured value) shown in are displayed. As a result, it is possible to visually grasp whether the measured value is changing according to the target value.

Further, by displaying the target value and the measured value in an identifiable manner, the operator can easily grasp each change while distinguishing the target value from the measured value. As the target value, for example, data transmitted from the control center to the autonomous driving vehicle A10 can be used.

The mismatched data display area m26 is an area for displaying the mismatched data of the data detected by the detection unit 232. In the example shown in FIG. 14, vehicle speed information, signal information, and distance information are displayed as mismatched data.

Further, when the operator selects the data displayed in the mismatched data list, the graph related to the data may be displayed in the graph display area m22 and / or m24. For example, when the operation input unit 43 detects that the position in the area m26 is pressed, the display control unit 461 identifies and identifies the data from the position information by notifying the display control unit 461 of the pressed position information. The data graph is controlled to be displayed in the area m22 or m24. As a result, the operator can easily check the graph of the mismatch data, and can easily visually grasp where the mismatch is.

The screen shown in FIG. 14 is an example, and the size and position of each region can be changed as appropriate. For example, the display control unit 461 may display regions in which changes due to data selection are linked to each other close to each other.

As described above, according to the embodiment of the present disclosure, it is possible to objectively analyze the situation of the autonomous driving vehicle controlled based on the instruction from the control system or the like. For example, when the autonomous driving vehicle A10 travels based on an instruction from the control system, the abnormality of the autonomous driving vehicle A10 can be objectively detected, or when an accident occurs, the accident situation can be grasped based on the objective facts. It will be possible to properly analyze insurance payments. Further, by devising the user interface displayed on the operator terminal 40, it becomes possible to easily confirm the accident situation based on the objective facts in the automobile accident.

<Modification example>
In the above embodiment, the insurance server 30 determines the error rate and performs various display controls, so that the operator terminal 40 displays a predetermined screen. However, the operator terminal 40 may determine the error rate or perform control for displaying a predetermined screen on the display device (display unit 42). In this case, after installing a program for determining the error rate and a program for controlling the screen display on the operator terminal 40, various data may be acquired from the relay server 20 or the insurance server 30 and these programs may be executed.

Further, each function of the relay server 20 may be possessed by the insurance server 30 or the control server 10. In this case, the insurance server 30 or the control server 10 executes the above-mentioned processing such as abnormality detection processing.

Further, the above-mentioned autonomous traveling vehicle A10 may be an autonomous traveling vehicle that does not require a control signal from the control system. In this case, the data acquired by the autonomous vehicle A10 is transmitted to the relay server 20 or the insurance server 30. This makes it possible to detect an abnormality and display a user interface for grasping an accident situation without using the second data.

1 ... Information processing system, 10 ... Information processing device (control server), 11 ... Communication interface, 12 ... Storage unit, 13 ... Processor, 20 ... Information processing device (relay server), 21 ... Communication interface, 22 ... Storage unit, 23 ... Processor, 30 ... Information processing device (insurance server), 31 ... Communication interface, 32 ... Storage unit, 33 ... Processor, 40 ... Information processing device (operator terminal), 41 ... Communication interface, 43 ... Operation input unit, 45 ... Storage unit, 46 ... Processor, 131 ... Indicator unit, 231 ... Extraction unit, 232 ... Detection unit, 233 ... Judgment unit, 234 ... Request unit, 331 ... Error judgment unit, 332 ... Claimor judgment unit, 333 ... Accident analysis Unit, 334 ... Display control unit, 461 ... Display control unit

Claims (8)

On the server
The first data relating to the control of the autonomous traveling vehicle transmitted from the autonomous traveling vehicle, the first data including one or a plurality of types of data, and the first data relating to the control of the autonomous traveling vehicle transmitted from the control system. The second data including two types of data and one or more types of data, and the third data regarding the roadside system transmitted from the roadside system and including one or more types of data. Receive data and
An abnormality of the autonomous driving vehicle is detected based on the comparison result of at least two data of the first data, the second data, and the third data, and the two data of the corresponding types, respectively. ,
A program that executes processing by transmitting information indicating the abnormality to another information processing device. Detecting the anomaly
When the comparison result of the first data received via the control system or received from the autonomous vehicle with any of the second data and the third data satisfies the first abnormality condition. The program according to claim 1, wherein the abnormality is detected. Detecting the anomaly
The program according to claim 1 or 2, wherein when the comparison result between the second data and the third data satisfies the second abnormality condition, the abnormality is detected. The program according to any one of claims 1 to 3, wherein the information processing apparatus further executes a process of determining the responsibility for the abnormality based on at least two data in which the abnormality is detected. The transmission is
The control data included in the first data or the second data, the control data used for the first control of the autonomous traveling vehicle, and the measured data measured in the first control of the autonomous traveling vehicle. The program according to any one of claims 1 to 4, which comprises transmitting the data to the other information processing apparatus. The transmission is
When it is determined that the autonomous driving vehicle cannot travel by using the first data, a request for arranging a vehicle for moving the autonomous driving vehicle is transmitted to the other information processing device. The program according to any one of claims 1 to 4. The server
The first data relating to the control of the autonomous traveling vehicle transmitted from the autonomous traveling vehicle, the first data including one or a plurality of types of data, and the first data relating to the control of the autonomous traveling vehicle transmitted from the control system. The second data including two types of data and one or more types of data, and the third data relating to the roadside transmitted from the roadside system and including one or more types of data. Received
An abnormality of the autonomous driving vehicle is detected based on the comparison result of at least two data of the first data, the second data, and the third data, and the two data of the corresponding types, respectively. ,
An information processing method for executing processing, in which information indicating the abnormality is transmitted to another information processing device. The first data relating to the control of the autonomous traveling vehicle transmitted from the autonomous traveling vehicle, the first data including one or a plurality of types of data, and the first data relating to the control of the autonomous traveling vehicle transmitted from the control system. The second data including two types of data and one or more types of data, and the third data relating to the roadside transmitted from the roadside system and including one or more types of data. And the receiver that receives
At least two of the first data, the second data, and the third data, and the abnormality of the autonomous driving vehicle is detected based on the comparison result of the two data of the corresponding types. With the detector
A server including a transmission unit that transmits information indicating the abnormality to another information processing device.

Images