JP2023165315A - Information processing apparatus, driving diagnosis method, and program - Google Patents

Abstract

To prevent wrong driving diagnosis.SOLUTION: An information processing apparatus includes: an acquisition unit that acquires travel information on the travel of a vehicle and information on computerized regulation display from a picked-up image of the regulation display picked up by a camera mounted on the vehicle; a pre-processing unit that, when computerization of the regulation display fails or the information has a defective part including an abnormal value, sets data of the defective part to successfully computerized information before or after the defective part; and a diagnosis unit that executes driving diagnosis of the vehicle for the regulation display based on the information on the computerized regulation display and the travel information.SELECTED DRAWING: Figure 7

Description

The present invention relates to an information processing device, a driving diagnosis method, and a program.

Patent Document 1 discloses a technique for displaying a surrounding image from an image captured by a wearable terminal on another wearable terminal, and a technique for complementing defects in the image captured by the wearable terminal.

WO2018/051815

When the conventional technology is applied to reading a traffic sign imaged by a moving vehicle, there is a possibility that an image of an incorrect sign may be interpolated. Therefore, when diagnosing vehicle driving based on read traffic signs, there is a risk of erroneous diagnosis.

An object of the present invention is to provide an information processing device, a driving diagnosis method, and a program that make it possible to suppress incorrect driving diagnoses.

The information processing device according to claim 1 includes an acquisition unit that acquires travel information related to the travel of a vehicle and information on a regulation display converted into information from a captured image of a regulation display captured by a camera mounted on the vehicle. If the informationization of the regulatory display fails or there is a missing part that includes an abnormal value in the information, before setting the data of the missing part to the information that was successfully turned into information before or after the missing part. The vehicle includes a processing section, and a diagnosis section that executes a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display that has been converted into information and the driving information.

In the information processing device according to claim 1, the acquisition unit obtains travel information related to the travel of the vehicle and information on the regulation display converted into information from a captured image of the regulation display captured by a camera mounted on the vehicle. get. Here, the restriction display is, for example, a display related to a speed limit or a display related to a prohibited act. If the informationization of the regulation display fails or there is a missing part including an abnormal value in the information, the preprocessing unit converts the data of the missing part into information that has been successfully turned into information before or after the missing part. Set. Here, failure to informatize the regulation display means, for example, that the reliability of the information on the regulation display that has been converted into information from the captured image of the regulation display is less than a threshold value. The diagnostic unit executes a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display and the driving information.

In the information processing device, if the information processing of the regulation display fails or if there is a missing part including an abnormal value in the information, the data of the missing part is replaced with information that was successfully turned into information before or after the missing part. Set to . Therefore, according to the information processing device, incorrect driving diagnosis can be suppressed.

In the information processing device according to claim 2, in the information processing device according to claim 1, the preprocessing unit generates information that has the missing portion and has been successfully converted into information before or after the missing portion. When the result of the driving diagnosis based on is good, the data of the missing part is set as the information of the regulation display when the result is good.

In the information processing device according to claim 2, when there is the defective part and the result of driving diagnosis performed based on information successfully converted into information before or after the defective part is good, the defective part is data is set as information on the regulation display when the result is good. According to the information processing device, the information on the regulation display when the result of a driving diagnosis performed based on information successfully converted from the data of the missing part to information before or after the missing part is good. Set to . Therefore, incorrect driving diagnosis can be further suppressed.

In the information processing apparatus according to claim 3, in the information processing apparatus according to claim 1, when there is the missing part, the preprocessing section converts the data of the missing part into data before or after the missing part. Set to the maximum value of information that has been successfully turned into information.

In the information processing apparatus according to claim 3, when there is the missing part, the data of the missing part is set to the maximum value of information successfully converted into information before or after the missing part. According to the information processing apparatus, the data of the missing part is set to the maximum value of the information successfully converted into information before or after the missing part. Therefore, incorrect driving diagnosis can be further suppressed.

The driving diagnosis method according to claim 4 acquires driving information related to the driving of the vehicle and information on the regulation display converted into information from a captured image of the regulation display captured by a camera mounted on the vehicle, and If the informationization of the regulatory display fails or if there is a missing part including an abnormal value in the information, the data of the missing part is set to the information successfully turned into information before or after the missing part, and the information is converted into information. A computer executes a process of performing a driving diagnosis of the vehicle with respect to the regulation display based on the information on the regulation display and the travel information.

In the driving diagnosis method according to claim 4, the computer acquires driving information related to the driving of the vehicle and information on the regulatory display converted from a captured image of the regulatory display captured by a camera mounted on the vehicle. do. If the computer fails to convert the regulatory display into information, or if there is a missing part that includes an abnormal value in the information, the data of the missing part is set to the information that was successfully converted into information before or after the missing part. . A computer executes a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display that has been converted into information and the driving information.

In this driving diagnosis method, if the regulation display fails to be converted into information, or if there is a missing part including an abnormal value in the information, the data of the missing part is converted into information that was successfully converted into information before or after the missing part. Set to . Therefore, according to the driving diagnosis method, incorrect driving diagnosis can be suppressed.

The program according to claim 5 acquires driving information related to the driving of a vehicle and information about the regulation display converted from a captured image of the regulation display captured by a camera mounted on the vehicle, If informationization fails or there is a missing part including an abnormal value in the information, the data of the missing part is set to the information that was successfully turned into information before or after the missing part, and the information converted into information is The program is a program that causes a computer to execute a process of performing a driving diagnosis of the vehicle with respect to the regulation display based on information on the regulation display and the driving information.

A computer on which the program according to claim 5 is executed acquires travel information related to vehicle travel and regulatory display information converted from a captured image of the regulatory display captured by a camera mounted on the vehicle. do. If the computer fails to convert the regulatory display into information, or if there is a missing part that includes an abnormal value in the information, the data of the missing part is set to the information that was successfully converted into information before or after the missing part. . A computer executes a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display that has been converted into information and the driving information.

In this program, if the regulation display fails to be converted into information, or if there is a missing part that includes an abnormal value in the information, the data of the missing part is set to the information that was successfully converted into information before or after the missing part. do. Therefore, according to the program, incorrect driving diagnosis can be suppressed.

According to the present invention, incorrect driving diagnosis can be suppressed.

1 is a diagram showing a schematic configuration of a driving diagnosis system according to the present embodiment. FIG. 1 is a block diagram showing the hardware configuration of a vehicle according to the present embodiment. It is a block diagram showing the composition of ROM of the vehicle-mounted device of this embodiment. FIG. 2 is a block diagram showing a storage configuration of the on-vehicle device according to the present embodiment. FIG. 2 is a block diagram showing the functional configuration of the on-vehicle device according to the present embodiment. FIG. 2 is a block diagram showing the hardware configuration of a center server according to the present embodiment. FIG. 2 is a block diagram showing the functional configuration of a center server according to the present embodiment. It is a flowchart which shows the flow of regulation display information transmission processing performed in an on-vehicle device of this embodiment. It is a flowchart which shows the flow of the driving diagnosis process performed in the center server of this embodiment. 7 is a flowchart showing the flow of processing performed by a preprocessing unit in the center server of the present embodiment. FIG. 7 is a diagram illustrating an example of information on a plurality of regulation displays when the regulation display information is a speed limit sign. FIG. 7 is a diagram illustrating an example of information on a plurality of regulation displays when the regulation display information is a parking prohibition sign.

A driving diagnosis system including the information processing device of the present invention will be described. A driving diagnosis system is a system that performs driving diagnosis using information on traffic signs collected in a vehicle and driving information of the vehicle.

(overall structure)
As shown in FIG. 1, the driving diagnosis system 10 of this embodiment includes a vehicle 12 and a center server 30 as an information processing device. Furthermore, an on-vehicle device 20 is mounted on the vehicle 12. The onboard device 20 and the center server 30 are interconnected through a network N. Although FIG. 1 shows one vehicle 12 and one vehicle-mounted device 20 for one center server 30, the number of vehicles 12 and vehicle-mounted device 20 is not limited to this.

The center server 30 is installed, for example, at a manufacturer that manufactures the vehicle 12, a car dealer, or any business operator.

(vehicle)
As shown in FIG. 2, the vehicle 12 according to the present embodiment includes an on-vehicle device 20, a plurality of ECUs (Electronic Control Units) 22, and a plurality of on-vehicle devices 24.

The onboard device 20 includes a CPU (Central Processing Unit) 20A, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, a storage 20D, a wireless communication I/F (Interface) 20E, and an in-vehicle communication I/F 20F. It is configured. The CPU 20A, ROM 20B, RAM 20C, storage 20D, wireless communication I/F 20E, and in-vehicle communication I/F 20F are communicably connected to each other via an internal bus 20G.

The CPU 20A is a central processing unit that executes various programs and controls various parts. That is, the CPU 20A reads the program from the ROM 20B or the storage 20D and executes the program using the RAM 20C as a work area.

The ROM 20B stores various programs and data. As shown in FIG. 3, a control program 100 is stored in the ROM 20B of this embodiment. The control program 100 is a program for transmitting regulatory display information converted from images captured by a camera to the center server 30.

As shown in FIG. 2, the RAM 20C temporarily stores programs or data as a work area.

The storage 20D, which is a memory, is configured with an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various programs and various data. As shown in FIG. 4, the storage 20D of this embodiment stores a regulation information DB (database) 120, which is a data group of information on regulation display information. Note that the storage 20D may store the control program 100 and the regulation information DB 120.

As shown in FIG. 2, the wireless communication I/F 20E is a wireless communication module for communicating with the center server 30. The wireless communication module uses communication standards such as 5G, LTE, and Wi-Fi (registered trademark), for example. Wireless communication I/F 20E is connected to network N.

The in-vehicle communication I/F 20F is an interface for connecting with each ECU 22. The interface uses a communication standard based on the CAN protocol. The in-vehicle communication I/F 20F is connected to the external bus 20H.

The ECU 22 includes at least an ADAS (Advanced Driver Assistance System)-ECU 22A, a steering ECU 22B, a brake ECU 22C, and an engine ECU 22D.

The ADAS-ECU 22A centrally controls the advanced driving support system. A vehicle speed sensor 24A, a yaw rate sensor 24B, and a camera 24C, which constitute the on-board equipment 24, are connected to the ADAS-ECU 22A. The camera 24C is a camera that images the surroundings of the vehicle 12.

Steering ECU 22B controls power steering. A steering angle sensor 24D that constitutes the on-vehicle equipment 24 is connected to the steering ECU 22B. The steering angle sensor 24D is a sensor that detects the steering angle of the steering wheel.

As shown in FIG. 5, in the vehicle-mounted device 20 of this embodiment, the CPU 20A functions as an acquisition section 200, a processing section 210, and a transmission section 220 by executing the control program 100.

The acquisition unit 200 has a function of acquiring vehicle information. The vehicle information includes information such as the state of the on-vehicle device 24, the state of the vehicle 12 obtained from the on-vehicle device 24, and images captured in the vehicle 12. The vehicle information in this embodiment includes driving information such as position information, vehicle speed, yaw rate, or steering angle. Further, the vehicle information includes a captured image of the exterior of the vehicle 12 captured by the camera 24C.

The processing unit 210 has a function of storing the vehicle information acquired by the acquisition unit 200 in the storage 20D and converting the vehicle information into regulatory display information by recognizing the regulatory display from the captured image captured by the camera 24C. have. Specifically, the processing unit 210 of this embodiment temporarily stores vehicle information in the storage 20D, and then transmits the vehicle information to the center server 30 using the transmitting unit 220 when there is a request from the center server 30. Further, the processing unit 210 converts the captured image captured by the camera 24C into regulatory display information through image recognition processing, and derives the reliability of the regulatory display information.

More specifically, the processing unit 210 recognizes a speed limit sign or a prohibition sign (a stop sign, a no-parking sign, or a no-turning sign), which is a restriction display represented by the captured image, and recognizes the speed limit sign or prohibition sign. Information is converted into a flag indicating the presence or absence of the information.

The transmitter 220 has a function of transmitting vehicle information and regulation display information stored in the storage 20D to the center server 30. Specifically, the transmitting unit 220 of this embodiment transmits the vehicle information and regulation display information stored in the storage 20D to the center server 30 when there is a request from the center server 30.

(center server)
As shown in FIG. 6, the center server 30 includes a CPU 30A, a ROM 30B, a RAM 30C, a storage 30D, and a communication I/F 30E. The CPU 30A, ROM 30B, RAM 30C, storage 30D, and communication I/F 30E are communicably connected to each other via an internal bus 30G. The functions of the CPU 30A, ROM 30B, RAM 30C, storage 30D, and communication I/F 30E are the same as those of the CPU 20A, ROM 20B, RAM 20C, storage 20D, and wireless communication I/F 20E of the vehicle-mounted device 20 described above. Note that the communication I/F 30E may perform wired communication. CPU30A is an example of a processor.

The storage 30D of this embodiment stores a processing program 150 as a program and a regulation value information DB 160. Note that the ROM 30B may store the processing program 150 and the regulation value information DB 160.

The processing program 150 is a program for controlling the center server 30. As the processing program 150 is executed, the center server 30 collects information on regulation displays from the vehicle 12 and executes various processes for performing driving diagnosis on the travel information of the vehicle 12.

The regulation value information DB 160 stores regulation display information and reliability collected from the vehicles 12.

Specifically, a flag indicating the presence or absence of a speed limit, a stop sign, a no-parking sign, or a no-turning sign, which is converted into information at each position, is stored together with the reliability.

As shown in FIG. 7, in the center server 30 of this embodiment, the CPU 30A functions as a collection section 250, an acquisition section 260, a preprocessing section 270, and a diagnosis section 280 by executing the processing program 150.

The collection unit 250 has a function of acquiring information on restriction display from the on-vehicle device 20 of the vehicle 12. The collection unit 250 stores the acquired regulation display information in the regulation value information DB 160 together with the reliability and position information indicating the informationized position.

The acquisition unit 260 has a function of acquiring vehicle information of the vehicle 12 from the on-vehicle device 20 of the vehicle 12.

If the informationization of the regulatory display fails or there is a missing part including an abnormal value in the information, the preprocessing unit 270 converts the data of the missing part into information that has been successfully turned into information before or after the missing part. Set.

Specifically, when there is a missing part, the preprocessing unit 270 sets the data of the missing part to the maximum value of the information successfully converted into information before or after the missing part.

More specifically, when the reliability of the sign related to the speed limit is equal to or higher than a threshold value (for example, 50%), the informationized speed limit is recorded.

In addition, if the reliability of the sign related to the speed limit is less than a threshold value (for example, 50%), it is determined that there is a missing part where the informationization of the regulation display has failed, and the speed limit of the missing part is changed to the missing part. Set to the maximum value of the speed limit that was successfully converted into information before or after the section.

In addition, if the difference between the previous or subsequent speed limit that was successfully converted into information is more than a threshold value (for example, 40 km/h), it is determined that the information is a missing part that includes an abnormal value, and the missing part is restricted. The speed is set to the maximum value of the speed limit successfully converted into information before or after the missing part.

In addition, when the informationized regulation display is a display related to a prohibited act (a stop sign, a no parking sign, a no turning sign), the preprocessing unit 270 determines whether or not there is an informationized display related to a prohibited act. If the reliability of the represented flag is equal to or higher than a threshold value (for example, 50%), a flag representing the presence or absence of a display related to a prohibited act is recorded.

In addition, if the reliability of the flag indicating the presence or absence of a display related to a prohibited act that has been computerized is less than a threshold value (for example, 50%), it is determined that there is a missing part where the informationization of the regulatory display has failed, and the relevant The flag of the missing part is set to the maximum value (0 or 1) of the flags successfully converted into information before or after the missing part. Here, when the flag is 1, it indicates that there is a display related to a prohibited act.

The diagnosis unit 280 diagnoses a violation when the vehicle traveling based on the traveling information included in the vehicle information acquired from the onboard device 20 of the vehicle 12 satisfies the violation condition based on the updated regulation value.

Specifically, the diagnostic unit 280 diagnoses whether or not the driving of the vehicle 12 is in violation, with the violation condition being that the vehicle is traveling significantly in excess of the speed limit in the vicinity of a speed limit sign.

For example, the violation condition is vehicle speed > speed limit + excessive speed. The excess speed is 20 km/h, 30 km/h or 40 km/h.

Furthermore, the diagnostic unit 280 diagnoses whether the driving of the vehicle 12 violates the condition of not stopping temporarily around a stop sign.

For example, if the flag related to a stop sign is on, it is tentatively diagnosed as a violation, and if the vehicle speed falls below a threshold (for example, 1 km/h), the provisional diagnosis as a violation is deleted and it is determined that there is no violation. Diagnose.

Furthermore, the diagnostic unit 280 diagnoses whether or not the driving of the vehicle 12 is in violation, with parking near a no-parking sign as a violation condition.

For example, if the flag related to a no-parking sign is on and the vehicle speed is less than a threshold value (for example, 1 km/h), a violation will be tentatively diagnosed, and the duration of the state in which the vehicle speed is less than the threshold value (1 km/h) is less than a threshold (for example, 180 seconds), the provisional diagnosis of violation is deleted and the diagnosis is made that there is no violation.

Furthermore, the diagnostic unit 280 diagnoses whether or not the driving of the vehicle 12 is in violation, using turning around the no-turn sign as a violation condition.

For example, if the flag related to the no-turn sign is on, a violation is tentatively diagnosed, and the maximum yaw angle of the vehicle 12 is less than a threshold (for example, 150°), and the maximum steering angle of the steering wheel of the vehicle 12 is determined. is less than a threshold value (for example, 400°), the provisional diagnosis of violation is deleted and the diagnosis is made that there is no violation.

(control flow)
The flow of processing executed by the driving diagnosis system 10 of this embodiment will be explained using flowcharts shown in FIGS. 8 to 10. Processing in the onboard device 20 is executed by the CPU 20A of the onboard device 20 functioning as an acquisition section 200, a processing section 210, and a transmission section 220. Further, the processing in the center server 30 is executed by the CPU 30A of the center server 30 functioning as a collection unit 250, an acquisition unit 260, a preprocessing unit 270, and a diagnosis unit 280.

First, while the vehicle 12 is running, the CPU 20A of the onboard device 20 executes the regulation display information transmission process shown in FIG.

In step S100 of FIG. 8, the processing unit 210 acquires a captured image of the exterior of the vehicle 12 captured by the camera 24C.

In step S102, the processing unit 210 converts the regulatory display into information by recognizing the regulatory display from the captured image captured by the camera 24C, derives the reliability of the regulatory display information, and generates regulatory information. Store it in DB120 once.

In step S104, the processing unit 210 determines whether the regulation display has been recognized through the process in step S102. If the regulation display is recognized through the processing in step S102, the process moves to step S106. On the other hand, if the regulation display is not recognized in the process of step S102, the regulation display information transmission process is ended.

In step S106, the transmitter 220 transmits the regulation display information obtained as the recognition result in step S102 to the center server 30 together with the reliability and position information of the regulation display information, and ends the regulation display information transmission process. do.

The center server 30 stores the regulation display information received from the onboard device 20 in the regulation value information DB 160 together with the reliability and the position information of the informationized position.

Further, while the vehicle 12 is running, the onboard device 20 transmits the acquired vehicle information to the center server 30. At this time, in the center server 30, the CPU 30A repeatedly executes the driving diagnosis process shown in FIG.

In step S<b>110 in FIG. 9 , the acquisition unit 260 acquires vehicle information of the vehicle 12 from the onboard device 20 of the vehicle 12 .

In step S112, the preprocessing unit 270 acquires, from the regulation value information DB 160, regulation display information corresponding to the position information included in the acquired vehicle information and the reliability of the regulation display information. Here, it is assumed that a plurality of pieces of regulation display information corresponding to the position information included in the acquired vehicle information are acquired.

Specifically, when the regulation display is a speed limit sign, the preprocessing unit 270 obtains the speed limit, which is the regulation value corresponding to the position information included in the acquired vehicle information, and the speed limit from the regulation value information DB 160. Obtain the reliability of the sign related to.

Further, when the regulation display is a stop sign, the preprocessing unit 270 retrieves from the regulation value information DB 160 a flag related to the stop sign, which is a regulation value corresponding to the position information included in the acquired vehicle information, and a temporary stop sign. Get the confidence level of a stop sign.

Further, when the restriction display is a turning prohibition sign, the preprocessing unit 270 retrieves from the restriction value information DB 160 a flag related to the turning prohibition sign, which is a restriction value corresponding to the position information included in the acquired vehicle information, and a turning prohibition sign. Get the confidence level of a prohibition sign.

In addition, when the regulation display is a parking prohibition sign, the preprocessing unit 270 extracts from the regulation value information DB 160 a flag related to the parking prohibition sign, which is a regulation value corresponding to the position information included in the acquired vehicle information, and a parking prohibition sign. Get the confidence level of a prohibition sign.

In step S114, the preprocessing unit 270 converts the data of the missing part into information about the regulation display acquired in step S112, if the information of the regulation display fails or if the information has a missing part including an abnormal value. Set to the information successfully converted into information before or after the missing part.

The above step S114 is realized by the processing routine shown in FIG. The processing routine shown in FIG. 10 is executed for each piece of regulation display information at each target position among the plurality of regulation display information acquired in step S112.

In step S120, the preprocessing unit 270 determines whether the reliability of the information on the regulation display at the target position is less than a threshold (for example, 50%), or whether the difference between the information on the regulation display before and after the target position is It is determined whether the speed is equal to or higher than a threshold value (for example, 40 km/h). If the reliability of the information on the regulation display at the target position is less than a threshold (for example, 50%), or if the difference between the information on regulation displays before and after the target position is equal to or greater than the threshold, the process moves to step S122. do. On the other hand, the reliability of the information on the regulation display at the target position is greater than or equal to the threshold (e.g., 50%), and the difference between the information on the regulation display before and after the target position is less than the threshold (e.g., 40 km/h). If so, the processing routine is ended without changing the information on the restriction display at the target position.

In step S122, the preprocessing unit 270 determines whether the reliability of the information on the regulation display before or after the target position is equal to or higher than a threshold value (for example, 50%).

In step S122, the preprocessing unit 270 moves to step S124 when the reliability of the information on the regulation display before or after the target position is equal to or higher than the threshold value. On the other hand, if the reliability of the information on the regulation displays before and after the target position is less than the threshold, the processing routine is ended without updating the information on the regulation displays at the target position.

In step S124, the preprocessing unit 270 updates the information on the regulation display at the target position with the maximum value of the information on the regulation displays before and after the target position, and ends the processing routine.

FIG. 11 shows an example of information on a plurality of regulation displays acquired in step S112, when the regulation display information is a speed limit sign. In this example, the reliability of the information on the regulation display at location No. "4" is 30%, which is less than the threshold, so the information on the regulation display that was successfully converted into information before and after location No. "4" is The speed limit at position No. "4" is updated with the speed limit at position No. "5", which is the maximum value.

Further, FIG. 12 shows an example of information on a plurality of regulation displays acquired in step S112, when the regulation display information is a parking prohibition sign. In this example, the reliability of the information on the regulation display at location No. "4" is 30%, which is less than the threshold, so the information on the regulation display that was successfully converted into information before and after location No. "4" is The flag related to the parking prohibition sign at position No. "4" is updated with the flag "1" related to the parking prohibition sign, which is the maximum value.

Then, in step S116 in FIG. 9, the diagnosis unit 280 determines that if the driving of the vehicle based on the driving information included in the vehicle information acquired from the onboard device 20 of the vehicle 12 satisfies the violation condition based on the updated regulation value. In this case, a violation is diagnosed and the driving diagnosis process is terminated.

Specifically, in the case where the information on the regulation display is a speed limit sign, the diagnosis unit 280 sets the violation condition to driving significantly in excess of the speed limit in the vicinity of the speed limit sign. It is diagnosed whether the driving of the vehicle 12 is in violation.

Furthermore, when the information on the regulation display is a stop sign, the diagnostic unit 280 diagnoses whether the driving of the vehicle 12 is in violation, with the violation condition being not stopping temporarily around the stop sign.

Furthermore, when the information on the regulation display is a no-parking sign, the diagnostic unit 280 diagnoses whether the driving of the vehicle 12 is in violation, with parking near the no-parking sign as a violation condition.

Furthermore, when the information on the restriction display is a no-turning sign, the diagnostic unit 280 diagnoses whether the driving of the vehicle 12 is in violation, using turning around the no-turning sign as a violation condition.

(Summary of embodiments)

When the center server 30 of this embodiment fails to informatize the regulation display or there is a missing part including an abnormal value in the information, the center server 30 successfully converts the data of the missing part into information before or after the missing part. Update the information. In this way, by supplementing the missing data with information that has been successfully converted into information, it is possible to prevent incorrect driving diagnosis.

[remarks]
In the above embodiment, the data of the missing part is set to the maximum value of the information successfully converted into information before or after the missing part, but this is not the case. If there is a defective part and the results of driving diagnosis based on the information successfully converted into information before or after the defective part are good, the data of the defective part will be used when the result is good. It may also be set to the information on the regulatory display. For example, if the vehicle is traveling at a speed of 55 km/h at a location where the speed limit is 60 km/h, the results of the driving diagnosis will be good. Here, if the speed limit of the defective part before or after the position where the speed limit is 60km/h is 40km/h, the speed limit of the defective part is 60km/h at the position where the diagnosis result is good. All you have to do is update.

Furthermore, the various processes that the CPU 20A and the CPU 30A read and executed the software (programs) in the above embodiments may be executed by various processors other than the CPU. In this case, the processor is a PLD (Programmable Logic Device) whose circuit configuration can be changed after manufacturing, such as an FPGA (Field-Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit) to execute specific processing. An example is a dedicated electric circuit that is a processor having a specially designed circuit configuration. Furthermore, each of the above-mentioned processes may be executed by one of these various processors, or a combination of two or more processors of the same type or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA). combinations etc.). Further, the hardware structure of these various processors is, more specifically, an electric circuit that is a combination of circuit elements such as semiconductor elements.

Furthermore, in the above embodiments, each program has been described as being stored (installed) in advance in a computer-readable non-temporary recording medium. For example, the control program 100 in the on-vehicle device 20 is stored in advance in the ROM 20B, and the processing program 150 in the center server 30 is stored in advance in the storage 30D. However, the program is not limited to this, and each program can be recorded on non-temporary recording media such as CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), and USB (Universal Serial Bus) memory. It may be provided in the form of Further, the program may be downloaded from an external device via a network.

The process flow described in the above embodiment is an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed without departing from the main idea.

12 Vehicle 20 Onboard equipment 30 Center server (information processing device)
30A CPU (processor)
30D storage (memory)
150 Processing program (program)
250 Collection unit 260 Acquisition unit 270 Preprocessing unit 280 Diagnosis unit

Claims (5)

an acquisition unit that acquires travel information related to vehicle travel and regulatory display information converted from a captured image of the regulatory display captured by a camera mounted on the vehicle;
a pre-processing unit that sets the data of the missing part to information that has been successfully turned into information before or after the missing part when the informationization of the regulation display fails or there is a missing part including an abnormal value in the information; and,
a diagnosis unit that executes a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display that has been converted into information and the driving information;
Information processing equipment including. The pre-processing section includes:
If there is the missing part and the result of a driving diagnosis based on the information successfully converted into information before or after the missing part is good, the data of the missing part is used as the result. 2. The information processing apparatus according to claim 1, wherein the information processing apparatus is set to the information of the restriction display when the restriction display is performed. The pre-processing section includes:
2. The information processing apparatus according to claim 1, wherein when the missing part exists, the data of the missing part is set to the maximum value of information successfully converted into information before or after the missing part. Obtaining driving information related to vehicle travel and regulatory display information converted from a captured image of the regulatory display captured by a camera mounted on the vehicle;
If the informationization of the regulation display fails or there is a missing part including an abnormal value in the information, the data of the missing part is set to information that was successfully turned into information before or after the missing part,
A driving diagnosis method in which a computer performs a process of executing a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display and the driving information. Obtaining driving information related to vehicle travel and regulatory display information converted from a captured image of the regulatory display captured by a camera mounted on the vehicle;
If the informationization of the regulation display fails or there is a missing part including an abnormal value in the information, the data of the missing part is set to information that was successfully turned into information before or after the missing part,
A program that causes a computer to execute a process of executing a driving diagnosis of the vehicle with respect to the regulation display based on the information of the regulation display that has been converted into information and the driving information.