JP2022158251A - Information processor - Google Patents

Abstract

To highly precisely detect an abnormality in a behavior of a driver of a vehicle.SOLUTION: An information processor includes a control unit that determines whether a driver's behavior is abnormal or not based on information which represents a steering angle of a vehicle and an image obtained by imaging a driver who drives the vehicle, and outputs at least one of a notification of abnormality and an advice for the driver when the driver's behavior is determined to be abnormal.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to an information processing device.

Conventionally, there is a technology in which an ECU detects vehicle sway based on a steering angle (for example, Patent Document 1).

JP 2019-182050 A JP 2018-180969 A

An object of the present disclosure is to provide an information processing device capable of accurately detecting abnormal behavior of a vehicle driver.

One aspect of the present disclosure is to determine whether or not the behavior of the driver is abnormal based on information indicating the steering angle of the vehicle and an image of the driver driving the vehicle. The information processing apparatus includes a control unit that outputs at least one of notification of the abnormality and advice to the driver when the behavior is determined to be abnormal.

Aspects of the present disclosure may include at least one of an information processing method, an information processing system, a program, and a recording medium recording the program, which have the same characteristics as the information processing apparatus.

According to the present disclosure, it is possible to accurately detect an abnormality in the behavior of the driver of the vehicle.

FIG. 1 is a schematic diagram of an information processing system according to an embodiment. FIG. 2 is a diagram illustrating a configuration example of a server. FIG. 3 is a diagram showing a configuration example of a terminal mounted on a vehicle. FIG. 4 is a flowchart illustrating an example of terminal processing. FIG. 5 is a flowchart illustrating an example of server processing.

An information processing apparatus according to an embodiment determines whether the driver's behavior is abnormal based on information indicating the steering angle of the vehicle and an image of the driver driving the vehicle, and determines whether the driver's behavior is abnormal. and a control unit that outputs at least one of notification of abnormality and advice to the driver when determining that there is an abnormality.

According to the information processing device, since it is determined whether or not the driver's behavior is abnormal by using not only the information indicating the steering angle but also the image information, it is possible to accurately detect the behavioral abnormality. Then, it is possible to provide the driver or the like with one of the abnormality notification and advice.

An information processing apparatus according to an embodiment will be described below with reference to the drawings. The configuration of the embodiment is an example, and the present disclosure is not limited to the configuration of the embodiment.

<Configuration of information processing system>
FIG. 1 is a schematic diagram of an information processing system according to an embodiment. In FIG. 1 , the information processing system includes a network 1 , a server 2 , a terminal 3 mounted on a vehicle 10 , a terminal 4 connected to the network 1 and a base station 5 . The server 2 is an example of an “information processing device”.

The network 1 is formed by connecting a public communication network such as the Internet and a wireless communication network, for example. The wireless communication network conforms to or complies with wireless communication standards available to the terminals 3 . Examples of wireless communication standards include 4G (Long Term Evolution (LTE)), 5G, wireless LAN (Local Area Network: including Wi-Fi), and BLE, but other standards may be used.

The network 1 provides the terminal 3 with a line conforming to the wireless communication standard supported by the terminal 3 . In this embodiment, as an example, the terminal 3 supports 5G, and the network 1 provides the terminal 3 with a 5G line. However, even if the terminal 3 is capable of communicating in other than 5G (for example, 4G (LTE)), it may support two or more wireless communication standards (for example, 4G and 5G).

A base station 5 is a base station of a wireless communication network forming the network 1 and is a wireless base station capable of wireless communication with the terminal 3 . Although one base station 5 is shown in FIG. 1, a plurality of base stations 5 are installed in a communication area that provides terminals 3 with an environment in which wireless communication is possible.

The terminal 3 is a terminal (in-vehicle terminal) mounted in the vehicle 10 . The terminal 3 may be fixed (installed) to the vehicle 10 or detachable from the vehicle 10 . The vehicle 10 is an automobile (passenger car, truck, bus, etc.). The terminal 3 receives information (referred to as steering angle information) indicating the steering angle of the vehicle 10 detected by the sensor 62 ( FIG. 2 ) mounted on the vehicle 10 and the image captured by the camera 61 mounted on the vehicle 10 . data (referred to as image information) is transmitted to the server 2 via the base station 5 and the network 1 . In this specification, the term "video" includes not only moving pictures but also still pictures (images).

The server 2 receives steering angle information and image information transmitted from the terminal 3 via the network 1, and determines whether or not the behavior of the driver (user) 11 of the vehicle 10 is abnormal based on this information. If the behavior of the driver 11 is determined to be abnormal, the server 2 transmits notification of the abnormality and advice (such as how to drive, tips for driving, recommended actions, etc.) to the terminal 3 (vehicle 10). . In addition, the server 2 transmits to the terminal 4 information about the vehicle 10 and the driver 11 and information indicating the result of determination as to whether there is an abnormality in behavior.

The terminal 4 is, for example, a terminal of an automobile insurance business operator, and is an automobile insurance (telematics insurance) business operator to which the driver 11 is enrolled. Information from the server 2 received by the terminal 4 is used as data for determining the insurance premium of the driver 11 and the like.

<Server configuration>
FIG. 2 is a diagram showing a configuration example of the server 2. As shown in FIG. The server 2 can be configured using a general-purpose information processing device (computer) such as a personal computer (PC) and workstation, or a dedicated information processing device such as a server machine. The server 2 has a communication function and can be connected to the network 1 by wire or wirelessly.

The server 2 includes a processor 21 as a processing unit or a control unit (controller), a storage device 22, and a communication interface 23 (communication IF 23), which are interconnected via a bus 26.
, an input device 24 and a display 25 . The server 2 may be one information processing device or a set (cloud) of two or more information processing devices.

The storage device 22 includes a main storage device and an auxiliary storage device. The main memory is used as a storage area for programs and data, a development area for programs, a work area for programs, a buffer area for communication data, and the like. The main memory is composed of a RAM (Random Access Memory) or a combination of a RAM and a ROM (Read Only Memory). Auxiliary storage is used as a storage area for data and programs. Non-volatile storage media such as hard disks, Solid State Drives (SSDs), flash memories, and EEPROMs (Electrically Erasable Programmable Read-Only Memory) can be applied as auxiliary storage devices.

The communication IF 23 is a circuit that performs communication processing, and operates as a transmitter and a receiver (communication section). For example, the communication IF 23 is a network interface card (NIC). Also, the communication IF 23 may be a wireless communication circuit that performs wireless communication (LTE, 5G, wireless LAN (Wi-Fi), BLE, etc.). Further, the communication IF 23 may include both a circuit that performs wired communication processing and a wireless communication circuit.

The input device 24 includes keys, buttons, a pointing device, a touch panel, etc., and is used to input information. The display 25 is, for example, a liquid crystal display or an organic EL display, and displays information and data.

The processor 21 is, for example, a CPU (Central Processing Unit). The processor 21 performs various processes by executing various programs stored in the storage device 22 .

For example, the processor 21 analyzes and analyzes the steering angle information and the image information, determines behavioral anomalies based on the results of the analysis, processes for transmitting an anomaly notification and advice to the terminal 3 based on the results of the anomaly determination, and determines the content of the anomaly determination. Processing such as transmission to the terminal 4 is performed.

<Device configuration>
FIG. 3 shows a configuration example of the terminal 3. As shown in FIG. As the terminal 3, a dedicated or general-purpose terminal device having a wireless communication function with the base station 5 can be applied. 3, the terminal 3 includes a processor 31, a storage device 32, a communication interface (communication IF) 33, an input device 34, a display 35, and input/output circuits (I/O) 37 and 38 connected to the bus B. An antenna 33 a is connected to the communication IF 33 . A camera 61 mounted on the vehicle 10 is connected to the I/O 37 , and a sensor 62 mounted on the vehicle 10 is connected to the I/O 38 .

The processor 31, storage device 32, input device 34, and display 35 can be the same as those described for the processor 21, storage device 22, input device 24, and display 25, respectively. However, depending on the difference in use, purpose of use, etc., the one applied to the server 2 and the one with different performance or type are applied.

The communication IF 33 is a communication interface for radio communication for radio communication with the base station 5, and is connected to the transmission/reception antenna 33a for transmission/reception of radio signals. The speaker 36 is used to emit sound based on the audio signal.

A video signal captured by a camera 61 mounted on the vehicle is input to the terminal 3 via the I/O 37 . The camera 61 is set inside the vehicle 10 , particularly at a position where it is possible to suitably capture the behavior (posture, etc.) of the driver 11 who is driving, and captures an image showing the behavior of the driver 11 . The video signal is converted into video data (moving image file) by the processor 31 or the like and stored in the storage device 32 .

Also, an output signal from a sensor 62 mounted on the vehicle 10 is input to the terminal 3 via the I/O 38 . The sensor 62 is used to detect (measure) the steering angle of the vehicle 10 by detecting the rotation angle of the steering wheel of the vehicle 10 . For example, the processor 31 can generate steering angle information indicating the steering angle and the like from the output signal of the sensor 62 and store it in the storage device 32 . The sensor 62 may measure the actual yaw rate or acceleration of the vehicle 10 in addition to the steering angle.

As the processors 21 and 31 described above, a plurality of CPUs or a multi-core CPU may be applied. At least part of the processing performed by the CPU may be performed by a processor other than the CPU, such as a DSP (Digital Signal Processor) or GPU (Graphical Processing Unit). In addition, at least part of the processing performed by the CPU, ASIC (Application Specific Integrated Circuit) and FPG
Dedicated or general-purpose integrated circuits (hardware) such as A (Field Programmable Gate Array)
, or by a combination of a processor and an integrated circuit. The combination is called, for example, a microcontroller (MCU), SoC (System-on-a-chip), system LSI, or chipset.

<Operation example>
FIG. 4 is a flow chart showing a processing example of the processor 31 of the terminal 3. As shown in FIG. The processing shown in FIG. 4 is performed by the processor 31 of the terminal 3 executing the program. In step S<b>001 , the processor 31 acquires steering angle information by generating steering angle information from the output signal of the sensor 62 .

In step S<b>002 , the processor 31 acquires image information by generating image information in which the behavior of the driver 11 is captured from the video signal captured by the camera 61 .

In step S<b>003 , the processor 31 performs processing for transmitting to the server 2 a message including steering angle information, image information, identification information (vehicle ID) of the vehicle 10 and identification information (user ID) of the driver 11 . The message is received by the server 2 via the network 1 from the communication IF 33 . Note that the terminal 3 already knows the network address of the server 2 .

In step S<b>004 , processor 31 waits for a response message from server 2 . In step S<b>005 , the processor 31 notifies the driver 11 of the abnormality included in the reply from the server 2 .

The notification is displayed on the display 35 that the behavior of the driver 11 or the vehicle 10 is abnormal (the vehicle 10 is swaying, or the behavior of the driver 11 is the cause of swaying (not swaying but causing the swaying). It can be done by displaying information indicating that it behaves like this)). Alternatively, the processor 31 may make the notification by causing the speaker 36 to emit a sound indicating the information described above.

In addition, when advice is included in the answer, the processor 31 uses at least one of the display 35 and the speaker 36 to notify the abnormality together with the notification of the abnormality or separately from the notification of the abnormality. The advice is posture, behavior, driving method, or the like that suppresses the behavior that causes the abnormality. There are no restrictions on the contents of the notification of abnormality and the advice.

In step S006, processor 31 determines whether or not to end the process. If it is determined not to end the process, the process returns to step S001, otherwise the process of FIG. 4 ends. Note that the order of steps S001 and S002 may be reversed.

FIG. 5 is a flowchart showing an example of processing by the server 2. As shown in FIG. The processing shown in FIG. 5 is performed by the processor 21 of the server 2 executing a program. In step S<b>101 , the processor 21 acquires steering angle information and image information included in the message received by the server 2 from the terminal 3 .

At step S102, the processor 21 analyzes the steering angle information and the image information. For example, the processor 31 uses the steering angle information to determine whether the steering angle changes suddenly after being maintained at a constant angle, or whether the driver 11 has fallen asleep and notices an abnormal behavior. analysis. Alternatively, if the steering angle information includes information indicating the actual yaw rate occurring in the vehicle 10, the processor 31 calculates the yaw rate difference, which is the difference between the actual yaw rate and the model yaw rate calculated based on the steering angle. and whether the vehicle 10 is staggering (whether the behavior is abnormal) may be determined from the yaw rate difference. Further, the yaw angular acceleration may be calculated based on the actual yaw rate, and the abnormal behavior of the vehicle 10 may be determined from the magnitude of the yaw angular acceleration.

In addition, the processor 21 analyzes the image information using information or data for image analysis pre-stored in the storage device 32, and determines the posture of the driver 11, looking aside, driving with one hand, or falling asleep (inclination of the neck). etc.).

In step S103, the processor 21 determines whether the behavior of the driver 11 is abnormal based on the analysis result of the steering angle information and the analysis result of the image information. If the behavior of the driver 11 is determined to be abnormal, the process proceeds to step S104, otherwise the process of FIG. 5 ends.

In step S104, the processor 21 generates a response message including an abnormality notification and advice, and performs processing for transmitting the response message to the source address (terminal 3) attached to the message from the terminal 3. . Note that either one of the abnormality notification and the advice may be used.

In step S<b>105 , the processor 21 performs processing for transmitting to the terminal 4 the analysis result of the steering angle information, the analysis result of the image information, and the information indicating the abnormality determination result based thereon together with the vehicle ID and the user ID. The network address of terminal 4 is known to server 2 .

<Action and effect of the embodiment>
The processor 21 (control unit) of the server 2 according to the embodiment determines whether the behavior of the driver 11 is abnormal based on the information indicating the steering angle of the vehicle 10 and the captured image of the driver 11 driving the vehicle 10. is determined, and when it is determined that the behavior of the driver 11 is abnormal, at least one of notification of abnormality and advice to the driver is output.

The server 2 determines whether the behavior of the driver 11 is abnormal based on both the behavioral abnormality determination of the vehicle 10 based on the steering angle information analysis result and the behavioral abnormality determination of the driver 11 based on the image information analysis result. do. Therefore, it is possible to improve the detection accuracy of the behavioral anomaly compared to the case where the behavioral anomaly is determined from the steering angle information. That is, it is possible to accurately detect an abnormality in the behavior of the driver of the vehicle 10 .

A configuration may be employed in which the terminal 3 performs operations corresponding to steps S102 to S105 shown in FIG. 5 and operates as the "information processing apparatus" in the embodiment. In this case, for example, the terminal 3 performs a process of notifying the driver 11 of the abnormality and advice in the process corresponding to step S104. In addition, the terminal 3 transmits the analysis result and the determination result to the server 2 in the process corresponding to step S105, and the server 2 transmits these to the terminal 4. FIG.

Note that the server 2 may convert the driving behavior of the driver 11 into a score based on the analysis results of the steering angle information and the image information, and notify the driver 11 of the driving behavior along with advice to contribute to safe driving.

<Others>
The above-described embodiment is merely an example, and the present disclosure can be modified as appropriate without departing from the scope of the present disclosure. Also, the processing described as being performed by one device may be shared and performed by a plurality of devices. Alternatively, processes described as being performed by different devices may be performed by one device. In a computer system, it is possible to flexibly change the hardware configuration (server configuration) to implement each function.

The present disclosure can also be implemented by supplying a computer program implementing the functions described in the above embodiments to a computer, and reading and executing the program by one or more processors of the computer. Such a computer program may be provided to the computer by a non-transitory computer-readable storage medium connectable to the system bus of the computer, or may be provided to the computer via a network. A non-transitory computer-readable storage medium can be any type of disk such as, for example, a magnetic disk (floppy disk, hard disk drive (HDD), etc.), an optical disk (CD-ROM, DVD disk, Blu-ray disk, etc.). be. Non-transitory computer readable media also include read only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards, flash memory, optical cards, suitable for storing electronic instructions. Including any type of medium.

Reference Signs List 1 network 2 servers 3, 4 terminals 21, 31 processors 22, 32 storage devices 23, 33 communication interfaces 24, 34 input device 25, 35 Display 61 Camera 62 Sensor

Claims (1)

determining whether the behavior of the driver is abnormal based on information indicating the steering angle of the vehicle and an image of the driver driving the vehicle; , an information processing device including a control unit that outputs at least one of notification of abnormality and advice to the driver.

Images