JP7445706B2 - driver assistance system - Google Patents

Description

TECHNICAL FIELD The present invention relates to a driver assistance system .

2. Description of the Related Art Conventionally, techniques for assisting drivers of moving objects are known (for example, see Patent Document 1). Patent Document 1 detects driving information such as brake operation and steering wheel operation, detects the traffic environment around the vehicle, determines whether the driving behavior is dangerous based on the detected driving information and the traffic environment, and detects the dangerous driving behavior. Disclosed is a safe driving support device that presents information regarding future dangerous driving behavior to the driver when it is determined that the driving behavior is a risky driving behavior in the future.

Japanese Patent Application Publication No. 2007-164525

Incidentally, even driving that a driver does not recognize as dangerous driving may be dangerous driving for other vehicles around the vehicle driven by the driver. However, since Patent Document 1 does not take matters related to other vehicles into consideration when determining whether or not the driver has engaged in dangerous driving, there is a possibility that it may not be possible to appropriately determine whether or not the driver has engaged in dangerous driving.
The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to enable it to appropriately determine whether or not the driver of a moving object has engaged in dangerous driving.

One aspect of the present invention is a driver support system for supporting a driver of a mobile object, which includes: a first acquisition unit that acquires first travel data that is travel data of a first mobile object; a second acquisition unit that acquires second travel data that is travel data of a second moving object that has traveled nearby; and a second acquisition unit that acquires second travel data that is travel data of a second mobile object that has traveled nearby; a first determination unit that determines whether or not the driver of the first mobile object has engaged in dangerous driving based on the second driving data; a selection section that selects a driving course according to the type of dangerous driving performed by the driver of the first mobile object; and a selection section that selects a driving course according to the type of dangerous driving performed by the driver of the first mobile object; a second determination unit that determines the state of the driver of the first mobile body when the driving occurs; and a second determination unit that determines the state of the driver of the first mobile body when the driving occurs; a third determination unit that determines whether or not the cause of dangerous driving is the state; and when the first determination unit determines that dangerous driving has occurred, transmitting notification information to the driver of the first mobile object; and a notification unit, wherein the notification information includes dangerous driving information indicating the type of dangerous driving performed by the driver of the first mobile object, and driving training information indicating the driving course selected by the selection unit. , a driver support system comprising: status information indicating the determination result of the second determination section; and cause information indicating the determination result of the third determination section .

According to one aspect of the present invention, it is possible to appropriately determine whether or not the driver of a mobile object has engaged in dangerous driving.

FIG. 1 is a diagram showing an overview of a driver support system. FIG. 2 is a diagram showing an example of the configuration of the first moving body. FIG. 3 is a block diagram showing an example of the configuration of the first moving body. FIG. 4 is a block diagram showing an example of the configuration of a server device. FIG. 5 is a block diagram showing an example of the configuration of a terminal device. FIG. 6 is a flowchart showing the operation of the driver support system.

[1. Overview of driver support system]
An overview of the driver support system 1000 will be explained with reference to FIG.
FIG. 1 is a diagram showing an overview of a driver support system 1000.

The driver support system 1000 is a system that supports the driver P of the mobile object 1. Specifically, the driver support system 1000 determines whether or not the driver P of the mobile object 1 has driven dangerously, and if it is determined that the driver P has driven dangerously, the driver support system 1000 determines whether the driver P has driven dangerously. This information is fed back to the driver P. Note that dangerous driving includes driving that is dangerous to other moving objects 1. This feedback allows the driver P to be conscious of not engaging in dangerous driving when driving the mobile object 1. Can support P1.

In this embodiment, a four-wheeled vehicle is illustrated as the moving body 1. However, the moving body 1 is not limited to a vehicle with four wheels, and may be a vehicle with five or more wheels, or a vehicle with three or less wheels. Moreover, the moving object 1 is not limited to a vehicle, and may be a ship or an aircraft.

The driver support system 1000 includes a mobile object 1.
FIG. 2 is a diagram showing an example of the configuration of the mobile object 1. As shown in FIG.

The mobile object 1 of this embodiment is a four-wheeled vehicle with a seating capacity of five people. The moving body 1 includes a driver's seat 10A, a passenger seat 10B, a rear right seat 10C, a rear center seat 10D, and a rear left seat 10E. In the mobile object 1 of FIG. 2, a situation is shown in which the driver P is seated in the driver's seat 10A. In FIG. 2, a wearable terminal 2 is attached to the arm of a seated driver P. Wearable terminal 2 includes various sensors such as a pulse sensor and a temperature sensor. Wearable terminal 2 detects the wearer's pulse, body temperature, and the like. Wearable terminal 2 communicates with mobile body control device 100 mounted on mobile body 1 .

The moving body 1 includes a right front door 11A, a left front door 11B, a right rear door 11C, a left rear door 11D, and a tailgate 11E. By opening the right front door 11A, the left front door 11B, the right rear door 11C, and the left rear door 11D, the moving body 1 can enter and exit the room. The tailgate 11E opens and closes the trunk of the mobile body 1.

The mobile body 1 includes a dashboard 12. A camera 13 for photographing the driver is provided on the dashboard 12 at a position facing the person seated in the driver's seat 10A. The driver photographing camera 13 photographs the interior of the moving body 1. The photographing range of the driver photographing camera 13 includes the head of the person seated in the driver's seat 10A.

A drive recorder 14 is installed inside the vehicle 1 . The drive recorder 14 photographs the front of the moving body 1. Drive recorder 14 communicates with mobile object control device 100 .

A front camera 20A for photographing the front of the moving body 1 is provided at the front of the moving body 1. A rear camera 20B for photographing the rear of the moving body 1 is provided at the rear of the moving body 1. Further, on the right side of the moving body 1, a right side camera 20C for photographing the right side of the moving body 1 is provided. Furthermore, a left side camera 20D is provided on the left side of the moving body 1 to photograph the left side of the moving body 1. The front camera 20A, the rear camera 20B, the right side camera 20C, and the left side camera 20D are cameras that take pictures of the surroundings of the moving body 1.

The mobile body 1 includes a mobile body control device 100. The mobile body control device 100 is a control device that controls the mobile body 1. The mobile control device 100 is connected to a TCU (Telematics Control Unit) 21 and communicates with the server device 3 via the TCU 21 .

Returning to the explanation of FIG. 1, the mobile control device 100 transmits the upload data AD to the server device 3 at a predetermined timing. Examples of the predetermined timing include the timing when the date changes and the timing when the driver P gets off the mobile object 1. Details of the upload data AD will be described later.

The driver support system 1000 includes a server device 3. The server device 3 is connected to the communication network NW. The communication network NW may be any data communication network, such as a wide area communication network including a public line network. The server device 3 receives upload data AD from the mobile control device 100. The server device 3 determines whether the driver P has driven dangerously based on the received upload data AD. Furthermore, when it is determined that the driver P has engaged in dangerous driving, the server device 3 performs various processes related to the dangerous driving performed by the driver P.

The driver support system 1000 includes a terminal device 4 . The terminal device 4 is a portable computer called a mobile device or a handheld computer, and is, for example, a smartphone. Note that the terminal device 4 may be a laptop computer, a desktop computer, or a tablet computer. The terminal device 4 receives notification information TJ from the server device 3. The notification information TJ will be described later. When the terminal device 4 receives the notification information TJ from the server device 3, it displays various information included in the received notification information TJ.

In this embodiment, the driver support system 1000 supports the driver P1 of the first mobile object 1A. That is, the driver support system 1000 of the present embodiment determines whether or not the driver P1 of the first moving body 1A has engaged in dangerous driving, taking into account the matters related to the second moving body 1B, and prevents the dangerous driving from occurring. If it is determined that the driver P1 has engaged in dangerous driving, the driver P1 is fed back that the driver P1 has engaged in dangerous driving. The second moving body 1B is the moving body 1 that has traveled near the first moving body 1A. Note that the moving object 1 that has traveled near the first moving object 1A refers to the cameras mounted on the first moving object 1A (the drive recorder 14, the front camera 20A, the rear camera 20B, the right side camera 20C, and the left side camera). 20D, etc.) is the moving object 1 shown in the photographic results. Although one second moving body 1B is illustrated in FIG. 1, the number of second moving bodies 1B may be plural.

[2. Mobile body configuration]
First, the configuration of the mobile body 1 will be explained.
FIG. 3 is a diagram showing an example of the configuration of the mobile object 1. As shown in FIG.

The mobile body 1 includes a mobile body control device 100, a TCU 21, a mobile body communication unit 22, a GNSS (Global Navigation Satellite System) unit 23, a camera 13 for photographing the driver, a drive recorder 14, a front camera 20A, a rear camera 20B, and a right side camera 13. It includes a camera 20C, a left side camera 20D, a pedal sensor 24, a vehicle condition sensor 25, and a steering sensor 26.

The mobile control device 100 includes a mobile processor 110 that is a processor such as a CPU (Central Processing Unit) or an MPU (Micro-processing unit), and a mobile memory 120 that is a memory that stores programs and data.

The mobile processor 110 reads and executes the control program 121 stored in the mobile memory 120, thereby controlling the first mobile communication control unit 111, the second mobile communication control unit 112, the data collection unit 113, and the upload data. It functions as a generation unit 114.

Mobile memory 120 stores programs executed by mobile processor 110 and data processed by mobile processor 110 . The mobile memory 120 stores a control program 121 executed by the mobile processor 110, map data 122, and other various data. Mobile memory 120 has a nonvolatile storage area. Additionally, the mobile memory 120 may include a volatile storage area and constitute a work area for the mobile processor 110.

The map data 122 is data that stores road map information, facility information such as various facilities, data for map matching, and the like. Road map information consists of a road network in which roads on a map are represented by lines, and includes information regarding links, which are divided into a plurality of parts with intersections, branch points, etc. as nodes, and the parts between each node are defined as links. The facility information indicates the location (latitude, longitude) of the facility, the name of the facility, etc.

The mobile object control device 100 includes a TCU 21, a mobile communication unit 22, a GNSS unit 23, a camera 13 for photographing the driver, a drive recorder 14, a front camera 20A, a rear camera 20B, a right side camera 20C, a left side camera 20D, and a pedal. A sensor 24, a vehicle condition sensor 25, and a steering sensor 26 are connected. Note that the devices connected to the mobile object control apparatus 100 are not limited to these devices, and other types of devices may be connected.

The mobile communication unit 22 includes a wireless communication device having an antenna, a wireless communication circuit, and the like. The mobile communication unit 22 of this embodiment communicates with the wearable terminal 2 and the terminal device 4.

The GNSS unit 23 measures the current position of the mobile object 1. The GNSS unit 23 outputs positioning results to the mobile object control device 100 at predetermined intervals.

Pedal sensor 24 includes an accelerator pedal sensor and a brake pedal sensor. Pedal sensor 24 outputs a detected value indicating the amount of depression to mobile object control device 100 at a predetermined cycle.

Vehicle condition sensor 25 includes, for example, a three-axis acceleration sensor, a yaw rate sensor, and a speed sensor. Vehicle condition sensor 25 outputs a detected value to mobile object control device 100 at a predetermined period.

The steering sensor 26 detects the operating torque or steering angle of a steering wheel provided on the dashboard 12. Steering sensor 26 outputs a detected value to mobile device 100 at a predetermined period.

As described above, the mobile processor 110 functions as the first mobile communication control section 111, the second mobile communication control section 112, the data collection section 113, and the upload data generation section 114.

The first mobile communication control unit 111 communicates with the server device 3 via the TCU 21.

The second mobile communication control section 112 communicates with the wearable terminal 2 via the mobile communication unit 22.

The data collection unit 113 collects various data included in the upload data AD. The data collected by the data collection unit 113 includes detected values. The data collection unit 113 starts collecting data at a timing when it can be assumed that the driver P starts using the mobile object 1. An example of the timing at which the driver P can be considered to have started using the mobile body 1 is the timing when the power of the mobile body 1 is turned on. The data collection unit 113 ends data collection at a timing when it can be assumed that the driver P has finished using the mobile object 1. An example of the timing at which it can be considered that the driver P has finished using the mobile body 1 is the timing when the power of the mobile body 1 is turned off.

The data collection unit 113 collects frame data constituting moving image data indicating a photographed result from each of the drive recorder 14, front camera 20A, rear camera 20B, right side camera 20C, and left side camera 20D.

Furthermore, the data collection unit 113 collects detection values of each of the pedal sensor 24, vehicle condition sensor 25, and steering sensor 26. The data collection unit 113 collects detected values every time each sensor outputs a detected value.

Further, the data collection unit 113 refers to the current position of the mobile body 1 measured by the GNSS unit 23 and the map data 122, and collects data on the route RT traveled by the mobile body 1. In the case of the route RT in FIG. 1, the data collection unit 113 collects data on the route RT from point SP1 to point SP2.

The data collection unit 113 also collects current position data indicating the current position of the mobile object 1 measured by the GNSS unit 23 from the GNSS unit 23 . The data collection unit 113 collects current position data every time the GNSS unit 23 outputs a positioning result.

Further, the data collection unit 113 collects frame data constituting video data indicating the photographing result from the driver photographing camera 13.

Further, in the data collection unit 113, the second mobile communication control unit 112 collects biological data such as pulse rate from the wearable terminal 2. The data collection unit 113 collects biometric data every time the wearable terminal 2 outputs biometric data.

The data collection unit 113 collects data into the mobile memory 120. That is, the data collection unit 113 stores the collected data in the mobile memory 120 in chronological order. The data collection unit 113 moves data while associating data with matching collection times with data at the collection time (hereinafter referred to as "collection time data") for each collection time (hereinafter referred to as "collection time data"). The information is collected in the body memory 120.

When a predetermined timing arrives, the upload data generation section 114 generates upload data AD including the data collected by the data collection section 113, and outputs the generated upload data AD to the first mobile communication control section 111. That is, when a predetermined timing arrives, the upload data generation unit 114 reads the collected data from the mobile body memory 120, generates upload data AD including the read data, and transfers the generated upload data AD to the first mobile body. It is output to the communication control unit 111. Note that in the upload data AD, data with matching collection times are associated with collection time data indicating the corresponding collection times. The first mobile communication control unit 111 transmits the upload data AD input from the upload data generation unit 114 to the server device 3.

The upload data generation unit 114 acquires a driver ID (Identification) that is identification information of the driver P when generating the upload data AD. If the driver ID is recorded in the mobile memory 120, the upload data generation unit 114 acquires the driver ID by reading the driver ID from the mobile memory 120. When the terminal device 4 and the mobile body control device 100 are connected for communication, the upload data generation unit 114 may acquire the driver ID from the terminal device 4 via the second mobile body communication control unit 112. The upload data generation unit 114 adds the acquired driver ID to the upload data AD.

[3. Server device configuration]
Next, the configuration of the server device 3 will be explained.
FIG. 4 is a block diagram showing an example of the configuration of the server device 3. As shown in FIG.

The server device 3 includes a server processor 30 that is a processor such as a CPU or an MPC, a server memory 31 that is a memory that stores programs and data, and a server communication unit 32.

The server processor 30 reads out and executes the control program 311 stored in the server memory 31, thereby controlling the server reception section 301, first acquisition section 302, second acquisition section 303, first determination section 304, and second determination section 305. , a third determination unit 306 , a selection unit 307 , a notification unit 308 , and a database processing unit 309 .

The server memory 31 stores programs executed by the server processor 30 and data processed by the server processor 30. The server memory 31 stores a control program 311 executed by the server processor 30, a driver DB (database) 312, a driving type DB 313, a driving training DB 314, map data 315, and other various data. Server memory 31 has a nonvolatile storage area. Further, the server memory 31 may include a volatile storage area and constitute a work area of the server processor 30.

The driver DB 312 stores a record R1 for each driver P. One record R1 includes a driver ID, communication information for communicating with the terminal device 4 used by the driver P corresponding to this driver ID, and upload data AD.

The driving type DB 313 stores records R2 for each type of driving. Record R2 includes name information indicating the name of the type of driving and feature information indicating the characteristics of the type of driving. The type of driving is predetermined, and includes, for example, right turn and parking. The characteristics of the driving type are predetermined similarly to the driving type. For example, if the type of driving is a right turn, the characteristic of this type is that the driver turned right.

The driving training DB 314 stores records R3 for each type of driving. Record R3 includes name information indicating the name of the type of driving and driving training information indicating the driving course. The driving training information includes information on the name of the driving training course. The driving training information may include information on the course content of the driving training course in addition to the information on the course name. A driving course is a course aimed at improving driving skills.

The map data 315 is data that stores road map information, facility information such as various facilities, data for map matching, and the like. Road map information consists of a road network in which roads on a map are represented by lines, and includes information regarding links, which are divided into a plurality of parts with intersections, branch points, etc. as nodes, and the parts between each node are defined as links. The facility information indicates the location (latitude, longitude) of the facility, the name of the facility, etc.

The server communication unit 32 includes a communication device having an antenna, a communication circuit, and the like. The server communication unit 32 communicates with the mobile body 1 and the terminal device 4 via the communication network NW.

As described above, the server processor 30 includes a server reception section 301, a first acquisition section 302, a second acquisition section 303, a first determination section 304, a second determination section 305, a third determination section 306, a selection section 307, and a notification section. 308 and a database processing unit 309.

The server reception section 301 receives upload data AD from the mobile object 1 via the server communication unit 32.
When the server receiving unit 301 receives the upload data AD, the database processing unit 309 identifies a record R1 having the driver ID added to the received upload data AD from the driver DB 312. Next, the database processing unit 309 updates the upload data AD of the identified record R1 to the received upload data AD.

The first acquisition unit 302 acquires the upload data AD from the driver DB 312, and from the acquired upload data AD acquires travel data of the mobile object 1 that has transmitted the upload data AD. The first acquisition unit 302 of this embodiment acquires first travel data, which is travel data of the first moving object 1A, from the upload data AD.

For example, the first acquisition unit 302 acquires each detection value of the pedal sensor 24, vehicle condition sensor 25, and steering sensor 26 included in the upload data AD as the first travel data. For example, the first acquisition unit 302 acquires the video data of the drive recorder 14 included in the upload data AD as the first travel data. For example, the first acquisition unit 302 acquires video data of at least one of the front camera 20A, rear camera 20B, right side camera 20C, and left side camera 20D included in the upload data AD as the first travel data.

The second acquisition unit 303 acquires, from the upload data AD acquired by the first acquisition unit 302, travel data of the mobile object 1 that has traveled near the mobile object 1 that has transmitted the upload data AD. The second acquisition unit 303 of this embodiment acquires second travel data that is travel data of the second moving body 1B.

For example, the second acquisition unit 303 acquires video data in which the second mobile object 1B is captured from among the video data included in the upload data AD as the second travel data. The second acquisition unit 303 acquires the second travel data from the upload data AD by identifying the second moving object 1B from the video indicated by the video data through image analysis such as pattern matching.

The first determination unit 304 determines whether the driver P of the mobile object 1 has engaged in dangerous driving. The first determination unit 304 of this embodiment determines whether the driver P1 of the first moving body 1A has performed dangerous driving.
The first determination unit 304 determines whether the driver P1 of the first moving body 1A has engaged in dangerous driving in the following manner.

First, the first determination unit 304 determines whether the behavior of the first moving body 1A has changed based on the first travel data acquired by the first acquisition unit 302.
For example, the first determination unit 304 determines that the behavior of the first moving body 1A has changed when the detected value of the steering sensor 26 indicated by the first travel data changes by a predetermined value or more per unit time. For example, the first determination unit 304 determines that the behavior of the first moving body 1A has changed when the detected value of the vehicle state sensor 25 indicated by the first travel data changes by a predetermined value or more per unit time. Further, for example, the first determination unit 304 performs an image analysis of the video indicated by the first travel data, and determines whether the first moving body 1A should turn right, turn left, or go backwards based on the moving direction and size of a predetermined object in the video. If such is detected, it is determined that the behavior of the first moving body 1A has changed.

Next, when determining that the behavior of the first mobile body 1A has changed, the first determination unit 304 determines that the behavior of the first mobile body 1A has changed based on the second travel data acquired by the second acquisition unit 303. It is determined whether the second mobile body 1B has changed in a predetermined behavior within a predetermined period.
For example, based on the collection time data included in the upload data AD, the first determination unit 304 determines a predetermined time from the time when the first mobile object 1A starts changing its behavior from the second travel data acquired by the second acquisition unit 303. Extract video data within the period. The first determination unit 304 identifies the second moving object 1B from the video data extracted by image processing such as pattern matching. Then, the first determination unit 304 determines, through image processing such as pattern matching, that if the identified second moving object 1B moves for a predetermined distance or more or a brake light turns on in the video indicated by the extracted video data, It is determined that the second moving body 1B has made a predetermined behavior change. Note that this predetermined behavior change is predetermined.

Next, when determining that the second mobile body 1B has made a predetermined behavior change, the first determination unit 304 determines that the driver P1 of the first mobile body 1A has engaged in dangerous driving.

When determining that the driver P1 of the first mobile body 1A has performed dangerous driving, the second determination unit 305 determines the state of the driver P1 when the driver P1 of the first mobile body 1A has performed dangerous driving. do. The second determination unit 305 of the present embodiment determines whether the driver P1 is in an irritated state, in a panicked state, or in any other state. Note that the types of states of the driver P1 determined by the second determining unit 305 are not limited to these three types, and may be two types or four or more types.

The second determination unit 305 determines the state of the driver P1, for example, as follows.
The second determination unit 305 acquires video data of the driver photographing camera 13 from the upload data AD acquired by the first acquisition unit 302. Next, the second determination unit 305 determines, based on the collected time data included in the upload data AD, the time when the first mobile object 1A started changing its behavior from the video data of the acquired driver camera 13. Extract video data within a predetermined period. Next, the second determination unit 305 determines whether the expression of the driver P1 shown in the video indicated by the extracted video data is an irritated expression, an irritated expression, or an expression other than these. . The second determination unit 305 determines facial expressions by pattern matching. The facial expression pattern data is stored in the server memory 31. When determining that the facial expression of the driver P1 is an irritated expression, the second determination unit 305 determines that the driver P1 is in an irritated state. Furthermore, when determining that the facial expression of the driver P1 is a panicked expression, the second determining unit 305 determines that the state of the driver P1 is a flustered state. Further, when the driver P1's facial expression is neither irritated nor panicked, the second determination unit 305 determines that the driver P1 is neither irritated nor panicked.

Note that the second determination unit 305 may determine the state of the driver P1 by taking into account the biometric data included in the upload data AD. For example, the second determination unit 305 determines that the driver P1 is in a panic state if the driver P1 has a panicked expression and the pulse rate indicated by the biometric data is equal to or higher than a predetermined value. By taking the biometric data into account when determining the state of the driver P1 in this way, the second determination unit 305 can accurately determine the state of the driver P1.

The third determination unit 306 determines, based on the state of the driver P1 determined by the second determination unit 305, the cause of the dangerous driving caused by the driver P1 of the first mobile object 1A. It is determined whether or not the driver P1 is in the state of the driver P1.

The third determination unit 306 makes the determination as follows, for example.
If the state of the driver P1 determined by the second determination unit 305 is an irritated or impatient state, the third determination unit 306 determines whether dangerous driving has occurred by the driver P1 of the first mobile object 1A. It is determined that the cause is the state of the driver P1 determined by the second determination unit 305. On the other hand, if the state of the driver P1 determined by the second determination section 305 is not an irritated state or an impatient state, the third determination section 306 determines that the dangerous driving caused by the driver P1 of the first mobile object 1A is not caused by the driver P1. It is determined that the cause of the occurrence is not the state of the driver P1 determined by the second determination unit 305.

When the first determining unit 304 determines that the driver P1 of the first mobile object 1A has engaged in dangerous driving, the selecting unit 307 identifies the type of driving that was performed by the driver P1 of the first mobile object 1A and that was determined to be dangerous driving; Select a driving course according to the specified type of driving. That is, the selection unit 307 selects a driving course according to the type of dangerous driving performed by the driver P1.

The selection unit 307 selects a driving course as follows.
The selection unit 307 refers to the first travel data acquired by the first acquisition unit 302 and extracts the characteristics of the behavior change of the first moving body 1A. For example, the selection unit 307 refers to the detected value of the steering sensor 26 within a predetermined period from the time when the first moving body 1A starts changing its behavior, based on the collection time data included in the upload data AD. Next, when this detected value indicates a change corresponding to a right turn, the selection unit 307 extracts the right turn as a characteristic of the behavior change of the first moving body 1A. Next, the selection unit 307 specifies, from the driving DB 313, a record R2 having characteristic information indicating the characteristics of the extracted behavior change of the first moving body 1A. Next, the selection unit 307 acquires name information from the identified record R2. Next, the selection unit 307 identifies the record R3 having the acquired name information from the driving training DB 314.

The notification unit 308 transmits notification information TJ to the terminal device 4 of the driver P1 of the first mobile body 1A when the first determination unit 304 determines that dangerous driving has been performed.

The notification information TJ includes dangerous driving information. The dangerous driving information is information indicating the type of dangerous driving performed by the driver P1 of the first moving body 1A. Similar to the selection unit 307, the notification unit 308 extracts the characteristics of the behavior change of the first mobile object 1A, specifies from the operation DB 313 a record R2 having characteristic information indicating the extracted characteristics, and selects the name of the specified record R2. Generate notification information TJ including the information.

The notification information TJ includes status information. The state information is information indicating the state of the driver P1 determined by the second determination unit 305. The notification unit 308 acquires the determination result from the second determination unit 305 and generates notification information TJ including status information indicating the acquired determination result.

The notification information TJ includes cause information. The cause information is information indicating the determination result determined by the third determination unit 306. The notification unit 308 acquires the determination result from the third determination unit 306 and generates notification information TJ that includes cause information indicating the acquired determination result.

The notification information TJ includes driving training information. The driving training information is information indicating the driving training selected by the selection unit 307. The notification unit 308 generates notification information TJ that includes the driving training information of the record R2 specified by the selection unit 307.

The notification information TJ includes first travel data. The notification unit 308 generates notification information TJ including the first travel data from the first acquisition unit 302.

[4. Terminal device configuration]
Next, the configuration of the terminal device 4 will be explained.
FIG. 5 is a block diagram showing an example of the configuration of the terminal device 4. As shown in FIG.
The driver support system 1000 includes a terminal device 4 .

The terminal device 4 includes a terminal control device 40, a first terminal communication unit 41, a second terminal communication unit 42, and a terminal touch panel 43 that is a touch panel.

The terminal control device 40 includes a terminal processor 400, which is a processor such as a CPU or an MPU, and a terminal memory 410, which is a memory that stores programs and data.

The terminal processor 400 functions as an application execution unit 401 by reading and executing an application 411 stored in the terminal memory 410.
The application execution unit 401 is an example of a display control unit of the present disclosure.

Terminal memory 410 stores programs executed by terminal processor 400 and data processed by terminal processor 400. Terminal memory 410 stores an application 411 executed by terminal processor 400 and other various data. Terminal memory 410 has a nonvolatile storage area. Further, the terminal memory 410 may include a volatile storage area and constitute a work area of the terminal processor 400.

The application 411 is an application program that causes the terminal processor 400 to function as the application execution unit 401.

A first terminal communication unit 41 , a second terminal communication unit 42 , and a terminal touch panel 43 are connected to the terminal control device 40 . Note that the devices connected to the terminal control device 40 are not limited to these devices, and other types of devices may be connected.

The first terminal communication unit 41 includes a communication device having an antenna, a wireless communication circuit, and the like. The first terminal communication unit 41 communicates with the server device 3 via the communication network NW.

The second terminal communication unit 42 includes a communication device having an antenna, a wireless communication circuit, etc., and performs short-range wireless communication with the mobile object 1 according to a predetermined short-range wireless communication standard.

As described above, the terminal processor 400 functions as the application execution unit 401.
The application execution unit 401 communicates with the server device 3 via the first terminal communication unit 41.
The application execution unit 401 communicates with the mobile object 1 via the second terminal communication unit 42.
The application execution unit 401 causes the terminal touch panel 43 to display information included in the notification information TJ received from the server device 3.

[5. Operation of driver support system]
Next, the operation of driver support system 1000 will be explained.
FIG. 6 is a flowchart showing the operation of the driver support system 1000.
In FIG. 6, a flowchart FA shows the operation of the server device 3, and a flowchart FB shows the operation of the terminal device 4 used by the driver P1 of the first mobile body 1A.

As shown in the flowchart FA, the first acquisition unit 302 acquires the upload data AD transmitted by the first mobile object 1A from the driver DB 312 (step SA1). An example of the timing for performing the process of step SA1 is the timing when the upload data AD of the first mobile body 1A is updated.

Next, the first acquisition unit 302 acquires first travel data from the acquired upload data AD (step SA2).

Next, the second acquisition unit 303 acquires second travel data from the upload data AD acquired in step SA1 (step SA3).

Next, the first determination unit 304 determines whether the driver P1 of the first mobile object 1A has driven dangerously (step SA4).

Next, the second determination unit 305 determines whether or not it was determined that dangerous driving was performed in step SA4 (step SA5).

If the second determining unit 305 determines that dangerous driving has not been performed (step SA5: NO), the server processor 30 ends this process.

On the other hand, if it is determined that the driver P1 of the first mobile body 1A has engaged in dangerous driving (step SA5: YES), the second determination unit 305 determines that the driver P1 of the first mobile body 1A is The state of driver P1 at the time of dangerous driving is determined (step SA6).

Next, the third determining unit 306 determines that the cause of the dangerous driving caused by the driver P1 of the first mobile object 1A is the state of the driver P1 determined by the second determining unit 305, based on the determination result of step SA6. It is determined whether or not (step SA7).

Next, the selection unit 307 selects a driving course according to the type of dangerous driving performed by the driver P1 of the first mobile object 1A, based on the upload data AD acquired in step SA1 (step SA8).

Next, the notification unit 308 generates notification information TJ (step SA9).
In step SA9, the notification unit 308 generates notification information TJ including dangerous driving information indicating the type of dangerous driving determined to have been performed by the driver P1 in step SA4.
Further, in step SA9, the notification unit 308 generates notification information TJ including status information indicating the determination result in step SA6.
Further, in step SA9, the notification unit 308 generates notification information TJ including cause information indicating the determination result in step SA7.
Further, in step SA9, the notification unit 308 generates notification information TJ including driving training information indicating the driving training course selected in step SA8.
Further, in step SA9, the notification unit 308 generates notification information TJ including the first travel data acquired in step SA2.

Next, the notification unit 308 transmits the notification information TJ generated in step SA9 to the terminal device 4 (step SA10). In step SA10, the notification unit 308 transmits notification information TJ to the terminal device 4 based on the communication information included in the record R2 having the upload data AD acquired in step SA1.

As shown in the flowchart FB, the application execution unit 401 receives notification information TJ (step SB1).

Next, the application execution unit 401 displays various information included in the received notification information TJ on the terminal touch panel 43 (step SB2).

In step SB2, the application execution unit 401 displays dangerous driving information on the terminal touch panel 43. For example, the application execution unit 401 displays information such as "turning right is dangerous driving." Thereby, the driver P1 can understand what kind of driving was dangerous driving. In addition, since matters related to the second mobile object 1B are taken into consideration in determining whether or not the driver P1 has engaged in dangerous driving, the driver P1 may realize that the driving that he did not recognize as dangerous driving was dangerous driving. can be understood. Therefore, the driver P1 can become aware of what kind of driving was dangerous when driving the mobile object 1, and the driver support system 1000 can prevent dangerous driving from occurring when driving the mobile object 1. person P1.

In step SB2, the application execution unit 401 displays the first driving data together with the dangerous driving information on the terminal touch panel 43. When the first travel data is video data, the application execution unit 401 may display the video indicated by the video data in a playable manner. Furthermore, when the first travel data is a detection value from the steering sensor 26 or the like, the application execution unit 401 may create a graph of changes in the detection value over time and display this graph. Since the first driving data is displayed in this way, the driver P1 can accurately grasp what kind of driving was dangerous driving. Therefore, since the driver P1 can become more aware of what kind of driving was dangerous when driving the mobile object 1, the driver support system 1000 can take measures to prevent dangerous driving from occurring when driving the mobile object 1. The driver P1 can be supported.

In step SB2, the application execution unit 401 displays the status information on the terminal touch panel 43. For example, the application execution unit 401 displays information such as "You were in an irritated state when you drove dangerously." Thereby, the driver P1 can understand what state he/she was in at the time of the dangerous driving. Therefore, when driving the mobile object 1, the driver P1 becomes aware of whether or not dangerous driving will occur in the current state. Therefore, the driver support system 1000 can support the driver P1 so as not to cause dangerous driving while driving the mobile object 1.

In step SB2, the application execution unit 401 displays cause information on the terminal touch panel 43. For example, the application execution unit 401 displays information such as "The cause of dangerous driving is an irritated state." Thereby, the driver P1 can understand whether or not his own condition was the cause of the dangerous driving. Therefore, the driver P1 can become aware of what conditions would cause dangerous driving when driving the mobile object 1. Therefore, the driver support system 1000 can support the driver P1 so as not to cause dangerous driving while driving the mobile object 1.

In step SB2, the application execution unit 401 displays driving training information on the terminal touch panel 43. For example, the application execution unit 401 displays information such as "The recommended driving course is a right-turn driving course." This allows the driver P1 to understand what kind of driving course he should take to reduce the occurrence of dangerous driving. Therefore, the driver support system 1000 can support the driver P1 so as not to cause dangerous driving while driving the mobile object 1.

[6. Other embodiments]
In other embodiments, the server processor 30 of the server device 3 further functions as an estimator. The estimating unit estimates the type of driver P1 that causes behavior that causes dangerous driving, depending on the state of driver P1 determined by second determining unit 305. For example, if the second determining unit 305 determines that the driver P1 is in an irritated state, the estimating unit estimates that the driver P1 is easily irritated. The estimation unit may make the estimation by referring to a database in which the state of the driver P1 and the type of the driver P1 are associated with each other. Further, the estimation unit may estimate the relationship between the state of the driver P1 and the type of the driver P1 using a learning model obtained by machine learning. When using a learning model, the estimation unit inputs the determination result of the second determination unit 305 into the learning model, and outputs the type of driver P1 from the learning model. Note that this learning model may be stored in the server memory 31 or in a device that can communicate with the server device 3.

In other embodiments, the server processor 30 of the server device 3 further functions as a scene acquisition unit in addition to the estimation unit described above. The scene acquisition unit acquires information on a dangerous scene or an accident scene corresponding to the type of driver P1 estimated by the estimation unit. For example, the scene acquisition unit may refer to a database in which the type of the driver P1 is associated with a dangerous scene or an accident scene, and acquire the scene. Further, the scene acquisition unit may acquire the scene using a learning model obtained by machine learning the relationship between the type of the driver P1 and a dangerous scene or an accident scene. When using a learning model, the scene acquisition unit may acquire the type of driver P1 by inputting the determination result of the second determination unit 305 into the learning model and outputting the type of the driver P1 from the learning model. Note that this learning model may be stored in the server memory 31 or in a device that can communicate with the server device 3.

In another embodiment, the dangerous scene or accident scene acquired by the scene acquisition unit described above is notified to the terminal device 4 used by the driver P1. In this configuration, the notification unit 308 transmits notification information TJ including information on a dangerous scene or an accident scene to the terminal device 4. The application execution unit 401 of the terminal device 4 causes the terminal touch panel 43 to display information on the dangerous scene or accident scene included in the notification information TJ.

In the embodiment described above, the state of the driver P1 is determined based on the facial expression of the driver P1. However, the second determination unit 305 may determine the state of the driver P1 based on factors other than the facial expression of the driver P1. For example, the second determination unit 305 may determine the state of the driver P1 from the biometric data included in the upload data AD.

In the embodiment described above, the second acquisition unit 303 is configured to acquire the second travel data from the upload data AD acquired by the first acquisition unit 302. In another embodiment, the second acquisition unit 303 may acquire the second travel data from upload data AD different from the upload data AD acquired by the first acquisition unit 302. In this configuration, the second acquisition unit 303 includes at least a part of the collection time data included in the upload data AD acquired by the first acquisition unit 302, and the upload data AD acquired by the first acquisition unit 302 includes Upload data AD including current position data indicating a current position that is a predetermined distance or less from the current position indicated by the included current position data is acquired from the driver DB 313. Then, similarly to the embodiment described above, the second acquisition unit 303 acquires the second travel data from the acquired upload data AD.

In the embodiment described above, the case where the driver P wears the wearable terminal 2 and drives the mobile object 1 is illustrated, but the mobile object 1 can upload data even if the driver P does not wear the wearable terminal 2. The data AD may be transmitted to the server device 3. In this case, the mobile body 1 transmits to the server device 3 the upload data AD that does not include the biometric data and has been transmitted by the wearable terminal 2 .

In the embodiment described above, the notification information TJ includes dangerous driving information, state information, cause information, driving training information, and first travel data. However, these four types of information and one type of data may be included in different notification information. Further, the timings at which these four types of information and one type of data are transmitted to the terminal device 4 may be different timings.

The server processor 30, mobile processor 110, and terminal processor 400 may be composed of a single processor or may be composed of a plurality of processors. These processors may be hardware programmed to implement corresponding functional units. That is, these processors may be configured with, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

Moreover, each part of the mobile body 1, the server device 3, and the terminal device 4 shown in FIGS. 2 to 4 is an example, and the specific implementation form is not particularly limited. That is, it is not necessarily necessary to implement hardware corresponding to each part individually, and it is of course possible to have a configuration in which the functions of each part are realized by one processor executing a program. Furthermore, in the embodiments described above, some of the functions realized by software may be realized by hardware, or some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other parts of the mobile body 1, the server device 3, and the terminal device 4 can also be changed arbitrarily.

In addition, the step units of the operation shown in FIG. 6 are divided according to the main processing content in order to facilitate understanding of the operation, and the present invention is not limited by the way the processing units are divided or the names. It never happens. Depending on the processing content, the process may be divided into more steps. Furthermore, the process may be divided so that one step unit includes more processes. Further, the order of the steps may be changed as appropriate within a range that does not interfere with the spirit of the present invention.

[7. Configurations supported by the above embodiment]
The above embodiment supports the following configurations.

(Configuration 1)
A driver support system that supports a driver of a mobile object, the system comprising: a first acquisition section that acquires first travel data that is travel data of a first mobile object; and a second mobile object that has traveled near the first mobile object. a second acquisition unit that acquires second travel data that is body travel data, and based on the first travel data acquired by the first acquisition unit and the second travel data acquired by the second acquisition unit. , a first determination unit that determines whether or not the driver of the first mobile object has engaged in dangerous driving.
According to the driver support system of configuration 1, in order to determine whether or not the driver of the mobile object has performed dangerous driving in consideration of the driving of other mobile objects, it is appropriately determined whether or not the driver of the mobile object has performed dangerous driving. can.

(Configuration 2)
The first determination unit determines whether or not the driver of the first mobile body has engaged in dangerous driving, based on a change in the behavior of the second mobile body that occurs within a predetermined period of time after a change in the behavior of the first mobile body. The driver support system according to configuration 1, which determines.
According to the driver support system of configuration 2, in order to determine whether or not dangerous driving has been performed by taking into account changes in the behavior of other moving objects that have occurred within a predetermined period after the change in the behavior of the first moving object, It is possible to more appropriately determine whether or not a driver has engaged in dangerous driving.

(Configuration 3)
a notification unit that notifies the driver of the first mobile body of dangerous driving information indicating the type of dangerous driving performed by the driver of the first mobile body when the first determination unit determines that the driver of the first mobile body has engaged in dangerous driving; The driver support system according to configuration 1 or configuration 2.
According to the driver support system of Configuration 3, the driver can become aware of what kind of driving is dangerous driving when driving a mobile object, and the driver support system can prevent dangerous driving when driving a mobile object. Drivers can be supported to prevent this from happening.

(Configuration 4)
The display control unit includes a display control unit that displays information on a display unit, and when the first determination unit determines that the driver of the first mobile body has engaged in dangerous driving, the display control unit determines the type of dangerous driving performed by the driver of the first mobile object. The driver support system according to any one of configurations 1 to 3, wherein the display unit displays dangerous driving information and the first travel data.
According to the driver support system of configuration 4, since the first driving data is displayed in this way, the driver can accurately understand what kind of driving was dangerous driving. Therefore, in order to make the driver more aware of what kind of driving is dangerous when driving a mobile object, the driver support system can help the driver to avoid dangerous driving when driving a mobile object. I can support you.

(Configuration 5)
Any one of configurations 1 to 4, further comprising a selection unit that selects a driving course according to the type of dangerous driving performed by the driver of the first mobile object when the first determination unit determines that the driver of the first mobile object has engaged in dangerous driving. The driver assistance system described in one of the above.
According to the driver support system of configuration 5, the driver can understand what kind of driving training course to take to reduce the occurrence of dangerous driving, so that the driver can prevent dangerous driving from occurring when driving a mobile object. The driver can be further supported.

(Configuration 6)
If the first determination unit determines that the driver of the first mobile body has engaged in dangerous driving, the vehicle further includes a second determination unit that determines the state of the driver of the first mobile body when the dangerous driving occurs by the driver of the first mobile body. , the driver support system according to any one of configurations 1 to 5.
According to the driver support system of configuration 6, the driver can understand what state he or she was in at the time of dangerous driving. Therefore, when driving the mobile object, the driver becomes aware of whether or not dangerous driving will occur in the current state. Therefore, the driver support system can support the driver to avoid dangerous driving when driving the mobile object.

(Configuration 7)
Configuration 6, comprising a third determination unit that determines whether or not the cause of dangerous driving caused by the driver of the first mobile object is the state based on the state determined by the second determination unit. Driver assistance systems described in .
According to the driver support system of configuration 7, the driver can understand whether or not his or her own condition is the cause of dangerous driving. Therefore, the driver can become aware of what conditions would cause dangerous driving when driving the mobile object. Therefore, the driver support system can support the driver to avoid dangerous driving when driving the mobile object.

(Configuration 8)
A driver support system for supporting a driver of a mobile object, the system comprising: acquiring first travel data of a first mobile object; and second travel data of a second mobile object traveling near the first mobile object. and determining whether or not the driver of the first mobile object has engaged in dangerous driving based on the acquired first travel data and the acquired second travel data. , a control method for a driver assistance system.
According to the control method for the driver support system of configuration 8, the same effects as the driver support system of configuration 1 are achieved.

DESCRIPTION OF SYMBOLS 1... Mobile object, 1A... First moving object, 1B... Second moving object, 3... Server device, 4... Terminal device, 30... Server processor, 31... Server memory, 32... Server communication unit, 301... Server receiving section , 302...first acquisition section, 303...second acquisition section, 304...first determination section, 305...second determination section, 306...third determination section, 307...selection section, 308...notification section, 309...database processing Part, 311... Control program, 312... Driver DB, 313... Driving type DB, 314... Driving training DB, 315... Map data, 401... Application execution unit (display control unit), 1000... Driver support system, P, P1...Driver, TJ...Notification information.

Claims (5)

A driver support system that supports a driver of a mobile object,
a first acquisition unit that acquires first travel data that is travel data of the first moving body;
a second acquisition unit that acquires second travel data that is travel data of a second mobile body that traveled near the first mobile body;
Based on the first travel data acquired by the first acquisition unit and the second travel data acquired by the second acquisition unit, it is determined whether the driver of the first mobile object has engaged in dangerous driving. a first determination unit that
a selection unit that selects a driving course according to the type of dangerous driving performed by the driver of the first mobile body when the first determination unit determines that the driver of the first mobile object has engaged in dangerous driving;
a second determination unit that determines the state of the driver of the first mobile body when the dangerous driving occurs by the driver of the first mobile body when the first determination unit determines that the driver of the first mobile body has engaged in dangerous driving;
a third determination unit that determines whether the state is the cause of dangerous driving caused by the driver of the first mobile object, based on the state determined by the second determination unit;
a notification unit that transmits notification information to the driver of the first mobile body when the first determination unit determines that dangerous driving has been performed;
The notification information includes dangerous driving information indicating the type of dangerous driving carried out by the driver of the first mobile object, driving training information indicating the driving course selected by the selecting section, and the determination by the second determining section. including status information indicating the result and cause information indicating the determination result of the third determination unit;
Driver assistance system. The first determination unit determines whether or not the driver of the first mobile body has engaged in dangerous driving, based on a change in the behavior of the second mobile body that occurs within a predetermined period of time after a change in the behavior of the first mobile body. determine,
The driver assistance system according to claim 1. Equipped with a display control unit that displays information on the display unit,
When the first determination unit determines that the driver of the first mobile body has engaged in dangerous driving, the display control unit displays dangerous driving information indicating the type of dangerous driving performed by the driver of the first mobile object and the first driving data. display on the display section;
The driver support system according to claim 1 or 2. comprising an estimating unit that estimates the type of the driver of the first mobile body who causes the behavior that causes dangerous driving according to the state of the driver of the first mobile body determined by the second determination unit;
The driver support system according to claim 1 or 2. comprising a scene acquisition unit that acquires a dangerous scene or an accident scene corresponding to the type of driver of the first mobile body estimated by the estimation unit,
The notification unit transmits the notification information including information on the dangerous scene or the accident scene acquired by the scene acquisition unit to the driver of the first mobile object.
The driver assistance system according to claim 4.

Images