JP2020008978A - Safety confirmation evaluation device, on-vehicle unit, safety confirmation evaluation system including them, safety confirmation evaluation method, and safety confirmation evaluation program - Google Patents

Abstract

To provide a safety confirmation evaluation device capable of property evaluating a safety confirmation operation of a driver even when a vehicle temporarily stops at an intersection.SOLUTION: A safety confirmation evaluation device for evaluating a safety confirmation operation of a driver of a vehicle includes: an intersection approach estimation section for estimating an approach time to an intersection by a vehicle; a behavior information acquisition section for acquiring information including a behavior of the face of a driver; and an evaluation section for evaluating a safety confirmation operation of a driver at an intersection on the basis of information acquired before/after an approach time. The evaluation section includes: a stop determination section for determining whether or not a vehicle stops after an approach time; and a first evaluation section for evaluating a safety confirmation operation of a driver on the basis of information acquired before/after re-starting after a vehicle stops when the stop determination section determines a stop of a vehicle.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a safety confirmation evaluation device, an in-vehicle device, a safety confirmation evaluation system including the same, a safety confirmation evaluation method, and a safety confirmation evaluation program.

Patent Literature 1 proposes a safe driving degree determination device that determines a safe driving degree at an intersection. The safe driving degree determination device includes a speed detection unit, a yaw rate detection unit, an acceleration detection unit, a vehicle position detection unit, a map database, and a controller.
The controller receives information on the right / left turn approach to the intersection, calculates an intersection passing characteristic value such as a vehicle speed, a yaw rate, and an acceleration, and calculates the intersection passing characteristic value of the intersection obtained from the information of the map database. The recording unit is recorded in association with the radius of curvature, and a process of determining a safe driving degree of the driver based on the intersection passage characteristic value for each of the classes of the radius of curvature of the intersection is performed. .

[Problems to be solved by the invention]
In the safe driving degree determination device described in Patent Literature 1, the safe driving degree of the driver is determined based on the traveling state of the vehicle such as the speed, the yaw rate, and the acceleration when passing through an intersection. Therefore, when turning right or left, such as when passing through an intersection, especially when the vehicle is temporarily stopped inside the intersection, it is necessary to check the driver's safety, such as whether the driver is properly checking the safety. There was a problem that it could not be evaluated.

JP-A-2015-76000

Means for solving the problem and its effects

  The present invention has been made in view of the above problems, and appropriately evaluates a driver's safety confirmation operation at an intersection, particularly, even when a vehicle temporarily stops in an intersection. It is an object of the present invention to provide a safety confirmation / evaluation device, an in-vehicle device, a safety confirmation / evaluation system including the same, a safety confirmation / evaluation method, and a safety confirmation / evaluation program.

In order to achieve the above object, a safety confirmation evaluation device (1) according to the present disclosure is a safety confirmation evaluation device that evaluates a safety confirmation operation of a driver of a vehicle,
An intersection approach estimating unit that estimates an approach time of the vehicle to the intersection,
A behavior information acquisition unit that acquires information including behavior of the driver's face;
An evaluation unit that evaluates the driver's safety check operation based on the information acquired before and after the approach time,
The evaluation unit,
A stop determination unit that determines whether the vehicle has stopped after the entry time,
When the stop determination unit determines that the vehicle has stopped, a first evaluation unit that evaluates the driver's safety confirmation operation based on the information obtained before and after the vehicle stops and restarts. And is characterized by having.

  According to the safety confirmation evaluation device (1), the safety confirmation operation of the driver at the intersection is evaluated based on the information acquired before and after the approach time. Further, when the stop determination unit determines that the vehicle has stopped after the entry time, based on the information acquired before and after the vehicle restarts after the vehicle stops, the driver's safety confirmation operation is performed. Is evaluated. Therefore, even when the vehicle is temporarily stopped in the intersection, the first evaluation unit determines whether or not the driver before and after the restart, in other words, at the timing of passing through the intersection. Safety evaluation operation can be properly evaluated.

Further, the safety confirmation evaluation device (2) according to the present disclosure is the above-described safety confirmation evaluation device (1),
The evaluation unit,
When the stop determination unit determines that the vehicle has stopped, the safety confirmation operation of the driver before the entry time is evaluated based on the information obtained at a predetermined time before the entry time. A second evaluation unit that performs the evaluation.

  According to the safety confirmation evaluation device (2), when the stop determination unit determines that the vehicle has stopped, based on the information acquired at a predetermined time before the entrance time, Previously, the driver's safety confirmation operation is evaluated. Therefore, the second evaluation unit can appropriately evaluate the driver's safety confirmation operation before entering the intersection.

Further, the safety confirmation evaluation device (3) according to the present disclosure is the same as the above-described safety confirmation evaluation device (1) or (2),
The evaluation unit,
When it is determined by the stop determination unit that the vehicle is not stopped, based on the information obtained at a predetermined time before and after the approach time, before and after the approach time, the safety confirmation operation of the driver. It is characterized by having a third evaluation unit for evaluating.

  According to the safety confirmation evaluation device (3), when the stop determination unit determines that the vehicle is not stopped, based on the information acquired at a predetermined time before and after the approach time, the approach time The safety confirmation operation of the driver before and after is evaluated. Therefore, when the vehicle does not stop temporarily in the intersection, the third evaluation unit can appropriately evaluate the driver's safety confirmation operation before and after entering the intersection.

Further, the safety confirmation evaluation device (4) according to the present disclosure is configured such that in any one of the safety confirmation evaluation devices (1) to (3),
The evaluation unit,
An evaluation time setting unit configured to compare a stop time from when the vehicle stops after the entry time to when the vehicle restarts with a predetermined time and set an evaluation time before the restart. It is characterized by having.

  According to the safety confirmation evaluation device (4), the evaluation time setting unit compares the stop time from the stop of the vehicle after the entry time to the restart of the vehicle with a predetermined time. Thus, the evaluation time before the restart is set. The stop time may be long or short depending on the difference in traffic conditions in the intersection, but by providing the evaluation time setting unit, the safety confirmation operation of the driver before and after the restart is performed. A more appropriate time can be set as the evaluation time so that the evaluation can be performed more appropriately.

Further, the safety confirmation evaluation device (5) according to the present disclosure is the above-described safety confirmation evaluation device (4),
The evaluation time setting unit,
When the stop time is shorter than the predetermined time, an evaluation time before the restart is set to the stop time.

  According to the safety confirmation evaluation device (5), when the stop time is shorter than the predetermined time, the evaluation time before the restart is set to the stop time by the evaluation time setting unit. Therefore, the driver's safety confirmation operation performed during the stop time can be evaluated. For example, when the stop time is relatively short (for example, when the stop time is less than 10 seconds), the evaluation time is set to the stop time, and the safety of the driver before restarting within the stop time is set. The confirmation operation can be evaluated.

Further, the safety confirmation evaluation device (6) according to the present disclosure is the above-described safety confirmation evaluation device (4),
The evaluation time setting unit,
When the stop time is longer than the predetermined time, an evaluation time before the restart is set to the predetermined time.

  According to the safety confirmation evaluation device (6), when the stop time is longer than the predetermined time, the evaluation time setting unit sets the evaluation time before the restart to the predetermined time. For example, when the stop time is long (for example, longer than 10 seconds), the evaluation time is set to the predetermined time (for example, 10 seconds). Therefore, even if the stop time is long, it is possible to appropriately evaluate the safety confirmation operation before restarting. The predetermined time is set, for example, to a length necessary to evaluate the driver's safety confirmation operation before the restart, based on the information.

Further, the safety confirmation evaluation device (7) according to the present disclosure is the safety confirmation evaluation device (1) to (3),
The evaluation unit,
When the stop determination unit determines that the vehicle has stopped, further includes a stop count detection unit that detects the number of times the vehicle has stopped,
The first evaluation unit includes:
When a plurality of stops are detected after the entry time by the stop number detecting unit, at least before and after restarting after the last stop, the safety confirmation operation of the driver is evaluated. I have.

  According to the safety confirmation evaluation device (7), when the stop determination unit determines that the vehicle has stopped, the stop count detection unit detects the number of times the vehicle stops after the entry time. You. When a plurality of stops are detected after the entry time, the first evaluation unit evaluates the safety confirmation operation of the driver at least before and after restarting after the last stop. Therefore, even when the vehicle stops several times in the intersection, at least before and after restarting after the last stop, that is, at the timing of passing through the intersection (for example, the timing of turning right or left) The driver's safety confirmation operation can be properly evaluated.

Further, the safety confirmation evaluation device (8) according to the present disclosure is configured such that in any one of the above safety confirmation evaluation devices (1) to (7),
The evaluation unit,
Based on the information, at least one of the right and left swing angles and swing times of the driver's face direction or the line of sight direction is detected, and based on the detected left and right swing angles and swing time, the driving is performed. It is characterized by evaluating the safety confirmation operation of a person.

  According to the safety confirmation evaluation device (8), based on the information, at least one of the left and right swing angles and swing times of the driver's face direction or gaze direction is detected, and the detected left and right swing angles are determined. The safety confirmation operation of the driver is evaluated based on the swing angle and swing time of the driver. Therefore, the driver's safety confirmation operation can be properly evaluated based on the driver's left and right turning state and turning time.

Further, the safety confirmation evaluation device (9) according to the present disclosure is the safety confirmation evaluation device (1) to (8),
The intersection approach estimation unit,
The approach time is estimated based on time-series data of the angular velocity of the vehicle.

  According to the safety confirmation evaluation device (9), the time when the vehicle enters the intersection is estimated based on the time-series data of the angular velocity of the vehicle. Therefore, the time when the vehicle enters the intersection can be estimated with a simple and low-cost configuration without using the intersection information included in the map information or the like. For example, an angle (a rotation angle with respect to a vertical axis) may be calculated by integrating time-series data of the angular velocity of the vehicle, and an intersection approach time may be estimated based on the calculated angle (for example, the angle A time that exceeds a predetermined value may be estimated as an intersection approach time).

Further, a safety confirmation evaluation system according to the present disclosure is configured to include any of the above-described safety confirmation evaluation devices (1) to (9) and an in-vehicle device mounted on a vehicle,
The onboard unit is
A driver monitoring unit that detects the behavior of the driver's face of the vehicle,
A position detection unit that detects a position of the vehicle,
A traveling behavior detection unit that detects a traveling behavior including an angular velocity of the vehicle,
An output unit that outputs data detected by the driver monitoring unit, the position detection unit, and the traveling behavior detection unit to the safety confirmation evaluation device.

  According to the safety confirmation evaluation system, any one of the safety confirmation evaluation devices (1) to (9) and the vehicle-mounted device are included. Therefore, the effects of the safety confirmation evaluation devices (1) to (9) can be obtained. Further, the data detected by the driver monitoring unit, the position detection unit, and the traveling behavior detection unit of the on-vehicle device are output to the safety confirmation evaluation device. By executing the evaluation of the safety confirmation operation, the processing load on the on-vehicle device can be reduced, the cost of the on-vehicle device can be reduced, and a system that can be widely introduced can be constructed.

Further, the safety confirmation evaluation method according to the present disclosure is a safety confirmation evaluation method for evaluating the safety confirmation operation of the driver of the vehicle,
An approach time estimating step of estimating the approach time of the vehicle to the intersection,
An information acquisition step of acquiring information including behavior of the driver's face;
Based on the information obtained before and after the approach time, including an evaluation step of evaluating the safety confirmation operation of the driver,
The evaluation step includes:
A stop determination step of determining whether the vehicle has stopped after the entry time,
When the stop determination step determines that the vehicle has stopped, a first evaluation step of evaluating a safety confirmation operation of the driver based on the information acquired before and after the vehicle restarts after the vehicle stops. And is characterized by including.

  According to the safety confirmation evaluation method, the evaluation step evaluates the driver's safety confirmation operation at the intersection based on the information acquired before and after the approach time. Further, when the stop determination step determines that the vehicle has stopped after the entry time, the first evaluation step is based on the information acquired before and after the vehicle restarts after stopping. Then, the driver's safety confirmation operation is evaluated. Therefore, even when the vehicle is temporarily stopped in the intersection, the first evaluation step determines whether the driver before or after the restart, in other words, at the timing of passing through the intersection, Safety evaluation operation can be properly evaluated.

The safety confirmation evaluation program according to the present disclosure is a safety confirmation evaluation program for causing at least one computer to execute a process of evaluating a safety confirmation operation of a vehicle driver,
The at least one computer
An approach time estimating step of estimating the approach time of the vehicle to the intersection,
An information acquisition step of acquiring information including behavior of the driver's face;
Based on the information obtained at a predetermined time before and after the approach time, based on the evaluation step to evaluate the safety confirmation operation of the driver,
In the evaluation step,
A stop determination step of determining whether the vehicle has stopped after the entry time,
When the stop determination step determines that the vehicle has stopped, a first evaluation step of evaluating a safety confirmation operation of the driver based on the information acquired before and after the vehicle restarts after the vehicle stops. And is executed.

  According to the safety confirmation evaluation program, the evaluation step evaluates the driver's safety confirmation operation at the intersection based on the information acquired before and after the approach time. Further, when the stop determination step determines that the vehicle has stopped after the entry time, the first evaluation step is based on the information acquired before and after the vehicle restarts after stopping. Then, the driver's safety confirmation operation is evaluated. Therefore, even when the vehicle is temporarily stopped in the intersection, the first evaluation step determines whether the driver before or after the restart, in other words, at the timing of passing through the intersection, A safety confirmation evaluation device capable of appropriately evaluating the safety confirmation operation of the present invention can be realized.

It is a schematic diagram which shows the example of a structure of the safety confirmation evaluation system which concerns on Embodiment (1). FIG. 3 is a block diagram illustrating a hardware configuration example of an on-vehicle device used in the safety confirmation evaluation system according to the embodiment (1). It is a figure showing an example of composition of detection data transmitted from a vehicle equipment to a server device. FIG. 3 is a block diagram illustrating a hardware configuration example of a server device used in the safety confirmation evaluation system according to the embodiment. FIG. 3 is a diagram illustrating a configuration example of a detection data file stored in a detection data storage unit. FIG. 3 is a diagram illustrating a configuration example of an evaluation data file stored in an evaluation data storage unit. FIG. 3 is a block diagram illustrating a functional configuration example of a server device according to Embodiment (1). FIG. 7 is a block diagram illustrating an example of a functional configuration of a security confirmation evaluation unit included in the server device according to Embodiment (1). 5 is a flowchart illustrating a processing operation performed by a driver monitoring unit of the on-vehicle device according to Embodiment (1). 5 is a flowchart illustrating a processing operation performed by a control unit of the on-vehicle device according to Embodiment (1). 9 is a flowchart illustrating a processing operation performed by a server computer of the server device according to Embodiment (1). It is a flowchart which shows the evaluation processing operation | movement of the safety confirmation operation | movement which the server computer of the server apparatus concerning Embodiment (1) performs. FIG. 18 is a block diagram illustrating an example of a functional configuration of a security confirmation evaluation unit included in a server device according to Embodiment (2). It is a flowchart which shows the evaluation processing operation | movement of the safety confirmation operation | movement which the server computer of the server apparatus concerning Embodiment (2) performs. It is a block diagram showing an example of functional composition of a safety check evaluation part with which a server device concerning an embodiment (3) is provided. It is a flowchart which shows the evaluation processing operation | movement of the safety confirmation operation | movement which the server computer of the server apparatus concerning Embodiment (3) performs.

Hereinafter, embodiments of a safety confirmation evaluation device, an in-vehicle device, a safety confirmation evaluation system including them, a safety confirmation evaluation method, and a safety confirmation evaluation program according to the present invention will be described with reference to the drawings.
The safety confirmation evaluation device according to the present invention can be widely applied to, for example, a system that evaluates a driver's safety confirmation operation of a vehicle managed by a business operator and supports improvement of the driver's safety awareness. is there.

[System configuration example]
FIG. 1 is a schematic diagram illustrating a configuration example of a safety confirmation evaluation system according to Embodiment (1).
The safety confirmation evaluation system 1 is a system for evaluating the safety confirmation operation of the driver 3 riding in the vehicle 2, and includes at least one vehicle-mounted device 10 mounted on at least one vehicle 2 and each vehicle-mounted device. And at least one or more server devices 40 that process data acquired from the server 10. The server device 40 is an example of the “safety confirmation evaluation device” of the present invention.

  The vehicle 2 on which the in-vehicle device 10 is mounted is not particularly limited. In the present embodiment, vehicles managed by a company that runs various businesses can be targeted. For example, trucks managed by transport operators, buses managed by bus operators, taxis managed by taxi operators, car-sharing vehicles managed by car sharing operators, rent-a-cars managed by car rental operators, company owned It may be a company-owned car that is leased from a car leasing company or used.

  The in-vehicle device 10 and the server device 40 are configured to be communicable via the communication network 4. The communication network 4 may include a wireless communication network such as a mobile phone network (3G / 4G) including a base station or a wireless LAN (Local Area Network), a wired communication network such as a public telephone network, the Internet, or a dedicated network. Etc. may be included. The server device 40 includes a communication unit 41, a server computer 50, and a storage unit 70.

  In addition, a terminal device 80 of a company that manages the vehicle 2 (hereinafter, referred to as a company terminal) is configured to be able to communicate with the server device 40 via the communication network 4. The business operator terminal 80 may be a personal computer having a communication function, a mobile information terminal such as a mobile phone, a smartphone, or a tablet device. Further, the operator terminal 80 may be configured to be able to communicate with the vehicle-mounted device 10 via the communication network 4.

  In the safety confirmation evaluation system 1, the server device 40 transmits the behavior of the face of the driver 3 (the direction of the face or the direction of the line of sight), the position of the vehicle 2, and the The detection data including the running behavior (angular velocity or the like) is accumulated, and the safety confirmation operation of each driver 3 is evaluated using the accumulated detection data of each vehicle-mounted device 10. The safety confirmation operation includes a safety confirmation operation of the driver 3 at the intersection. The server device 40 executes, for example, using detection data acquired from each of the on-vehicle devices 10, after completing one day of driving of each vehicle 2, performs an evaluation process of a safety confirmation operation at each intersection that has passed on that day. Alternatively, the evaluation process of the safety confirmation operation at each intersection that has passed within the predetermined period may be executed at regular intervals, and the execution timing of the driving evaluation process is not particularly limited.

  Then, in the server device 40, for example, when there is a request from the business operator terminal 80, information such as the evaluation result of the safety confirmation operation of the driver 3 of each vehicle 2 is transmitted to the business operator terminal 80 via the communication network 4. Perform the processing provided to By presenting the evaluation result displayed on the operator terminal 80 to the driver 3, the operator can carry out safety education such as improving the driver's safety awareness.

  In evaluating the safety confirmation operation of the driver 3 at the intersection, the server device 40 performs a process of estimating the intersection entry time of the vehicle 2 (hereinafter, also referred to as the entry time). For example, the server device 40 accumulates angular velocity data of the vehicle 2 (for example, angular velocity data before and after passing through an intersection) transmitted from the on-vehicle device 10, and based on the accumulated angular velocity data of the vehicle 2, the entry time May be estimated. The entry time is, in other words, the time when the vehicle 2 starts turning right and left (right and left turn start time), and is a boundary time for evaluating the driver's safety confirmation operation before and after entering the intersection. It may be.

  The intersection is, for example, a junction where two or more roads intersect with each other, and may include a T-junction or a Y-junction in addition to a crossroad (four-junction). May be included. It does not matter whether there is a traffic light or a pedestrian crossing. In other words, the intersection includes a point at which the vehicle 2 switches the traveling direction by turning right or left, and in addition to the above-mentioned intersection of the road and the road, a path leading to the road and roadside facilities (stores, parking lots, etc.). May intersect, that is, an entrance point to a roadside facility. The passage leading to the roadside facility may include a sidewalk portion.

  Further, the server device 40 accumulates information on the behavior of the driver's face when the vehicle 2 passes through the intersection acquired from the on-vehicle device 10 (hereinafter, also referred to as face behavior information), and before and after the estimated approach time. Based on the acquired facial behavior information, a process for evaluating the driver's safety confirmation operation is performed. For example, the server device 40 performs processing for evaluating a driver's safety confirmation operation at a predetermined time before the entry time and at a predetermined time after the entry time, and stores the evaluation results.

  The face behavior information is not particularly limited as long as it is related to the behavior of the face of the driver 3, and may be appropriately determined according to the embodiment. The face behavior information includes, for example, at least one of the direction of the face of the driver 3 and the direction of the line of sight. In addition to these, whether or not the face can be detected, the face movement, the position of the facial organ, and the eye And at least one of the opening and closing of.

  By the way, when the vehicle 2 makes a right or left turn at an intersection, for example, after the vehicle 2 enters the intersection, the vehicle 2 may make a right or left turn without stopping in the intersection, or may temporarily stop in the intersection and then restart. You may turn right or left. Specifically, when turning right at an intersection, after the vehicle 2 enters the intersection, the vehicle 2 stops temporarily at the intersection (for example, just before the center of the intersection) to wait for the oncoming vehicle to pass, and the oncoming vehicle passes. Later, they may restart and make a right turn. In the case of turning left at an intersection, after the vehicle 2 enters the intersection, the vehicle 2 stops temporarily at the intersection (for example, just before a pedestrian crossing) to wait for a pedestrian or the like to cross the road. After crossing, you may restart and make a left turn.

  The length of the stop time when the vehicle temporarily stops at such an intersection differs depending on the traffic conditions at each intersection, and may be as short as about several seconds or as long as 10 seconds or more. In particular, when the vehicle stops in an intersection for a long time, it is more important to appropriately evaluate the safety confirmation operation before and after restarting after the stop than the safety confirmation operation immediately after the stop. In evaluating the driver's safety confirmation operation at an intersection in this way, it is necessary to evaluate whether an appropriate safety confirmation operation has been performed at a more appropriate timing in consideration of the stopping state of the vehicle 2 in the intersection. is there.

  Therefore, in the server device 40, when performing the process of evaluating the safety confirmation operation of the driver 3 at the intersection, it is determined whether or not the vehicle 2 has stopped after the entry time to the intersection, and the vehicle 2 has stopped. When it is determined that the vehicle 2 is stopped, the processing for evaluating the driver's safety confirmation operation is executed based on the face behavior information acquired before and after the vehicle 2 restarts.

  According to the server device 40, even when the vehicle stops in the intersection, before and after the vehicle restarts after the stop, in other words, the safety confirmation operation of the driver 3 at the timing of actually turning around the intersection is evaluated. Is possible, and the safety check operation of the driver 3 at the intersection can be more appropriately evaluated.

[Example of hardware configuration]
FIG. 2 is a block diagram illustrating a hardware configuration example of the vehicle-mounted device 10 used in the safety confirmation evaluation system 1 according to the embodiment.
The on-vehicle device 10 includes a platform unit 11 and a driver monitoring unit 20. Further, a drive recorder unit 30 is connected to the vehicle-mounted device 10.

  The platform unit 11 is equipped with an acceleration sensor 12 for measuring the acceleration of the vehicle 2, an angular velocity sensor 13 for detecting the rotational angular velocity of the vehicle 2, and a GPS (Global Positioning System) receiving unit 14 for detecting the position of the vehicle 2. . The platform unit 11 includes a communication unit 15 that performs communication processing with an external device via the communication network 4, a notification unit 16 that outputs a warning sound such as a beep sound, or a sound such as a warning message, and a storage unit. 17 and an external interface (external I / F) 18. Further, the platform section 11 is provided with a control section 19 for controlling the processing operation of each section. The acceleration sensor 12 and the angular velocity sensor 13 are an example of the “running behavior detecting unit” of the vehicle-mounted device according to the present invention. The GPS receiver 14 is an example of the “position detector” of the vehicle-mounted device according to the present invention.

  The acceleration sensor 12 is configured by, for example, a three-axis acceleration sensor that measures acceleration in three directions of the XYZ axes. As the three-axis acceleration sensor, a semiconductor type acceleration sensor such as a piezoresistive type can be used in addition to the capacitance type. Note that a two-axis, one-axis acceleration sensor may be used as the acceleration sensor 12. The acceleration data measured by the acceleration sensor 12 is stored in the RAM 19b of the control unit 19, for example, in association with the detection time (that is, in a time series).

  The angular velocity sensor 13 is a sensor capable of detecting angular velocity according to at least rotation about a vertical axis (yaw direction), that is, angular velocity data according to rotation (turning) of the vehicle 2 in the left-right direction, for example, a gyro sensor (yaw rate) Sensor). The angular velocity sensor 13 includes, besides a single-axis gyro sensor around a vertical axis, a two-axis gyro sensor that also detects an angular velocity around a horizontal axis in the horizontal direction (pitch direction), and a rotation around the horizontal axis in the front-rear direction (roll direction). May be used. As these gyro sensors, an optical or mechanical gyro sensor may be used in addition to a vibration gyro sensor.

  Further, the detection direction of the angular velocity about the vertical axis of the angular velocity sensor 13 may be set to, for example, a positive direction in the clockwise direction and a negative direction in the counterclockwise direction. In this case, if the vehicle 2 turns right, positive angular velocity data is detected, and if the vehicle 2 turns left, negative angular velocity data is detected. The angular velocity sensor 13 detects an angular velocity at a predetermined cycle (for example, a cycle of several tens of ms), and stores the detected angular velocity data in the RAM 19b of the control unit 19 in association with, for example, the detection time. The acceleration sensor 12 and the angular velocity sensor 13 may use an inertial sensor in which these are mounted in one package.

  The GPS receiver 14 receives a GPS signal from an artificial satellite via the antenna 14a at a predetermined cycle (for example, every one second), and detects position data (latitude and longitude) of the current location. The position data detected by the GPS receiving unit 14 is stored in the RAM 19b of the control unit 19, for example, in association with the detection time. Note that the device that detects the position of the vehicle 2 is not limited to the GPS receiving unit 14. For example, a positioning device corresponding to another satellite positioning system such as the quasi-zenith satellite in Japan, GLONASS in Russia, Galileo in Europe, or Compass in China may be used.

  The communication unit 15 is an example of the “output unit” of the vehicle-mounted device according to the present invention, and includes a communication module that performs data output processing and the like to the server device 40 via the communication network 4.

  The storage unit 17 includes, for example, a removable storage device such as a memory card, or one or more storage devices such as a hard disk drive (HDD) and a solid state drive (SSD). The storage unit 17 may be configured to store various types of detection data acquired from the acceleration sensor 12, the angular velocity sensor 13, the GPS receiving unit 14, the driver monitoring unit 20, or the drive recorder unit 30 in time series.

  The external I / F 18 is configured to include an interface circuit and a connector for transmitting and receiving data and signals to and from a vehicle-mounted device such as the drive recorder unit 30.

  The control unit 19 is configured by a microcomputer including a CPU (Central Processing Unit) 19a, a RAM (Random Access Memory) 19b, and a ROM (Read Only Memory) 19c. The control unit 19 performs processing of storing various types of detection data acquired from the acceleration sensor 12, the angular velocity sensor 13, the GPS receiving unit 14, the driver monitoring unit 20, or the drive recorder unit 30 in the RAM 19b or the storage unit 17. In addition, the control unit 19 reads various detection data stored in the RAM 19b or the storage unit 17 as necessary, in addition to the program stored in the ROM 19c, and executes a predetermined program.

  For example, the control unit 19 detects a time when the absolute value of the angular velocity detected by the angular velocity sensor 13 exceeds a predetermined angular velocity threshold ωth, and sets the detected time as an intersection passing time t0 (hereinafter, also referred to as a passing time t0). The storage process is performed. If the vehicle speed at the passing time t0 is equal to or higher than the predetermined intersection upper limit speed, the intersection may be regarded as not turning right or left, and the time t0 may be canceled. The vehicle speed can be calculated, for example, from a time-series change in position data detected by the GPS receiving unit 14. The control unit 19 also performs processing of transmitting various types of detection data acquired before and after the passage time t0 to the server device 40 at a predetermined timing.

The driver monitoring unit 20 includes a driver camera 21, an image analysis unit 22, and an interface (I / F) 23.
The driver camera 21 is configured to include, for example, a lens unit (not shown), an imaging element unit, a light irradiation unit, and a camera control unit that controls these units.

  The imaging element unit includes, for example, an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), a filter, and a microlens. The image sensor unit includes an infrared sensor such as a CCD, a CMOS, or a photodiode that can form a captured image by receiving infrared rays or ultraviolet rays such as near infrared rays, in addition to an element that can form a captured image by receiving light in a visible region. May be included. The light irradiation unit may include a light emitting element such as an LED (Light Emitting Diode), and may use an infrared LED or the like so that the state of the driver can be imaged day and night. The driver camera 21 may be a monocular camera or a stereo camera.

  The camera control unit includes, for example, a processor. The camera control unit controls the image sensor unit and the light irradiating unit, irradiates light (for example, near-infrared light) from the light irradiator, and controls the image sensor unit to capture the reflected light. I do. The driver camera 21 captures an image at a predetermined frame rate (for example, 30 to 60 frames per second), and data of the image captured by the driver camera 21 is output to the image analysis unit 22.

  The image analysis unit 22 is configured to include, for example, an image processing processor and the like, and the behavior of the face of the driver 3 (for example, the direction of the face, the direction of the line of sight, the degree of eye opening, etc.) ) Is detected. Data indicating the behavior of the face of the driver 3 detected by the image analysis unit 22, image data, and imaging date / time data are sent to the platform unit 11 via the interface (I / F) 23, and the RAM 19b of the platform unit 11 Alternatively, it is stored in the storage unit 17.

  The direction of the face of the driver 3 detected by the image analysis unit 22 is, for example, a pitch angle that is an angle (up and down direction) around the X axis (horizontal axis) of the driver's face, and the Y axis of the face. It may be indicated by a yaw angle that is an angle (horizontal direction) around the (vertical axis) and a roll angle that is an angle (horizontal inclination) around the Z axis (front-rear axis) of the face. Is included. Further, these angles can be indicated by angles with respect to a predetermined reference direction. For example, the reference direction may be set to the front direction of the driver.

  The direction of the line of sight of the driver 3 detected by the image analysis unit 22 is, for example, the direction of the driver's face detected from the image and information on the eye area (the position of the inner or outer corner of the eye, the position of the pupil, etc.). ) And can be indicated by a line-of-sight vector V (three-dimensional vector) on three-dimensional coordinates. The line-of-sight vector V is, for example, a pitch angle that is an angle (up and down direction) around the X axis (left and right axis) of the driver's face, and a yaw that is an angle (left and right direction) around the Y axis (up and down axis) of the driver's face. The angle may be estimated from at least one of an angle and a roll angle, which is an angle (lateral inclination) around the Z axis (front-back axis) of the face, and the eye area information. In addition, the line-of-sight vector V indicates a part of the value of the three-dimensional vector in common with the value of the vector of the face direction (for example, the origin of the three-dimensional coordinates is common), or the vector of the face direction is used as a reference. Or a relative angle (a relative value of the vector of the face direction).

  The degree of eye opening of the driver 3 detected by the image analysis unit 22 may be, for example, information on the driver's eye area (the position of the inner or outer eyes, the position of the upper and lower eyelids, or the position of the pupil) detected from the image. Etc.).

  The drive recorder unit 30 is connected to the external I / F 18 of the platform unit 11. The drive recorder unit 30 is configured to include an outside camera 31 and an inside camera 32.

  The outside camera 31 is a camera that captures an image in front of the vehicle 2, and the inside camera 32 is a camera that captures an image of the interior of the vehicle 2. The outside camera 31 and the inside camera 32 can be constituted by, for example, a visible light camera, but may be constituted by a near-infrared camera or the like.

  The exterior camera 31 and the interior camera 32 each capture an image at a predetermined frame rate (for example, several tens of frames per second), and the image captured by the exterior camera 31 and the interior camera 32 and data such as the date and time of capture are stored in the platform unit 11. And stored in the RAM 19 b or the storage unit 17 of the platform unit 11. The drive recorder unit 30 may have a configuration including only the camera 31 outside the vehicle.

  The vehicle-mounted device 10 can have a compact configuration in which the platform unit 11 and the driver monitoring unit 20 are housed in one housing. In this case, the location of the vehicle-mounted device 10 in the vehicle is not particularly limited as long as the driver camera 21 can capture at least a field of view including the driver's face. For example, in addition to the vicinity of the center of the dashboard of the vehicle 2, it may be installed near the handle column, near the meter panel, near the rearview mirror, or at the A pillar. In addition, information including the specifications of the driver camera 21 (for example, the angle of view and the number of pixels (length × width), etc.) and the position and orientation (for example, the mounting angle and the distance from a predetermined origin (the center position of the handle, etc.)) are stored in the driver camera 21. It may be stored in the monitoring unit 20 or the platform unit 11. Further, the driver monitoring unit 20 may be configured separately from the platform unit 11, in addition to the configuration integrated with the platform unit 11.

FIG. 3 is a diagram illustrating a configuration example of detection data transmitted from the vehicle-mounted device 10 to the server device 40.
The detection data includes, in addition to the identification information (such as a serial number) of the vehicle-mounted device 10 and the intersection passing time t0, the direction of the driver's face (pitch, yaw, and roll), the direction of the line of sight (pitch and yaw), Eye opening (right eye and left eye), vehicle acceleration (front and back, left and right, and up and down), angular velocity (yaw), driver image, vehicle outside image, vehicle position data (latitude and longitude), and traveling speed Time series data of a predetermined period (for example, before and after the passing time t0) is included. Note that the configuration of the detection data transmitted to the server device 40 is not limited to the configuration illustrated in FIG. The detection data illustrated in FIG. 3 is transmitted, for example, after the in-vehicle device 10 detects that the vehicle 2 has passed the intersection (for example, after a certain period of time at the passage time t0).

FIG. 4 is a block diagram illustrating a hardware configuration example of the server device 40 used in the safety confirmation evaluation system 1 according to the embodiment.
The server device 40 includes a communication unit 41, a server computer 50, and a storage unit 70, which are connected via a communication bus 42.

  The communication unit 41 is configured by a communication device for realizing transmission and reception of various data and signals with the vehicle-mounted device 10 and the business operator terminal 80 via the communication network 4.

  The server computer 50 includes a central processing unit 51 including one or more CPUs and a main memory 52 storing a control program 53. The central processing unit 51 executes various processes according to a control program 53 in a main memory 52.

  The storage unit 70 is configured by one or more mass storage devices such as a hard disk drive and a solid state drive, and includes a detection data storage unit 71, an evaluation data storage unit 72, a driver information storage unit 73, and the like. It is configured.

In the detection data storage unit 71, various types of detection data (see FIG. 3) acquired from the in-vehicle devices 10 of the vehicles 2 are accumulated in a time series in association with the identification information of the in-vehicle devices 10.
FIG. 5 is a diagram illustrating a configuration example of a detection data file stored in the detection data storage unit 71.
In the detection data file 71a, for example, the driver ID, the intersection passing time t0, the direction of the driver's face (pitch, yaw, and roll) and the line of sight are associated with the identification information (serial number or the like) of the vehicle-mounted device 10. Direction (pitch and yaw), eye opening (right eye and left eye), vehicle acceleration (back and forth, left and right, and up and down), angular velocity (yaw), driver image (imaging date and time, frame number, and image data) In addition, data such as an image outside the vehicle (imaging date and time, frame number, and image data), position information (latitude and longitude) of the vehicle, and traveling speed are accumulated in chronological order.

  In the evaluation data storage unit 72, information on the evaluation result of the safety confirmation operation of the driver 3 of each vehicle 2 executed by the server computer 50, that is, at least information on the evaluation result of the safety confirmation operation of the driver 3 at the intersection is stored. It is stored for each vehicle-mounted device 10 or for each driver 3.

FIG. 6 is a diagram illustrating a configuration example of the evaluation data file stored in the evaluation data storage unit 72.
The evaluation data file 72a includes identification information of the vehicle-mounted device 10, the driver ID, the intersection passing time t0, the intersection position, the entry time t5 at the intersection, the stop time t6 within the intersection, and the restart time after the stop time t6. t7, evaluation conditions (such as whether or not there is a stop in an intersection), and evaluation results are included. The evaluation result stores, for example, evaluation data scored by performing statistical processing based on a result evaluated based on a predetermined evaluation item, or ranked evaluation data.

  The driver information storage unit 73 stores various information (driver identification information (driver ID), work schedule, and the like) on the driver 3 managed by the business operator.

[Functional configuration example]
FIG. 7 is a block diagram illustrating an example of a functional configuration of the server device 40 used in the safety confirmation evaluation system 1 according to Embodiment (1).
The server computer 50 of the server device 40 includes an intersection approach estimating unit 54, a behavior information acquiring unit 55, and a safety confirmation evaluating unit 56. The safety confirmation evaluation unit 56 is an example of the “evaluation unit” of the present invention.

  The server computer 50 reads out the control program 53 stored in the main memory 52 shown in FIG. 4 and executes the control program 53, whereby the intersection approach estimation unit 54, the behavior information acquisition unit 55, and the safety confirmation evaluation unit 56 And the like.

  The intersection approach estimating unit 54 performs a process of estimating the approach time t5 of the vehicle 2 to the intersection based on the angular velocity data of the vehicle 2 and the like stored in the detection data storage unit 71 of the storage unit 70. The intersection approach estimating unit 54 may include a direction estimating unit 54b in addition to the approach time detecting unit 54a.

  The entry time detection unit 54a calculates the integral value θ (that is, angle) of the angular velocity data for a predetermined time (for example, ± n seconds) before and after the intersection passing time t0, and calculates the calculated integral value θ as a predetermined integration ratio θr (Time to reach the integral value θ) is detected, and the time is estimated as the entry time t5 to the intersection. The ± n seconds may be set to, for example, any time of about ± 10 to 20 seconds. When calculating the integral value θ, the calculation may be performed using only angular velocity data whose absolute value of the angular velocity is equal to or greater than a predetermined lower limit of angular velocity ωL in order to reduce the error component of angular velocity. Further, the integration ratio θr may be set to, for example, any value (%) of 10% or less of the integration value θ. Further, the set value of the integral ratio θr may be changed according to the value of the integral value θ, or the set value of the integral ratio θr may be changed according to the change state of the angular velocity before the passage time t0. Good.

  When the integrated value θ calculated by the entry time detection unit 54a is not within the range of the predetermined road intersection angle (in other words, when it is estimated that the intersection is not an intersection), the detection of the entry time t5 is stopped. Processing may be performed. In the range of the predetermined road intersection angle, for example, a range from the intersection angle lower limit value to the intersection angle upper limit value (for example, 40 degrees to 120 degrees) may be set.

  The direction estimating unit 54b estimates the turning direction of the vehicle 2 based on the sign of the integral value of the angular velocity data calculated by the entry time detecting unit 54a. In one example of this embodiment, when the integral value is positive, it is estimated that the vehicle turns right, and when the integral value is negative, it is estimated that the vehicle turns left.

  The behavior information acquisition unit 55 acquires various types of detection data transmitted from the vehicle-mounted device 10, stores the acquired detection data in the detection data storage unit 71, and executes an evaluation process in the safety confirmation evaluation unit 56. At this time, a process of reading various types of detection data from the detection data storage unit 71 is performed. The various types of detection data include data detected by the acceleration sensor 12, the angular velocity sensor 13, the GPS receiving unit 14, the driver monitoring unit 20, and the drive recorder unit 30. The data detected by the driver monitoring unit 20 includes information on the behavior of the driver's face.

  The safety confirmation evaluation unit 56 performs a process of evaluating the driver's safety confirmation operation before and after the entry time t5 estimated by the intersection entry estimation unit 54. For example, based on the driver's face behavior information stored in the detection data storage unit 71, the safety confirmation evaluation unit 56 may be configured to perform before and after (at least before or after) the entry time t5, and / or to restart. Before and after t7 (at least either before or after), the left and right swing angles and swing times of the driver's face direction or gaze direction are detected. Then, the safety confirmation evaluation unit 56 evaluates the safety confirmation operation of the driver 3 before and after the approach time t5 and / or before and after the restart time t7 based on the detected right and left swing angles and swing times.

FIG. 8 is a block diagram illustrating an example of a functional configuration of the safety confirmation evaluation unit 56 included in the server device 40.
The safety confirmation evaluation unit 56 includes a stop determination unit 57, a first evaluation unit 58, a second evaluation unit 59, a third evaluation unit 60, and an evaluation point calculation unit 61.

  The stop determination unit 57 determines whether or not the vehicle 2 has stopped after the entry time t5 to the intersection (for example, within a predetermined time that is assumed to be necessary to pass through the intersection).

When the stop determination unit 57 determines that the vehicle 2 has stopped, the first evaluation unit 58 performs driving based on the facial behavior information of the driver 3 acquired before and after the vehicle 2 stops and restarts. A process for evaluating the safety confirmation operation of the person 3 is performed.
For example, in the first evaluation unit 58, based on the right and left swing angles and swing times detected before and after the restart time t7 (for example, a predetermined time before and after), a left or right or course change direction (for example, a right turn or It is determined whether at least one of the safety confirmation operations (left turn) has been performed. The order of detection in each of the left and right directions does not matter.

When the stop determination unit 57 determines that the vehicle 2 has stopped, the second evaluation unit 59 determines based on the face behavior information of the driver 3 acquired at a predetermined time before the intersection entry time t5. A process for evaluating the driver's 3 safety confirmation action before the entry time t5 is performed.
For example, the second evaluating unit 59 determines whether the left and right safety confirmation operation has been performed based on the left and right swing angles and the swing time detected before the entry time t5 (for example, a predetermined time). The order of detection in each of the left and right directions does not matter.

When the stop determination unit 57 determines that the vehicle 2 has not stopped, the third evaluation unit 60 enters based on the facial behavior information of the driver 3 acquired before and after the entry time t5 to the intersection. A process for evaluating the safety confirmation operation of the driver 3 before and after the time t5 is performed.
For example, in the third evaluation unit 60, based on the right and left swing angles and swing times detected before and after the approach time t5 (for example, a predetermined time before and after), the left and right and the course change direction (for example, right turn or left turn) It is determined whether the safety confirmation operation of (1) has been performed. The order of detection in each of the left and right directions does not matter.

  For the safety check in the right direction evaluated by each of the first evaluation unit 58, the second evaluation unit 59, and the third evaluation unit 60, for example, [Evaluation Item 1] When the swing angle to the right is equal to or more than a predetermined angle. [Evaluation Item 2] It is determined whether the state at or above the predetermined angle has continued for a predetermined time or more. Similarly, for the safety check in the left direction, [Evaluation Item 3] It is determined whether the swing angle to the left is equal to or greater than a predetermined angle, and [Evaluation Item 4] The state in which the swing angle is equal to or more than the predetermined angle is equal to or more than a predetermined time. Determine if it is continuing.

Also, regarding the safety confirmation of the course change direction, for example, [Evaluation Item 5] it is determined whether the swing angle in the course change direction of turning right or left is equal to or larger than a predetermined angle, and [Evaluation Item 6] is equal to or larger than the predetermined angle. It is determined whether the state has continued for a predetermined time or more.
Further, a process of evaluating the driver's awareness of deceleration may be performed based on the speed of the vehicle 2 before and after the entry time t5. For example, [Evaluation Item 7] The presence or absence of deceleration awareness may be evaluated by determining whether the maximum value of the speed of the vehicle 2 at a predetermined time before and after the entry time t5 is equal to or lower than a predetermined upper limit speed.

When the stop determination unit 57 determines that the vehicle 2 has stopped, the evaluation point calculation unit 61 performs a safety confirmation evaluation before and after the restart time t7 executed by the first evaluation unit 58, and a second evaluation unit 59. Based on the safety confirmation evaluation before the executed entry time t5, a process of calculating the evaluation points of the safety confirmation operation at each intersection is performed. Then, the evaluation point calculation unit 61 performs a process of storing the calculated evaluation points in the evaluation data storage unit 72 of the storage unit 70.
In addition, when the stop determination unit 57 determines that the vehicle 2 is not stopped, the evaluation point calculation unit 61 performs each evaluation based on the safety confirmation evaluation before and after the entry time t5 executed by the third evaluation unit 60. A process of calculating an evaluation point of the safety check operation at the intersection is performed, and a process of storing the calculated evaluation point in the evaluation data storage unit 72 of the storage unit 70 is performed.
For example, the evaluation point calculation unit 61 performs a statistical process such as summing, averaging, or normalizing the evaluation points determined in each of the evaluation items 1 to 7 to calculate an evaluation point for each intersection, A process of storing the calculated evaluation points in the evaluation data storage unit 72 of the storage unit 70 is performed.

  In addition, the safety confirmation evaluator 56 based on the face behavior information stored in the detection data storage 71, before and after the approach time t5 and / or before and after the restart time t7, the face direction or the line of sight of the driver. Of the driver's face and / or the line of sight at predetermined times before and after the entry time t5 and / or the restart time t7. If a vertical swing angle equal to or more than a predetermined value is detected together with the swing angle of the above, a process of excluding the face behavior information when the vertical swing angle is detected from the evaluation target of the safety confirmation operation may be performed. The vertical swing angle equal to or greater than the predetermined value can be set to an angle that can be determined to be an inattentive look in the vertical direction.

  Further, the server device 40 according to another embodiment may be configured to provide a cloud service including a Web server operating as a presentation layer, an application server operating as an application layer, and a database server operating as a database layer. . The configuration of the server for providing the cloud service is not limited to the three-layer structure described above.

  The Web server operates as the communication unit 41. For example, the Web server processes an HTTP request requested from the browser of the business operator terminal 80 and instructs the application server to perform a corresponding process. And performs a process of presenting a processing result to the business operator terminal 80 through a browser.

  The application server operates as the server computer 50. For example, in response to a request from a Web server, the application server accesses a database server to search for and extract data necessary for processing, and to enter an intersection entry estimating unit 54. , The behavior information acquisition unit 55, and the safety confirmation evaluation unit 56.

  The database server operates as the storage unit 70. For example, the database server manages various detection data, evaluation data, driver information, and the like acquired from the vehicle-mounted device 10, and stores data in response to a request from an application server or the like. Search, extract, save, etc.

[Processing operation example]
FIG. 9 is a flowchart illustrating a processing operation performed by the driver monitoring unit 20 in the vehicle-mounted device 10 according to the embodiment. This processing operation is executed, for example, at a timing when an image is captured by the driver camera 21 (for example, every frame or every frame at a predetermined interval).

First, in step S1, the image analysis unit 22 acquires an image captured by the driver camera 21, and proceeds to step S2.
In step S2, the image analysis unit 22 performs a process of detecting a driver's face or a face region from the acquired image, and proceeds to step S3. The method of detecting a face from an image is not particularly limited, but it is preferable to employ a method of detecting a face at high speed and with high accuracy.

  In step S3, the image analysis unit 22 performs a process of detecting the position and shape of a facial organ such as an eye, a nose, a mouth, and eyebrows from the face region detected in step S2, and proceeds to step S4. There is no particular limitation on a method of detecting a face organ from a face region in an image, but it is preferable to employ a method that can detect a face organ at high speed and with high accuracy. For example, a method may be employed in which the image analysis unit 22 creates a three-dimensional face shape model, fits this to a face region on a two-dimensional image, and detects the position and shape of each organ of the face. According to this method, it is possible to accurately detect the position and shape of each organ of the face regardless of the installation position of the driver camera 21, the direction of the face in the image, and the like. As a technique for fitting a three-dimensional face shape model to a human face in an image, for example, a technique described in JP-A-2007-249280 can be applied, but the technique is not limited to this.

  In step S4, the image analysis unit 22 performs a process of detecting the orientation of the driver's face based on the position and shape data of each organ of the face obtained in step S3, and proceeds to step S5. For example, the pitch angle of the vertical rotation (around the X axis), the yaw angle of the horizontal rotation (around the Y axis), and the roll angle of the overall rotation (around the Z axis) included in the parameters of the three-dimensional face shape model are described. It may be detected as information on the direction of the driver's face.

  In step S5, the image analysis unit 22 determines the orientation of the driver's face obtained in step S4, the position and shape of the driver's facial organ obtained in step S3, and particularly the characteristic points of the eyes (the outer corner of the eye, the inner eye, and the pupil). The processing for detecting the direction of the line of sight is performed based on the position and the shape of ()), and the processing proceeds to step S6.

  The direction of the line of sight is, for example, various face directions and the feature amounts of the eye image (the relative positions of the outer and inner corners of the eyes, the pupil, or the relative positions of the sclera (so-called white eye) portion and the iris (so-called black eye) portion, shading, May be detected by learning in advance using a learning device, and evaluating the degree of similarity with the learned feature amount data. Alternatively, using the fitting result of the three-dimensional face shape model and the like, the size and center position of the eyeball are estimated from the size and orientation of the face and the position of the eye, and the position of the pupil is detected, and the center of the eyeball is detected. A vector connecting the center of the pupil may be detected as the line-of-sight direction.

  In step S6, the image analysis unit 22 opens the eyes based on the position and shape of the driver's facial organ obtained in step S3, particularly the positions and shapes of the characteristic points of the eyes (the outer corner of the eye, the inner eye, the pupil, and the eyelid). A process for detecting the degree is performed, and the process proceeds to step S7.

  In step S7, the image analysis unit 22 determines the direction of the driver's face detected in step S4, the direction of the driver's line of sight detected in step S5, the driver's eye opening detected in step S6, The image of the user and the imaging time are associated with each other and transmitted to the platform unit 11 as image information. Thereafter, the image analysis unit 22 returns to step S1 and repeats the processing.

  FIG. 10 is a flowchart illustrating an example of a processing operation performed by the control unit 19 in the vehicle-mounted device 10 according to Embodiment (1). This processing operation is executed at a predetermined cycle of several tens ms to several seconds, for example.

First, in step S11, the control unit 19 performs processing of acquiring acceleration data measured by the acceleration sensor 12 and storing the data in the RAM 19b, and proceeds to step S12.
In step S12, the control unit 19 performs a process of acquiring the angular velocity data detected by the angular velocity sensor 13 and storing the acquired angular velocity data in the RAM 19b, and proceeds to step S13.

In step S13, the control unit 19 performs a process of acquiring the image information transmitted from the driver monitoring unit 20 and storing the acquired image information in the RAM 19b, and proceeds to step S14.
In step S14, the control unit 19 performs a process of acquiring the data (data of the outside image and the inside image) transmitted from the drive recorder unit 30 and storing the data in the RAM 19b, and proceeds to step S15.

In step S15, the control unit 19 acquires the position data detected by the GPS receiving unit 14, and proceeds to step S16.
In step S16, the control unit 19 performs a process of calculating the traveling speed of the vehicle 2 based on a change per unit time of the position data acquired in step S15, and storing the position data and the traveling speed in the RAM 19b, The process proceeds to step S17. In addition, the order of each process from step S11 to S16 is not particularly limited. Further, each of these processes may be executed in parallel.

  In step S17, the control unit 19 determines whether the vehicle 2 is passing through the intersection (that is, turning right or left). For example, the control unit 19 determines whether or not the absolute value of the angular velocity acquired in step S12 is equal to or greater than a predetermined angular velocity threshold ωth. The angular velocity threshold ωth is set to a value that can determine that the vehicle is turning right or left at an intersection. Further, in the determination process of step S17, it may be added to the determination condition that the vehicle speed when the absolute value of the angular speed becomes equal to or more than the predetermined angular speed threshold ωth is equal to or less than the predetermined intersection upper limit speed. Note that the predetermined intersection upper limit speed is set in consideration of a speed at which an intersection can be safely turned right and left.

In step S17, if the control unit 19 determines that the vehicle 2 is not passing through the intersection, the control unit 19 returns to step S11 and repeats the processing.
On the other hand, in step S17, if control unit 19 determines that vehicle 2 is passing through the intersection, it proceeds to step S18.

In step S18, the control unit 19 detects the time when the absolute value of the angular velocity becomes equal to or more than the predetermined angular velocity threshold value ωth (that is, the passing time t0), and proceeds to step S19.
In step S19, the control unit 19 determines whether the vehicle 2 has passed the intersection. For example, the control unit 19 may determine whether or not a predetermined time has elapsed from the passing time t0, or the integrated value of the angular velocity data (that is, the angle around the vertical axis) indicates that the vehicle 2 has finished passing the intersection. Alternatively, it may be determined whether or not the threshold value (angle) indicating the fact has been exceeded.

If the control unit 19 determines in step S19 that the vehicle 2 has passed the intersection, the control unit 19 proceeds to step S20.
In step S20, the control unit 19 stores the detection data (data acquired in steps S11 to S16) acquired in the predetermined period (for example, several tens of seconds) before and after the passage time t0 together with the data of the passage time t0, in the RAM 19b or the storage unit. 17 and controls the communication unit 15 to transmit these data to the server device 40. Thereafter, the control unit 19 returns to Step S11 and repeats the processing. FIG. 3 shows an example of the structure of the detection data transmitted from the vehicle-mounted device 10 to the server device 40.

  Note that, in step S20, when the control unit 19 detects the stop state of the vehicle 2 (for example, the state where the vehicle speed is 0) at a predetermined time before and after the passing time t0, the control unit 19 performs control before and after the time when the stop state of the vehicle 2 is detected. The detection data acquired within a predetermined time may be transmitted to the server device 40.

  The control unit 19 may store the detection data read from the RAM 19b or the storage unit 17 in the storage unit 17 (for example, a removable storage medium) instead of the process in step S20. After the driving of the day, the driver 3 removes the storage unit 17 from the in-vehicle device 10 and causes the business terminal 80 to read the detection data stored in the storage unit 17. May be transmitted.

FIG. 11 is a flowchart illustrating a processing operation performed by the server computer 50 in the server device 40 according to Embodiment (1).
First, in step S21, the server computer 50 determines whether or not the detection data transmitted from the in-vehicle device 10 has been received. If it is determined that the detection data has been received from the in-vehicle device 10, the process proceeds to step S22. On the other hand, if it is determined that the detection data has not been received from the vehicle-mounted device 10, the process proceeds to step S23.

  In step S22, the server computer 50 performs a process of storing the detection data received from the in-vehicle device 10 in the detection data storage unit 71 in association with the identification information of the in-vehicle device 10, and proceeds to step S23.

  In step S23, the server computer 50 determines whether it is time to evaluate the driver's safe driving behavior. Whether the timing for performing the evaluation may be determined based on, for example, whether a signal indicating the end of the driving operation of the vehicle 2 has been received from the in-vehicle device 10 or whether a predetermined evaluation execution time has been reached. You may judge by.

  In step S23, if the server computer 50 determines that it is not the timing to execute the evaluation, the process returns to step S21. On the other hand, if the server computer 50 determines that it is time to execute the evaluation, the process proceeds to step S24.

  In step S24, the server computer 50 performs an evaluation process of a safety confirmation operation at an intersection or the like of the driver 3 of the vehicle 2 on which the vehicle-mounted device 10 is mounted. A specific example of the evaluation processing executed in step S24 will be described with reference to the flowchart in FIG.

When the server computer 50 finishes the evaluation process of the safety confirmation operation in step S24, the process proceeds to step S25.
In step S25, the server computer 50 performs a process of storing the result of the evaluation process in the evaluation data storage unit 72 in association with the identification information of the vehicle-mounted device 10 and the driver ID, and thereafter ends the process.

  FIG. 12 is a flowchart illustrating an example of the evaluation processing operation (processing operation of step S24 in FIG. 11) of the safety confirmation operation performed by the server computer 50 in the server device 40 according to Embodiment (1). Note that this flowchart shows a processing operation for evaluating the safety confirmation operation of the driver 3 at each intersection that the vehicle 2 equipped with the on-vehicle device 10 has passed until the day of driving is completed.

First, in step S31, the server computer 50 operates as the intersection approach estimating unit 54, extracts data at the intersection passing time t0 from the detection data storage unit 71, and proceeds to step S32.
In step S32, the server computer 50 operates as the intersection approach estimating unit 54, and outputs the passing time t0 ± n seconds (± n seconds is, for example, any one of ± 10 to 20 seconds) from the detection data storage unit 71. ) Is read out, and the process proceeds to step S33.

  In step S33, the server computer 50 operates as the intersection approach estimating unit 54, calculates the intersection approach time t5 based on the time-series data of the angular velocity read in step S32, and then proceeds to step S34. For example, the server computer 50 integrates the time series data of the angular velocity to obtain an integral value θ, detects a time when the obtained integral value θ reaches a predetermined integration ratio θr, and determines the time at which the vehicle enters the intersection. It is stored as t5.

  In step S34, the server computer 50 operates as the intersection approach estimating unit 54, performs a process of estimating the right / left turn direction (right / left turn) of the vehicle 2, and proceeds to step S35. For example, the server computer 50 estimates the right / left turning direction of the vehicle 2 based on the sign of the integral value θ of the angular velocity calculated in step S33, and stores the right / left turning direction at the entry time t5.

  In step S35, the server computer 50 stores, from the detection data storage unit 71, the detection data detected during the entry time t5 ± m seconds (driver's face behavior information, data on the position of the vehicle, data on the traveling behavior of the vehicle, and the like). Then, the process proceeds to step S36. Note that ± m seconds may be set to any time of, for example, ± 0 to 20 seconds. Further, ± m seconds may be set so that the entry time t5 ± m seconds falls within the time of the passage time t0 ± n seconds.

  In step S36, the server computer 50 operates as the stop determination unit 57, and the vehicle 2 stops after the entry time t5 (for example, between time t5 and time t5 + m seconds) (in other words, within the intersection). It is determined whether or not. The determination as to whether or not the vehicle 2 has stopped may be made, for example, based on whether or not a time during which the traveling speed is 0 is detected after the entry time t5, or the angular velocity is set to 0 after the entry time t5. May be determined based on whether or not a certain time is detected.

In step S36, if the server computer 50 determines that the vehicle 2 has stopped after the entry time t5, the server computer 50 proceeds to step S37.
In step S37, the server computer 50 detects the time t6 when the vehicle 2 stops after the entry time t5, and proceeds to step S38.

  In step S38, the server computer 50 detects a time (restart time) t7 at which the vehicle restarted after the stop time t6, and proceeds to step S39. The server computer 50 may detect, for example, a time at which the running speed after the stop time t6 has become 0 or more than a predetermined speed as a restart time t7, or the angular velocity after the stop time t6 is 0. May be detected as the restart time t7.

  In step S39, the server computer 50 operates as the first evaluation unit 58, and based on the face behavior information acquired for a predetermined time (for example, t7 ± s seconds) before and after the restart time t7, the server computer 50 restarts the restart time t7. Before and after (in other words, during the passage of the intersection), a process of evaluating the safety confirmation operation of the driver 3 is performed, and then the process proceeds to step S40. Note that ± s seconds is set to any time of, for example, ± 0 to 15 seconds. The ± s seconds may be a fixed time or a variable time.

  In step S40, the server computer 50 operates as the second evaluation unit 59, and outputs the face behavior information acquired at a predetermined time before the entry time t5 (for example, from time t5 to m seconds to time t5). Based on this, a process of evaluating the safety confirmation operation of the driver 3 before the entry time t5 (in other words, before entering the intersection) is performed, and then the process proceeds to step S41. The processing in step S40 may be performed before step S39, and the processing order of steps S39 and S40 does not matter.

  In step S41, the server computer 50 performs a process of storing the results of the evaluation in steps S39 and S40 in the evaluation data storage unit 72, and then proceeds to step S42.

On the other hand, in step S36, if server computer 50 determines that vehicle 2 has not stopped after entry time t5, it proceeds to step S43.
In step S43, the server computer 50 operates as the server computer 50, and based on the face behavior information acquired at a predetermined time before and after the entry time t5 (for example, t5 ± m seconds), before and after the entry time t5. A process for evaluating the driver's safety check operation is performed, and then the process proceeds to step S44.

  In step S44, the server computer 50 performs a process of storing the result of the evaluation in step S43 in the evaluation data storage unit 72, and then proceeds to step S42.

  In step S42, the server computer 50 determines whether there is the next intersection passing time t0, and if it determines that there is the next intersection passing time t0, returns to step S31 and extracts all the intersection passing times t0. Repeat until the process is completed. On the other hand, if it is determined in step S42 that there is no next intersection passing time t0, that is, it is determined that the extraction of all the intersection passing times t0 has been completed from the accumulated data, the evaluation processing is thereafter terminated.

  According to the safety confirmation evaluation system 1 according to the embodiment (1), the in-vehicle device 10 detects the intersection passing time t0 from the change in the angular velocity, and the server device 40 integrates the angular velocity θ before and after the passing time t0. Is estimated as the entry time t5 to the intersection. Therefore, the entry time t5 of the vehicle 2 to the intersection can be estimated with a simple and low-cost configuration using angular velocity data without using intersection information such as a map database. In addition, using the estimated approach time t5 to the intersection, the driver's safety confirmation operation before and after the approach to the intersection is determined based on at least one of the face direction and / or the gaze direction included in the driver's face behavior information. Can be appropriately evaluated based on the above information.

  Further, according to the server device 40, when the stop determination unit 57 determines that the vehicle 2 has stopped after the entry time t5, the stop determination unit 57 determines the vehicle behavior based on the face behavior information acquired before and after restarting after the vehicle 2 stops. Thus, the safety confirmation operation of the driver 3 is evaluated. Therefore, even when the vehicle 2 temporarily stops in the intersection, the first evaluation unit 58 determines whether the driver 3 before and after restarting in the intersection, in other words, at the timing of passing through the intersection. Safety evaluation operation can be properly evaluated.

  Further, according to the server device 40, when the stop determination unit 57 determines that the vehicle 2 has stopped after the entry time t5, based on the face behavior information acquired at a predetermined time before the entry time t5, The safety confirmation operation of the driver 3 before the entry time t5 is evaluated. Therefore, the second evaluation unit 59 can appropriately evaluate the safety confirmation operation of the driver 3 before entering the intersection.

  Further, according to the server device 40, when the stop determination unit 57 determines that the vehicle 2 is not stopped after the approach time t5, the stop determination unit 57 performs the determination based on the face behavior information acquired at a predetermined time before and after the approach time t5. The safety confirmation operation of the driver 3 before and after the entry time t5 is evaluated. Therefore, when the vehicle 2 turns right or left without stopping temporarily at the intersection, the third evaluation unit 60 can appropriately evaluate the safety confirmation operation of the driver 3 before and after entering the intersection. .

  According to the server device 40, based on the face behavior information, at least one of the left and right swing angles and swing times of the face direction or the line-of-sight direction of the driver 3 is detected, and the detected left and right swing angles and Based on the swing time, the safety confirmation operation of the driver 3 before and after the approach time t5 and / or before and after the restart time t7 is evaluated. Therefore, the safety confirmation operation of the driver 3 can be properly evaluated based on the left and right turning state and the turning time of the driver 3. Further, by calculating the evaluation points of the safety check operation for each intersection, the safety check operation at the entire intersection that has passed can be evaluated at a higher level.

  Further, according to the on-vehicle device 10, the detection data such as the face behavior of the driver 3 and the vehicle behavior of the vehicle 2 is output to the server device 40, and the server device 40 executes the evaluation of the driver 3's safety confirmation operation. By doing so, the processing load on the vehicle-mounted device 10 can be reduced. In addition, the configuration of the vehicle-mounted device 10 can be simplified, retrofitting to the vehicle 2 can be easily performed, and the safety confirmation evaluation system 1 can be introduced at low cost.

  Next, a safety confirmation evaluation system according to the embodiment (2) will be described. However, the configuration of the security confirmation evaluation system 1A according to the embodiment (2) is substantially the same as the security confirmation evaluation system 1 according to the embodiment (1) shown in FIG. 1 except for the server device 40A. Therefore, configurations having the same functions are denoted by the same reference numerals, and description thereof will be omitted.

The difference between the server device 40A according to the embodiment (2) and the server device 40 according to the embodiment (1) lies in the configuration of a safety confirmation evaluation unit 56A.
FIG. 13 is a block diagram illustrating an example of a functional configuration of a security confirmation evaluation unit 56A included in a server device 40A according to Embodiment (2). However, components having the same functions as those of the safety confirmation evaluator 56 shown in FIG. 8 are denoted by the same reference numerals, and description thereof will be omitted.

  In the safety confirmation evaluator 56 of the server device 40 according to the above-described embodiment (1), when the stop determiner 57 determines that the vehicle 2 has stopped, the first evaluator 58 determines whether the vehicle 2 has stopped. The configuration is such that the safety confirmation operation of the driver 3 during the passage of the intersection is evaluated based on the face behavior information acquired at a predetermined time before and after the restart (restart time t7 ± s seconds).

An evaluation time setting unit 62 is provided in the safety confirmation evaluation unit 56A of the server device 40A according to Embodiment (2).
In the safety confirmation evaluation unit 56A of the server device 40A, when the stop determination unit 57 determines that the vehicle 2 has stopped, the evaluation time setting unit 62 determines whether the vehicle 2 stops after the entry time t5 and restarts. The stop time (time from stop time t6 to restart time t7) is compared with a predetermined time, and an evaluation time before restart is set.

  Then, the first evaluation unit 58A performs driving during the passage through the intersection based on the face behavior information acquired at the evaluation time before the restart set by the evaluation time setting unit 62 and the predetermined time after the restart. It is configured to evaluate the safety confirmation operation of the person 3.

  FIG. 14 is a flowchart illustrating the evaluation processing operation of the safety confirmation operation before and after the restart time t7, which is performed by the server computer 50A of the server device 40A according to Embodiment (2). This flowchart shows another processing operation example of the processing in step S39 shown in FIG.

  First, in step S51, the server computer 50A operates as the evaluation time setting unit 62, and determines the stop time (time from the stop time t6 to the restart time t7) ΔT (t7−t6) after entering the intersection. Then, it is determined whether the stop time ΔT (t7−t6) is longer than the predetermined time Tx.

  In step S51, when the server computer 50A determines that the stop time ΔT (t7-t6) is longer than the predetermined time Tx (that is, the stop time in the intersection is long), the server computer 50A proceeds to step S52. The predetermined time Tx may be set to any one of 10 to 20 seconds, for example.

  In step S52, the server computer 50A operates as the evaluation time setting unit 62, and sets the evaluation time before the restart to Tx seconds before the restart time t7 (restart time t7-Tx seconds). The process proceeds to S53.

  In step S53, the server computer 50A operates as the first evaluation unit 58A, and evaluates the safety confirmation operation of the driver 3 during the restart time t7-Tx seconds (that is, immediately before the restart at the intersection). And then the process proceeds to step S54.

  In step S54, the server computer 50A operates as the first evaluation unit 58A, performs processing for evaluating the safety confirmation operation of the driver 3 at the restart time t7 + Ty seconds (that is, after the restart), and then performs the evaluation processing. Are completed, and the process proceeds to step S40 in FIG. The time Ty may be set to the same time as the time Tx, may be set to a time longer than the time Tx, or may be set to a time shorter than the time Tx.

On the other hand, in step S51, if the server computer 50A determines that the stop time ΔT (t7-t6) is shorter than the predetermined time Tx (that is, the stop time in the intersection is shorter), the server computer 50A proceeds to step S55.
In step S55, the server computer 50A operates as the evaluation time setting unit 62, sets the evaluation time before restarting to the stop time ΔT (t7-t6), and proceeds to step S56.

  In step S56, the server computer 50A operates as the first evaluation unit 58A, and evaluates the safety confirmation operation of the driver 3 during the stop time ΔT (t7-t6) (that is, a short stop period at the intersection). Then, the process proceeds to step S57.

  In step S57, the server computer 50A operates as the first evaluation unit 58A, performs processing for evaluating the safety confirmation operation of the driver 3 at the restart time t7 + Ty seconds (that is, after the restart), and then performs the evaluation processing. Are completed, and the process proceeds to step S40 in FIG.

  According to the server device 40A according to the embodiment (2), the same effect as the server device 40 is obtained. In addition, the evaluation time setting unit 62 determines that the vehicle 2 stops after the entry time t5 and restarts. The stop time ΔT (t7−t6) is compared with a predetermined time Tx, and an evaluation time before restarting is set.

  For example, when the stop time ΔT (t7−t6) is shorter than the predetermined time Tx (in other words, when the stop time is relatively short), the evaluation time setting unit 62 sets the evaluation time before the restart to the stop time ΔT ( t7-t6). Therefore, the safety confirmation operation of the driver 3 performed during the short stop time can be properly evaluated.

  When the stop time ΔT (t7−t6) is longer than the predetermined time Tx (in other words, when the stop time is relatively long), the evaluation time setting unit 62 sets the evaluation time before restarting to the predetermined time Tx. Is set. Therefore, even if the stop time is long, the safety confirmation operation of the driver 3 performed before restarting can be properly evaluated.

  As described above, the stop time ΔT (t7−t6) may be long or short depending on the difference in traffic conditions in the intersection. By including the evaluation time setting unit 62, a more appropriate time can be set as the evaluation time so that the safety confirmation operation of the driver 3 can be more appropriately evaluated before and after the restart.

  Next, a safety confirmation evaluation system according to Embodiment (3) will be described. However, the configuration of the security confirmation evaluation system 1B according to the embodiment (3) is substantially the same as the security confirmation evaluation system 1 according to the embodiment (1) shown in FIG. 1 except for the server device 40B. Therefore, configurations having the same functions are denoted by the same reference numerals, and description thereof will be omitted.

The difference between the server device 40B according to the embodiment (3) and the server device 40 according to the embodiment (1) lies in the configuration of the safety confirmation evaluation unit 56B.
FIG. 15 is a block diagram illustrating an example of a functional configuration of a security confirmation evaluation unit 56B included in a server device 40B according to Embodiment (3). However, components having the same functions as those of the safety confirmation evaluator 56 shown in FIG. 8 are denoted by the same reference numerals, and description thereof will be omitted.

The safety confirmation evaluator 56B of the server device 40A according to Embodiment (3) is provided with a stop count detector 63.
In the safety confirmation evaluation unit 56B of the server device 40B, when the stop determination unit 57 determines that the vehicle 2 has stopped, the stop count detection unit 63 detects the number of stops of the vehicle 2.

  Then, when the stop number detecting unit 63 detects a plurality of stops after the entry time t5, the first evaluation unit 58B determines at least the face behavior information acquired before and after restarting after the last stop. Thus, the safety confirmation operation of the driver 3 is evaluated.

FIG. 16 is a flowchart illustrating an example of an evaluation processing operation of a safety confirmation operation performed by the server computer 50B in the server device 40B according to Embodiment (3).
The processing operations shown in the flowchart of FIG. 12 are the same as the processing operations of steps S31 to S36, S43, and S44, and thus description thereof is omitted here.

  After executing the processes of steps S31 to S35, server computer 50B determines in step S36 whether vehicle 2 has stopped after entry time t5 (for example, time t5 + m seconds), and vehicle 2 stops. If so, the process proceeds to step S61.

  In step S61, the server computer 50B operates as the number-of-stops detection unit 63, detects all times t6 at which the vehicle 2 stops after the entry time t5, and proceeds to step S62.

  In step S62, the server computer 50B operates as the number-of-stops detection unit 63, determines whether a plurality of stop times t6 are detected, and if it is determined in step S62 that a plurality of stop times t6 is detected, the process proceeds to step S63. Processing proceeds to

  In step S63, the server computer 50B performs a process of detecting a time t7 at which the vehicle restarts after the last stop time t6 among the plurality of detected stop times t6, and proceeds to step S64.

  In step S64, the server computer 50B operates as the first evaluator 58B, and acquires face behavior information acquired at a predetermined time (for example, t7 ± s seconds) before and after the time t7 when the vehicle restarts after the last stop time t6. , A process of evaluating the safety confirmation operation of the driver 3 before and after the restart time t7 (in other words, during the passage of the intersection), and then the process proceeds to step S65. Note that ± s seconds may be a fixed time or a variable time. For example, -s seconds may be a fixed time, may be set to the time from the last stop time t6 to the restart time t7, or may be set to the time from the first stop time t6 to the last restart time t7. May be set.

  In step S65, the server computer 50B operates as the second evaluation unit 59, and based on the face behavior information acquired at a predetermined time (t5-m seconds) before the entry time t5, the server computer 50B performs the operation before the entry time t5 ( In other words, a process of evaluating the safety confirmation operation of the driver 3 (before entering the intersection) is performed, and then the process proceeds to step S66.

  In step S66, the server computer 50B performs a process of storing the results of the evaluation in steps S64 and S65 in the evaluation data storage unit 72, and then proceeds to step S42.

  On the other hand, in step S62, if server computer 50B determines that a plurality of stop times t6 have not been detected (ie, stop time t6 has been detected once), server computer 50B proceeds to step S67.

In step S67, the server computer 50B performs a process of detecting a time t7 at which the vehicle restarts after the detected stop time t6, and proceeds to step S68.
In step S68, the server computer 50B determines that the time ΔT (t7−t5) from the entry time t5 to the re-start time t7 to the intersection is equal to or less than a predetermined time Ty (second) (in other words, the intersection). Is determined to be short). The predetermined time Ty may be set to, for example, any time of about 0 to 5 seconds.

  In step S68, if the server computer 50B determines that the time ΔT (t7−t5) is equal to or shorter than the predetermined time Ty (in other words, the vehicle has stopped after entering the intersection, but has started immediately), the process proceeds to step S69. Proceed with the process.

  In step S69, the server computer 50B operates as the first evaluator 58B, and restarts on the basis of the face behavior information acquired at a predetermined time (for example, t7 ± m seconds) before and after the restart time t7. A process for evaluating the driver's 3 safety confirmation operation before and after time t7 (that is, before entering the intersection and before and after restarting) is performed, and then the process proceeds to step S70. Note that ± m seconds may be set to any one of ± 0 to 20 seconds, for example. If the time ΔT (t7−t5) is equal to or shorter than the predetermined time Ty, that is, if the time from entering the intersection to restarting is short, the evaluation before the entry time t5 is evaluated at the time t7 when the vehicle restarts. The evaluation at a predetermined time before is substituted.

  In step S70, the server computer 50B performs a process of storing the result of the evaluation in step S69 in the evaluation data storage unit 72, and then proceeds to step S42.

  On the other hand, in step S68, if the server computer 50B determines that the time ΔT (t7−t5) is not shorter than or equal to the predetermined time Ty (in other words, it has stopped after entering the intersection, but has not started immediately) The process proceeds to step S71.

  In step S77, the server computer 50B operates as the first evaluation unit 58B, and has restarted based on the face behavior information acquired at a predetermined time (for example, t7 ± s seconds) before and after the restart time t7. A process for evaluating the driver's 3 safety confirmation operation before and after time t7 is performed, and then the process proceeds to step S72.

  In step S72, the server computer 50B operates as the second evaluation unit 59, and based on the face behavior information acquired at a predetermined time (t5-m seconds) before the entry time t5, the server computer 50B performs the operation before the entry time t5. Then, a process of evaluating the safety confirmation operation of the driver 3 is performed, and then the process proceeds to step S73.

  In step S73, the server computer 50B performs a process of storing the results of the evaluation in steps S71 and S72 in the evaluation data storage unit 72, and then proceeds to step S42.

  Instead of the process of step S63 described above, for example, a process of detecting all restart times t7 restarted after each of the plurality of detected stop times t6 is performed, and instead of the process of step S64 described above, A process of evaluating the safety confirmation operation of the driver 3 before and after all the restart times t7 (in other words, every time the vehicle restarts after being temporarily stopped) may be performed.

  Further, in the above-described evaluation processing of step S71, the evaluation processing of the safety confirmation operation around the restart time t7 shown in FIG. 14 may be performed.

According to the server device 40B according to the above-described embodiment (3), the same effect as the server device 40 can be obtained, and when the stop determination unit 57 determines that the vehicle 2 has stopped, the number of stop times is detected. The unit 63 detects the number of times the vehicle 2 has stopped after the entry time t5. When a plurality of stops are detected after the entry time t5, the first evaluation unit 58B evaluates the driver's safety confirmation operation at least before and after restarting after the last stop.
Therefore, even if the vehicle stops several times in the intersection, at least before and after restarting after the last stop, that is, at the timing of passing through the intersection (for example, the timing of turning right and left), the driver 3 The safety confirmation operation can be properly evaluated.

  According to the server device 40B, when the time ΔT (t7−t5) from the entry time t5 to the restart time t7 is equal to or less than the predetermined time Ty (in other words, the vehicle stops immediately after entering the intersection. However, when the vehicle restarts immediately), the safety confirmation operation of the driver 3 before and after entering the intersection can be evaluated based on the face behavior information acquired at a predetermined time before and after the restart time t7.

  As described above, the embodiments of the present invention have been described in detail. However, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention.

  In the above embodiment, the entry time t5 of the vehicle 2 to the intersection is estimated based on the angular velocity data of the vehicle 2, in other words, based on the angular velocity data detected when the vehicle 2 turns right and left. It is configured to evaluate the driver's safety confirmation operation within a predetermined time before and after the time t5.

  For example, in another embodiment, the approach time of the vehicle 2 to the entrance / exit point of the roadside facility is estimated based on the angular velocity data of the vehicle 2, and the safety confirmation operation of the driver within a predetermined time before and after the estimated time is performed. May be evaluated. According to such a configuration, it is also possible to evaluate a driver's safety confirmation operation when entering a roadside facility from a road or when exiting a road from a roadside facility.

[Appendix]
Embodiments of the present invention may be described as in the following supplementary notes, but are not limited thereto.
(Appendix 1)
A safety confirmation evaluation device (40) for evaluating a safety confirmation operation of a driver (3) of the vehicle (2),
An intersection approach estimating unit (54) for estimating an approach time of the vehicle (2) to the intersection;
A behavior information acquisition unit (55) for acquiring information including behavior of the face of the driver (3);
An evaluation unit (56) for evaluating a safety confirmation operation of the driver (3) based on the information acquired before and after the approach time,
The evaluation unit (56)
A stop determination unit (57) that determines whether the vehicle has stopped after the entry time;
When the stop determination unit (57) determines that the vehicle (2) has stopped, the driver (3) is determined based on the information obtained before and after the vehicle (2) stops and restarts. And a first evaluator (58) for evaluating the safety confirmation operation of (1).

(Appendix 2)
A safety confirmation evaluation device (40);
A vehicle-mounted device (10) mounted on the vehicle (2);
The in-vehicle device (10)
A driver monitoring unit (20) for detecting a behavior of a face of a driver (3) of the vehicle (2);
A position detector (14) for detecting a position of the vehicle (2);
A driving behavior detecting unit (13) for detecting a driving behavior including an angular velocity of the vehicle (2);
An output unit (15) that outputs data detected by the driver monitoring unit (20), the position detection unit (14), and the traveling behavior detection unit (13) to the safety confirmation evaluation device (40); A safety confirmation evaluation system (1) comprising:

(Appendix 3)
A safety confirmation evaluation method for evaluating a safety confirmation operation of a driver (3) of a vehicle (2),
An entry time estimation step (S33) for estimating the entry time of the vehicle (2) into the intersection;
An information acquisition step (S35) of acquiring information including behavior of the face of the driver (3);
An evaluation step (S36 to S44) of evaluating a safety confirmation operation of the driver (3) based on the information acquired before and after the approach time,
The evaluation step (S36-S44)
A stop determination step (S37) for determining whether or not the vehicle (2) has stopped after the entry time;
When it is determined in the stop determination step (S37) that the vehicle (2) has stopped, the driver (3) is determined based on the information obtained before and after the vehicle (2) stops and restarts. A) a first evaluation step (S39) of evaluating the safety confirmation operation of (3).

(Appendix 4)
A safety confirmation evaluation program (53) for causing at least one computer (50) to execute a process of evaluating a safety confirmation operation of a driver (3) of the vehicle (2),
Said at least one computer (50)
An approach time estimation step (S33) for estimating the approach time of the vehicle to the intersection;
An information acquisition step (S35) of acquiring information including behavior of the driver's face;
An evaluation step (S36 to S44) of evaluating a safety confirmation operation of the driver based on the information acquired at a predetermined time before and after the entry time,
In the evaluation step (S36 to S44),
A stop determination step (S37) of determining whether or not the vehicle has stopped after the entry time;
If it is determined in the stop determination step (S37) that the vehicle has stopped, a safety evaluation operation of the driver is evaluated based on the information acquired before and after the vehicle stops and restarts. (1) A safety confirmation evaluation program (53), wherein the evaluation step (S39) is executed.

1, 1A, 1B Safety confirmation evaluation system 2 Vehicle 3 Driver 4 Communication network 10 In-vehicle device 11 Platform unit 12 Acceleration sensor 13 Angular velocity sensor 14 GPS receiving unit 15 Communication unit 16 Notification unit 17 Storage unit 18 External interface (external I / F) )
19 control unit 19a CPU
19b RAM
19c ROM
20 Driver monitoring unit 21 Driver camera 22 Image analysis unit 23 Interface (I / F)
30 Drive recorder unit 31 Outside camera 32 Inside camera 40, 40A, 40B Server device (safety confirmation evaluation device)
41 Communication Unit 50, 50A, 50B Server Computer 51 Central Processing Unit 52 Main Memory 53 Control Program 54 Intersection Entry Estimation Unit 54a Entry Time Detection Unit 54b Direction Estimation Unit 55 Behavior Information Acquisition Units 56, 56A, 56B Safety Confirmation Evaluation Unit 57 Stop Judgment units 58, 58A, 58B First evaluation unit 59 Second evaluation unit 60 Third evaluation unit 61 Evaluation point calculation unit 62 Evaluation time setting unit 63 Stop frequency detection unit 70 Storage unit 71 Detection data storage unit 71a Detection data file 72 Evaluation Data storage unit 72a Evaluation data file 73 Driver information storage unit 80 Business terminal

Claims (12)

A safety confirmation evaluation device that evaluates a safety confirmation operation of a vehicle driver,
An intersection approach estimating unit that estimates an approach time of the vehicle to the intersection,
A behavior information acquisition unit that acquires information including behavior of the driver's face;
An evaluation unit that evaluates the driver's safety check operation based on the information acquired before and after the approach time,
The evaluation unit,
A stop determination unit that determines whether the vehicle has stopped after the entry time,
When the stop determination unit determines that the vehicle has stopped, a first evaluation unit that evaluates the driver's safety confirmation operation based on the information obtained before and after the vehicle stops and restarts. And a safety confirmation and evaluation device. The evaluation unit,
When the stop determination unit determines that the vehicle has stopped, the safety confirmation operation of the driver before the entry time is evaluated based on the information obtained at a predetermined time before the entry time. The safety confirmation evaluation device according to claim 1, further comprising a second evaluation unit that performs the evaluation. The evaluation unit,
When it is determined by the stop determination unit that the vehicle is not stopped, based on the information obtained at a predetermined time before and after the approach time, before and after the approach time, the safety confirmation operation of the driver. 3. The safety confirmation evaluation device according to claim 1, further comprising a third evaluation unit for evaluating. The evaluation unit,
An evaluation time setting unit configured to compare a stop time from when the vehicle stops after the entry time to when the vehicle restarts with a predetermined time and set an evaluation time before the restart. The safety confirmation evaluation device according to any one of claims 1 to 3, wherein: The evaluation time setting unit,
The safety confirmation evaluation device according to claim 4, wherein when the stop time is shorter than the predetermined time, an evaluation time before the restart is set to the stop time. The evaluation time setting unit,
The safety confirmation evaluation device according to claim 4, wherein when the stop time is longer than the predetermined time, an evaluation time before the restart is set to the predetermined time. The evaluation unit,
When the stop determination unit determines that the vehicle has stopped, further includes a stop count detection unit that detects the number of times the vehicle has stopped,
The first evaluation unit includes:
When a plurality of stops are detected after the entry time by the stop number detecting unit, at least before and after restarting after the last stop, the safety confirmation operation of the driver is evaluated. The safety confirmation evaluation device according to claim 1. The evaluation unit,
Based on the information, at least one of the right and left swing angles and swing times of the driver's face direction or the line of sight direction is detected, and based on the detected left and right swing angles and swing time, the driving is performed. The safety confirmation evaluation device according to any one of claims 1 to 7, which evaluates a safety confirmation operation of a person. The intersection approach estimation unit,
The safety confirmation evaluation device according to any one of claims 1 to 8, wherein the approach time is estimated based on time-series data of the angular velocity of the vehicle. A safety confirmation evaluation device according to any one of claims 1 to 9,
And a vehicle-mounted device mounted on the vehicle.
The onboard unit is
A driver monitoring unit that detects the behavior of the driver's face of the vehicle,
A position detection unit that detects a position of the vehicle,
A traveling behavior detection unit that detects a traveling behavior including an angular velocity of the vehicle,
A safety confirmation evaluation system, comprising: an output unit that outputs data detected by the driver monitoring unit, the position detection unit, and the traveling behavior detection unit to the safety confirmation evaluation device. A safety check evaluation method for evaluating the safety check operation of a vehicle driver,
An approach time estimating step of estimating the approach time of the vehicle to the intersection,
An information acquisition step of acquiring information including behavior of the driver's face;
Based on the information obtained before and after the approach time, including an evaluation step of evaluating the safety confirmation operation of the driver,
The evaluation step includes:
A stop determination step of determining whether the vehicle has stopped after the entry time,
When the stop determination step determines that the vehicle has stopped, a first evaluation step of evaluating a safety confirmation operation of the driver based on the information acquired before and after the vehicle restarts after the vehicle stops. And a safety confirmation evaluation method characterized by including the following. A safety confirmation evaluation program for causing at least one computer to execute a process of evaluating a safety confirmation operation of a vehicle driver,
The at least one computer
An approach time estimating step of estimating the approach time of the vehicle to the intersection,
An information acquisition step of acquiring information including behavior of the driver's face;
Based on the information obtained at a predetermined time before and after the approach time, based on the evaluation step to evaluate the safety confirmation operation of the driver,
In the evaluation step,
A stop determination step of determining whether the vehicle has stopped after the entry time,
When the stop determination step determines that the vehicle has stopped, a first evaluation step of evaluating a safety confirmation operation of the driver based on the information acquired before and after the vehicle restarts after the vehicle stops. And a safety confirmation evaluation program characterized by being executed.

Images