JP2018151905A - Device for determining degree of concentration, method for determining degree of concentration, and program for determining degree of concentration - Google Patents

Abstract

PROBLEM TO BE SOLVED: To consider both safety of driving and comfort of driving.SOLUTION: A device for determining the degree of concentration comprises: a monitoring data acquisition part that acquires monitoring data from a sensor monitoring a vehicle driver; a concentration degree estimation part that, when the vehicle travels on a first road, estimates a first degree of driving concentration of the driver on the basis of one or more indices constituting a first index group from the monitoring data, and when the vehicle travels on a second road different in a road environment from the first road, estimates a second degree of driving concentration of the driver on the basis of one or more indices constituting a second index group different from the first index group from the monitoring data; a reference comparison part that compares the first degree of driving concentration or the second degree of driving concentration with a reference; and a signal output part that, when the first degree of driving concentration or the second degree of driving concentration does not meet the reference, outputs an instruction signal for instructing execution of support for the driver.SELECTED DRAWING: Figure 4

Description

  The present invention relates to, for example, a concentration degree determination apparatus, a concentration degree determination method, and a program for determining a concentration degree that determine the degree of concentration of a vehicle driver.

  In recent years, as a driving mode of a vehicle, in addition to a manual driving mode in which the vehicle is driven based on a driving operation of the driver, an automatic driving mode in which the vehicle is driven along a predetermined route without depending on the driving operation of the driver. Development is underway.

  Development of a cruise control technology according to the environment in which the vehicle is traveling is also underway (see Patent Document 1).

Japanese Patent No. 4600542

  The driver is required to have driving safety regardless of the driving mode, but the driving concentration required by the driver differs depending on the situation where the driver is placed. Driving safety can be maintained if the vehicle constantly monitors the driving concentration for various indicators and issues a warning when the driving concentration falls below this standard. However, depending on the situation where the driver is placed, the vehicle frequently issues a warning. In this case, the driver's driving comfort is impaired.

  The present invention has been made paying attention to the above circumstances. A concentration level determination device, a concentration level determination method, and a program for determining the concentration level, which can take into account both driving safety and driving comfort. It is something to be offered.

  In order to solve the above-described problem, a first aspect of the present invention is a monitoring data acquisition unit that acquires monitoring data from a sensor that monitors a driver of the vehicle, and when the vehicle is traveling on a first road The first driving concentration level of the driver is estimated from the monitoring data based on one or more indexes constituting the first index group, and the vehicle has a second road environment different from that of the first road. When the vehicle is traveling on the road, the second driving concentration degree of the driver is estimated from the monitoring data based on one or more indices constituting a second index group different from the first index group. A concentration level estimation unit, a reference comparison unit for comparing the first driving concentration level or the second driving concentration level with a reference, and the first driving concentration level or the second driving concentration level based on the reference. If not, instruct the driver to perform assistance A concentration determination apparatus and a signal output unit for outputting a No. 示信.

  According to a second aspect of the present invention, in the concentration determination apparatus according to the first aspect, the first road is an expressway and the second road is a general road.

  According to a third aspect of the present invention, in the concentration determination apparatus according to the first aspect, the second index group includes a larger number of indices than the number of indices constituting the first index group. It is what I did.

  According to a fourth aspect of the present invention, in the concentration determination apparatus according to the first aspect, the second indicator group is included in all the indicators constituting the first indicator group and the first indicator group. It is made up of one or more indicators that are not.

  According to a fifth aspect of the present invention, in the concentration determination apparatus according to the first aspect, the second index group is composed of one or more indices that are all different from the indices constituting the first index group. It is a thing.

  According to a sixth aspect of the present invention, in the concentration determination apparatus according to the first aspect, the second indicator group includes at least one indicator among indicators constituting the first indicator group, and the first indicator group. And at least one index not included in the index group.

  According to a seventh aspect of the present invention, in the concentration determination apparatus according to the first aspect, the second indicator group is not included in the first indicator group, and the degree of recognition of the driver with respect to a target is used as an indicator. It is what was included.

  According to an eighth aspect of the present invention, in the concentration determination apparatus according to the seventh aspect, a state detection unit that detects the degree of recognition using the monitoring data and the position information of the target is provided.

  According to a ninth aspect of the present invention, there is provided a monitoring data acquisition process for acquiring monitoring data from a sensor for monitoring a driver of the vehicle, and when the vehicle is traveling on a first road, When the driver's first driving concentration degree is estimated based on one or more indicators constituting an indicator group, and the vehicle is traveling on a second road having a different road environment from the first road A concentration degree estimation process for estimating a second driving concentration degree of the driver based on one or more indicators constituting a second indicator group different from the first indicator group from the monitoring data; A reference comparison process for comparing one driving concentration degree or the second driving concentration degree with a reference, and when the first driving concentration degree or the second driving concentration degree does not satisfy the reference, A signal that outputs an instruction signal instructing the execution of support A concentration determination method and an output process.

  A tenth aspect of the present invention is a program for determining a degree of concentration that causes a computer to function the processing of each unit provided in the concentration degree determining apparatus according to any one of the first to eighth aspects.

  According to the first aspect of the present invention, the concentration determination device selectively uses the first index group and the second index group according to the road environment in which the vehicle is traveling, and allows the driver to It is determined whether or not the state is suitable for driving. Therefore, the concentration degree determination device can ask the driver for the driving concentration degree according to the road environment in which the vehicle is traveling. As a result, the driver can maintain a state in which the driver appropriately concentrates on driving according to the road environment in which the vehicle is traveling. Therefore, driving safety is maintained regardless of the driver's situation.

  In addition, the concentration determination device is configured so that even when the driver is in the same state when the vehicle is traveling on the first road and when the vehicle is traveling on the second road, The instruction signal is output when the vehicle is traveling on the second road, but the instruction signal is not output when the vehicle is traveling on the first road. Therefore, the concentration determination apparatus can reduce the output of excessive instruction signals, particularly when the vehicle is traveling on the first road. This prevents the driver from receiving excessive warnings, particularly when the vehicle is traveling on the first road. The driver can comfortably keep a state of concentration on driving regardless of the road environment in which the vehicle is traveling. Accordingly, driving comfort is maintained regardless of the driver's situation.

  That is, according to the first aspect, the concentration degree determination device can take into consideration both driving safety and driving comfort.

  According to the second aspect of the present invention, when the vehicle is traveling on a general road, the concentration determination device asks the driver for a higher driving concentration than when the vehicle is traveling on a highway. be able to. Thus, the driver can maintain a state of being concentrated on driving on a general road that requires more concentration and attention than driving on an expressway. Furthermore, the concentration determination apparatus can reduce the output of excessive instruction signals, particularly when the vehicle is traveling on an expressway. The driver needs less warning when the vehicle is traveling on a highway than when the vehicle is traveling on a general road. Therefore, the driver does not receive an excessive warning when the vehicle is traveling on the highway, and can drive the vehicle comfortably.

  According to the third aspect of the present invention, when the vehicle is traveling on the second road, the concentration determination device operates for more indicators than when the vehicle is traveling on the first road. The degree of concentration can be estimated. The concentration determination device monitors whether or not the driver is more suitable for driving when the vehicle is traveling on the second road than when the vehicle is traveling on the first road. Can do. Thus, the driver can maintain a more concentrated state of driving when the vehicle is traveling on the second road than when the vehicle is traveling on the first road. Furthermore, the driver is less likely to receive a warning when the vehicle is traveling on the first road than when the vehicle is traveling on the second road, so that the road environment in which the vehicle is traveling is reduced. Regardless of this, it is possible to maintain a comfortable state of concentration while driving.

  According to the fourth aspect of the present invention, when the vehicle is traveling on the second road, the concentration determination device operates for more indicators than when the vehicle is traveling on the first road. The degree of concentration can be estimated. The concentration determination device monitors whether or not the driver is more suitable for driving when the vehicle is traveling on the second road than when the vehicle is traveling on the first road. Can do. Thereby, the driver can safely and comfortably maintain a state where he / she is properly concentrated on driving regardless of the road environment in which the vehicle is traveling. Furthermore, the concentration level determination apparatus can reduce the number of indexes that require the driving concentration level to be estimated as compared with the case where the first index group is not a subset of the second index group. Therefore, the processing load on the concentration determination device is reduced.

  According to the fifth aspect of the present invention, the concentration determination device determines whether or not the driver is in a state suitable for driving by using a group of indicators configured with preferable indicators for each road environment in which the vehicle is traveling. Can be monitored appropriately. Thereby, the driver can safely and comfortably maintain a state where he / she is properly concentrated on driving regardless of the road environment in which the vehicle is traveling.

  According to the sixth aspect of the present invention, the concentration determination device uses the indicator group configured with preferable indicators for each road environment in which the vehicle is traveling, and determines whether or not the driver is in a state suitable for driving. Can be monitored appropriately. As a result, the driver can safely and comfortably maintain a state concentrated on driving regardless of the road environment in which the vehicle is traveling. Furthermore, the concentration degree determination apparatus can reduce the processing load by sharing a part of the indexes included in each of the first index group and the second index group.

  According to the seventh aspect of the present invention, when the vehicle is traveling on the second road, the concentration degree determination device allows the driver to recognize the target recognition degree, which is an index having a large influence on driving safety. It is possible to monitor whether or not the state is suitable for driving. As a result, the driver can maintain a concentrated state of driving when the vehicle is traveling on the second road. The degree of object recognition may be lower when the vehicle is traveling on the first road than when the vehicle is traveling on the second road. However, the concentration determination device does not consider the degree of object recognition when the vehicle is traveling on the first road. As a result, the driver is less likely to receive an excessive warning when the vehicle is traveling on the first road, so that the driver can keep a comfortable state of concentration.

  According to the eighth aspect of the present invention, the concentration determination device can appropriately detect the state of the driver using the degree of object recognition as an index by using at least the monitoring data and the position information of the object.

  According to the ninth aspect of the present invention, the concentration determination method can obtain the same effect as that of the first aspect described above. That is, the concentration degree determination method can take into account both driving safety and driving comfort.

  According to the tenth aspect of the present invention, the program for determining the degree of concentration can obtain the same effects as those of the first aspect described above. That is, the program for determining the degree of concentration can take into account both driving safety and driving comfort.

The figure which shows the whole structure of a vehicle provided with the concentration determination apparatus which concerns on one Embodiment of this invention. The block diagram which shows the structure of the concentration determination apparatus which concerns on one Embodiment of this invention. The block diagram which shows the structure of the state detection part which concerns on one Embodiment of this invention. The flowchart which shows the procedure of the concentration degree determination by the concentration degree determination apparatus shown in FIG.

Embodiments according to the present invention will be described below with reference to the drawings.
[One Embodiment]
(Constitution)
FIG. 1 is a diagram showing an overall configuration of a vehicle 1 including a concentration degree determination device 2 according to an embodiment of the present invention. The concentration determination device 2 is mounted on a vehicle 1 such as a passenger car. The configuration of the concentration determination device 2 will be described later. The vehicle 1 may be, for example, any one of an automobile, a bus, a truck, a train, and the like, or a vehicle on which a driver (hereinafter also referred to as a driver) other than these rides.

  The vehicle 1 includes, as basic equipment, a power unit 3 including a power source and a transmission, a steering device 4 equipped with a steering wheel 5, and further includes a manual operation mode and an automatic operation mode as operation modes. . An engine and / or a motor is used as the power source.

  The manual driving mode is a mode in which the vehicle 1 is driven mainly by a driver's manual driving operation, for example. In the manual driving mode, for example, an operation mode for driving the vehicle 1 based only on the driving operation of the driver and an operation for performing driving operation support control for supporting the driving operation of the driver while mainly driving the driving operation of the driver. Mode is included.

  In the driving operation support control, for example, the steering torque is assisted so that the driver's steering becomes an appropriate steering amount based on the curvature of the curve when the vehicle 1 is traveling on the curve. The driving operation support control includes control for assisting a driver's accelerator operation (for example, operation of an accelerator pedal) or brake operation (for example, operation of a brake pedal), manual steering (manual operation of steering), and manual speed adjustment (speed). Adjustment manual operation) is also included. In manual steering, the vehicle 1 is steered mainly by the driver's operation of the steering wheel 5. In the manual speed adjustment, the speed of the vehicle 1 is adjusted mainly by the driver's accelerator operation or brake operation.

  Note that the driving operation support control does not include control for forcibly intervening in the driving operation of the driver and causing the vehicle 1 to automatically travel. That is, in the manual driving mode, the driving operation of the driver is reflected in the driving of the vehicle 1 within a preset allowable range, but the driving of the vehicle 1 is compulsory under certain conditions (for example, lane departure of the vehicle 1). Interventive control is not included.

  On the other hand, the automatic driving mode is a mode for realizing an operating state in which the vehicle 1 is automatically driven along a road on which the vehicle 1 is traveling, for example. The automatic driving mode includes, for example, a driving state in which the vehicle 1 is automatically driven toward a preset destination without driving by the driver. In the automatic driving mode, it is not always necessary to automatically control all of the vehicle 1, and the driving state in which the driving operation of the driver is reflected in the traveling of the vehicle 1 within a preset allowable range is also included in the automatic driving mode. That is, the automatic driving mode includes control for forcibly intervening in the traveling of the vehicle 1 under certain conditions, while reflecting the driving operation of the driver in the traveling of the vehicle 1 within a preset allowable range.

  The vehicle 1 further includes an outside camera 6, a steering sensor 7, an accelerator pedal sensor 8, a brake pedal sensor 9, a GPS receiver 10, a gyro sensor 11, a vehicle speed sensor 12, a navigation device 13, an automatic An operation control device 14, a driver camera 15, and an audio output device 16 are provided.

  The vehicle exterior camera 6 is installed at an arbitrary position of the vehicle 1 so that the outside of the vehicle 1 can be photographed. Although one vehicle exterior camera 6 is shown in FIG. 1, the vehicle 1 may include a plurality of vehicle exterior cameras that capture different directions. The outside camera 6 continuously captures the driving environment in the vicinity of the vehicle 1. The vehicle exterior camera 6 is activated in response to the start of operation of the vehicle 1 and continuously captures the outside of the vehicle 1. The vehicle exterior camera 6 outputs the captured image (hereinafter also referred to as vehicle exterior image data) to the concentration degree determination device 2 and the automatic driving control device 14.

The steering sensor 7 detects a steering angle. The steering sensor 7 outputs the detection result to the automatic driving control device 14.
The accelerator pedal sensor 8 detects an operation amount of the accelerator pedal. The accelerator pedal sensor 8 outputs the detection result to the automatic operation control device 14.
The brake pedal sensor 9 detects the operation amount of the brake pedal. The brake pedal sensor 9 outputs the detection result to the automatic operation control device 14.
The GPS receiver 10 receives current position information of the vehicle 1. The GPS receiver 10 outputs the current position information to the concentration determination device 2, the navigation device 13, and the automatic operation control device 14.
The gyro sensor 11 detects the behavior of the vehicle 1. The gyro sensor 11 outputs the detection result to the automatic operation control device 14.
The vehicle speed sensor 12 detects the speed of the vehicle 1. The vehicle speed sensor 12 outputs the detection result to the automatic driving control device 14.

The navigation device 13 is an example of a video display device that includes a display 131 that displays video. The navigation device 13 stores map information. The navigation device 13 extracts route information from the current position to the destination by using information on the destination input by the driver or the like, map information, and current position information from the GPS receiver 10. The navigation device 13 displays route information on the display 131. The navigation device 13 can also display information other than route information on the display 131.
The navigation device 13 outputs the route information to the concentration degree determination device 2 and the automatic driving control device 14.

The route information described above may include not only information on the route from the current position to the destination, but also information on the road environment from the current position to the destination.
Some examples of information about the road environment will be described.
The information on the road environment may include information on the type of road that passes from the current position to the destination. The types of roads are classified into, for example, roads in which human traffic is restricted or roads in which human traffic is not restricted. The road where the passage of people is restricted is, for example, an expressway. A highway refers to a highway national highway and a motorway. The road where the passage of people is not restricted is, for example, a general road. A general road refers to a road other than a highway.

The information on the road environment may include information on the speed limit of the road that passes from the current position to the destination.
The information regarding the road environment may include position information of an installation on the road passing from the current position to the destination. The installed object is, for example, a sign, but may be an object installed on the road.
The information regarding the road environment may include position information of a building near the road passing from the current position to the destination.
Note that the route information may include information other than the above example as information on the road environment.

The configuration of the automatic operation control device 14 will be described.
The automatic operation control device 14 automatically controls traveling of the vehicle 1 when the operation mode is the automatic operation mode.
The automatic driving control device 14 includes an outside image data from the outside camera 6, a detection result from the steering sensor 7, a detection result from the accelerator pedal sensor 8, a detection result from the brake pedal sensor 9, and a GPS receiver 10. Current position information, a detection result from the gyro sensor 11, a detection result from the vehicle speed sensor 12, and route information from the navigation device 13 are acquired. For example, the automatic driving control device 14 automatically controls the travel of the vehicle 1 based on these information and traffic information acquired by road-to-vehicle communication.

  Automatic control includes, for example, automatic steering (automatic steering operation) and automatic speed adjustment (automatic driving of speed). Automatic steering is an operating state in which the steering device 4 is automatically controlled. Automatic steering includes LKAS (Lane Keeping Assist System). For example, the LKAS automatically controls the steering device 4 so that the vehicle 1 does not deviate from the traveling lane even when the driver does not perform the steering operation. Note that the steering operation of the driver may be reflected in the steering of the vehicle 1 within a range (allowable range) in which the vehicle 1 does not deviate from the travel lane even during execution of LKAS. Note that automatic steering is not limited to LKAS.

  Automatic speed adjustment is an operating state in which the speed of the vehicle 1 is automatically controlled. Automatic speed adjustment includes ACC (Adaptive Cruise Control). For example, when there is no preceding vehicle ahead of the vehicle 1, ACC performs constant speed control that causes the vehicle 1 to travel at a constant speed at a preset speed, and when the preceding vehicle exists ahead of the vehicle 1. Is a follow-up control that adjusts the vehicle speed of the vehicle 1 in accordance with the inter-vehicle distance from the preceding vehicle. The automatic operation control device 14 decelerates the vehicle 1 according to the driver's brake operation (for example, operation of the brake pedal) even when ACC is being executed. Further, the automatic driving control device 14 can operate the driver's accelerator operation (for example, accelerator) up to a preset maximum permissible speed (for example, the maximum speed legally determined on the traveling road) even when ACC is being executed. The vehicle 1 can be accelerated according to the pedal operation. The automatic speed adjustment is not limited to ACC but also includes CC (Cruise Control).

The configuration of the driver camera 15 will be described.
The driver camera 15 is installed, for example, at a position that is in front of the driver as on a dashboard. The driver camera 15 is an example of a sensor that monitors a driver. The driver camera 15 is activated in response to the start of driving of the vehicle 1 and continuously captures a predetermined range including the driver's face. The driver camera 15 outputs the captured image (hereinafter referred to as driver image data) to the concentration degree determination device 2. Driver image data is an example of monitoring data used to detect the state of the driver. The driver's condition is, for example, driver's forward gaze, drowsiness, looking aside, putting on and taking off clothes, telephone operation, leaning on the window / armrest, driving disturbance by passengers and pets, onset of illness, backward facing, kneeling, eating and drinking , Smoking, dizziness, abnormal behavior, car navigation / audio operation, attachment / detachment of glasses / sunglasses, photography, and a degree of recognition of a subject (a degree of recognition of a subject). The degree of object recognition is an index of how much the driver has recognized the object (for example, visually), and is the degree to which the driver is aware by confirming the object (for example, visually). The state of the driver may include an index other than the index exemplified here.

  The audio output device 16 includes a speaker 161. The audio output device 16 outputs various information as audio.

A configuration of the above-described concentration degree determination device 2 will be described.
The concentration level determination device 2 estimates the driver's concentration level based on the above-described driver state, and determines whether or not the driver is in a state suitable for driving the vehicle 1. The driving concentration degree is a degree suitable for the driver to drive the vehicle 1. As the driving concentration increases, the driver becomes more suitable for driving the vehicle 1. Conversely, as the degree of driving concentration decreases, the driver becomes more unsuitable for driving the vehicle 1.

FIG. 2 is a block diagram illustrating a configuration of the concentration determination device 2 as an example.
The concentration degree determination device 2 includes an input / output interface unit 21, a storage unit 22, and a control unit 23.

  The input / output interface unit 21 connects the outside camera 6, the GPS receiver 10, the navigation device 13, the automatic driving control device 14, the driver camera 15, and the audio output device 16 to the control unit 23.

The configuration of the storage unit 22 will be described.
The storage unit 22 is a non-volatile memory that can be written and read at any time, such as a solid state drive (SSD) and a hard disk drive (HDD). The storage unit 22 includes a driver image data storage unit 221, a vehicle exterior image data storage unit 222, and a concentration level table storage unit 223.

The driver image data storage unit 221 stores driver image data that the control unit 23 acquires from the driver camera 15.
The vehicle exterior image data storage unit 222 stores vehicle exterior image data that the control unit 23 acquires from the vehicle exterior camera 6.

  The concentration level table storage unit 223 stores a concentration level table used by the control unit 23 to estimate the driving concentration level. The concentration degree table associates the state of the driver with a plurality of levels corresponding to the degree of driving concentration for each index. The plurality of levels are divided into, for example, three levels of level 1, level 2, and level 3, but the present invention is not limited to this. Here, an example is described in which the driving concentration is set to be lower as the level number is larger, but the present invention is not limited to this. It may be set such that the driving concentration increases as the level number increases.

The information managed in the concentration level table will be described with an example of looking aside.
In the concentration level table, the driver's state is associated with each of level 1, level 2, and level 3 as follows for the side-view as an index. Level 1 is associated with, for example, the state of a driver who is looking at a direction tilted at an angle in the range of 0 degrees or more and less than the first angle with respect to the traveling direction of the vehicle 1. That is, Level 1 is a state in which the driver is not looking aside and driving concentration is high. Level 2 is associated with, for example, the state of the driver who is looking at a direction tilted at an angle in the range of the first angle and less than the second angle with respect to the traveling direction of the vehicle 1. That is, Level 2 is a state in which the driver is looking aside and has a lower driving concentration than Level 1. Level 3 is associated with, for example, the state of the driver who is looking at a direction inclined at an angle equal to or greater than the second angle with respect to the traveling direction of the vehicle 1. That is, Level 3 is a state in which the driver is looking aside and the driving concentration is lower than Level 2. Here, the information managed in the concentration level table has been described by taking a side look as an example, but the same applies to other indexes.

The configuration of the control unit 23 will be described.
The control unit 23 includes a processor 231 and a memory 232.
The processor 231 is, for example, a CPU (Central Processing Unit) that constitutes a computer. The configuration of each unit included in the processor 231 will be described later. Note that although one processor 231 is shown in FIG. 2, the control unit 23 may include one or more processors.
The memory 232 includes a program that causes the processor 231 to perform processing of each unit included in the processor 231. The program can also be referred to as an instruction for operating the processor 231. The program is stored in the storage unit 22 and is read from the storage unit 22 to the memory 232. The program in the memory 232 is read by the processor 231. One embodiment may be realized by a program.

The configuration of each unit included in the processor 231 will be described.
The processor 231 includes a monitoring data acquisition unit 2311, a vehicle exterior image data acquisition unit 2312, a route information acquisition unit 2313, a current position information acquisition unit 2314, a state detection unit 2315, a concentration degree estimation unit 2316, and a reference comparison unit. 2317 and a signal output unit 2318. Each unit may be distributed among one or more processors.

The monitoring data acquisition unit 2311 acquires driver image data from the driver camera 15 via the input / output interface unit 21. The monitoring data acquisition unit 2311 stores the driver image data in the driver image data storage unit 221.
The vehicle exterior image data acquisition unit 2312 acquires vehicle exterior image data from the vehicle exterior camera 6 via the input / output interface unit 21. The vehicle exterior image data acquisition unit 2312 stores the vehicle exterior image data in the vehicle exterior image data storage unit 222.

The route information acquisition unit 2313 acquires route information from the navigation device 13 via the input / output interface unit 21. The route information acquisition unit 2313 outputs the route information to the state detection unit 2315.
The current position information acquisition unit 2314 acquires current position information from the GPS receiver 10 via the input / output interface unit 21. The current position information acquisition unit 2314 outputs the current position information to the state detection unit 2315.

The state detection unit 2315 detects the state of the driver from the driver image data stored in the driver image data storage unit 221. In addition to the driver image data, the state detection unit 2315 detects, for example, the above-described object recognition degree as the driver's state using at least one of image data outside the vehicle, route information, and current position information. Also good. An example of detection of the driver's state by the state detection unit 2315 will be described later. Note that the state detection unit 2315 may acquire the driver image data from the monitoring data acquisition unit 2311 without using the driver image data storage unit 221. In this case, the storage unit 22 may not include the driver image data storage unit 221.
The state detection unit 2315 outputs the driver's state to the concentration degree estimation unit 2316.

The concentration degree estimation unit 2316 estimates the driver's driving concentration degree based on the driver's state detected by the state detection unit 2315. Note that since the driver's state is detected from the driver image data as described above, the concentration degree estimation unit 2316 can estimate the driver's driving concentration degree from the driver image data.
When the vehicle 1 is traveling on the first road, the concentration degree estimation unit 2316 determines the driver's driving concentration degree (hereinafter referred to as the first degree) based on one or more indices constituting the first index group from the monitoring data. Is also referred to as the degree of driving concentration). The concentration degree estimation unit 2316 may estimate, for example, a first driving concentration degree corresponding to each of one or more indicators constituting the first indicator group. The concentration degree estimation unit 2316 may estimate a single first driving concentration degree based on, for example, one or more indicators constituting the first indicator group. In the latter case, the concentration degree estimation unit 2316 may estimate a single first driving concentration degree by appropriately setting a weight for each indicator constituting the first indicator group. The weight set for each index constituting the first index group may be arbitrarily changeable.
When the vehicle 1 is traveling on a second road having a different road environment from the first road, the concentration degree estimation unit 2316 forms a second index group different from the first index group from the monitoring data. Based on the one or more indicators, the driver's driving concentration level (hereinafter also referred to as second driving concentration level) is estimated. The concentration degree estimation unit 2316 may estimate the second driving concentration degree corresponding to each of one or more indices constituting the second index group, for example. The concentration degree estimation unit 2316 may estimate a single second driving concentration degree based on, for example, one or more indicators constituting the second indicator group. In the latter case, the concentration level estimation unit 2316 may estimate a single second driving concentration level by appropriately setting a weight for each index constituting the second index group. The weight set for each index constituting the second index group may be arbitrarily changeable.

  Configuration examples of the first index group and the second index group will be described later.

  An example of determining the road environment of the road on which the vehicle 1 is traveling by the concentration degree estimation unit 2316 will be described. The concentration degree estimation unit 2316 can determine the road environment of the road on which the vehicle 1 is traveling based on, for example, route information from the navigation device 13. For example, the concentration degree estimation unit 2316 may determine the road environment of the road on which the vehicle 1 is traveling based on information obtained by road-to-vehicle communication. The concentration degree estimation unit 2316 may determine the road environment of the road on which the vehicle 1 is traveling based on information other than these.

    Examples of the first road and the second road will be described. The second road is, for example, a road environment in which the driver needs more concentration and attention than the first road for driving the vehicle 1. Note that the second road may be a road having a different road environment from the first road as described above, and is not limited to this example.

Here, some examples will be described in which the second road becomes a road in a road environment in which the driver needs more concentration and attention to drive the vehicle 1 than the first road, but the present invention is not limited thereto. It is not a thing.
In one example, the first road is a highway and the second road is a general road. On highways, there is usually no human jump out. On the other hand, people can jump out on ordinary roads. Furthermore, the highway is a road having a straight section longer than a general road. Therefore, a general road requires more concentration and attention to drive the vehicle 1 than a highway, regardless of the driving mode.

  In another example, the first road is a road section including an intersection where a signal is installed among general roads, and the second road is a road section including an intersection where no signal is installed among general roads. . At intersections where signals are installed, it is unlikely that people will jump out. On the other hand, there is a high possibility that a person jumps out at an intersection where no signal is installed. Therefore, the road section including the intersection where no signal is installed requires more concentration and attention to drive the vehicle 1 than the road section including the intersection where the signal is installed, regardless of the driving mode. .

An example of estimating the driving concentration level by the concentration level estimation unit 2316 will be described.
In one example, the concentration degree estimation unit 2316 can estimate the driving concentration degree with a numerical value such as a ratio. The numerical value estimated by the concentration degree estimation unit 2316 may increase as the driving concentration degree increases, or may decrease as the driving concentration degree increases.

  In another example, the concentration degree estimation unit 2316 refers to the concentration degree table stored in the concentration degree table storage unit 223 and estimates the level of driving concentration corresponding to the driver's state from a plurality of levels. be able to. Note that when the concentration level estimation unit 2316 estimates the driving concentration level numerically, the storage unit 22 may not include the concentration level table storage unit 223.

  The estimation of the driving concentration by the concentration estimating unit 2316 may be performed using an AI (Artificial Intelligence) function such as machine learning or deep learning. In this case, the concentration degree estimation unit 2316 can estimate the state of the driver with high accuracy by using the past estimation result for estimation of the current driving concentration degree, for example.

  The reference comparison unit 2317 compares the driving concentration estimated by the concentration estimation unit 2316 with the reference. When the concentration degree estimation unit 2316 estimates the driving concentration degree for each of the plurality of indices, the reference comparison unit 2317 compares the driving concentration degree for each of the plurality of indices with the reference. When the concentration level estimation unit 2316 estimates a single driving concentration level based on a plurality of indices, the reference comparison unit 2317 compares the single driving concentration level with a reference. The reference comparison unit 2317 compares, for example, the driving concentration degree estimated by the concentration degree estimation unit 2316 with a reference value or reference level serving as a reference. If the driving concentration degree is equal to or higher than the reference value or the reference level, the reference comparison unit 2317 determines that the driving concentration degree satisfies the reference. The reference comparison unit 2317 outputs the comparison result to the signal output unit 2318. Note that the reference may be arbitrarily changed.

As an example, the comparison between the driving concentration degree estimated by the numerical value by the reference comparison unit 2317 and the reference will be described.
First, the case where the numerical value estimated by the concentration degree estimation unit 2316 increases as the driving concentration degree increases will be described. The reference value is a numerical value A. If the numerical value estimated by the concentration degree estimation unit 2316 is smaller than the numerical value A, which is the reference value, the reference comparison unit 2317 determines that the driving concentration degree estimated by the concentration degree estimation unit 2316 is lower than the reference value.

  Next, the case where the numerical value estimated by the concentration degree estimation unit 2316 becomes smaller as the driving concentration degree becomes higher will be described. If the numerical value estimated by the concentration degree estimation unit 2316 is larger than the numerical value A that is the reference value, the reference comparison unit 2317 determines that the driving concentration degree estimated by the concentration degree estimation unit 2316 is lower than the reference value.

As another example, a comparison between the driving concentration degree estimated by the level by the reference comparison unit 2317 and the reference level will be described.
The reference level is level B extracted from a plurality of levels. When a driving concentration degree lower than the reference level level B is assigned to the level estimated by the concentration degree estimating unit 2316, the reference comparing unit 2317 indicates that the driving concentration degree estimated by the concentration degree estimating unit 2316 is the reference level. Judged to be lower than the level.

  Here, as described above, an example in which the concentration degree table associates the state of the driver with the three levels of Level 1, Level 2, and Level 3 for each index will be specifically described. For example, the reference level is level 1. The reference comparison unit 2317 determines that level 2 or level 3 estimated by the concentration degree estimation unit 2316 is lower than level 1, which is the reference level. On the other hand, the reference comparison unit 2317 determines that the level 1 estimated by the concentration degree estimation unit 2316 is not lower than the level 1 that is the reference level.

  The signal output unit 2318 outputs a signal to each unit via the input / output interface unit 21. Hereinafter, examples of some signals output from the signal output unit 2318 will be described.

  Based on the comparison result from the reference comparison unit 2317, the signal output unit 2318 determines whether or not to output an instruction signal for instructing the driver to perform support to the support providing apparatus. The signal output unit 2318 outputs an instruction signal when the driving concentration level estimated by the concentration level estimation unit 2316 does not satisfy the standard. When receiving the instruction signal from the signal output unit 2318, the support providing apparatus performs support for the driver. The support providing device is, for example, the navigation device 13 or the audio output device 16.

  For example, the signal output unit 2318 outputs an instruction signal to at least one of the navigation device 13 and the audio output device 16. Based on the instruction signal, the navigation device 13 displays a warning on the display 131 as an image or video that gives a warning to the driver. The voice output device 16 outputs a warning for giving a warning to the driver from the speaker 161 based on the instruction signal. The warning is not limited to a specific output mode as long as it is a content that warns the driver that the degree of driving concentration is low or that the driver concentrates on driving. The driver recognizes from the warning that the driver is not in a state suitable for driving the vehicle 1 and can concentrate on driving the vehicle 1 again. The signal output unit 2318 may output the instruction signal to a support providing device other than the navigation device 13 and the voice output device 16. For example, the signal output unit 2318 may output an instruction signal to a support providing device that gives an external stimulus such as vibration to the driver. The support for the driver may be any output content that acts on the driver based on the driving concentration level, and includes various types of support for improving the driving concentration level in addition to warnings, alerts, and information provision.

  The signal output unit 2318 can output an instruction signal when one or more driving concentration degrees among a plurality of driving concentration degrees estimated from a plurality of indices do not satisfy the standard. The signal output unit 2318 may output an instruction signal when a predetermined number or more of driving concentration levels estimated from a plurality of indices do not satisfy the standard. The signal output unit 2318 can output an instruction signal when a single degree of driving concentration estimated based on a plurality of indices does not satisfy the standard.

  The signal output unit 2318 may output a switching signal for switching the operation mode to the automatic operation control device 14. For example, when the output condition of the instruction signal described above is satisfied in the manual operation mode, the signal output unit 2318 outputs an instruction signal and a switching signal for switching the operation mode from the manual operation mode to the automatic operation mode. You may output to the automatic driving | operation control apparatus 14. FIG.

Next, an example of detection of the driver's state using the driver image data by the state detection unit 2315 will be described. Note that the method for detecting the driver's state is not limited to the example described here.
FIG. 3 is a block diagram illustrating a configuration of the state detection unit 2315. As an example, the state detection unit 2315 includes a local state detection unit 23151, a global state detection unit 23152, and a driver state detection unit 23153.

  The local state detection unit 23151 detects the state of at least one of the organs included in the driver's face in the driver image data. The organs included in the face are, for example, the eyes, mouth, nose and ears, but other organs may be used. When the local state detection unit 23151 detects an eye state, the local state detection unit 23151 detects, for example, a driver's eye open / closed degree, a line-of-sight direction, a face direction, and the like. Local state detection unit 23151 outputs a detection result (hereinafter also referred to as local information) to driver state detection unit 23153.

  The global state detection unit 23152 detects at least one of the global states of the driver in the driver image data. The global state is, for example, the movement and posture of the driver, but may be other than these. The global state detection unit 23152 outputs a detection result (hereinafter also referred to as global information) to the driver state detection unit 23153.

The driver state detection unit 23153 detects the above-described driver state using the local information from the local state detection unit 23151 and the global information from the global state detection unit 23152.
Thus, the state detection unit 2315 can detect various driver states by combining local information and global information, for example.

  Next, some detection examples of the degree of object recognition by the state detection unit 2315 will be described. The state detection unit 2315 can detect the degree of object recognition using the monitoring data and the position information of the object.

  As an example, the state detection unit 2315 can detect the degree of object recognition by the driver's vision using the image data outside the vehicle in addition to the driver image data as follows. The state detection unit 2315 extracts a target for detecting the degree of object recognition from the image data outside the vehicle. The target is, for example, an installation such as a sign or a building, but is not particularly limited as long as the driver may confirm (for example, visually) and be aware of it. The state detection unit 2315 detects the driver's line of sight and face orientation from the driver image data captured at substantially the same timing as when the image data outside the vehicle from which the target was extracted was captured. The driver's line of sight and face orientation are detected by the local state detection unit 23151 as described above. The state detection unit 2315 detects the degree of object recognition using at least one of the driver's line of sight and face orientation and the position information of the object. It can be said that the degree of object recognition increases as the driver's line of sight and face direction face the object.

The state detection unit 2315 describes several examples for detecting the level of object recognition.
In one embodiment, the state detection unit 2315 has a high degree of object recognition on condition that at least one of the driver's line of sight and face orientation is in a state that matches the position of the object for a predetermined time. It may be detected. On the other hand, when at least one of the driver's line of sight and face orientation is directed to the target position but passes without recognizing the target, the state detection unit 2315 detects that the degree of target recognition is low. May be. The state detection unit 2315 may detect the degree of object recognition in accordance with the length of time that the driver stays in a state where at least one of the driver's line of sight and face orientation matches the target position.

  In another example, the state detection unit 2315 may estimate the degree of object recognition based on the presence or absence of a specific driving operation or a driver's action that is assumed to result from the driver's recognition of the object. For example, when the driver recognizes that a pedestrian is present near the pedestrian crossing in front of the vehicle 1, it is assumed that the driver performs a deceleration operation. Therefore, when the concentration determination device 2 detects that a pedestrian is present near the pedestrian crossing in front of the vehicle 1, the state detection unit 2315 detects the driver's deceleration operation, and the degree of object recognition is You may detect that it is high. On the other hand, when the concentration determination device 2 detects that a pedestrian is present near the pedestrian crossing in front of the vehicle 1, the state detection unit 2315 detects the driver's deceleration operation even after a predetermined time has elapsed. If not, it may be detected that the degree of object recognition is low. For example, depending on the length of time from when the concentration determination device 2 detects a target pedestrian until the driver's deceleration operation is detected, the state detection unit 2315 may detect the target recognition degree. Good.

As another example, the state detection unit 2315 can detect the degree of object recognition using route information and current position information in addition to driver image data as follows.
The state detection unit 2315 refers to the route information and the current position information and extracts a target located in the vicinity of the vehicle 1. As described above, the target is, for example, an installation such as a sign or a building, but is not particularly limited as long as the driver may confirm (for example, visually) and recognize it. The state detection unit 2315 detects the driver's line of sight and the direction of the face from the driver image data captured at approximately the same timing as the vehicle 1 passes near the target. The state detection unit 2315 detects the degree of object recognition using at least one of the driver's line of sight and face orientation and the position information of the object.

  As another example, the state detection unit 2315 may obtain the target position and the timing at which the vehicle 1 passes near the target through road-to-vehicle communication. In this case, the state detection unit 2315 detects the driver's line of sight and face direction from the driver image data captured at substantially the same timing as the vehicle 1 passes through the vicinity of the target. The state detection unit 2315 detects the degree of object recognition using at least one of the driver's line of sight and face orientation and the position information of the object.

  As another example, the state detection unit 2315 may use an image or video displayed on the display 131 of the navigation device 13 as a target. In this case, the state detection unit 2315 detects the driver's line of sight and face direction from the driver image data captured at substantially the same timing as when the image or video is displayed on the display 131. The state detection unit 2315 detects the degree of object recognition using at least one of the driver's line of sight and face orientation and the position information of the object.

As described above, when the state detection unit 2315 uses at least the monitoring data and the target position information, the state detection unit 2315 can appropriately detect the driver's state using the degree of object recognition as an index.
Note that the state detection unit 2315 may use an object located in the vicinity of the front, rear, left, or right of the vehicle 1. The state detection unit 2315 preferably uses an object located near the left side or the right side rather than the front side of the vehicle 1. If the object is located on the front side of the vehicle 1, the driver's line of sight and face do not move much. On the other hand, if the object is located near the left side or right side of the vehicle 1, the driver's line of sight and face move to the left or right side. Therefore, the state detection unit 2315 can appropriately detect the target recognition degree.

Several configuration examples of the first index group and the second index group described above will be described.
First, the types of indices included in each of the first index group and the second index group will be described.
As an example, the first indicator group preferably estimates the driving concentration degree when the vehicle 1 is traveling on the first road in order to consider both driving safety and driving comfort. A first type of indicator may be included. The second index group preferably estimates the driving concentration degree when the vehicle 1 is traveling on the second road in order to consider both driving safety and driving comfort. An index of type may be included.

Here, examples of the first type index and the second type index will be described.
The index X1 is related to the state of the driver who is required to be monitored on the first road, but is related to the state of the driver who is not required to be monitored on the second road. The index X1 is likely to affect the safety of driving on the first road depending on the degree. Therefore, the index X1 is an example of the first type of index. In an example in which the first road is a highway and the second road is a general road, the indicator X1 is, for example, a confirmation of the left or right side of the vehicle 1 in the vicinity of the parking area, service area or tollgate is there. In the example in which the first road is a road section including an intersection where a signal is installed and the second road is a road section including an intersection where no signal is installed, the indicator X1 is, for example, the degree of recognition of a traffic light Etc.

  The index X2 is related to the state of the driver who is not required to be monitored on the first road, but is related to the state of the driver who is required to be monitored on the second road. The index X2 is highly likely not to affect the safety of driving on the first road regardless of the degree. On the other hand, the index X2 is likely to affect the safety of driving on the second road depending on the degree. Therefore, the index X2 is an example of the second type of index. In an example in which the first road is a highway and the second road is a general road, the index X2 is, for example, a general object recognition degree. In an example in which the first road is a road section including an intersection where a signal is installed and the second road is a road section including an intersection where no signal is installed, the indicator X2 is, for example, other than a pedestrian The degree of object recognition for a vehicle or the like approaching the intersection from a direction different from that of the own vehicle.

  It is assumed that the index X3 relates to the state of the driver regardless of whether monitoring is required on the first road or the second road. The index X3 has a high possibility of affecting driving safety on both the first road and the second road depending on the degree. Therefore, the index X3 is both an example of the first type of index and an example of the second type of index. The index 3 is, for example, drowsiness, looking aside and the onset of illness.

  If the first indicator group includes at least one indicator of the first type, the first indicator group is preferable for estimating the driving concentration when the vehicle 1 is traveling on the first road, or It can be said that it is a suitable indicator group. The concentration level determination device 2 can estimate the driving concentration level corresponding to the first type of index by using the first index group. The concentration degree determination device 2 can ask the driver for a driving concentration degree that is suitable when the vehicle 1 is traveling on the first road.

  On the other hand, if the second indicator group includes at least one indicator of the second type, the second indicator group is used to estimate the driving concentration when the vehicle 1 is traveling on the second road. It can be said that the indicator group is preferable or suitable. The concentration level determination device 2 can estimate the driving concentration level corresponding to the second type of index by using the second index group. The concentration degree determination device 2 can ask the driver for a driving concentration degree suitable for the case where the vehicle 1 is traveling on the second road.

  For example, the second index group may include a driver's recognition degree (target recognition degree) with respect to the target, which is not included in the first index group, as an index. The target recognition degree is an example of the index X2. For example, when the vehicle 1 is traveling on a second road that requires more concentration and attention to drive the vehicle 1 than the first road, the driver checks a sign or the like. Probability is high. On the other hand, when the vehicle 1 is traveling on the first road, the driver may not confirm a sign or the like. When it is assumed that the first index group includes the degree of object recognition as an index, the concentration level determination device 2 has a high possibility of issuing an unnecessary warning. In addition, even if the degree of object recognition is inferior when the vehicle 1 is traveling on the first road, the driver is ready to perform manual driving immediately when an unexpected situation occurs. be able to. Therefore, even if the first index group does not include the target recognition degree as an index, driving safety is maintained.

  According to this example, when the vehicle 1 is traveling on the second road, the concentration degree determination device 2 is suitable for driving by the driver with respect to the target recognition degree, which is an index having a large influence on driving safety. It is possible to monitor whether or not Thereby, the driver | operator can maintain the state concentrated on driving | running | working, when the vehicle 1 is drive | working the 2nd road. The degree of object recognition may be lower when the vehicle 1 is traveling on the first road than when the vehicle 1 is traveling on the second road. However, the concentration determination device 2 does not consider the degree of object recognition when the vehicle 1 is traveling on the first road. As a result, when the vehicle 1 is traveling on the first road, the driver is less likely to receive an excessive warning, so that the driver can keep a comfortable state of concentration.

As another example, the second indicator group may include a third type of indicator that does not require normal monitoring on either the first road or the second road. There is a high possibility that the third index does not affect driving safety on either the first road or the second road regardless of the degree. The third type of index is, for example, a lookout while the vehicle is stopped due to traffic jams. For example, the vehicle 1 may stop due to occurrence of a traffic jam. The driver may look around the surroundings while the vehicle 1 is stopped, regardless of the road on which the vehicle 1 is traveling. For this reason, the look aside when the vehicle is stopped due to a traffic jam is a driver's condition in which normal monitoring is not required regardless of the road on which the vehicle 1 is traveling in terms of driving safety. However, when a traffic jam occurs, the driver cannot predict when the vehicle ahead of the vehicle 1 will travel.
When the first road is an expressway, even if there is a space between the vehicle 1 and the vehicle in front of the vehicle 1, another vehicle enters the front of the vehicle 1 from a direction different from the traveling direction of the vehicle 1. There is nothing. On the other hand, when the second road is a general road, if there is a space between the vehicle 1 and the vehicle ahead of the vehicle 1, another vehicle turns right or left from a direction different from the traveling direction of the vehicle 1. There is a possibility that the vehicle 1 tries to enter the front of the vehicle 1. In this case, the driver of the vehicle 1 and the driver of another vehicle trying to enter this space may check each other, and not only the vehicle 1 but also other vehicles may not be able to travel smoothly.
In addition, when the first road is a road section including an intersection where a signal is installed, it is assumed that there is a space between the vehicle 1 and the vehicle ahead of the vehicle 1. In the vicinity of the intersection, the progress of the vehicle is managed by a signal. Therefore, in the vicinity of the intersection, it is unlikely that another vehicle enters the front of the vehicle 1 from a direction different from the traveling direction of the vehicle 1. On the other hand, when the second road is a road section including an intersection where no signal is installed, it is assumed that there is a space between the vehicle 1 and the vehicle in front of the vehicle 1. In the vicinity of the intersection, another vehicle may enter the front of the vehicle 1 from a direction different from the traveling direction of the vehicle 1. In this case, the driver of the vehicle 1 and the driver of another vehicle trying to enter this space may check each other, and not only the vehicle 1 but also other vehicles may not be able to travel smoothly.

  If the first index group does not include the third type index, and the second index group includes at least one third type index, the second index group includes the first index It can be said that it is a stricter indicator group regarding the estimation of driving concentration than the group. The concentration determination device 2 determines whether or not the driver is more suitable for driving when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Can be monitored. Thus, the driver can maintain a more concentrated state of driving when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Furthermore, the driver can drive the vehicle 1 smoothly when the vehicle 1 is traveling on the second road.

Next, the number of indices constituting each of the first index group and the second index group will be described.
As an example, the second index group may be configured with a larger number of indices than the number of indices constituting the first index group. In addition, the content of the parameter | index which comprises each of the 1st parameter | index group and the 2nd parameter | index group is not limited.

  According to this example, the concentration degree determination device 2 uses the driving concentration degree for more indicators when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Can be estimated. The concentration determination device 2 determines whether or not the driver is more suitable for driving when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Can be monitored. Thus, the driver can maintain a more concentrated state of driving when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Furthermore, since the driver is less likely to receive a warning when the vehicle 1 is traveling on the first road than when the vehicle 1 is traveling on the second road, the vehicle 1 is traveling. Regardless of the road environment, it is possible to maintain a comfortable state of concentration while driving.

Next, the number of indices that overlap in the first index group and the second index group will be described.
As an example, the second index group may be configured by all the indices constituting the first index group and one or more indices that are not included in the first index group. That is, the first index group can be said to be a subset of the second index group. In addition, the content of the index which comprises each of the 1st index group and the 2nd index group is not limited.

  According to this example, the concentration degree determination device 2 uses the driving concentration degree for more indicators when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Can be estimated. The concentration determination device 2 determines whether or not the driver is more suitable for driving when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Can be monitored. As a result, the driver can safely and comfortably maintain a state where the driver 1 is appropriately concentrated on driving regardless of the road environment in which the vehicle 1 is traveling. Furthermore, the concentration level determination apparatus 2 can reduce the number of indexes that need to estimate the driving concentration level compared to the case where the first index group is not a subset of the second index group. Therefore, the processing load of the concentration degree determination device 2 is reduced.

  As another example, the second indicator group may be composed of one or more indicators that are all different from the indicators constituting the first indicator group. For example, the first index group may be composed of one or more indices X1, and the second index group may be composed of one or more indices X2. In addition, the content of the parameter | index which comprises each of the 1st parameter | index group and the 2nd parameter | index group is not limited.

  According to this example, the degree-of-concentration determination device 2 appropriately determines whether or not the driver is in a state suitable for driving by using an index group composed of preferable indices for each road environment in which the vehicle 1 is traveling. Can be monitored. As a result, the driver can safely and comfortably maintain a state where the driver 1 is appropriately concentrated on driving regardless of the road environment in which the vehicle 1 is traveling.

  As yet another example, the second index group is composed of at least one index among the indices constituting the first index group and at least one index not included in the first index group. May be. For example, the first index group may be composed of one or more indices X1 and one or more indices X3, and the second index group may be composed of one or more indices X2 and one or more indices X3. In addition, the content of the parameter | index which comprises each of the 1st parameter | index group and the 2nd parameter | index group is not limited.

  According to this example, the degree-of-concentration determination device 2 appropriately determines whether or not the driver is in a state suitable for driving by using an index group composed of preferable indices for each road environment in which the vehicle 1 is traveling. Can be monitored. As a result, the driver can safely and comfortably maintain a state concentrated on driving regardless of the road environment in which the vehicle 1 is traveling. Furthermore, the concentration degree determination apparatus 2 can reduce the processing load by sharing a part of the indexes included in each of the first index group and the second index group.

  The first index group and the second index group are not limited to the above-described several configuration examples. Therefore, for example, the contents of the indexes constituting the first index group and the second index group are not limited. For example, the number of indices constituting each of the first index group and the second index group is not limited. For example, the number of indices overlapping in the first index group and the second index group is not limited.

(Operation)
Next, the operation of the concentration determination device 2 configured as described above will be described. FIG. 4 is a flowchart showing a procedure as an example of concentration level determination by the concentration level determination device 2. The operation of the concentration determination device 2 described here may be the same regardless of whether the operation mode is the automatic operation mode or the manual operation mode.

  The monitoring data acquisition unit 2311 acquires monitoring data from a sensor that monitors the driver of the vehicle 1 (step S101). In step S <b> 101, the monitoring data acquisition unit 2311 acquires driver image data from the driver camera 15 via, for example, the input / output interface unit 21. Note that the interval at which the monitoring data acquisition unit 2311 acquires the monitoring data may be the same as or shorter than the interval at which the state detection unit 2315 detects the driver's state.

  Next, the state detection unit 2315 detects the state of the driver from the monitoring data (step S102). In step S102, the state detection unit 2315 detects the state of the driver from the driver image data, for example. The state detection unit 2315 can detect the state of the driver at a predetermined interval, for example. The state detection unit 2315 may detect the state of the driver at the same interval in the automatic operation mode and the manual operation mode, or may detect the state of the driver at different intervals. Even if the state detection unit 2315 detects the driver's state at the same interval when the vehicle 1 is traveling on the first road and when the vehicle 1 is traveling on the second road, the state detection unit 2315 is different in interval. The driver's condition may be detected by The state detection unit 2315 may detect the state of the driver at an arbitrary timing.

  Next, the concentration degree estimation unit 2316 determines whether or not the vehicle 1 is traveling on the first road (step S103). When the vehicle 1 is traveling on the first road (step S103, Yes), the concentration level estimation unit 2316 selects the first index group as an index group used for estimating the driving concentration level (step S104). ). The concentration level estimation unit 2316 estimates the first driving concentration level of the driver based on one or more indexes constituting the first index group from the monitoring data (step S105). That is, in step S105, when the vehicle 1 is traveling on the first road, the concentration degree estimation unit 2316 determines the driver's first based on one or more indices constituting the first index group from the monitoring data. Estimate the concentration of driving.

  Next, the reference comparison unit 2317 compares the first driving concentration degree with the reference (step S106). When the first driving concentration degree satisfies the standard (step S106, Yes), the processing of the concentration degree determination device 2 may transition from step S106 to step S101. When the first driving concentration does not satisfy the standard (No in step S106), the signal output unit 2318 outputs an instruction signal instructing the driver to perform support (step S107).

  When the vehicle 1 is not traveling on the first road (No at Step S103), the concentration level estimation unit 2316 selects the second index group as an index group used for estimating the driving concentration level (Step S108). ). Here, the case where the vehicle 1 is not traveling on the first road corresponds to the case where the vehicle 1 is traveling on a second road having a different road environment from the first road. Next, the concentration level estimation unit 2316 estimates the second driving concentration level of the driver based on one or more indexes constituting the second index group from the monitoring data (step S105). That is, in step S105, when the vehicle 1 is traveling on the second road, the concentration degree estimation unit 2316 uses the second data of the driver based on one or more indices constituting the second index group from the monitoring data. Estimate the concentration of driving.

  Next, the reference comparison unit 2317 compares the second driving concentration degree with the reference (step S106). When the second driving concentration degree satisfies the standard (step S106, Yes), the processing of the concentration degree determination device 2 may transition from step S106 to step S101. When the second driving concentration does not satisfy the standard (No at Step S106), the signal output unit 2318 outputs an instruction signal instructing execution of assistance to the driver (Step S107).

  In step S103, the concentration degree estimation unit 2316 may determine, for example, the second road as a road that requires more concentration and attention for driving the vehicle 1 than the first road as described above. . Here, a case where the first road is a highway and the second road is a general road will be described as an example, but the same applies to other examples. The concentration determination device 2 can ask the driver for a higher driving concentration when the vehicle 1 is traveling on a general road than when the vehicle 1 is traveling on a highway. Thus, the driver can maintain a state of being concentrated on driving on a general road that requires more concentration and attention than driving on an expressway. Furthermore, the concentration determination device 2 can reduce the output of excessive instruction signals especially when the vehicle 1 is traveling on a highway. The driver needs less warning when the vehicle 1 is traveling on the highway than when the vehicle 1 is traveling on a general road. The driver does not receive an excessive warning when the vehicle 1 is traveling on the highway, and can drive the vehicle 1 comfortably.

  When the first road is an expressway and the second road is a general road, a predetermined section on the expressway may be excluded from the first road. That is, the reference comparison unit 2317 does not necessarily need to apply a reference (for example, the second reference) different from that of a general road in all sections of the expressway. The reference comparison unit 2317 may apply a reference (for example, the first reference) equivalent to that of a general road in a predetermined section of the expressway. Examples of the predetermined section include a section within a predetermined distance starting from an entrance / exit of an expressway, a toll gate, or a junction.

(effect)
As described above in detail, in one embodiment of the present invention, the concentration determination device 2 selectively uses the first index group and the second index group according to the road environment in which the vehicle 1 is traveling. Thus, it is determined whether or not the driver is in a state suitable for driving. Therefore, the concentration level determination device 2 can ask the driver for the driving concentration level according to the road environment in which the vehicle 1 is traveling. Thereby, the driver can maintain a state where the driver 1 is appropriately concentrated on driving according to the road environment in which the vehicle 1 is traveling. Further, the concentration determination device 2 is configured so that the vehicle 1 travels on the second road (for example, a road that requires more concentration and attention for driving the vehicle 1 than the first road). Can ask the driver for a higher degree of driving concentration than when traveling on the first road. Thus, the driver can maintain a more concentrated state of driving when the vehicle 1 is traveling on the second road than when the vehicle 1 is traveling on the first road. Therefore, driving safety is maintained regardless of the driver's situation.

  Further, the concentration determination device 2 is configured so that the driver is in the same state when the vehicle 1 is traveling on the first road and when the vehicle 1 is traveling on the second road. The instruction signal is output when the vehicle 1 is traveling on the second road, but the instruction signal is not output when the vehicle 1 is traveling on the first road. Therefore, the concentration determination apparatus 2 can reduce the output of an excessive instruction signal particularly when the vehicle 1 is traveling on the first road. This prevents the driver from receiving an excessive warning, particularly when the vehicle 1 is traveling on the first road. The driver can comfortably keep the state concentrated on driving regardless of the road environment in which the vehicle 1 is traveling. Accordingly, driving comfort is maintained regardless of the driver's situation.

  Thus, according to one embodiment, the concentration determination device 2 can take into account both driving safety and driving comfort.

[Other Embodiments]
In the one embodiment, the concentration determination device 2 detects the driver's state using the driver image data captured by the driver camera 15 as monitoring data, and estimates the driving concentration. However, the monitoring data is not limited to the driver image data. The monitoring data may be, for example, biological data obtained by a biological sensor that monitors the driver of the vehicle 1. The biological sensor is, for example, a pulse wave sensor or a heart rate sensor. The biological sensor is not limited to these as long as it can monitor the driver. Note that the biological sensor may be a contact sensor or a non-contact sensor. The concentration degree determination device 2 can detect the state of the driver from the biological data. The state of the driver detected from the biological data is an index such as a pulse wave or a heartbeat.
Furthermore, the monitoring data may be, for example, data obtained by a sensor that measures the strength of the driver's steering wheel 5 installed on the steering wheel 5.

In addition, you may combine each Example demonstrated here suitably.
In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine the component covering different embodiment suitably.

  In addition, the above-described embodiment may be realized by a storage medium such as a ROM (Read Only Memory) that stores a program that causes the processor 231 to perform the processing of each unit included in the processor 231.

A part or all of the above embodiment can be described as in the following supplementary notes, but is not limited to the following.
(Appendix 1)
Obtain monitoring data from sensors that monitor the driver of the vehicle,
When the vehicle is traveling on a first road, the driver estimates a first driving concentration degree based on one or more indexes constituting a first index group from the monitoring data, and the vehicle When traveling on a second road having a different road environment from the first road, based on one or more indices constituting a second index group different from the first index group from the monitoring data Estimating a second driving concentration of the driver;
Comparing the first driving concentration or the second driving concentration with a reference;
A processor configured to output an instruction signal instructing execution of assistance to the driver when the first driving concentration or the second driving concentration does not satisfy the reference;
A memory for storing instructions for operating the processor;
A concentration determination device comprising:
(Appendix 2)
A monitoring data acquisition process for acquiring monitoring data from a sensor for monitoring a driver of the vehicle using at least one processor;
When the vehicle is traveling on a first road using the at least one processor, the first driving of the driver based on one or more indices constituting a first index group from the monitoring data When the degree of concentration is estimated and the vehicle is traveling on a second road having a different road environment from the first road, a second index group different from the first index group is obtained from the monitoring data. A concentration level estimation process for estimating a second driving concentration level of the driver based on one or more constituent indices;
A reference comparison process using the at least one processor to compare the first driving concentration or the second driving concentration with a reference;
A signal output process for outputting an instruction signal for instructing the driver to perform support when the first driving concentration level or the second driving concentration level does not satisfy the criterion using the at least one processor. When,
Concentration determination method comprising:

  DESCRIPTION OF SYMBOLS 1 ... Vehicle, 2 ... Concentration determination apparatus, 3 ... Power unit, 4 ... Steering device, 5 ... Steering wheel, 6 ... Outside vehicle, 7 ... Steering sensor, 8 ... Accelerator pedal sensor, 9 ... Brake pedal sensor, 10 ... GPS Receiver 11, gyro sensor 12, vehicle speed sensor 13, navigation device 14, automatic driving control device 15 driver camera 16 sound output device 21 input / output interface unit 22 storage unit 23 Control unit 131 ... Display 161 Speaker Speaker 221 Driver image data storage unit 222 Outside vehicle image data storage unit 223 Concentration level table storage unit 231 Processor 232 Memory 2311 Monitoring data acquisition unit , 2312 ... Outside-vehicle image data acquisition unit, 2313 ... Route information acquisition unit, 314 ... Current position information acquisition unit, 2315 ... State detection unit, 2316 ... Concentration estimation unit, 2317 ... Reference comparison unit, 2318 ... Signal output unit, 23151 ... Local state detection unit, 23152 ... Global state detection unit, 23153 ... Driving Person state detector.

Claims (10)

A monitoring data acquisition unit that acquires monitoring data from a sensor that monitors the driver of the vehicle;
When the vehicle is traveling on a first road, the driver estimates a first driving concentration degree based on one or more indexes constituting a first index group from the monitoring data, and the vehicle When traveling on a second road having a different road environment from the first road, based on one or more indices constituting a second index group different from the first index group from the monitoring data A concentration level estimation unit for estimating the second driving concentration level of the driver;
A reference comparison unit that compares the first driving concentration or the second driving concentration with a reference;
A signal output unit that outputs an instruction signal instructing execution of assistance to the driver, when the first driving concentration or the second driving concentration does not satisfy the criterion;
A concentration determination device comprising:   The concentration determination apparatus according to claim 1, wherein the first road is an expressway and the second road is a general road.   The concentration determination apparatus according to claim 1 or 2, wherein the second index group includes a larger number of indices than the number of indices constituting the first index group.   4. The system according to claim 1, wherein the second index group includes all the indices constituting the first index group and one or more indices that are not included in the first index group. The concentration degree determination apparatus according to claim 1.   The concentration determination apparatus according to any one of claims 1 to 3, wherein the second index group includes one or more indices that are all different from the indices constituting the first index group.   The second index group includes at least one index among indices constituting the first index group and at least one index not included in the first index group. The concentration determination apparatus according to any one of 1 to 3.   The concentration determination apparatus according to any one of claims 1 to 6, wherein the second index group includes, as an index, a degree of recognition of the driver with respect to a target that is not included in the first index group.   The concentration determination apparatus according to claim 7, further comprising: a state detection unit that detects the degree of recognition using the monitoring data and the position information of the target. A monitoring data acquisition process for acquiring monitoring data from a sensor for monitoring a vehicle driver;
When the vehicle is traveling on a first road, the driver estimates a first driving concentration degree based on one or more indexes constituting a first index group from the monitoring data, and the vehicle When traveling on a second road having a different road environment from the first road, based on one or more indices constituting a second index group different from the first index group from the monitoring data A concentration estimation process for estimating a second driving concentration of the driver;
A reference comparison process for comparing the first driving concentration or the second driving concentration with a reference;
A signal output step of outputting an instruction signal instructing execution of assistance to the driver when the first driving concentration or the second driving concentration does not satisfy the criterion;
Concentration determination method comprising:   A program for determining a degree of concentration that causes a computer to function the processing of each unit included in the concentration level determination apparatus according to any one of claims 1 to 8.