JP2017091448A - Operation apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation apparatus that increases and decreases the category or number of functions or both of the function and number thereof that are usable by a driver on the basis of the driving state of the driver himself.SOLUTION: An operation apparatus 2 includes: a reception part 21 for receiving an image containing at least an eye of a driver picked up by an on-vehicle camera 11; a sight line detection part 22 for detecting a sight line of the driver on the basis of the image; and a control part 24 for increasing and decreasing a category or number of functions or both of the function and number thereof that are usable by a driver, in accordance with a direction of the sight line and a movement thereof detected by the sight line detection part 22. The operation apparatus 2 determines a driving state of the driver himself by detecting the sight line of the driver, and increases and decreases the category or number of functions or both of the function and number thereof that are usable by a driver on the basis of the driving state.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an operating device mounted on a vehicle.

  An operating device is described in Patent Document 1, for example. In this operating device, driving information related to the driving situation of the vehicle is acquired. The driving information is, for example, information that the vehicle is crossing a railroad crossing or information that the vehicle is turning right or left. And in this operating device, based on driving | operation information, it is determined whether it is the situation where a driver | operator can operate or it is difficult to operate. When it is determined that the situation is difficult to operate, this operating device limits the functions that can be operated by the driver.

JP 2005-263155 A

  However, the conventional operating device described in Patent Document 1 only has a function restriction based on the running state of the vehicle, and there is a problem that the driving state of the driver is not taken into consideration.

  The present invention has been made in view of the above problems, and provides an operating device that increases or decreases the types and / or number of functions available to the driver based on the driving state of the driver. Objective.

  The present invention is an operating device, a receiving unit that receives an image including at least a driver's eyes captured by an in-vehicle camera, a gaze detection unit that detects a driver's gaze based on the image, and a gaze detection A control unit that increases or decreases the type and / or number of functions available to the driver according to the direction and movement of the line of sight detected by the unit.

  In the present invention, the type and / or number of functions available to the driver are increased or decreased according to the direction and movement of the driver's line of sight. Thus, in the present invention, the driver's own driving state is determined by detecting the driver's line of sight, and the type and / or number of functions available to the driver are increased or decreased based on the driving state. be able to.

  As described above, according to the present invention, the type and / or number of functions available to the driver can be increased or decreased based on the driving state of the driver.

Block diagram of a driving support device equipped with an operating device Flow chart showing operation of operation device

  Hereinafter, embodiments will be described in detail with reference to FIGS.

[Overview]
The operating device according to the present embodiment receives an image including at least the eyes of the driver captured by the in-vehicle camera. The operating device detects the driver's line of sight, and increases or decreases the types and / or number of functions available to the driver according to the direction and movement of the line of sight. Thus, the operating device according to the present embodiment can increase or decrease the type and / or number of functions based on the driver's own driving state.

[Configuration of operation device]
The present embodiment is a driving support device 1 provided with the operation device 2 of the present invention. FIG. 1 is a block diagram of a driving support device 1 including an operation device 2. As shown in FIG. 1, the driving support device 1 includes an in-vehicle camera 11 and an operation device 2. The controller device 2 includes a receiving unit 21, a line-of-sight detection unit 22, a determination unit 23, and a control unit 24.

  The in-vehicle camera 11 is attached, for example, in the vicinity of a room mirror, and images at least the eyes of the driver at predetermined time intervals. The predetermined time interval is appropriately set to an interval capable of detecting the movement of the driver's line of sight described later. The in-vehicle camera 11 transmits the captured image information to the receiving unit 21.

  The line-of-sight detection unit 22 detects the driver's line of sight based on an image including at least the driver's eyes received by the reception unit 21. A known method can be adopted as the visual line detection method.

  The determination unit 23 determines whether the direction and movement of the line of sight detected by the line-of-sight detection unit 22 satisfy a predetermined condition within a predetermined determination time. The determination time is a time that is appropriately set to determine whether the direction and movement of the driver's line of sight satisfy a predetermined condition. The predetermined condition is appropriately set, and is, for example, (1) to (5) described below.

(1) The line of sight is out of the predetermined range in front of the driver for a predetermined time or more.
If this condition is met, the driver may be driving aside.
(2) The line of sight remains within a predetermined range for a predetermined time or more and is substantially constant.
When this condition is met, the driver may be watching one point.
(3) The number of times that the line of sight is directed to a place where safety confirmation is performed, such as a room mirror or a side mirror, is less than a predetermined number.
When this condition is met, the driver may have insufficient safety confirmation.
(4) The amount of movement of the line of sight is less than a predetermined amount.
When this condition is met, the driver has a small amount of line-of-sight movement and may have a reduced awareness of driving.
(5) The number of times that the line of sight is directed to a place where safety confirmation is performed, such as a room mirror or a side mirror, is equal to or greater than a predetermined number.
When this condition is met, the driver frequently confirms safety and there is a possibility that the driving load is high.

  Here, each predetermined time, predetermined amount, and each predetermined number of times in (1) to (5) are set as appropriate, but each predetermined time in (1) to (2) is set to a time shorter than the determination time. Is done. The determination unit 23 may determine each predetermined time (1) to (2) not only within one determination time but also over the next determination time.

  The control part 24 restrict | limits the function which a driver | operator can utilize, when it determines with the direction and movement of a driver | operator's eyes | visual_axis satisfying predetermined conditions by the determination part 23. FIG. That is, the control unit 24 reduces the type and / or number of functions available to the driver. The function restriction method will be specifically described. The controller device 2 is provided with a plurality of function restriction levels. The type and / or number of functions available to the driver decreases as the level of function restriction increases. Hereinafter, in order to simplify the description, the plurality of levels are assumed to be three levels of levels 1 to 3. Level 1 is a level at which all functions of the controller device 2 can be used without any function restriction. Level 2 is a level at which only audio-related functions can be used, for example. Level 3 has the highest function restriction level. For example, all the functions of the controller device 2 cannot be used.

  Then, when the determination unit 23 determines that the direction and movement of the driver's line of sight satisfy the predetermined condition, the control unit 24 enhances the function restriction of the controller device 1 by one level and can be used by the driver. Reduce the type and / or number of functions. For example, the control unit 24 strengthens the function restriction by one level from the state in which the function restriction level for the controller device 2 is level 1 to obtain a level 2 state.

  On the other hand, the control unit 24 determines that the direction and movement of the driver's line of sight does not satisfy the predetermined condition when the type and / or number of functions available to the driver are reduced. If so, relax the functional restrictions. That is, the control unit 24 increases the type and / or number of functions available to the driver. A method for relaxing the function restriction will be specifically described. The function restriction mitigation method is the reverse of the function restriction enhancement method described above. That is, the control unit 24 relaxes the function restriction by one level when the determination unit 23 determines that the direction and movement of the driver's line of sight does not satisfy the predetermined condition, and the types of functions available to the driver. Or increase the number or both. For example, the control unit 24 relaxes the function restriction by one level from the state in which the function restriction level for the controller device 2 is level 3 to obtain a level 2 state.

[Operation device operation]
Next, the operation of the controller device 2 will be described with reference to FIG. FIG. 2 is a flowchart showing the operation of the controller device 2. The flowchart shown in FIG. 2 is started when, for example, the vehicle is powered on.

  First, in step S <b> 21, the control unit 24 sets no function restriction on the controller device 2. The driver can use all the functions of the controller device 2.

  After setting without function restriction by the control unit 24 in step S <b> 21, the reception unit 21 receives an image including at least the eyes of the driver captured by the in-vehicle camera 11 in step S <b> 22. The in-vehicle camera 11 images the driver at least while the vehicle is traveling.

  After the receiving unit 21 receives an image including at least the driver's eyes in step S22, the line-of-sight detection unit 22 detects the driver's line of sight based on the received image in step S23. The line-of-sight detection unit 22 analyzes the image and detects the line of sight each time the reception unit 21 receives an image.

  After the line-of-sight detection unit 22 detects the line of sight in step S23, in step S24, the determination unit 23 determines whether or not the direction and movement of the line of sight detected by the line-of-sight detection unit 22 satisfy a predetermined condition. As described above, the determination unit 23 determines whether or not the direction and movement of the line of sight satisfy a predetermined condition within a predetermined determination time. When it is determined that the direction and movement of the line of sight satisfy the predetermined condition within the determination time, the process proceeds to step S25, and when it is determined that the direction and movement of the line of sight does not satisfy the predetermined condition within the determination time, the process proceeds to step S26. .

  When it is determined in step S24 that the direction and movement of the line of sight satisfy the predetermined condition, in step S25, the control unit 24 enhances the function restriction by one level, and the type or number of functions available to the driver, Or reduce both.

  On the other hand, if it is determined in step S24 that the direction and movement of the line of sight does not satisfy the predetermined condition, in step S26, the control unit 24 determines whether the type and / or number of functions has already been reduced. judge. If the type and / or number of functions has been reduced, the process proceeds to step S27. If the type and / or number of functions has not been reduced, the process proceeds to step S28.

  If it is determined in step S26 that the type and / or number of functions has been reduced, in step S27, the control unit 24 relaxes the function restriction by one level, and the functions available to the driver. Increase type and / or number.

  After step S25, step S26, or step S27, in step S28, the control unit 24 determines whether or not the operation is finished. For example, the control unit 24 determines that the driving is finished when the power of the vehicle is turned off. When the driving is not finished, the process returns to step S22, and when the driving is finished, the operation of the controller device 2 is finished.

[Effect of the embodiment]
In the present embodiment, when the direction and movement of the driver's line of sight satisfy a predetermined condition, the type and / or number of functions available to the driver are reduced. As described above, in this embodiment, the driver's own driving state is determined by detecting the driver's line of sight, and the type and / or number of functions available to the driver based on the driving state are determined. Can be reduced.

  Further, in the present embodiment, when the type and / or number of functions has already been reduced and the direction and movement of the driver's line of sight does not satisfy the predetermined condition, the type or number of functions, or Increase both. Thereby, in this Embodiment, a driver | operator can use many functions of the operating device 2, and a driver | operator's convenience improves.

[Modification]
Next, a modified example will be described. The in-vehicle camera 11 may image not only the driver's eyes but also the driver's upper body. Furthermore, the vehicle-mounted camera 11 may image the upper body of the passenger on the passenger seat. And the determination part 23 identifies whether the driver | operator is going to operate with respect to the operating device 2 based on the image which the vehicle-mounted camera 11 imaged, or the passenger seat passenger is going to operate. . Then, the control unit 24 may perform function restriction when the driver is about to perform an operation, and may not perform function restriction when the passenger on the passenger seat is about to perform the operation.

  When the technical scope based on this modification is considered, for example, the following description is given. A receiving unit that receives the captured images of the driver and the passenger on the passenger seat, a line-of-sight detection unit that detects the driver's line of sight based on the received image, and the driver trying to perform an operation based on the received image A determination unit that identifies whether the passenger in the passenger seat is about to operate, and the direction of the line of sight detected by the line-of-sight detection unit when the determination unit identifies that the driver is about to operate And a controller that increases or decreases the types and / or number of functions available to the driver according to the movement.

[Reference example]
Next, a reference example will be described. The operating device may determine that the driving load on the driver is low when the driving support system is operating, and may increase the type and / or number of functions available to the driver. The driving support system is, for example, a radar cruise control that travels while keeping an appropriate distance from the preceding vehicle. Considering the technical scope based on this reference example, for example, the description is as follows. A receiving unit that receives an image of the captured driver's eye, a line-of-sight detection unit that detects the driver's line of sight based on the received image, and a determination unit that determines whether the driving support system is operating And a control unit that increases or decreases the type and / or number of functions available to the driver according to the determination result of the determination unit and the direction and movement of the line of sight detected by the line of sight detection unit.

  The driving support device may use information acquired by the car navigation system in determining whether to reduce or increase the type and / or number of functions. For example, when the vehicle is traveling in a time zone in which many accidents occur, the driving support device determines that the driving load on the driver is high and reduces the type and / or number of functions. In addition, when the vehicle is running around the departure point and the destination, the driving support device determines that the driving load on the driver is high and reduces the type and / or number of functions. In addition, the driving support device determines that the driver's driving load is high when the vehicle is driving on narrow streets, curves, highway ICs, JCTs, and accident-prone intersections. Decrease. Considering the technical scope based on this reference example, for example, the description is as follows. A receiving unit that receives an image of the driver's eyes that has been imaged, a line-of-sight detection unit that detects the driver's line of sight based on the received image, a navigation unit that acquires the traveling state of the vehicle, and a navigation unit A controller that increases or decreases the types and / or number of functions available to the driver according to the traveling state of the vehicle and the direction and movement of the line of sight detected by the line-of-sight detection unit.

  In addition, the driving assistance device may use the warning activation history of the collision avoidance assistance system in determining whether to reduce or increase the type and / or number of functions. For example, the driving support device reduces the type and / or number of functions when there is an activation history of a lane departure alert (LDA), a pre-crash safety system (PCS), and a predecessor transmission notification function. Lane departure alert is a function that informs the driver of the danger of lane departure. The pre-crash safety system is a function that avoids the danger of a collision with a pedestrian. The preceding person transmission notification function is a function that informs the driver that the preceding vehicle has transmitted while the vehicle is waiting for a signal or is stopped due to traffic jams. Considering the technical scope based on this reference example, for example, the description is as follows. A determination unit that receives a captured driver's eye image, a gaze detection unit that detects the driver's line of sight based on the received image, and a determination that determines whether or not a collision avoidance support system warning has been triggered And a control unit that increases or decreases the type and / or number of functions available to the driver according to the determination result of the determination unit and the direction and movement of the line of sight detected by the line-of-sight detection unit. .

  In addition, the driving support device further includes a camera that captures the outside of the vehicle, and in a situation where a vehicle is always present around the vehicle, the driver's driving load is high, and the type and / or number of functions are reduced. Also good. Considering the technical scope based on this reference example, for example, the description is as follows. A receiver that receives an image around the vehicle and an image of the driver's eyes, a line-of-sight detector that detects the driver's eye based on the driver's eyes, and an image based on the image around the vehicle Types of functions that can be used by the driver according to the determination unit that determines whether or not a vehicle always exists around the vehicle, the determination result of the determination unit, and the direction and movement of the line of sight detected by the line-of-sight detection unit Or a control unit that increases or decreases the number or both.

  The present invention can be applied to an operation device mounted on a vehicle.

DESCRIPTION OF SYMBOLS 1 Driving assistance device 2 Operating device 11 Car-mounted camera 21 Receiving part 22 Line-of-sight detection part 23 Judgment part 24 Control part

Claims (1)

An operating device,
A receiving unit that receives an image including at least a driver's eyes imaged by an in-vehicle camera;
A line-of-sight detection unit that detects the line of sight of the driver based on the image;
An operation device comprising: a control unit that increases or decreases the type and / or number of functions available to the driver according to the direction and movement of the line of sight detected by the line-of-sight detection unit.

Images