KR20230099497A - Headlamp position control system and control method using adaptive careless judgment function - Google Patents

Abstract

The present invention relates to a system for controlling air conditioning/ventilation using an adaptive carelessness determination function. The system includes: a forward image photographing unit photographing a gazing direction of a driver; a driver image photographing unit photographing the driver; an adaptive reference area parameter setting unit detecting pupil information of the driver from an image of the driver, and setting an adaptive reference area parameter for determining the carelessness of the driver using the pupil information of the driver; an eye tracking unit detecting a gazing position of the driver using the pupil information of the driver and the gazing direction of the driver; an external driving environment information detection unit detecting a driving speed of the vehicle; a carelessness determination unit determining the carelessness of the driver through the adaptive reference area parameter set in the images of the gazing position of the driver and the gazing direction of the driver; and an air conditioning/ventilation control unit controlling the air conditioning/ventilation control system in accordance with a step of detecting external driving environment information of the vehicle and a vehicle driving condition of the driver. Therefore, the present invention is capable of improving logic performance through analysis on the condition of the driver relative to a set carelessness determination parameter.

Description

Air conditioning/ventilation control system and control method using adaptive careless judgment function {Headlamp position control system and control method using adaptive careless judgment function}

The present invention relates to an air conditioning/ventilation control system using an adaptive inattention judgment function, and more particularly, to a mass-produced camera-based driver carelessness (departure from the front area, eyes closed) judgment system, based on predetermined judgment rules, to determine driver carelessness situations. It relates to an air conditioning/ventilation control system using an adaptive inattention judgment function capable of determining and warning.

In the existing camera-based driver condition analysis system, inattention warning system defines an inattention judgment parameter as an arbitrary area to determine the level change and warning time of the driver's inattention situation.

Therefore, the conventional camera-based driver condition analysis based carelessness warning system warns based on the forward area/vehicle speed/departure time defined by the manufacturer when determining departure from the front area, and the eye closing time defined by the manufacturer when determining whether eyes are closed. warn according to

In this way, in the conventional camera-based driver condition analysis based inattention warning system, since the inattention level change and warning time point are generalized according to the decision parameter defined by the designer, frequent false warnings occur due to incorrect judgment, and the warning and level change conditions are met. There is a problem inevitably giving inconvenience to drivers as a problem that cannot accommodate hundreds of millions of drivers around the world.

The present invention is to solve the conventional problem, and in an air conditioning/ventilation control system using a camera-based adaptive inattention judgment function, a parameter value for determining inattention is not fixed and determined at the time of initial design, but a biologically based driver of the collected driver Air conditioning/ventilation control system using an adaptive inattention judgment function that can automatically determine driver adaptive judgment parameters by analyzing state analysis and external driving environment information and provide the driver with the optimal carelessness warning time and carelessness level change time want to provide

The object of the present invention is not limited to the object mentioned above, and other objects not mentioned will be clearly understood by those skilled in the art from the description below.

In order to achieve the above object, an air conditioning/ventilation control system using an adaptive inattention judgment function according to an embodiment of the present invention includes a front image capture unit for capturing a driver's gaze direction; a driver image capturing unit that photographs the driver; an adaptive reference region parameter setting unit that detects pupil information of the driver from an image of the driver and sets an adaptive reference region parameter for determining the driver's negligence using the driver's pupil information; a gaze tracking unit that detects a driver's gaze position using the driver's pupil information and the driver's gaze direction; a driver's negligence determination unit for determining driver's negligence based on the driver's gaze position and the adaptive reference region parameter set in the driver's gaze direction image; and

and an air conditioning/ventilation control unit controlling an air conditioning/ventilation control system according to the driver's vehicle driving state.

The air conditioning/ventilation control unit determines whether the air conditioning/ventilation control system is driven while drowsy and generates a drowsiness warning. Here, the drowsiness warning is preferably provided through one of haptic, buzzer, and pop-up functions.

Preferably, the air conditioning/ventilation control unit differently controls the operation function of the air conditioner according to the driver's drowsiness warning level.

If the drowsiness warning step is level 1, if the air-conditioning state is the internal circulation state, it is converted to the outside air circulation state. This lowers the carbon dioxide density inside the vehicle, allowing the driver to escape from drowsiness.

If the drowsiness warning level is the second level, the vehicle's air conditioner is controlled so that air below a predetermined temperature is introduced into the vehicle. This allows the driver to get out of a drowsy situation.

When the drowsiness warning level is level 3, the vehicle windows are opened to ventilate the entire interior of the vehicle. This allows the driver to get out of a drowsy situation. The drowsiness warning step may be cumulatively generated.

An air conditioning/ventilation control method using an adaptive inattention judgment function according to an embodiment of the present invention is an adaptive method for determining driver's carelessness by using driver's pupil information and driving environment information of a vehicle by a carelessness judgment criterion setting unit. setting reference area parameters; detecting driver's gaze information; determining whether the driver is careless by using the adaptive reference area parameter and the driver's gaze information; detecting external driving environment information of the vehicle; and controlling an air conditioning/ventilation control system according to the driving state of the driver.

In the controlling of the air conditioning/ventilation control system, a drowsiness warning is generated by determining whether drowsy operation is performed before the air conditioning/ventilation control system is operated. Here, the drowsiness warning is preferably provided through one of haptic, buzzer, and pop-up functions.

In the step of controlling the air conditioning/ventilation control system, it is preferable to differently control the operating function of the air conditioner according to the driver's drowsiness warning step.

In the step of controlling the air conditioning/ventilation control system, if the drowsiness warning step is the first step, and the air conditioning state is the internal circulation state, the air conditioning state is converted to the outside air circulation state. This lowers the carbon dioxide density inside the vehicle, allowing the driver to escape from drowsiness.

If the drowsiness warning level is the second level, the vehicle's air conditioner is controlled so that air below a predetermined temperature is introduced into the vehicle. This allows the driver to get out of a drowsy situation.

When the drowsiness warning level is level 3, the vehicle windows are opened to ventilate the entire interior of the vehicle. This allows the driver to get out of a drowsy situation. The drowsiness warning step may be cumulatively generated.

According to an embodiment of the present invention, there is an effect of improving convenience through automatic tuning of driver-adaptive judgment parameters for negligent judgment.

In addition, the present invention has an effect of improving the performance of the decision logic through determining the driver adaptive inattention warning time/inattention level change time.

In addition, the present invention has an effect of securing an optimal judgment parameter tuning technology by analyzing the driver's condition compared to the negligent judgment parameter determined by other companies.

1 is a block diagram illustrating an air conditioning/ventilation control system using an adaptive inattention judgment function according to an embodiment of the present invention.
FIG. 2 is a reference diagram for explaining a negligent judgment criterion setting unit of FIG. 1 ;
3 is a reference diagram for explaining the detailed configuration of the biometric information detection unit of FIG. 2;
FIG. 4 is a reference view for explaining a driving external environment detection unit of FIG. 1;
FIG. 5 is a reference diagram for explaining an example of setting an adaptive reference region parameter of the negligent judgment criterion setting unit of FIG. 1;
6 is a flowchart illustrating an air conditioning/ventilation control method using an adaptive inattention judgment function according to an embodiment of the present invention.
FIG. 7 is a flowchart illustrating driver's pupil information detection in FIG. 6 .

Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various different forms, only these embodiments make the disclosure of the present invention complete, and common knowledge in the art to which the present invention belongs. It is provided to fully inform the holder of the scope of the invention, and the present invention is only defined by the scope of the claims. Meanwhile, terms used in this specification are for describing the embodiments and are not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, "comprises" and/or "comprising" means that a stated component, step, operation, and/or element is the presence of one or more other components, steps, operations, and/or elements. or do not rule out additions.

1 is a block diagram illustrating an air conditioning/ventilation control system using an adaptive inattention judgment function according to an embodiment of the present invention.

As shown in FIG. 1 , the air conditioning/ventilation control system using the adaptive inattention judgment function according to an embodiment of the present invention includes a front image capture unit 100, a driver image capture unit 200, and an inattention judgment criterion setting unit. 300, an eye tracking unit 400, a vehicle external driving environment information detection unit 500, an inattention determination unit 600, and an air conditioning/ventilation control unit 700.

The front image capture unit 100 is a front camera, and captures a direction in which the driver gazes.

The driver image capturing unit 200 is a camera that photographs the driver, and photographs the driver so as to obtain driver information.

The adaptive reference region parameter setting unit 300 detects pupil information of the driver from a photographed image of the driver, and sets an adaptive reference region parameter for determining the driver's negligence using the driver's pupil information. Here, the driver's pupil information is at least one of pupil size information including central vision/peripheral vision of the driver and pupil size change information of central vision and peripheral vision to detect a focal distance change.

The inattention determination criterion setting unit 300 may change driving-adaptive front region parameters by converging not only the driver's pupil size information but also the driver and external environment/vehicle driving information. Here, the inattention warning time (time) and the inattention level change time (time) may be changed according to the driver's carelessness level.

That is, as shown in FIG. 5 , the inattention determination criterion setting unit 300 uses the pupil size 301, the vehicle speed 302, the vehicle state 303, and the driving external environment 304 to adapt the reference region. Parameter 305 is set or changed. On the other hand, it is preferable that the adaptive reference area parameter set by the inattention judgment criterion setting unit 300 is set to an area having a certain size in the front image. Therefore, if the driver's gaze is out of the area set by the adaptive reference region parameter, the driver's careless state is determined as an inattentive state, and if the driver's gaze is located inside the set area, the driver's careless state is determined as a normal state. be able to Accordingly, the driver's careless state may be graded and the emergency braking system may be applied differently according to the speed of the vehicle.

In this way, the inattention judgment criterion setting unit 300 provides visual information of the central vision where the image of the object is formed in the center of the retina and the field of view that can see the object most clearly and accurately, and the outer range of the unfocused gaze. An adaptive reference region parameter may be applied by reflecting the driver's viewing angle feature detected through peripheral vision that accepts .

In addition, the inattention determination criterion setting unit 300 may apply an adaptive reference area parameter by reflecting the driver's viewing angle feature in which the driver detects a range in which the driver can check color objects using both eyes.

In addition, the inattention determination criterion setting unit 300 may apply an adaptive reference area parameter by reflecting the focal length and viewing angle feature information of the driver's vision that changes according to the driving speed of the vehicle.

In addition, the inattention judgment criterion setting unit 300 may apply an adaptive reference region parameter by reflecting changes in viewing angles (center vision/peripheral vision) for each vehicle speed and characteristics of relative visual acuity information felt by a person. That is, the field of view narrows when the speed of the vehicle increases.

On the other hand, the inattention judgment criterion setting unit 300 reflects the information on the focal length change according to the size change of the cavity, which causes a light smearing phenomenon and a focused distance range that is more limited than that of daytime driving due to an increase in the size of the pupil during night driving, and reflects the adaptive criterion. Area parameters can be applied. Here, the pupil is the same as a human pupil size change condition in which a focal distance increases as the pupil size narrows and the focal distance shortens as the pupil size widens, like a camera diaphragm.

In addition, the careless judgment criterion setting unit 300 may apply an adaptive reference area parameter by reflecting the correlation between focal distances. For example, when the size of the pupil is narrowed, the focal length is increased, and thus the central vision is narrowed.

Accordingly, the adaptive reference area parameter setting unit 300 includes a biometric information detector 310, a vehicle information detector 320, and an external environment detector 330, as shown in FIG. 2 .

The biometric information detector 310 detects the driver's pupil information from the image captured by the driver's image capture unit 200 . Here, as shown in FIG. 3 , the biometric information detector 300 provides pupil size information 311 including driver's central vision/peripheral vision, and pupil change information of central vision and peripheral vision for detecting a focal distance change ( 312) is detected.

The vehicle information detector 320 detects vehicle state information. In this embodiment, it is preferable to typically detect the speed of the vehicle. Here, the vehicle state information is one of vehicle speed information, steering wheel information, and direction indicator information.

As shown in FIG. 4 , the external environment detector 330 detects at least one of map information 331, weather information 332, driver's sunglasses wearing information 333, and illuminance information 334. It is preferable that the driving external environment detection unit 330 interlocks with the GPS device.

In addition, the inattention determination criterion setting unit 300 may fuse the driver's biometric information and vehicle state information and apply the inattention warning system adaptive alarm generation.

In addition, the gaze tracking unit 400 performs calibration between the images captured by the front image capturing unit 100 and the driver's image capturing unit 200, and detects the driver's gaze position.

According to an embodiment of the present invention, by reflecting the characteristics of the driver's pupil, the driving characteristics of the vehicle, and the external driving environment characteristics to automatically adjust the driver's adaptive determination parameter for determining inattention, more accurate and precise determination of driver's carelessness. can do.

The vehicle external driving environment information detector 500 detects vehicle external driving environment information. In this embodiment, the driving environment information outside the vehicle is driving direction information of the vehicle. Driving direction information of the vehicle may be obtained through a turning radius of the steering wheel.

The carelessness determining unit 600 determines the driver's carelessness based on whether the driver's gaze deviates from the determined adaptive reference region parameter. To this end, the inattention determination unit 600 determines the driver's carelessness through the driver's gaze position and the adaptive reference region parameter set in the driver's gaze direction image.

The air conditioning/ventilation control unit 700 includes an air conditioning/ventilation control unit that controls an air conditioning/ventilation control system according to the driving state of the driver.

The air conditioning/ventilation control unit 700 determines whether the air conditioning/ventilation control system is driven while drowsy and generates a drowsiness warning. Here, the drowsiness warning is preferably provided through one of haptic, buzzer, and pop-up functions.

It is preferable that the air conditioning/ventilation control unit 700 differently controls the operation function of the air conditioner according to the driver's drowsiness warning level.

If the drowsiness warning step is level 1, if the air-conditioning state is the internal circulation state, it is converted to the outside air circulation state. This lowers the carbon dioxide density inside the vehicle, allowing the driver to escape from drowsiness.

If the drowsiness warning level is the second level, the vehicle's air conditioner is controlled so that air below a predetermined temperature is introduced into the vehicle. This allows the driver to get out of a drowsy situation.

When the drowsiness warning level is level 3, the vehicle windows are opened to ventilate the entire interior of the vehicle. This allows the driver to get out of a drowsy situation. The drowsiness warning step may be cumulatively generated.

Hereinafter, an air conditioning/ventilation control method using an adaptive inattention judgment function according to an embodiment of the present invention will be described with reference to FIG. 6 .

First, the driver's pupil information and the driving environment information of the vehicle are used by the inattention judgment criterion setting unit to set an adaptive reference region parameter for driver's careless judgment (S100).

Hereinafter, detailed steps of setting an adaptive reference region parameter ( S100 ) according to an embodiment of the present invention will be described with reference to FIG. 7 .

First, a front image is obtained by photographing the driver's gaze direction by the front image capturing unit (S110).

Then, the driver's image is obtained by photographing the driver by the driver's image capture unit (S120).

The driver's pupil information is detected from the driver's photographed image by the biometric information detector (S130). Here, the driver's pupil information includes pupil size information and pupil size change information. The adaptive reference region parameter is set to the driver's gaze direction image captured through the front-facing camera by the inattention judgment criterion setting unit.

In addition, the size of the driver's pupil in one embodiment of the present invention is the same as the size of the driver's pupil in another embodiment of the present invention, but in the other embodiment, the adaptive reference region parameter is changed according to the speed of the vehicle. For example, when the speed of the vehicle increases, the focal distance and viewing angle of the driver's vision narrow, so the adaptive reference area parameter is reduced and set.

On the other hand, if the driving environment information is acquired (YES) in the step of determining whether the driving environment information has been obtained, the driver's pupil information, vehicle speed information, and driving environment information are used to determine the driver's negligence. Set the standard area parameters.

On the other hand, in the step of determining whether vehicle speed information is acquired, if vehicle speed information is not obtained and only driving environment information is obtained (YES), the driver's careless judgment is performed using the driver's pupil information and driving environment information. Set the adaptive reference zone parameters. Here, the driving environment information is information of one or more of time, road, tunnel, and weather information. That is, the size of the driver's pupil in one embodiment of the present invention and the size of the driver's pupil in another embodiment of the present invention are the same, but in another embodiment, the adaptive reference region parameter is changed according to the driving environment. do. For example, when the weather changes, such as cloudy weather, rain or snow, vehicles entering or exiting tunnels, or the driving environment changes, such as evening, the focal length and viewing angle of the driver's vision also change. change the adaptive reference region parameter.

As described above, according to the present invention, by changing the adaptive reference region parameter according to the driver's pupil, vehicle speed, and driving environment, it is possible to more accurately determine the driver's negligence.

Then, the driver's gaze position in the front image is detected using the driver's pupil information and the driver's gaze direction (S200).

Then, it is determined whether the driver is careless by using the adaptive reference area parameter and the driver's gaze information (S300).

Subsequently, the vehicle external driving environment information detection unit 500 detects vehicle external driving environment information (S400). Here, the external driving environment information of the vehicle is vehicle speed information.

An air conditioning/ventilation control system is controlled according to the driving state of the driver (S500).

In the controlling of the air conditioning/ventilation control system, a drowsiness warning is generated by determining whether drowsy operation is performed before the air conditioning/ventilation control system is operated. Here, the drowsiness warning is preferably provided through one of haptic, buzzer, and pop-up functions.

Hereinafter, detailed steps of the step (S500) of controlling the air conditioning/ventilation control system of the present invention will be described with reference to FIG. 7.

The air conditioning/ventilation control unit 700 determines whether or not the driving illuminance environment is equal to or less than preset illuminance information through the external environment detection unit 330 (S510).

As a result of the determination, if the driving illumination environment is equal to or less than the predetermined illumination intensity information (YES), the driver's gaze direction and the vehicle driving direction information are used to control the high-speed driving pilot position of the vehicle using the driver's gaze direction information and the vehicle driving direction information. It is determined whether the driving direction information of the match (S520).

If the driver's gaze direction and the driving direction information of the vehicle match (YES), it is preferable to differently control the operation function of the air conditioner according to the level of the driver's drowsiness warning.

In the step of controlling the air conditioning/ventilation control system, if the drowsiness warning step is the first step, and the air conditioning state is the internal circulation state, the air conditioning state is converted to the outside air circulation state. This lowers the carbon dioxide density inside the vehicle, allowing the driver to escape from drowsiness.

If the drowsiness warning level is the second level, the vehicle's air conditioner is controlled so that air below a predetermined temperature is introduced into the vehicle. This allows the driver to get out of a drowsy situation.

When the drowsiness warning level is level 3, the vehicle windows are opened to ventilate the entire interior of the vehicle. This allows the driver to get out of a drowsy situation. The drowsiness warning step may be cumulatively generated.

In the above, the configuration of the present invention has been described in detail with reference to the accompanying drawings, but this is only an example, and various modifications and changes within the scope of the technical idea of the present invention to those skilled in the art to which the present invention belongs Of course this is possible. Therefore, the scope of protection of the present invention should not be limited to the above-described embodiments, but should be defined by the description of the claims below.

Claims (8)

a front image capture unit for capturing a driver's gaze direction;
a driver image capturing unit that photographs the driver;
an adaptive reference region parameter setting unit that detects pupil information of the driver from an image of the driver and sets an adaptive reference region parameter for determining the driver's negligence using the driver's pupil information;
a gaze tracking unit that detects a driver's gaze position using the driver's pupil information and the driver's gaze direction;
a driver's negligence determination unit for determining driver's negligence based on the driver's gaze position and the adaptive reference region parameter set in the driver's gaze direction image; and
An air conditioning/ventilation control system using an adaptive negligence judgment function including an air conditioning/ventilation control unit controlling the air conditioning/ventilation control system according to the driver's vehicle driving state.
According to claim 1,
The air conditioning / ventilation control unit,
The air conditioning/ventilation control system using an adaptive inattention judgment function, characterized in that the air conditioning/ventilation control unit determines whether drowsy operation is performed before driving the air conditioning/ventilation control system and generates a drowsiness warning.
According to claim 2,
The air conditioning / ventilation control unit,
The drowsiness warning is an air conditioning / ventilation control system using an adaptive inattention judgment function, characterized in that to warn through one of the functions of haptic, buzzer, pop-up.
According to claim 1,
The air conditioning / ventilation control unit,
Control the operation function of the air conditioner differently according to the level of the driver's drowsiness warning,
If the drowsiness warning level is level 1, if the air-conditioning state is the internal circulation state, it is converted to the external air circulation state,
If the drowsiness warning level is level 2, the air conditioner of the vehicle is controlled so that air below a predetermined temperature is introduced into the vehicle,
An air conditioning/ventilation control system using an adaptive inattention judgment function, characterized in that when the drowsiness warning level is the third level, the window of the vehicle is opened to ventilate the entire interior of the vehicle.
setting an adaptive reference region parameter for determining the driver's inattention by using the driver's pupil information and the driving environment information of the vehicle, by the inattention judgment criterion setting unit;
detecting driver's gaze information;
determining whether the driver is careless by using the adaptive reference area parameter and the driver's gaze information; and
An air conditioning/ventilation control method using an adaptive inattention judgment function comprising the step of controlling an air conditioning/ventilation control system according to the driving state of the driver.
According to claim 5,
The control step is
In the step of controlling the air conditioning/ventilation control system, before driving the air conditioning/ventilation control system, it is determined whether drowsy operation is performed and a drowsiness warning is generated.
According to claim 6,
The drowsiness warning,
An air conditioning/ventilation control method using an adaptive inattention judgment function, characterized in that a warning is given through one of haptic, buzzer, and pop-up functions.
According to claim 7,
The control step is
Control the operation function of the air conditioner differently according to the level of the driver's drowsiness warning,
If the drowsiness warning level is level 1, if the air-conditioning state is the internal circulation state, it is converted to the external air circulation state,
If the drowsiness warning level is level 2, the air conditioner of the vehicle is controlled so that air below a preset temperature is introduced into the vehicle,
An air conditioning/ventilation control method using an adaptive inattention judgment function, characterized in that when the drowsiness warning step is the third step, opening the vehicle windows to ventilate the entire interior of the vehicle.

Images