KR101636241B1 - System for preventing drowsy drive - Google Patents

Abstract

The present invention relates to a drowsiness driving prevention system for a vehicle in which a seat or a headrest is provided with a vibration device, the system comprising: a driver's photographic image of a driver of the automobile; A driver's photographing image, a road surface photographing image, and the running state information to divide and set the driver's drowsiness into a plurality of states, A driver condition monitoring unit for generating a warning signal corresponding to the state, and an alarm unit for performing a drowsiness alarm to the driver in response to the warning signal corresponding to a plurality of states.

Description

{SYSTEM FOR PREVENTING DROWSY DRIVE}

The present invention relates to a drowsy driving prevention relates to the ^city's system, especially the drowsiness that can be recorded simultaneously with the notification of dangerous situations drowsiness alert to determine whether the sleepiness of motorists driving prevention system.

In modern society, automobiles are exploding because of the increase of income and the pursuit of convenience of consumers. As a result, casualties due to traffic accidents are increasing. To reduce traffic accident casualties, various safety devices are added to cars.

In particular, Korean Patent Laid-Open Publication No. 10-2013-0009158 discloses a method for detecting a driver's warning by detecting a departure from a left lane or a right lane of the vehicle in a running state of the vehicle, In the patent document No. 617777, a driver's eye image is quickly detected in a driver image input from a camera using an eye search template having a structure similar to that of a driver's eye stored in advance. A driver's eye image detecting apparatus and method of a drowsiness driving warning apparatus that enables a driver to perceive a driver's eye image.

However, Korean Patent Laid-Open Publication No. 10-2013-0009158 can not distinguish intentional lane change by the user and lane departure due to drowsiness driving or carelessness, which may cause discomfort to the user.

In addition, in Japanese Patent No. 10-061777, since it is judged whether or not to be drowsy by using only eye images, there is a problem that the drowsiness can not be accurately confirmed.

A problem to be solved by the present invention is to provide a drowsiness driving prevention system which can judge whether a driver of a car is drowsy and can record a drowsiness situation while notifying a danger warning.

In order to solve the above problems, the present invention provides a system for preventing drowsiness in a vehicle having a seat or a headrest equipped with a vibration device, the system comprising: a driver photographing the driver of the automobile; An information collecting unit for collecting road surface photographing images and driving state information of the automobile; A driver condition monitor for setting a driver's sleepiness status by combining the driver's photographed image, the road surface photographed image, and the driving state information to generate a warning signal corresponding to the plurality of states; And an alarm unit for performing a drowsiness alarm to the driver in response to the warning signal corresponding to the plurality of states.

Wherein the information collecting unit comprises: a first camera unit for photographing the driver, the first camera unit being formed on a steering side of the automobile and photographing the driver in an upward direction; A second camera section for photographing the traveling road; And an ECU (Electrical Control Unit) information collecting unit for collecting status information of the vehicle through CAN (Controller Area Network) communication with the vehicle.

The driver status monitoring unit being connected to the information collecting unit and receiving the driver photographed image, the road surface photographed image, and the vehicle status information; A drowsiness judging unit for distinguishing the drowsiness of the driver into a normal state, a caution state, a warning state and a dangerous state; And a warning signal generator for generating the warning signal corresponding to the separated state.

The warning signal generator may generate a voice warning signal, a video warning signal, and a tactile warning signal, and may transmit at least one warning signal to the alarm unit in accordance with the state of the driver determined by the drowsiness determination unit.

Wherein the alarm unit comprises: an auditory warning module for outputting a warning message set in accordance with the voice warning signal to a speaker; A visual warning module for outputting a warning message set in accordance with the image warning signal; And a tactile warning module for causing the seat or the headrest to vibrate.

The driver condition monitoring unit may further include a driver reaction confirmation unit for receiving a response from the driver after the operation of the alarm unit,

The driver reaction confirmation unit may cancel the drowsiness alarm if the driver confirms the reaction within the set time, and may raise the drowsiness notification step in the drowsiness determination unit if there is no driver response within the set time.

If the driver is in any one of the state of caution, the warning state, and the dangerous state, an event signal may be generated and transmitted to the situation recording unit attached to the vehicle.

The drowsiness prevention system according to the embodiment of the present invention can effectively prevent drowsiness by generating and outputting different warning signals for each drowsiness state of the driver.

The drowsiness driving prevention system according to the embodiment of the present invention can prevent malfunction by dividing the drowsiness state of the driver into multiple stages by simultaneously using the photographed image and the vehicle state information.

In addition, the drowsiness prevention system according to the embodiment of the present invention is provided with a camera for photographing a driver on the steering device side of the vehicle, so that it can more accurately confirm whether or not the driver is drowsy.

1 is a block diagram showing a drowsiness driving prevention system according to an embodiment of the present invention;
Fig. 2 is a block diagram showing the information collecting unit shown in Fig. 1. Fig.
FIG. 3 is a view showing, for example, an installation position of each component included in the information collecting unit shown in FIG. 2;
4 is a block diagram showing an example of the driver status monitor shown in FIG.
5 is a block diagram showing an example of the alarm unit shown in Fig.
FIG. 6 is a flowchart sequentially illustrating an operation method of the drowsiness driving prevention system according to the embodiment of the present invention shown in FIG.

Hereinafter, the description of the present invention with reference to the drawings is not limited to a specific embodiment, and various transformations can be applied and various embodiments can be made. It is to be understood that the following description covers all changes, equivalents, and alternatives falling within the spirit and scope of the present invention.

In the following description, the terms first, second, and the like are used to describe various components and are not limited to their own meaning, and are used only for the purpose of distinguishing one component from another component.

Like reference numerals used throughout the specification denote like elements.

As used herein, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. It is also to be understood that the terms " comprising, "" comprising, "or" having ", and the like are intended to designate the presence of stated features, integers, And should not be construed to preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1 to 6 attached hereto.

1 is a block diagram illustrating a drowsiness driving prevention system according to an embodiment of the present invention.

1, the drowsiness driving prevention system according to the embodiment of the present invention may include an information collecting unit 100, a driver condition monitoring unit 200, an alarm unit 300, and a situation recording unit 400 .

Specifically, the information collecting unit 100 determines whether or not the driver of the vehicle is drowsy and transmits the information to the driver condition monitoring unit 200. The information collecting unit 100 may photograph the face or the pupil and provide the photographed image to the driver condition monitor unit 200. [ In addition, the information collecting unit 100 may photograph the driving image of the automobile and provide it to the driver condition monitoring unit 200. The information collecting unit 100 collects vehicle status information such as a speed, a steering angle, and a brake status of the vehicle from an electronic control unit (ECU) built in the vehicle, and transmits the collected status information to the driver status monitor 200 .

The driver condition monitoring unit 200 can determine whether the driver is drowsy using the captured image information or the vehicle condition information received by the information collecting unit 100. [ At this time, the driver condition monitoring unit 200 can divide the driver's sleepiness into three or more levels.

For example, the driver condition monitoring unit 200 may distinguish drowsiness by 1 to 4 levels, and may distinguish between drowsiness and non-drowsiness. The first stage is normal, the second stage is attention, the third stage is the warning, and the fourth stage is the danger. In addition, the driver condition monitoring unit 200 can be classified into a normal state, a caution state, a warning state, and a dangerous state according to the drowsy stage.

The driver condition monitoring unit 200 analyzes the image of the pupil or the face of the driver from the information collecting unit 100 to determine whether or not the user is drowsy. The driver condition monitoring unit 200 receives the lane departure information of the vehicle from the information collecting unit 100 and determines whether the user is drowsy or not by matching with the drowsiness read from the driver image. In addition, the driver condition monitoring unit 200 receives the speed, steering angle, brake operation information, and the like of the vehicle from the ECU of the automobile, and matches the driver with drowsiness to finally determine whether or not to drowsy.

The driver condition monitoring unit 200 can generate a warning signal based on the drowsiness determination result. The warning signal may include a voice warning signal, a video warning signal, and a tactile warning signal.

The voice warning signal, the video warning signal, and the tactile warning signal may be transmitted simultaneously or simultaneously according to the drowsiness stage. For example, a voice warning signal may be output in the drowsiness stage, a voice warning signal and a video warning signal may be simultaneously output in the drowsiness warning stage, and three signals may be simultaneously transmitted in the danger warning stage.

The driver condition monitoring unit 200 can release the warning signal or output the warning signal repeatedly according to the response from the driver within a predetermined time after the warning signals are transmitted. At this time, if there is no driver response, the driver condition monitoring unit 200 may raise the drowsiness level and output a corresponding warning signal.

Meanwhile, the driver condition monitoring unit 200 may generate an event signal according to each sleeping step and provide the event signal to the situation recording unit 400.

The alarm unit 300 drives the alarm devices installed in the vehicle according to the warning signals so that the driver can call attention. For example, the alarm unit 300 outputs a caution operation guidance message corresponding to the voice warning signal. The alarm unit 300 receives the image warning signal and outputs a warning message or a warning color to the image providing apparatus for the automobile head-up display, the navigation apparatus, or the separate operation.

Upon receiving the tactile warning signal, the alarm unit 300 can drive the driver's seat of the automobile or the vibration device mounted on the headrest.

The situation recording unit 400 records a situation when receiving an event signal generated during the drowsiness warning step, the drowsiness warning step, and the danger alarm step. The situation recording unit 400 may include a black box mounted in the car shown in Fig. The situation recording unit 400 may store the time when the event signal is generated together with the image when recording.

FIG. 2 is a block diagram showing the information collecting unit shown in FIG. 1, and FIG. 3 is a view showing an example of the installation position of each component included in the information collecting unit shown in FIG.

2 and 3, the information collecting unit 100 may include a first camera unit 110, a second camera unit 120, and an ECU information collecting unit 130.

Specifically, the first camera unit 110 photographs the driver's face or pupil. The first camera unit 110 may transmit the photographed images to the driver condition monitor unit 200 at predetermined time intervals.

3, the first camera unit 110 may be installed at a position where the driver's face or pupil can be easily photographed. In particular, it is important to set the installation position so that the first camera unit 110 can confirm the pupil's reaction even during the daytime when the sunlight shines directly on the driver. Accordingly, the first camera unit 110 may be provided on the steering device side. When the first camera unit 110 is provided on the steering apparatus side, the face or eyes can be accurately photographed when the driver's head is turned downward to be downward, thereby facilitating drowsiness judgment.

The second camera unit 120 may photograph the road surface indicated by the lane and may transmit the road surface image to the driver condition monitor unit 200 at predetermined time intervals. The second camera unit 120 may be installed outside the front end of the automobile to photograph the road surface.

The ECU information collecting unit 130 can collect automobile information using the CAN communication method. The ECU information collecting unit 130 collects the state information of the automobile such as the speed, the steering angle, and the break state of the automobile using the CAN communication system. The ECU information collecting unit 130 may transmit the collected vehicle information to the driver condition monitoring unit 200. [

4 is a block diagram showing an example of the operation state monitoring unit shown in FIG.

4, the driving state monitoring unit 200 includes an information receiving unit 210, a drowsiness determining unit 220, a warning signal generating unit 230, an operator response confirming unit 240, and an event signal generating unit 250. [ . ≪ / RTI >

Specifically, the information receiving unit 210 receives the image and the vehicle status information transmitted from the information collecting unit 100. The information receiving unit 210 may be an interface connected to the information collecting unit 100.

The drowsiness determination unit 220 determines whether the driver is drowsy using the image and the vehicle status information received from the information collection unit 100. [ In the embodiment of the present invention, the drowsiness determination unit 220 determines whether the driver is drowsy in four states or steps.

For example, the drowsiness determination unit 220 classifies the drowsiness as one to four levels, and classifies the drowsiness as one, normal, two, three, and four. The drowsiness determination unit 220 may further classify the state into a normal state, a state of caution, a state of warning, and a state of danger. Here, it is assumed that the higher the step, the more dangerous the first to fourth steps are.

The drowsiness determination unit 220 may determine whether the user is in a normal state using the video signals received from the first camera unit 110 and the second camera unit 120 shown in FIGS. When the first camera unit 110 reads the image signal of the driver's face or pupil and determines that the user is drowsy, the state is set to a state of caution. If the image received by the second camera unit 120 is determined to be a lane departure, it is classified into a warning state or a dangerous state at a high level in the first or second stage in the state of caution.

The drowsiness determination unit 220 applies the vehicle state information to the driver state determined through the first camera unit 110 and the second camera unit 120 to finally set the driver drowsiness state. For example, if the steering angle of the vehicle is constantly changed or exceeds the set speed (40 km / h) at the step of determining the state of attention, the drowsiness level may be set higher by one level.

The drowsiness determination unit 220 can set a higher step by one or two by applying a weight when there is no driver response to the drowsiness alarm in the driver reaction confirmation unit 240. [ When the weight signal is received from the driver reaction confirmation unit 240, the drowsiness determination unit 220 may set the alarm level higher as described above.

The warning signal generating unit 230 generates a warning signal in accordance with the drowsy notification step set by the drowsiness determination unit 220. The warning signal generating unit 230 may generate an alarm signal in accordance with the state of caution, the state of warning, and the state of danger.

The warning signal generator 230 may generate a voice warning signal, a video warning signal, and a tactile warning signal to selectively generate and transmit an alarm signal corresponding to the drowsy state. For example, the warning signal generating unit 230 generates only one of a voice warning signal, a video warning signal, and a tactile warning signal in a state of attention, and transmits the alarm signal to the alarm unit 300. The warning signal generating unit 230 generates two warning signals, that is, a voice warning signal, a video warning signal, and a tactile warning signal, in the warning state, and transmits the generated warning signal to the alarm unit 300. In the dangerous state, And transmits it to the alarm unit 300.

The driver reaction confirmation unit 240 confirms the response from the driver within a set time after the alarm unit 300 operates. The driver reaction confirmation unit 240 cancels the drowsiness alarm upon confirming the response from the driver. However, when there is no driver response, the driver response confirmation unit 240 may raise the drowsiness notification step and transmit a weight signal to the drowsiness determination unit 220 so as to output a corresponding warning signal.

The event signal generation unit 250 may generate an event signal by considering all the alert signals generated by the alert signal generation unit 230 as an event, and may transmit the alert signal to the vehicle black box.

5 is a block diagram showing an example of the alarm unit shown in FIG.

Referring to FIG. 5, the alarm unit 300 may include an auditory warning module 310, a visual alert module 320, and a tactile alert module 330.

The auditory warning module 310 receives the audible warning signal and outputs the set message. To this end, the auditory warning module 310 may be connected to a speaker or navigation device installed in the vehicle, or may have its own speaker. The set message may include, for example, a safe driving guidance message, a warning ventilation guidance message, a drowsiness warning message, a danger alarm message, and the like.

The visual alert module 320 receives the image warning signal and outputs the set screen. The set screen can be output to the head-up display or output to the navigation system. For example, when the visual warning module 320 receives the image warning signal, the driver may repeat the color of the stimulus or continuously output the specific message.

The tactile alert module 330, when receiving a tactile alert signal, may activate a vibrating device mounted on a car seat or headrest.

FIG. 6 is a flowchart sequentially illustrating an operation method of the drowsiness driving prevention system according to the embodiment of the present invention shown in FIG. In the description of FIG. 6, the same reference numerals are used for the constituent elements and constituent elements described in FIG. 1 to FIG.

6, the operation of the drowsiness prevention system may include an information collection step S100, an analysis step S200 according to drowsiness state, an alarm part operation step S300, and a driver response confirmation step S400 .

Specifically, the information collecting step (S100) collects the photographed image photographed by the driver, the photographed image of the running road surface of the automobile, and the state information of the automobile. At this time, the camera images collected through the cameras installed in the vehicle, particularly, the first and second camera units 110 and 120 shown in FIGS. 2 and 3, and the vehicle state information is collected by the ECU information collecting unit 130 do.

The drowsiness driving state analysis step (S200) analyzes the drowsiness driving state of the driver using the captured images and the vehicle state information. For example, in the analyzing step according to drowsiness driving state, the driver's state is divided into four steps by applying the photographed images and the vehicle state signal.

The driver states of the four stages are steady state, caution state, warning state and dangerous state.

The steady state is a state in which the driver is not drowsy, the vehicle is traveling in accordance with the lane, and the steering angle information and the speed information of the vehicle state information are normally received.

The state of caution is the case where it is analyzed that there is an abnormality in either the driver's image or the running image of the vehicle. If the pupil reaction is closed below the set value in the driver's image, or if the front of the driver's face is in a certain direction (downward) longer than the set time, the state is classified as abnormal. At this time, in the image taken on the road surface of the vehicle, the vehicle is set to the state above the state of caution and the state of the state of caution when the vehicle runs without involving the lane and when the lane is invaded. Here, the state of attention is set when the lane is not invaded, and the warning state or the dangerous state when the lane is invaded.

 Next, the state of caution, the state of warning, and the state of danger are classified according to the case where the speed of the vehicle is less than or equal to the reference value (40 km / h). If the speed of the car is less than the reference value, it is confirmed as a state of caution. If it exceeds the set value, it is determined as a warning state. Also, if it is set to warning state or dangerous state, if the speed of the vehicle is higher than the reference value, it is determined as a dangerous state.

In addition, the analyzing step S200 according to the drowsy driving state generates a warning signal according to the driver's state and outputs it. For example, in the case of a caution state, one of a voice or image warning signal is generated and output, and in the case of a warning state, two signals of a voice, an image and a tactile warning signal are generated and output, All three warning signals are generated and output.

The alarm unit operation step (S300) receives the warning signal and operates a warning module corresponding to the warning signal. The warning module may include an auditory warning module, a visual warning module, and a tactile warning module, and each of the warning modules may drive a speaker, a navigation device, and a vibration device attached to or attached to the automobile.

In the driver response confirmation step S400, the driver may check the reaction after the alarm part is operated to continuously output the warning signal or stop the warning signal. For example, when the driver performs an operation for eliminating drowsiness within a set time after the warning signal is output, the warning is stopped. The operation for eliminating drowsiness may include a signal for lowering a glass door of the automobile which can be recognized as an operation of a driver, a room acoustics device operation signal, and the like.

If the driver does not react within a predetermined time after the warning signal is output, the warning signal may be continuously generated, or a weight signal may be output to generate a warning signal at a higher level than the previous warning signal. The weight signal may be generated so as to generate a warning signal higher than before in the drowsiness driving state analysis step S200.

In the operation of the drowsiness driving prevention system according to the embodiment of the present invention, when an alarm signal is generated, an event signal is generated, and an event signal is provided to a situation recording unit of the vehicle to start recording, It may be displayed to notify the driver of the sleep alert event.

As described above, the drowsiness prevention system according to the embodiment of the present invention can effectively prevent drowsiness by generating and outputting different warning signals for each drowsiness state of the driver.

The drowsiness driving prevention system according to the embodiment of the present invention can prevent malfunction by dividing the drowsiness state of the driver into multiple stages by simultaneously using the photographed image and the vehicle state information.

In addition, the drowsiness prevention system according to the embodiment of the present invention is provided with a camera for photographing a driver on the steering device side of the vehicle, so that it can more accurately confirm whether or not the driver is drowsy.

100: Information collecting section
110: first camera section
120: Second camera section
130: ECU information collecting unit
200: Driver status monitor section
210: Information collecting section
220: drowsiness judgment unit
230: Warning signal generator
240: Driver response confirmation part
250: Event signal generator
300:
310: Auditory Warning Module
320: Visual Warning Module
330; Tactile Warning Module
400: situation recording unit

Claims (7)

1. A drowsiness prevention system for a vehicle having a seat or a headrest equipped with a vibration device,
An information collecting unit collecting a driver photographed image of a driver of the automobile, a road surface photographed image of a driving road on which the automobile travels, and driving state information of the automobile;
A driver condition monitor for setting a driver's drowsiness state into a plurality of states by combining the driver's photographed image, the road surface photographed image, and the driving state information, and generating an alarm signal corresponding to the plurality of states; And
And an alarm unit for performing a sleepiness alarm to the driver in response to the warning signal corresponding to the plurality of states,
The driver condition monitoring unit
An information receiving unit connected to the information collecting unit and receiving the driver photographed image, the road surface photographed image, and the vehicle condition information;
A drowsiness judging unit for distinguishing the drowsiness of the driver into a normal state, a caution state, a warning state and a dangerous state;
An alarm signal generator for generating the alarm signal corresponding to the separated state; And
And an event signal generator for generating an event signal and transmitting the generated event signal to a situation recording unit attached to the vehicle when the driver is in any one of the caution state, the warning state, and the dangerous state.
The method according to claim 1,
The information collecting unit
A first camera unit for photographing the driver and formed on a steering side of the automobile to photograph the driver in an upward direction;
A second camera section for photographing the traveling road; And
And an ECU (Electrical Control Unit) information collecting unit for collecting state information of the vehicle through CAN (Controller Area Network) communication with the vehicle.
delete The method according to claim 1,
The warning signal generation unit
A voice warning signal, a video warning signal and a tactile warning signal,
And transmits at least one warning signal to the alarm unit according to the state of the driver determined by the drowsiness determination unit.
5. The method of claim 4,
The alarm unit
An auditory warning module for outputting a warning message set in accordance with the voice warning signal to a speaker;
A visual warning module for outputting a warning message set in accordance with the image warning signal; And
And a tactile warning module for causing the seat or the headrest to vibrate.
The method according to claim 1,
The driver condition monitoring unit
And a driver response confirmation unit for receiving a response from the driver after the operation of the alarm unit,
When the driver's reaction confirmation unit confirms the response from the driver within the set time, the driver's alarm confirmation unit cancels the drowsy alarm,
And when the driver does not react within the set time, the drowsiness determination unit raises the drowsiness notification step.
delete

Images