KR102320484B1 - System for monitering a careless driving - Google Patents

Abstract

The present invention relates to a system for monitoring careless driving. An objective of the present invention is to provide the system for monitoring careless driving, capable of monitoring whether or not a driver is careless through conversation with the driver and taking a corresponding action. The system for monitoring careless driving of the present invention comprises: a face recognition device (121); a carbon dioxide sensing device (122); a temperature sensing device (123); a voice recognition device (124); a speaker (131); a sound playing device (132); a lighting device (133); a perfume injecting device (134); a collecting device (125); an analysis device (136); a lamp (126); an input device (127); a telephony device (128); and a control device (110).

Description

Monitoring system for careless driving

The present invention relates to a system capable of monitoring inattentive driving.

As the number of automobiles increases and the road network becomes more complex, automobile accidents are increasing.

In particular, accidents due to driver's negligence, such as drowsy driving or driver distraction, are increasing.

Accordingly, various methods and systems for preventing accidents due to careless driving have been proposed. However, a more specific system capable of reliably preventing an accident due to negligence in driving has not been provided.

SUMMARY OF THE INVENTION An object of the present invention, which has been proposed to solve the above-described problems, is to provide a driving careless monitoring system capable of monitoring whether the driver is negligent in driving through conversation with the driver and taking measures accordingly.

A driving careless monitoring system according to the present invention for achieving the above-described technical problem, the driver's eye movement, the driver's eye closing duration, the driver's blink frequency, the driver's mouth shape, and changes in the position of the driver's face a face recognition device 121 to detect; a carbon dioxide sensing device 122 for sensing the concentration of carbon dioxide; a temperature sensing device 123 for sensing the temperature inside the vehicle; a voice recognition device 124 for recognizing the driver's voice; a speaker 131 for outputting at least one of a warning sound, music, and a warning sound; a sound reproducing device 132 for generating at least one of a warning sound, music, and a warning sound; a lighting device 133 mounted inside a vehicle to generate lighting; A perfume spraying device 134 for spraying a perfume; a collection device 125 for collecting the location and distance of a nearby rest stop or drowsiness shelter; an analysis device 136 for analyzing the driver's driving careless occurrence pattern; and a face recognition device 121 , a carbon dioxide sensing device 122 , a temperature sensing device 123 , a voice recognition device 124 , a speaker 131 , a sound reproducing device 132 , a lighting device 133 , and a perfume injection device. 134, including a control device 110 for controlling the driving of the collection device 125 and the analysis device 136, and the movement of the pupil recognized by the face recognition device 121, the duration of the driver's eye closing, It is determined that the driver is driving carelessly by at least one of changes in the blinking frequency, mouth shape, and position of the face, or the amount of carbon dioxide inside the vehicle sensed by the carbon dioxide sensing device 122 exceeds a preset amount. It is determined that there is a possibility that the driver may drive carelessly, or the temperature inside the vehicle sensed through the temperature sensing device 123 exceeds a preset value, and thus it is determined that there is a possibility that the driver may drive carelessly, or After every set period or every random period, the control device outputs a first request message for requesting the driver's attention and a response to it through the speaker 131, and then the first answer voice to the request message is voiced. It is determined whether or not it has been received through the recognition device 124, and as a result of the determination, if the driver's first answer voice is received, the control device outputs the first final request message to continue safe driving through the speaker 131, As a result of the determination, if the driver's first answer voice is not received, the control device outputs a second request message through the speaker 131 and then determines whether a second answer voice to the second request message is received, As a result of the determination, if the driver's second voice answer is not received, the control device outputs the third request message and then determines whether the third request message has been received, and also for the third prompt message. If the third answer voice is not received, the control device drives the sound reproducing device 132 to generate a warning message of at least one of a warning sound, music, and a warning sound and outputs it through the speaker 131, a warning When a stop request is received from the driver after the message is output through the speaker 131, the control device stops the output of the warning message, changes the color of the interior of the vehicle according to the driver's request, and It guides the location and distance, and predicts and guides the frequent occurrence pattern information of negligence and future negligence behavior in advance.

According to the present invention, it is possible to monitor whether the driver is negligent in driving through a conversation with the driver, and as a result of the monitoring, if it is determined that the driver is driving in a state of negligence, a warning message for safe driving may be output to the driver.

In particular, the present invention may sequentially increase the intensity of conversation with the driver in order to prevent a problem in which an accident may occur due to a sudden warning message or the like.

In addition, when the driver wants or carelessness is detected, the present invention changes the vehicle lighting color, guides the location and distance of nearby rest stops and drowsiness shelters, and predicts information on frequent driver carelessness occurrence patterns and future careless behavior in advance By doing so, it can help to prevent the driver's carelessness.

1 is a configuration diagram of an embodiment of a driving careless monitoring system according to the present invention.
2 is an exemplary view for explaining a method of recognizing a driver's face by the face recognition device applied to the driving careless monitoring system according to the present invention.
3 is a flowchart illustrating an operation method of a driving careless monitoring system according to an embodiment of the present invention;

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of an embodiment of a careless driving monitoring system according to the present invention, and FIG. 2 is an example for explaining a method of recognizing a driver's face by a face recognition device applied to the careless driving monitoring system according to the present invention It is also

1, the driver's eye movement, the driver's eye closing duration, the driver's blink frequency, the driver's mouth shape, and the driver's face position A face recognition device 121 for detecting a change in ), a speaker 131 for outputting at least one of a warning sound, music, and a warning sound, a sound reproducing device 132 for generating at least one of a warning sound, music, and a warning sound, a lighting device mounted inside a vehicle to generate lighting ( 133), a perfume injection device 134 that sprays a perfume, a collection device 125 that collects the location and distance of a nearby rest area or drowsiness shelter, an analysis device 136 that analyzes the driver's careless driving pattern, and a face recognition device 121, a carbon dioxide sensing device 122, a temperature sensing device 123, a voice recognition device 124, a speaker 131, a sound reproducing device 132, a lighting device 133, a perfume injection device 134, and a control device 110 for controlling the operation of the collection device 125 and the analysis device 136 .

In addition to the above components, the driving careless monitoring system 100 according to the present invention includes a lamp 126 for outputting at least two colors, an input device 127 for receiving information from a driver, and a phone call device for making a phone call. (128), a storage device 135 for storing various types of information, and a communication device 140 capable of performing communication with the service server 300 through a network may be further included.

Here, the face recognition device 121, the lamp 126, the voice recognition device 124 and the control device 110 are, as shown in FIG. 2, a case mounted on the dashboard 200 in front of the driver's seat of the vehicle. (190) may be embedded.

In addition, the carbon dioxide sensing device 122, the temperature sensing device 123, the input device 127, the phone call device 128, the communication device 140, the speaker 131, the sound reproducing device 132, the lighting device 133 , at least one of the perfume injection device 134 , the collection device 125 , the analysis device 136 , and the storage device 135 may be further embedded in the case 190 .

Components that are not embedded in the case 190 may be mounted at various locations inside the vehicle. In this case, the speaker 131 and the lighting device 133 may be the speaker 131 and the lighting device 133 that are basically installed in a vehicle.

3 is a flowchart illustrating an operating method of a driving careless monitoring system according to an embodiment of the present invention. Hereinafter, an operating method of the driving careless monitoring system according to the present invention will be described with reference to FIGS. 1 to 3 .

First, the control device 110 recognizes the driver's face using the face recognition device 121, and determines at least one of eye movement, eye closing duration, blinking frequency, mouth shape, and a change in the position of the face ( 502). Also, the control device 110 senses a state inside the vehicle ( S504 ). For example, the control device 110 determines whether the amount of carbon dioxide inside the vehicle sensed through the carbon dioxide sensing device 122 exceeds a preset amount, and determines whether the amount of carbon dioxide inside the vehicle sensed through the temperature sensing device 123 is It is determined whether the temperature exceeds a preset value.

Next, the control device 110 may determine whether the driver is negligent in driving through a conversation with the driver.

For example, it is determined that the driver is driving carelessly by at least one of changes in eye movement, eye closing duration, blinking frequency, mouth shape, and position of the face recognized by the face recognition device 121, or Alternatively, it is determined that the amount of carbon dioxide inside the vehicle sensed by the carbon dioxide sensing device 122 exceeds a preset amount, so that the driver is likely to drive carelessly, or the temperature inside the vehicle sensed by the temperature sensing device 123 . When it is determined that there is a possibility that the driver may drive carelessly by exceeding a preset value, or every preset or random period, the control device 110 requests a request for driver attention and a response thereto. After outputting the first request message through the speaker 131 , it is determined whether or not a first response voice to the request message has been received through the voice recognition device 124 ( 510 ).

Next, as a result of the determination, if the driver's first response voice is received, the control device 110 outputs a first final request message to continue safe driving through the speaker 131 .

Next, as a result of the determination, if the driver's first answer voice is not received, the control device 110 outputs the second request message through the speaker 131 and determines whether the second answer voice to the second request message is received. decide whether

Next, as a result of the determination, if the driver's second answering voice is not received, the control device outputs the third request message and then determines whether a third answer voice to the third request message is received.

Next, as a result of the determination, if the third answer voice is not received even for the third request message, the control device drives the sound reproducing device 132 to generate at least one warning message among warning sound, music, and warning sound to generate the speaker 131 . ) through (512).

That is, since the driver may not recognize the first and second request messages due to various reasons, the controller 110 may output up to the third request message.

However, the fact that the third response voice is not received even for the third request message means that the driver is drowsy or inattentive. Accordingly, when the third answer voice is not received even for the third request message, the control device 110 generates a warning message and outputs it through the speaker 131 ( 512 ).

Accordingly, the driver may wake up from drowsiness or escape from a careless situation and perform safe driving.

When a second response message is received from the driver or a third response message is received, the control device 110 may output a second final request message or a third final request message to continue safe driving through the speaker 131 . .

The control device 110 may execute the following functions at any time when a request message is generated or when a user's voice request is separately received through the voice recognition device 124 . For example, the control device 110 may include information on a rest area or a drowsiness shelter, information on frequent occurrence patterns of driving negligence, information on predicting negligence that may occur in the future, and the current negligence situation of the driver identified through the facial recognition device. Outputs at least one of information on the vehicle status, information on the state of the vehicle detected through the carbon dioxide sensing device 122 and the temperature sensing device 123 through the speaker 131, or illuminates the interior of the vehicle through the lighting device 133 The color may be changed, or the perfume may be sprayed through the perfume spraying device 134 ( 514 ).

Information on rest stops or drowsiness shelters, frequent driving carelessness occurrence pattern information, and future carelessness prediction information are collected from the server through the communication device 140, or a collection device 125 and an analysis device (without communication connection) ( After being generated by itself through 136 , the control device 110 may output it through the speaker 131 . The analysis device 136 or the control device 110 may predict in advance according to a pattern when any environmental and driving negligence behavior is detected. In addition, the collection device may collect information about a rest area or a resting place for drowsiness.

That is, the control device 110 may allow the driver to drive safely by providing various types of information on dangerous situations caused by negligence in driving to the driver.

Next, when a stop request is received from the driver after the warning message is output through the speaker 131 , the control device 110 may stop the output of the warning message.

Finally, after the output of the warning message is stopped according to the interruption request, the control device collects information about a rest area or shelter for drowsiness, information on frequent occurrence patterns of driving negligence, information on predicting possible negligence in the future, and a facial recognition device. At least one of information about the driver's current careless situation identified through the The color of the interior of the vehicle may be changed through the lighting device 133 , or the air freshener may be sprayed through the perfume injection device 134 .

That is, the control device 110 provides the driver with various information (information broadcasts) and other follow-up measures (changing the lighting color, spraying air freshener, etc.) about a dangerous situation caused by careless driving, so that the driver can drive safely. can do.

The features of the present invention as described above are briefly summarized as follows.

First, the present invention monitors specific organs (eyes, mouth, face position, etc.) of the driver's face in real time, and collects and analyzes environmental information (temperature, carbon dioxide concentration, etc.) inside the vehicle to detect current driving carelessness. Of course, it is possible to predict future inattention based on the analysis of past inattention patterns.

The present invention can detect the driver's careless state using the face recognition device 121, and use the carbon dioxide sensing device 122 and the temperature sensing device 123 to measure the state of the vehicle interior, that is, the carbon dioxide concentration and temperature. can detect

In particular, according to the present invention, a face image of a driver can be collected in real time regardless of day/night and illumination through the face recognition device 121 using an infrared camera.

For example, according to the present invention, it is possible to determine whether the driver is looking forward by monitoring the position of the driver's pupils. In addition, according to the present invention, sleepiness can be determined by calculating the eye closing duration and blinking frequency. In addition, the present invention may determine whether the driver is sleepy by calculating the duration of a specific mouth shape of the driver. For example, since a specific mouth shape may be maintained when the driver is dozing, the present invention may determine whether the driver is dozing by using the driver's specific mouth shape. In addition, according to the present invention, it is also possible to determine whether or not sleepiness is obtained by calculating the change in the position of the face (head), the frequency of nodding, and the duration of closing the eyes. In addition, the present invention can determine whether an inappropriate environment that causes drowsiness continues by checking the temperature and carbon dioxide (CO _{2 ) concentration inside the vehicle in real time.} As such, according to the present invention, the result of carelessness determined through the driver's condition and environmental inspection may be provided through the speaker 131 in real time.

Next, the present invention can provide the following functions in addition to this. For example, the present invention provides a warning voice message output function, a voice question and answer function for real-time driving carelessness, a function to guide nearby rest stops and drowsiness shelters through the collection device 125, and frequent driving through the analysis device 136. It is possible to perform a function of guiding inattentive occurrence pattern information and inattention prediction information that may occur in the future, and change the color of the vehicle interior lighting through the lighting device 133 and spray the perfume through the perfume injection device 134 automatically or at the driver’s request. can be run at any time.

In particular, the present invention may provide a warning message or various types of information about a dangerous situation caused by negligence in driving through a conversation between the control device 110 and the driver.

Next, the present invention may determine whether the driver is careless through a conversation with the driver. The driver may call the control device 110 by voice at any time and may perform the following conversation.

The control device may transmit environmental information (temperature, carbon dioxide concentration, etc.) inside the vehicle to the driver through voice.

The driver may change user setting information related to all service operations provided by the device through the voice recognition device 124 , and may select and implement only the driving careless prevention measures desired by the user.

The control device may transmit a record of occurrence of the user's negligence in driving that has occurred in the past to the user by voice.

At least one of the control device 110 and the analysis device 136 analyzes frequent occurrence pattern information of inattention and analysis (time data of the time when the carelessness mainly occurs and the elapsed driving time, the environment and the driver until the inattention occurs) Behavior change analysis) can provide the driver with all of the predictive information about future driving carelessness obtained by voice.

The driver can change the color of the lighting device mounted inside the vehicle through the voice recognition device 124 at any time, and can spray the air freshener.

Finally, the control device may generate and output at least one warning message of a warning sound, music, and warning sound through the speaker 131 in order to prevent careless driving, It can guide the location and distance of nearby rest stops and resting places for drowsiness.

Millions of automobile accidents occur every year on the road, and among them, drowsy driving is 23 times more likely to occur, and there are statistics that it is more than twice as fatal. In particular, according to statistics and surveys, 4 out of 10 drivers experience drowsy driving. Therefore, the present invention can provide an effective solution for overcoming drowsiness and forward inattention while driving. That is, according to the present invention as described above, various types of automobile accidents can be prevented in advance.

In particular, the present invention can predict not only the driving carelessness that has already occurred, but also predict the future carelessness, and when the carelessness is detected, it is possible to help the driver overcome the carelessness by executing the follow-up measures as described above. In addition, the present invention may support a voice conversation between the driver and the controller 110 for real-time requests and responses of the driver. Accordingly, the driver can concentrate more only on driving. In conclusion, the present invention can greatly reduce the probability of an accident occurring due to careless driving.

The driving careless monitoring system according to the present invention may further include the following features in addition to the features described above.

First, the controller may control the speaker so that the second request message is greater than the first request message and the third request message is greater than the second request message.

In this case, the control device determines whether the size of the first answer voice is smaller than the preset first answer voice, the second answer voice is smaller than the preset second answer voice, or the third answer voice If is smaller than the preset volume of the third answer voice, a re-answer message requesting an answer with a louder voice may be output through the speaker 131 .

For example, even a driver who is drowsy driving may recognize the first request message and generate a first response voice. However, the voice of the driver who was driving while drowsy is highly likely to be smaller than the preset first warning message. Therefore, even if the first answer voice is received, if the volume of the first answer voice is smaller than the preset volume of the first answer voice, the control device sends a re-answer message requesting an answer with a louder voice to the speaker 131 . can be output through

The driver who confirms the reply message can generate a louder primary reply voice with a louder voice. Accordingly, the sleeping driver can wake up and drive safely.

Even when the volume of the second answer voice is smaller than the preset second answer voice or the third answer voice is smaller than the preset third answer voice, the above methods may be applied.

Second, if the size of the first answer voice is smaller than the preset first answer voice, the control device outputs the first final request message larger than the preset first final request message size, and the second answer voice size If is smaller than the preset second answer voice, output a second final request message that is larger than the preset second final request message, and the third answer voice is smaller than the preset third answer voice. , a third final request message larger than the preset third final request message may be output.

For example, even a driver who is drowsy driving may recognize the first request message and generate a first response voice. However, the voice of the driver who was driving while drowsy is highly likely to be smaller than the preset first warning message. Therefore, even if the first answer voice is received, the control device outputs the first final request message in a louder voice if the volume of the first answer voice is smaller than the preset first answer voice level, so that the driver is assuredly safe can make you drive.

That is, if the driver suddenly hears a very large first warning message while driving in a state where he is not drowsy, he may be surprised, and accordingly, an accident may occur. Therefore, the control device outputs the first request message and the first final request message in a small size so that the driver is not surprised, and if the volume of the first answer voice is smaller than the preset first answer voice, the driver slightly It is determined that the user is asleep, and the first final request message having a size larger than the first final request message having a preset size may be output.

Even when the volume of the second answer voice is smaller than the preset second answer voice or the third answer voice is smaller than the preset third answer voice, the above methods may be applied.

Third, the driving careless monitoring system according to the present invention may further include a lamp 126 for outputting at least two colors.

When outputting each of the first request message, the second request message and the third request message, the control device outputs any one color through the lamp, and each of the first request message, the second request message and the third request message has A message may be included asking what color is output through lamp 126 (508).

In this case, if there is no answer related to the color of the lamp in each of the 1st answer voice, the 2nd answer voice, and the 3rd answer voice, or contains an answer for a color different from the color output through the lamp, the control unit sends the 1st answer It may be determined that each of the voice, the second answer voice, and the third answer voice is not received.

For example, the lamp 126 is a case 190 mounted on the dashboard 200 in front of the driver's seat as shown in FIG. 2 so that the driver who is driving normally can recognize it without special attention. can be embedded in

Therefore, a driver who is driving safely can easily recognize the color output through the lamp 126 when each of the first request message, the second request message, and the third request message is output. Accordingly, answers related to the color of the lamp may be included in each of the first answer voice, the second answer voice, and the third answer voice.

However, if the driver is in a state of negligence due to drowsiness, etc., the color output through the lamp 126 may not be easily recognized when each of the first request message, the second request message, and the third request message is output. , the first answer voice, the second answer voice, and the third answer voice may not include an answer related to the color of the lamp. Therefore, if there is no answer related to the color of the lamp in each of the 1st answer voice, the 2nd answer voice, and the 3rd answer voice, or contains an answer for a color different from the color output through the lamp, the control unit will display the 1st answer voice , it may be determined that each of the second answer voice and the third answer voice is not received.

Accordingly, at least one of the second request message, the third request message, and the warning message may be further output.

Fourth, the driving careless monitoring system according to the present invention may further include an input device 127 for receiving information from the driver and a phone call device 128 for making a phone call.

After the output of the warning message is stopped, the control device may output a call message through the speaker 131 to perform a preset phone call with the family or to transmit a message about the driver's careless driving state to the family.

In this case, if a call message is output and a request to stop the phone call is received from the input device or the voice recognition device before a preset period elapses, the control device may stop the phone call. In addition, when the call message is output and a preset period elapses, the control device may drive the phone call device 128 to make a phone call with the family ( 516 ).

If you are a negligent driver, it is very likely that you do not want to tell your family that you are negligent. Therefore, the driver who confirms the call message will immediately get out of the driving careless state and then generate a request to stop the phone call. Accordingly, the driver can safely drive from the state of careless driving.

Drivers in a state of negligence in driving can make a phone call with their family to wake up, instead of requesting to stop the phone call, and communicate information about their condition to the family through the phone call with the family. can be broken from

Accordingly, the driver may get out of the driving careless state and drive safely.

Among the above explanations, information on rest stops or shelters for drowsiness, information on frequent occurrence patterns of negligence in driving, and information on future occurrences Possible careless prediction information, information about the driver's current careless situation detected through the face recognition device, or information about the state of the vehicle detected through the carbon dioxide sensing device 122 and the temperature sensing device 123 is a communication device. After being received from the service server 300 through 140 or generated by itself through the collection device 125 and the analysis device 136 without a communication connection , the control device 110 outputs through the speaker 131. can

In addition, after the output of the warning message is stopped according to the interruption request, the control device uses information about resting places or drowsiness shelters, information about frequent occurrence patterns of driving carelessness, predictive information that may occur in the future, and a facial recognition device. At least one (referred to as announcement) of information on the current careless situation of the driver or information on the state of the vehicle identified through the carbon dioxide sensing device 122 and the temperature sensing device 123 is transmitted to the speaker 131 can be output through Also, all guide information may be stored in a storage device or a service server.

Those skilled in the art to which the present invention pertains will understand that the present invention may be embodied in other specific forms without changing the technical spirit or essential characteristics thereof. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: driving careless monitoring system 200: dashboard
300: service server

Claims (2)

a facial recognition device 121 for detecting changes in the driver's eye movement, the driver's eye closing duration, the driver's blink frequency, the driver's mouth shape, and the position of the driver's face;
a carbon dioxide sensing device 122 for sensing the concentration of carbon dioxide;
a temperature sensing device 123 for sensing the temperature inside the vehicle;
a voice recognition device 124 for recognizing the driver's voice;
a speaker 131 for outputting at least one of a warning sound, music, and a warning sound;
a sound reproducing device 132 for generating at least one of a warning sound, music, and a warning sound;
a lighting device 133 mounted inside a vehicle to generate lighting;
A perfume spraying device 134 for spraying a perfume;
a collection device 125 for collecting the location and distance of a nearby rest stop or drowsiness shelter;
an analysis device 136 for analyzing the driver's driving careless occurrence pattern;
a lamp 126 for outputting at least two colors;
an input device 127 for receiving information from the driver;
a phone call device 128 for making a phone call; and
Face recognition device 121, carbon dioxide sensing device 122, temperature sensing device 123, voice recognition device 124, speaker 131, sound reproducing device 132, lighting device 133, perfume injection device ( 134), a collection device 125, an analysis device 136, a lamp 126, an input device 127, and a control device 110 for controlling the operation of the phone call device 128,
It is determined that the driver is driving carelessly by at least one of a change in the pupil movement, the driver's eye closing duration, the blinking frequency, the mouth shape, and the position of the face recognized by the facial recognition device 121, or carbon dioxide It is determined that the amount of carbon dioxide inside the vehicle sensed by the sensing device 122 exceeds a preset amount, so that the driver may drive carelessly, or the temperature inside the vehicle sensed through the temperature sensing device 123 is When it is determined that there is a possibility that the driver will drive carelessly by exceeding the set value, or every preset period, or every random period,
After outputting the first request message for requesting the driver's attention and requesting an answer thereto through the speaker 131 , the control device determines whether the first answer voice to the request message is received through the voice recognition device 124 . to decide whether
As a result of the determination, if the driver's first response voice is received, the control device outputs the first final request message to continue safe driving through the speaker 131,
As a result of the determination, if the driver's first answer voice is not received, the control device outputs a second request message through the speaker 131 and then determines whether a second answer voice to the second request message is received, As a result of the determination, if the driver's second answer voice is not received, the control device outputs the third request message and then determines whether the third answer voice to the third request message is received,
If the 3rd answer voice is not received even for the 3rd request message, the control device generates at least one warning message among warning sound, music, and warning sound by driving the sound reproducing device 132 and outputs it through the speaker 131, ,
When a stop request is received from the driver after the warning message is output through the speaker 131, the control device stops the output of the warning message,
The control device controls the speaker so that the second request message is larger than the first request message and the third request message is larger than the second request message,
The control device determines that the size of the first answer voice is smaller than the preset first answer voice, the second answer voice is smaller than the preset second answer voice, or the third answer voice is preset. If it is smaller than the volume of the third answer voice, a re-answer message requesting an answer with a louder voice is output through the speaker 131,
When the control device outputs each of the first request message, the second request message, and the third request message, it outputs any one color through the lamp 126,
Each of the first request message, the second request message, and the third request message includes a message asking what color is output through the lamp 126,
If there is no answer related to the color of the lamp in each of the 1st answer voice, the 2nd answer voice, and the 3rd answer voice, or contains an answer for a color different from the color output through the lamp, the control unit sends the 1st answer voice, 2 It is determined that each of the second answer voice and the third answer voice has not been received,
After the output of the warning message is stopped, the control device outputs a call message to perform a phone call with a preset family through the speaker 131,
When a call message is output and a call stop request is received from an input device or a voice recognition device before a preset period elapses, the control device stops the phone call,
When a call message is output and a preset period elapses, the control device drives the phone call device 128 to make a phone call with the family. The method of claim 1,
After the output of the warning message is stopped according to the interruption request, the control device,
Information on rest areas or drowsiness shelters, frequent driver carelessness occurrence pattern information and future carelessness prediction information, information on the driver's current careless situation identified through a face recognition device, and a carbon dioxide sensing device (122) and at least one of information on the state of the vehicle detected through the temperature sensing device 123 is outputted through the speaker 131 , and the color of the interior lighting of the vehicle is changed through the lighting device 133 or air freshener is sprayed A careless driving monitoring system that dispenses air freshener through device 134 .

Images