KR20170007001A - Safety driving control method using the eye-recognition function of the terminal, apparatus and a recording medium - Google Patents

Abstract

The present invention relates to a method, an apparatus, and a recording medium for controlling safe driving based on pupil recognition by using a terminal. The safe driving method based on pupil recognition according to an embodiment of the present invention comprises: a step of determining, by a terminal, whether a vehicle is being driven; a step of measuring, by the terminal, a terminal gaze state of a user when it is determined that the vehicle is being driven; a step of determining whether satisfying a terminal use condition on the basis of the measurement result of the terminal gaze state; and a step of transmitting, by the terminal, a warning signal to the vehicle when satisfying the terminal use condition. According to the safe driving method based on pupil recognition according to the present invention, it is possible to induce a driver to concentrate on driving, finally, safe driving is performed, and it is possible to prevent a traffic accident.

Description

Technical Field [0001] The present invention relates to a safety driving control method, an apparatus, and a recording medium using a pupil recognition function of a terminal,

The present invention relates to a safe driving control method, an apparatus, and a recording medium using a terminal, and more particularly, to a safety driving control method using a terminal's pupil recognition function, which automatically activates a warning function and a function necessary for safe driving.

More particularly, the present invention relates to a method and apparatus for detecting a driver's use of an actual terminal by using Eye-Tracking (Eye-Detection) technology, A control method, an apparatus, and a recording medium.

Recently, traffic accidents that occur when a driver uses a portable device such as a smart phone are increasing each year. As the driver tries to use the device while driving, the gaze toward the front of the vehicle is diverted to the device, and as the frequency increases, the response to the forward situation is delayed.

On the contrary, a technology for providing a warning about a front-eye deviation by utilizing an eye-tracking (Eye-Detection) device or a wearable device in a vehicle is being considered.

In detail, eye tracking (Eye Detecting, Eye-recognition) using a camera in a vehicle or a wearable device is carried out, and the visual direction recognized as the pupil recognition result is compared with the traveling direction, If the inconsistency and frequency are high, it is a technique to induce the driver to concentrate on the driving by providing warning to the driver about dispersion of the warning through warning sound or warning vibration.

In other words, when it is determined that the line of sight required for driving is dispersed in comparison with the driving direction, a warning for safe driving is provided.

However, in this case, when a device is used in the driving direction, for example, a portable device such as a smart phone is placed on a steering wheel, it is difficult to recognize that the device is out of sight. In comparing the gaze direction and the traveling direction, There is a limitation in providing only a passive method such as a simple warning sound or a warning vibration to the user.

In order to solve this problem, it is necessary to judge whether the driver uses the actual terminal while driving by utilizing the Eye Tracker (Eye Detection) It is necessary to provide an active defense method for activating functions necessary for safety driving of the vehicle as well as a passive defense method of warning sound or warning vibration occurrence when judged to be used.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems of the conventional art, and it is an object of the present invention to provide an apparatus and method for an eye- And provides a warning and further a safety driving control method using a pupil recognition function of the terminal which automatically recognizes a function required for safe driving (such as forward detection) by considering the deviation as an out-of-sight in this case.

It is still another object of the present invention to provide a computer-executable recording medium on which an application for supporting a safe driving control method using the pupil recognition function of the terminal is recorded.

Another object of the present invention is to provide a vehicle and a terminal as a safe operation control device based on pupil recognition.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

A safe driving control method, apparatus and recording medium using the pupil recognition function of the terminal are provided.

According to an aspect of the present invention, there is provided a method for operating a pupil recognition based safety operation, the method comprising: determining whether the terminal is in a driving state; Measuring a state of watching the user's terminal when the terminal is determined to be in a running state of the vehicle; Determining whether the terminal use condition is satisfied based on a result of measuring a state of watching of the terminal; And transmitting a warning signal to the vehicle when the terminal satisfies the terminal use condition.

According to the embodiment, the vehicle running state may be determined using at least one of the running speed, the running direction information, the gear state information, and the navigation availability.

According to an embodiment, the terminal watching state may be a terminal viewing time and a viewing frequency of a user.

According to an exemplary embodiment, the step of the terminal measuring the user's terminal watching state may include the step of activating the terminal's eye sensing module.

According to an exemplary embodiment, whether the terminal use condition is satisfied based on the terminal watching state measurement result may be determined based on whether the terminal watching state exceeds the threshold time or the threshold frequency.

According to an embodiment, the vehicle receiving the warning signal may be passively or actively defending the vehicle.

According to an embodiment, the passive defense may generate a beep or warning vibration.

According to an embodiment, the active defense can be automatically switched to the safe running mode.

According to an embodiment, the beep or warning vibration may have a magnitude of the sound and a magnitude of the vibration corresponding to the degree to which the gaze time or gaze frequency exceeds the threshold time or the critical frequency.

According to an embodiment, the beep or warning vibration may be activated in the vehicle steering wheel or in the vehicle chair.

According to an embodiment, the safe driving mode may be an ADAS (Advanced Driver Assistance System) mode, and the ADAS may activate an Adaptive Cruise Control (ACC) module or an HDA (Highway Driving Assist) module.

According to an embodiment, the terminal may be any one of a smart phone, a tablet PC, a PDA, and other mobile communication terminals.

According to an embodiment of the present invention, there is further provided a method of wireless communication between a terminal and a vehicle, the method comprising the steps of: wired or wirelessly connecting communication between the terminal and the vehicle, It is possible to use either USB or Mobile High-Definition Link (MHL).

Also, the terminal according to an embodiment of the present invention may include a terminal interface unit for connecting communication with a vehicle; A terminal communication unit for transmitting and receiving signals with the vehicle after being connected to the vehicle by the terminal interface; A driving state determination unit for determining whether the vehicle is in a running state using information received from the vehicle through the terminal communication unit; A watching state measuring unit for measuring a state of watching the user's terminal when the driving state determining unit determines that the vehicle is in a running state; And a use determination unit for determining, based on the measurement result of the terminal watching state, whether the terminal usage condition of the user is satisfied or not; And the terminal communication unit may transmit a warning signal to the vehicle when the terminal use condition is satisfied.

According to an embodiment, the terminal communication unit may further include a terminal defense control module that generates a warning sound or an alert vibration at the terminal while transmitting the warning signal to the vehicle.

According to the embodiment, the driving state determination unit may determine at least one of the traveling speed, the traveling direction information, the gear state information, and the navigation use from the vehicle using the utilization.

According to an embodiment, the terminal watching state may be a terminal start time of a user, an ending time of a terminal, a time of a terminal, and a frequency of a terminal.

According to an embodiment, the watching state measuring unit may activate the eye recognition module (EYE DETECTION MODULE) of the terminal.

According to the embodiment, the use determination unit may determine based on whether the terminal watching state exceeds the threshold time or the threshold frequency.

According to an embodiment, the terminal may be any one of a smart phone, a tablet PC, a PDA, and other mobile communication terminals.

According to an embodiment, the terminal interface unit may be connected by wire or wireless, and may be any of WIFI (Wireless Fidelity) or BlueTooth when connected by wireless communication. In case of being connected by wire communication, Or a Mobile High-Definition Link (MHL).

According to an embodiment, the beep or warning vibration may have a magnitude of a sound and an intensity of a vibration corresponding to a degree that a gaze time exceeds a threshold time or a gaze frequency exceeds a threshold frequency.

According to another aspect of the present invention, there is provided a vehicle including: a vehicle interface unit for connecting a communication with a terminal; A vehicle communication unit for transmitting and receiving signals to and from the terminal after being connected to the terminal by the vehicle interface; A use determination unit for receiving the driving state information of the vehicle and the watching state information of the terminal from the terminal through the vehicle communication unit and determining whether the condition of use of the terminal is satisfied based on the received information; A vehicle defense control module for passively or actively defending if the terminal use condition is satisfied; . ≪ / RTI >

According to the embodiment, the traveling state information may be measured using at least one of traveling speed, traveling direction information, gear state information, and navigation use.

According to the embodiment, in measuring the watch state information of the terminal, the user can measure the start time of the terminal, the end time of the terminal, the time of the terminal, and the frequency of the terminal.

According to an embodiment of the present invention, the terminal may activate the eye recognition module (EYE DETECTION MODULE) in measuring the user terminal's state of watching information.

According to an exemplary embodiment of the present invention, when determining whether the terminal satisfies the terminal use condition based on the result of the measurement of the condition of the watch, the terminal may determine whether the terminal watch state exceeds the threshold time or the threshold frequency.

According to an embodiment, the passive defense may generate a beep or warning vibration.

According to an embodiment, the active defense can be automatically switched to the safe running mode.

According to an embodiment, the beep or warning vibration may have a magnitude of a sound and an intensity of a vibration corresponding to a degree that a gaze time exceeds a threshold time or a gaze frequency exceeds a threshold frequency.

According to an embodiment, the beep or warning vibration may be activated in the vehicle steering wheel or in the vehicle chair.

According to an embodiment, the safe driving mode may be an ADAS (Advanced Driver Assistance System) mode, and the ADAS may activate an Adaptive Cruise Control (ACC) module or an HDA (Highway Driving Assist) module.

According to an embodiment, the terminal may be any one of a smart phone, a tablet PC, a PDA, and other mobile communication terminals.

According to the embodiment, the vehicle interface unit may be connected by wire or wireless, and may be either Wireless Fidelity (WIFI) or BlueTooth when connected by wireless communication. When connected by wire communication, Or a Mobile High-Definition Link (MHL).

Further, an embodiment of the present invention may be a computer-readable recording medium on which an application for executing the safe driving control method is recorded.

The safety operation control method, apparatus, and recording medium based on pupil recognition using the terminal according to the present invention will now be described.

First, the present invention eliminates the need for mounting an additional in-vehicle sensor by using an eye detection sensor of a terminal, and therefore, there is no overhead in terms of cost.

Second, it is difficult to recognize whether the terminal is used in the existing method when the terminal is stared on the same direction as the driving direction, but it is possible to overcome the limit by judging whether the terminal is actually used or not.

Third, it has the effect of supporting active safety driving by automatically activating the safety device in the vehicle beyond the warning given to the driver.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. It is to be understood, however, that the technical features of the present invention are not limited to the specific drawings, and the features disclosed in the drawings may be combined with each other to constitute a new embodiment.
1 is a block diagram of a safety operation control system based on pupil recognition.
2 is a flowchart for explaining a safe driving control method based on pupil recognition using a terminal according to an embodiment of the present invention.
FIG. 3 is a flowchart for explaining FIG. 2 in more detail.
4 is a block diagram of a safe driving control apparatus based on pupil recognition using a terminal according to an embodiment of the present invention.
5 is a configuration diagram of a safe driving control device based on pupil recognition using a terminal according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an apparatus and various methods to which embodiments of the present invention are applied will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is a block diagram of a safety operation control system based on pupil recognition.

The safe driving control method using the pupil recognition function of the terminal 100 utilizes the pupil recognition function installed in the terminal 100 itself.

For example, in order to realize the pupil recognition function, an image processing process is used. When a facial image transmitted from a camera is received as a digital image, a normal microprocessor, a digital signal processor, The face and eye positions are detected and represented by numerical data. Then, an edge signal is detected from a two-dimensional digital image or pixels sampled at a low resolution with respect to the edge image, and edge signals generated in the edge of the edge image are applied to a predetermined geometric relationship And then detects the eye position using the polarity of the edge signal in the horizontal direction through an appropriate process.

In this way, the face position is detected in the edge image using the T-type search region. When the T-type search region is located at the position of the face to be detected as a T-shaped search region, , The nose, the authentication, and the lip. A region where the total amount of edge signals becomes maximum in the T-shaped search region satisfying these conditions is detected as a face position.

On the other hand, the eye detects the eye position based on the detected face position, positions the T-shaped search region at the detected face position, and detects the eye position using the polarity of the edge signal in the horizontal direction in the T-shaped search region. In the T-shaped search region, edge signals having a positive polarity are detected in the form of a horizontal line, which indicates the upper eyelid line region. The upper eyelid line region can be simply detected as the eye position. When the eye is detected as described above, the pupils included in the eye are tracked. Usually, the direction of motion is estimated by checking the difference between the past image and the current image. In the image processing algorithm used, the block matching algorithm (BMA: Block Matching Algorithm) is mainly used as a motion estimation method.

As another example, the user senses an infrared signal emitted from a terminal with two eyes, detects an image of light reflected from two eyes through a camera lens of the terminal, and uses eye-related information according to an electric signal corresponding to the image of light Thereby realizing the pupil recognition function.

As another example, the pupil recognition function can be implemented by acquiring the face image of the user, extracting the user's eye tail position from the face image, and calculating the motion of the face.

Other techniques for recognizing the pupil by using the image processing technique of the terminal 100 are also various, and the present invention using the pupil recognition function is not limited thereto.

The present invention uses the pupil recognition function of the terminal 100 without installing a camera or other equipment in addition to the vehicle 200. [

The information obtained from the pupil recognition function is used to determine whether or not the driver's gaze deviates. When it is determined that the driver uses the terminal 100, it is regarded that the gaze is deviated and the warning signal is transmitted to the vehicle 200, Safe operation can be controlled.

The vehicle 200 receiving the warning signal from the terminal 100 can induce the safe driving by giving an alarm to the driver as a passive defense or automatically performing a safe driving mode as an active defense.

FIG. 2 is a flowchart for explaining a safe driving control method based on pupil recognition using the terminal 100 according to an embodiment of the present invention.

The driver can ride the vehicle 200 and the portable device of the driver, that is, the terminal 100, can establish a wireless or wired communication with the vehicle 200 (S101).

The terminal 100 connected wirelessly or wiredly determines whether the vehicle 200 is running. If it is determined that the vehicle 200 is running, if the eyes of the driver, that is, the eyes of the driver, are directed to the terminal 100 by activating the pupil recognition module, (S102).

The terminal 100 or the vehicle 200 determines whether or not the driver has used the terminal 100 in a case where the gaze time is longer than the threshold time or the gaze frequency exceeds the threshold frequency (S103).

When it is determined that the driver is using the terminal 100 during driving, the vehicle 200 generates a warning sound and / or warning vibration by a passive defense mechanism to warn the driver of safe driving (S105).

The vehicle 200 performs an active defense mechanism together with a passive defense mechanism, specifically, a safe driving mode, and the safe driving mode may be an ADAS (Advanced Driver Assistance System) mode.

ADAS (Advanced Driver Assistance System) is a state-of-the-art driver assistance system that helps drivers to operate.

ADAS is equipped with an ACC (Adaptive Cruise Control) module that uses a radar mounted on the front of the vehicle to automatically maintain proper spacing between the front cars, a Highway Driving Assist (HDA) module, which is a highway driving support system, Emergency Braking Module for Emergency Braking, Pedestrian Detection Module for Preventing Pedestrian Collision, Collision Avoidance Module for Collision Prevention, Traffic Sign Recognition Module for Traffic Signage Recognition, Cross Traffic Alert Module for Side Rear Access Vehicle Warning, The Blind Spot Detection module provides information about the car being located, the Rear Collision Warning module to prevent rear collision, the Surround View module for blind spots in all fields except front and rear, A Lane Departure Warning module to alert the driver, and a Park Assist module to assist the driver. It can hamhal. However, ADAS is not limited to these modules.

FIG. 3 is a flowchart for explaining FIG. 2 in more detail.

When the driver boarded the vehicle 200, the terminal 100 of the driver connects the vehicle 200 with the wired or wireless communication (S201).

When connected by wireless communication, a wireless fidelity (WIFI) or a Bluetooth communication method may be used, but the scope of the present invention is not limited thereto.

In addition, when connected by wire communication, USB or MHL (Mobile High-Definition Link) communication method can be used, but the scope of the present invention is not limited thereto.

The terminal 100 receives information on the traveling speed, the traveling direction information, the gear status information, and the navigation availability from the vehicle 200 and uses at least one of the information to determine whether or not the vehicle 200 is in the traveling state (S202). This is because there is no need to perform a control method for safe operation when the vehicle 200 is not traveling.

For example, when the vehicle 200 is an automatic transmission gear, it may be determined that the vehicle is in the running state, unless the gear state is at the P-end, or if the running speed is 0 km / h If not, it can be judged as driving.

For example, when the traveling speed of the vehicle 200 is greater than 0 km / h, the terminal will determine that the vehicle is in a running state. It is necessary to consider information on whether or not navigation is used, that is, information on driving direction information and whether or not to use the navigation, rather than determining whether the vehicle 200 is running only by the traveling speed information, have. For example, when the driver sets the traveling route using the navigation system, recognizes the stop signal while the vehicle travels at a speed of 40 km / h, stops the vehicle, and the traveling speed is 0 km / h, The terminal 100 determines whether the user is looking through the terminal 100. If the terminal 200 determines that the vehicle 200 is running using the information received from the vehicle 200, . At this time, the eye recognition module (EYE DETECTION MODULE) is activated to detect the pupil of the terminal 100, and the time or the frequency with which the driver gazes at the terminal 100 using the pupil recognition module of the terminal 100 is measured (S203).

The examination time is a time from the start of recognition of the user's pupil to the end of recognition of the pupil, and the frequency of the recognition is the number of times the terminal 100 recognizes the user's pupil for a preset time.

The terminal 100 determines whether the measured time of the test exceeds the preset threshold time or whether the frequency of the test exceeds the predetermined threshold frequency (S204).

The critical time and critical frequency can be set differently according to the traveling speed information using the traveling speed information of the vehicle 200 received from the vehicle 200. When the traveling speed of the vehicle 200 is high, The threshold time can be set to be shorter than the case.

In addition, as the running speed increases, the threshold time is set shorter so that the driver can be assured of a faster time to respond to the emergency situation. The threshold frequency can likewise be set differently according to the traveling speed information.

If the gazing time exceeds the preset threshold time or the gazing frequency exceeds the threshold frequency [YES path of S204], the warning signal is transmitted to the vehicle 200 [S205], and if not exceeding [NO path of S204 ], And starts monitoring again whether or not the driver stare at the terminal 100.

The vehicle 200 receiving the warning signal performs a function for preventing a traffic accident by securing a time for the driver to respond to an emergency situation by performing an alarm to the driver as a passive defense or performing a safety driving mode automatically as an active defense [S206].

For example, as a passive defense, an alarm can be stimulated by the driver's five senses. Among the five senses, stimulation of at least one of visual, auditory, and tactile sensations can be used, and a warning sound or warning vibration can be considered as an appropriate warning to the driver.

The warning sound and the warning sound can be activated in the terminal 100 or the vehicle 200 and can alert the driver of the dispersion of the attention, in particular, by generating the warning vibration in the vehicle steering wheel or the vehicle chair.

4 is a block diagram of a safe driving control apparatus based on pupil recognition using a terminal according to an embodiment of the present invention.

4, a terminal 100a for performing a safe operation control method based on pupil recognition includes a terminal interface unit 110, a terminal communication unit 120, a driving state determination unit 130, a viewing state measurement unit 140 A pupil recognition module 150, a use determination unit 160, a terminal defense control module 170, and a terminal control unit 180.

The vehicle 200a connected with the wired or wireless communication may include a vehicle interface unit 210, a vehicle communication unit 220, a vehicle defense control module 230, and a vehicle control unit 240. [

The components shown in FIG. 4 are not essential, and a home gateway device having more or fewer components may be implemented.

Hereinafter, the components will be described in detail.

The terminal interface unit 110 includes an input / output terminal for connecting to the vehicle 200a by wire communication or a wireless adapter for connecting to the vehicle 200a by wireless communication after the driver boarded the vehicle 200a And may include a transceiver for a Bluetooth connection.

The terminal interface unit 110 can be connected by wire or wireless, and when connected by wireless communication, a WIFI (Wireless Fidelity) or BlueTooth communication scheme can be used, but the scope of the present invention is not limited thereto.

In addition, when connected by wire communication, USB or MHL (Mobile High-Definition Link) communication method can be used, but the scope of the present invention is not limited thereto.

The terminal communication unit 120 can send and receive signals required for the safe operation control after the terminal interface unit 110 is connected to the vehicle 200a.

The driving state determination unit 130 may determine that the vehicle is traveling or not by using the navigation state determined by the driving state determination unit 130 based on the traveling speed, the traveling direction information, the gear state information, It is determined whether or not the vehicle 200a is running by using the information. This is because it is not necessary to perform the safe operation control when the driver simply rides without driving the vehicle 200a.

The state monitoring unit 140 activates the pupil recognition module 150 to measure whether or not the driver is watching the terminal 100a. The pupil recognition function performed by the pupil recognition module 150 is the same as described with reference to Fig.

Information on the start time, the watching end time, and the viewing frequency for the driver to watch the terminal 100a from the pupil recognition module 150 is measured by the watching state measuring unit 140. [

The pupil recognition module 150 may perform the pupil recognition function of the terminal 100a illustrated in Figure 1. The use determination unit 160 determines whether the terminal use condition is satisfied based on the terminal watching state measurement result Based on whether the terminal watch state exceeds the threshold time or the threshold frequency.

The reference time is a time from the start of the user's eye recognition to the end of eye recognition, and the frequency of the reference is the number of times the terminal 100a recognizes the user's eyes (e.g., 30 seconds) to be. The threshold time and the threshold frequency can be set in advance.

When the use determining unit 160 determines that the driver is using the terminal 100a, the terminal communication unit 120 transmits a warning signal to the vehicle 200a to allow the vehicle 200a to perform passive or active defense If it is determined that the driver does not use the terminal 100a, the watch state determination unit 140 measures whether or not the driver is watching the terminal.

The terminal defense control module 170 may generate a warning sound or alert vibration of the terminal 100a itself when the warning signal is transmitted to the vehicle 200a. The audible or warning vibration may correspond to a magnitude in which the gaze time is longer than the threshold time or the gaze frequency exceeds the threshold frequency, so that the magnitude of the magnitude and vibration may be greater in the sound.

The terminal control unit 180 typically controls the overall operation of the terminal 100a. And activates the function by transmitting a signal between each module of the terminal 100a. For example, when the terminal 200 is connected to the vehicle 200a by the terminal interface unit 110, the signal is transmitted to the terminal communication unit 120 so that the traveling speed, the traveling direction information, Status information, and whether navigation is available. Also, the driving state determination unit 130 determines whether to activate the viewing state measurement unit 140 according to the determination result of the driving state determination unit 130, and the terminal control unit can also control whether the pupil recognition module 150 operates.

The vehicle interface unit 210 may include a terminal, a port, and an adapter for connecting the terminal 100a with a wired or wireless communication after the driver boarded the vehicle 200a.

The vehicle communication unit 220 can send and receive signals necessary for the safe operation control after the communication with the terminal 100a is established by the vehicle interface unit 210. [

The vehicle defense control module 230 performs a passive or active defense when receiving the warning signal from the terminal 100a. Passive defense is to alert the driver by causing a beep or warning vibration. The beep or warning vibration may have a magnitude of the magnitude of the sound and a magnitude of the vibration corresponding to the degree to which the gaze time or gaze frequency exceeds the threshold time or critical frequency. Beep or warning vibration can be activated in the vehicle steering wheel or in the vehicle chair.

The active defense may be an automatic driver changeover to a safe driving mode, the safe driving mode may be an ADAS (Advanced Driver Assistance System) mode, the ADAS may activate an Adaptive Cruise Control (ACC) module or a Highway Driving Assist .

ADAS (Advanced Driver Assistance System) is a state-of-the-art driver assistance system that helps drivers to operate.

ADAS is equipped with an ACC (Adaptive Cruise Control) module that uses a radar mounted on the front of the vehicle to automatically maintain proper spacing between the front cars, a Highway Driving Assist (HDA) module, which is a highway driving support system, Emergency Braking Module for Emergency Braking, Pedestrian Detection Module for Preventing Pedestrian Collision, Collision Avoidance Module for Collision Prevention, Traffic Sign Recognition Module for Traffic Signage Recognition, Cross Traffic Alert Module for Side Rear Access Vehicle Warning, The Blind Spot Detection module provides information about the car being located, the Rear Collision Warning module to prevent rear collision, the Surround View module for blind spots in all fields except front and rear, A Lane Departure Warning module to alert the driver, and a Park Assist module to assist the driver. It can hamhal. However, ADAS is not limited to these modules.

The vehicle control unit 240 typically controls the overall operation of the vehicle 200a. In general, a head unit of the vehicle 200a may be a vehicle control unit 240 and performs a function of processing an external control signal.

5 is a configuration diagram of a safe driving control device based on pupil recognition using a terminal according to another embodiment of the present invention.

Referring to FIG. 5, the safe operation control apparatus shown in FIG. 5 has substantially the same configuration and functions except for the feature of FIG. 4 and some features. In the embodiment of FIG. 4, the terminal 100a determines whether the user uses the terminal. However, in the embodiment of FIG. 5, the vehicle 200b determines whether the user uses the terminal.

Hereinafter, the distinguishing features from the embodiment of FIG. 4 will be described in detail.

4, the use determination unit 160 of the terminal 100a determines whether the user is using the terminal by using the information measured by the state monitoring unit 140 of the terminal 100a. In FIG. 5, The state measuring unit 140 transmits the measurement information on the terminal starting time, the terminal ending time, and the terminal stationing frequency to the vehicle 200b, and the use determination unit 250 in the vehicle 200b determines whether the information And determines whether the driver uses the terminal 100b by using at least one of them.

Thereafter, when the use determination unit 250 determines that the driver is using the terminal 100b while driving, the process of performing passive or active defense in the vehicle 200b is not different from that of FIG.

The use determination unit 250 in the vehicle 200b as shown in FIG. 5 is advantageous in that, in the case of a smart phone, it is possible to perform data operations for a call by performing an excessive calculation, The power consumption of the terminal can be reduced.

100: terminal
200: vehicle
100a, 100b:
200a, 200b: vehicle
110: terminal interface unit
120:
130:
140:
150: pupil recognition module
160:
170: Terminal defense control module
180:
210: vehicle interface unit
220: vehicle communication section
230: vehicle defensive control module
240:
250: use judgment unit

Claims (27)

Determining whether the terminal is in a vehicle traveling state;
Measuring a state of watching the user's terminal when the terminal is determined to be in a running state of the vehicle;
Determining whether the terminal use condition is satisfied based on a result of measuring a state of watching of the terminal; And
Transmitting a warning signal to the vehicle when the terminal satisfies the use condition;
Based on the pupil recognition method. The method according to claim 1,
Whether or not the vehicle is in the running state
Based on at least one of driving speed, driving direction information, gear state information, and navigation use. The method according to claim 1,
The terminal watching state
A safe driving method based on pupil recognition, which is a user 's terminal time and frequency of gazing. The method according to claim 1,
The step of the terminal measuring the state of the user's terminal
And activating the EYE DETECTING MODULE of the terminal. The method according to claim 1,
Whether or not the terminal use condition is satisfied based on the terminal watching state measurement result
Based on whether the terminal watching state exceeds the threshold time or the threshold frequency
Safe driving based on pupil recognition. The method according to claim 1,
Passively or actively defending a vehicle receiving the warning signal;
The method comprising the steps of: The method according to claim 6,
Wherein said passive defense generates a beep or warning vibration. The method according to claim 6,
Wherein the active defense is automatically switched to a safe driving mode. 8. The method of claim 7,
Wherein the warning or warning vibration is based on a pupil recognition method in which the magnitude of the sound and the magnitude of the vibration are increased corresponding to the degree of the gaze time exceeding the threshold time or the gaze frequency exceeding the threshold frequency. 8. The method of claim 7,
Wherein the beep or warning vibration is activated in a vehicle steering wheel or a vehicle chair. 9. The method of claim 8,
The safe driving mode may be an ADAS (Advanced Driver Assistance System) mode, and the ADAS may be an ACC (Adaptive Cruise Control) module or an HDA (Highway Driving Assist) module. The method according to claim 1,
Wherein the terminal is any one of a smart phone, a tablet PC, a PDA, and other mobile communication terminals. The method according to claim 1,
Further comprising the step of connecting the communication between the terminal and the vehicle by wire or wireless,
When connected by wireless communication, either Wireless Fidelity (WIFI) or BlueTooth may be used,
A method of safe driving based on pupil recognition using any one of USB or MHL (Mobile High-Definition Link) when connected by wire communication. A terminal interface unit for connecting communication with a vehicle;
A terminal communication unit for transmitting and receiving signals with the vehicle after being connected to the vehicle by the terminal interface;
A driving state determination unit for determining whether the vehicle is in a running state using information received from the vehicle through the terminal communication unit;
A watching state measuring unit for measuring a state of watching the user's terminal when the driving state determining unit determines that the vehicle is in a running state; And
A use determination unit for determining whether the user's terminal usage condition is satisfied based on the measurement result of the terminal watching state;
/ RTI >
When the terminal use condition is satisfied, the terminal communication unit transmits an alert signal to the vehicle
Terminal. 15. The method of claim 14,
Wherein the terminal communication unit transmits a warning signal to the vehicle and generates a warning sound or an alert vibration at the terminal. 15. The method of claim 14,
Wherein the driving state determination unit determines the driving state based on at least one of the traveling speed, the traveling direction information, the gear state information, and navigation use from the vehicle. 15. The method of claim 14,
The terminal watching state
The terminal is the terminal's viewing time and frequency. 15. The method of claim 14,
The eye state measuring unit activates an eye detection module of the terminal. 15. The method of claim 14,
Wherein the use determination unit determines based on whether the terminal watching state exceeds a threshold time or a threshold frequency. A vehicle interface unit for connecting a communication with a terminal;
A vehicle communication unit for transmitting and receiving signals to and from the terminal after being connected to the terminal by the vehicle interface;
A use determination unit for receiving the driving state information of the vehicle and the watching state information of the terminal from the terminal through the vehicle communication unit and determining whether the condition of use of the terminal is satisfied based on the received information;
A vehicle defense control module for passively or actively defending if the terminal use condition is satisfied;
≪ / RTI > 21. The method of claim 20,
Wherein the driving state information is measured using at least one of traveling speed, traveling direction information, gear state information, and navigation availability. 22. The method of claim 21,
Wherein the measuring device measures the starting state of the terminal, the ending time of the terminal, the time of the terminal, and the frequency of the terminal in measuring the state of the terminal. 22. The method of claim 21,
Wherein the terminal activates the eye recognition module (EYE DETECTION MODULE) of the user's terminal in measuring the user's terminal watching state information. 22. The method of claim 21,
In determining whether the terminal satisfies the terminal use condition based on the result of the watching condition measurement,
Based on whether the terminal watching state exceeds a threshold time or a threshold frequency. 22. The method of claim 21,
Wherein the passive defense generates a warning sound or an alert vibration. 22. The method of claim 21,
Wherein the active defense automatically switches to the safe running mode. A computer-readable recording medium storing an application for executing the method according to any one of claims 1 to 13.

Images