KR20160112213A - Audio navigation device, vehicle having the same, user device, and method for controlling vehicle - Google Patents

Abstract

The present invention provides a vehicle and a control method of the vehicle. According to an aspect, the vehicle may comprise: an acquisition unit acquiring human body information of a driver; a determination unit determining a human body state of the driver based on the acquired human body information of the driver; and a control unit controlling at least one device within the vehicle based on a predetermined guide in accordance with the determination result.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a control method for a vehicle,

A vehicle, and a control method of the vehicle.

In recent years, advanced driver assistance systems (ADAS) have been introduced in vehicles. The vehicle driving assistance system is a system that assists the driver in driving the vehicle, Warning system, warning of lane departure due to drowsiness, warning of pedestrian collision ahead, etc. In addition, various systems have been introduced to assist drivers in driving the vehicle.

A vehicle according to one side includes an acquiring unit for acquiring body information of a driver; A determining unit for determining a physical condition of the driver based on the acquired physical information of the driver; And a control unit for controlling at least one device in the vehicle based on a preset guide according to the determination result.

The determination unit may be configured to collect body information of the driver to generate average body information of the driver, compare the average body information of the driver with the obtained body information of the driver to determine the body condition of the driver can do.

The determination unit may determine the physical condition of the driver based on at least one of the facial expression of the driver identified by using the camera, the rotation angle of the steering wheel, and the voice of the driver received using the microphone.

The determination unit may determine the driver's pulse rate measured using the infrared sensor mounted on the steering wheel, the blood pressure of the driver measured using the pressure sensor mounted on the steering wheel, The physical condition of the driver can be determined from at least one of the respiration of the driver.

In addition, the determining unit may determine the driver's tension, the electrocardiogram, the blood glucose level of the driver measured using an infrared photocoupler mounted on the steering wheel, and the driver's seat blood pressure measured using an electrode mounted on the steering wheel, The body condition of the driver can be determined from at least one of the body temperature of the driver measured using the temperature sensor mounted on the vehicle.

In addition, the judging unit judges whether or not the eyebrow angle, the eyebrow height, the eyebrow position, the moxibustion degree, the mouth size, the mouth width, the mouth tail angle, the forehead wrinkle, the head angle, The facial expression of the driver can be determined from at least one of the angles.

The control unit may determine whether the driver's emotional state, drowsy state, emergency state, or drinking state, based on the determination result, is determined based on a predetermined guide corresponding to the determination result, The operation of one or more devices can be controlled.

In addition, the determination unit may store the average body information of the driver in the database for each driver.

In addition, if there is no preset guide corresponding to the determination result, the control unit may request update to the external system.

A method of controlling a vehicle according to one side includes: acquiring body information of a driver; Determining a physical condition of the driver based on the sensed driver's body information; And controlling at least one device in the vehicle based on a preset guide according to the determination result.

The determining may include collecting body information of the driver to generate average body information of the driver, comparing the average body information of the driver with the body information of the driver, Can be determined.

In addition, the determining step may determine whether the driver is drowsy from at least one of facial expressions of the driver identified by using the camera, the rotational angle of the steering wheel, and the voice of the driver received using the microphone .

In addition, the determining may be performed using a facial expression of the driver identified using a camera, a pulse rate of the driver measured using an infrared sensor mounted on the steering wheel, and a pressure sensor mounted on the steering wheel The driver's emotional state can be determined from at least one of the blood pressure of the driver, the respiration of the driver measured using the air conditioner, the tension of the driver measured using the electrode mounted on the steering wheel, and the electrocardiogram.

In addition, the determining may be performed using a pulse rate of the driver measured using an infrared sensor mounted on a steering wheel, a blood pressure of the driver measured using a pressure sensor mounted on the steering wheel, The driver's tension, the electrocardiogram, the blood glucose level of the driver measured using the infrared photocoupler mounted on the steering wheel, the backrest of the driver's seat, or the bottom of the driver's seat, measured by the respiration of the driver, It is possible to determine whether or not the driver is in an emergency situation based on at least one of the temperature of the driver measured using the temperature sensor mounted on the vehicle.

The determining may further include determining whether the driver is in a drinking state from at least one of the pulse rate of the driver measured using the infrared sensor mounted on the steering wheel and the respiration of the driver measured using the air conditioner .

The determining may further include storing the average body information of the driver in the database for each driver.

Further, the controlling step may determine, based on the determination result, whether the driver corresponds to the emotion state, the drowsy state, the emergency state, or the drinking state of the driver, and based on a predetermined guide corresponding to the determination result The operation of one or more devices in the vehicle can be controlled.

In addition, in the case where there is no preset guide corresponding to the determination result, the controlling step may request update to the external system.

1 is a view schematically showing an external configuration of a vehicle according to an embodiment.
2 is a view showing an internal configuration of a vehicle according to an embodiment.
3 is a block diagram of a vehicle according to an embodiment.
4 is a view showing an infrared photocoupler and a pressure sensor mounted on a steering wheel according to an embodiment.
5 to 7 are diagrams illustrating a method of determining a physical condition from a feature point of a driver's face according to an embodiment.
FIG. 8 is a view showing information on body information required to grasp a physical condition of a driver according to an embodiment.
6 is a diagram illustrating a method of recognizing a physical condition according to an individual facial expression of a driver according to an exemplary embodiment.
9 to 11 are diagrams showing operation flow charts of the vehicle according to the physical condition of the driver.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view schematically showing an external configuration of a vehicle according to an embodiment.

1, a vehicle 200 includes a vehicle body 80 that forms an appearance of the vehicle 200, and wheels 93 and 94 that move the vehicle 200. As shown in Fig. The vehicle body 80 includes a hood 81, a front fender 82, a door 84, a luggage compartment lid 85, a quarter panel 86, and the like.

A front window 87 provided on the front side of the vehicle body 80 to provide a view of the front of the vehicle 200, a side window 88 providing a side view, a door 84 Side mirrors 91 and 92 provided on the rear side of the vehicle 200 to provide the rear and side view of the vehicle 200 and a rear window 90 provided on the rear side of the vehicle body 80 to provide a view of the rear of the vehicle 200. [ May be provided. Hereinafter, the internal configuration of the vehicle 200 will be described in detail.

3 is a block diagram of a vehicle according to an embodiment of the present invention. FIG. 4 is a block diagram of a vehicle equipped with a steering wheel according to an embodiment of the present invention. Referring to FIG. 2, An infrared photocoupler and a pressure sensor. 5 to 7 are views illustrating a method of determining a physical condition from a feature point of a driver's face according to an embodiment. 8 is a view showing information on body information required to grasp a physical condition of a driver according to an embodiment. To avoid overlapping descriptions, we shall describe them together.

2 and 3, an air conditioner 196 is installed in the vehicle 200 to perform both heating and cooling, and air heated or cooled is discharged through the air vent 153, The internal temperature can be controlled. The air conditioner 196 described below can automatically control the air conditioning environment including indoor / outdoor environmental conditions of the vehicle 200, intake / exhaustion of air, circulation, cooling / heating state, etc., And the like.

According to one embodiment, the air conditioner 196 may correspond to a dual-zone automatic temperature controller (DATC). The DATC refers to a fully automatic temperature control device that automatically sets temperature or the like for the driver's seat 21 and the front passenger's seat 22 or sets it according to a user's control command. The vehicle 200 can provide comfort to the passengers by individually controlling the air conditioning environment for the driver's seat 21 and the passenger seat 22 for the occupant sits using the DATC. On the other hand, the air conditioner 196 has a built-in sensor, so that it is possible not only to measure the concentration of carbon dioxide in the vehicle 200, but also to detect ethanol.

On the other hand, an AVN terminal (Audio Video Navigation) 100 may be provided inside the vehicle 200. The AVN terminal 100 refers to a terminal that can provide a navigation function for providing a path to a destination to a user and can integrally provide audio and video functions. The AVN terminal 100 can selectively display at least one of an audio screen, a video screen and a navigation screen through the display 101 as well as various control screens related to the control of the vehicle 200, A screen related to an additional function that can be executed by the user can be displayed.

According to one embodiment, the AVN terminal 100 can display various control screens related to the control of the air conditioner through the display 101 in cooperation with the above-described air conditioner. In addition, the AVN terminal 100 can control the operation state of the air conditioner 196 to adjust the air conditioning environment in the vehicle.

On the other hand, the display 101 may be located in the center fascia 11, which is the central area of the dashboard 10. According to one embodiment, the display 101 may be implemented with a liquid crystal display (LCD), a light emitting diode (LED), a plasma display panel (PDP), an organic light emitting diode (OLED), a cathode ray tube However, this is not the case.

A speaker 143 capable of outputting sound may be provided inside the vehicle 200. Accordingly, the vehicle 200 can output the sound necessary for performing the audio function, the video function, the navigation function, and other additional functions through the speaker 143. [

The navigation input unit 102 may be located in the center fascia 11, which is a central area of the dashboard 10. [ The driver can input various control commands by operating the navigation input unit 102. [ In addition, the navigation input unit 102 may be provided in a hard key type in an area adjacent to the display 101. [ When the display 101 is implemented as a touch screen type, the display 101 may also perform the functions of the navigation input unit 102. [

Meanwhile, the center console 40 may be provided with a center input unit 43 of a jog shuttle type or a hard key type. The center console 40 refers to the portion where the gear operating lever 41 and the tray 42 are formed between the driver's seat 21 and the front passenger's seat 22. The center input unit 43 may perform all or some of the functions of the navigation input unit 102. [

The acquiring unit 110 can acquire the driver's body information through various devices in the vehicle. 3, the acquiring unit 110 may include a camera 191, a pressure sensor 192, an infrared sensor 193, an electrode 194, an infrared photocoupler 195, The air conditioner 196, the temperature sensor 197, or the like.

The body information of the driver is information that can be used to determine the driver's physical condition. The driver's body information includes not only information that can be derived from the outside and inside of the driver's body but also all information that can be derived from elements emitted from the driver's body . According to one embodiment, the body information of the driver includes all facial expressions, voice, blood pressure, pulse, tension, electrocardiogram, blood sugar level, components exhaled through respiration, body temperature, and the like, but is not limited to the embodiment.

The voice input unit 190 can receive the voice of the driver. Specifically, the voice input unit 190 can receive voice uttered by the driver through a microphone and convert the voice into an electrical signal. The voice input unit 190 may be mounted on the head lining 13 as shown in FIG. 2, but the present invention is not limited thereto. The voice input unit 190 may be mounted on the dashboard 10 or may be mounted on the steering wheel 12 As shown in Fig. In addition, there is no limit to the location that is suitable for receiving the voice of the driver in operation. As will be described later, the determination unit 120 can use the voice of the driver received from the voice input unit 190 to determine the emotional state of the driver.

On the other hand, the camera 191 can photograph a driver. For example, the camera 191 may be mounted on the head lining 13, such as the voice input unit 190, to photograph the driver. As will be described later, the determination unit 120 can recognize the face portion of the driver from the image of the driver acquired from the camera 191. [ Accordingly, the determination unit 120 can identify the feature points that can grasp the emotion state in the face portion of the driver, and can be used to determine the emotion state of the driver or whether or not the driver is sleeping. In addition, the camera 191 can also be photographed in front of the vehicle 200. Accordingly, as will be described later, the determination unit 120 can determine the lane of the road in the image photographed through the camera 191, and determine whether the vehicle 200 departs the lane.

On the other hand, the pressure sensor 192 can measure the blood pressure of the driver. The pressure sensor 192 described below refers to a sensor that measures blood pressure through the pressure of a driver's hand. The pressure sensor 192 may be provided between the diagonal direction and the rear diagonal direction of the front of the vehicle 200 where the pressure at which the driver grasps the steering wheel 12 is highest as shown in Fig. However, the position of the pressure sensor 192 is not limited to this, and may be located anywhere on the position where the driver's hand touches.

Further, the infrared sensor 193 can measure the pulse rate of the driver. The infrared ray sensor 193 described below means a sensor for measuring the pulse rate by sensing the motion of the driver's blood vessel. The infrared sensor 193 may be provided in the front direction of the steering wheel 12 and the side direction of the inner side as shown in FIG. 4 (a). However, the position of the infrared sensor 193 is not limited to this, but may be located anywhere on the position where the driver's hand touches.

Further, the infrared photocoupler 195 can measure the blood glucose level of the driver. Glucose, which corresponds to blood sugar, can absorb the infrared (2,500-10,000 nm) of medium-wave infrared rays. Accordingly, the infrared photocoupler 195 can estimate the blood glucose level by irradiating the hands of the driver with infrared rays, measuring the intensities of the irradiated infrared rays by the wavelengths, and determining the absorbance of the middle infrared rays with respect to the infrared rays. The infrared photocoupler 195 irradiates infrared light through a light emitting element such as an LED or the like, and measures the absorbance of the infrared band of the medium wave field through the infrared sensor 193, thereby measuring the blood glucose level. 4 (a), the infrared photocoupler 195 may be provided in the front direction of the steering wheel 12 and the lateral direction of the inner side, as shown in FIG. 4 (a) .

Also, the electrode 194 can measure the psychological strain and the electrocardiogram of the driver. If the driver is nervous, his hands become sweaty. For example, the conductivity of the sweat is increased by the salt component, and conversely, when the sweat is dry, the conductivity drops. Accordingly, the electrode 194 can measure the psychological strain and the electrocardiogram of the driver by measuring the minute current generated according to the heartbeat and calculating the conductivity. For example, the electrode 194 may be mounted to the steering wheel 12, but is not limited thereto. As will be described later, the determination unit 120 can use the psychological strain acquired through the electrode 194, and the electrocardiogram to determine whether the emotional state of the driver is an emergency situation.

Also, the temperature sensor 197 can measure the body temperature of the driver. The temperature sensor 197 is a sensor capable of measuring the body temperature of the driver and may be provided at a portion capable of contacting the driver's body. For example, the temperature sensor 197 may be provided at the backrest portion or the lower end portion of the seat of the driver's seat 22 shown in Fig. However, the position of the temperature sensor is not limited thereto, but may be provided at any position where the body temperature of the driver on board the vehicle 200 can be measured.

In addition, the sensing unit 110 may analyze the respiration of the driver through the air conditioner 196. The air conditioner 196 is provided with a sensor capable of detecting ethanol and carbon dioxide, and it is possible to detect not only the respiration rate but also the air pollution degree by analyzing the components contained in the respirator discharged during the respiration of the driver. As will be described later, the determination unit 120 can detect the rate of increase and the concentration of ethanol and carbon dioxide emitted during respiration of the driver through the air conditioner 196. The acquiring unit 110 may acquire the driver's body information from the above-described components. Hereinafter, the determination unit 120 that determines the physical condition of the driver based on the body information acquired through the acquisition unit 110 will be described in detail.

The determination unit 120 may determine the state of the driver's body based on the body information acquired through the acquisition unit 110. [ The physical condition of the driver described below means information on what state the driver's body corresponds to. For example, the physical condition of the driver includes information on whether the driver is currently sleeping, whether the emotion is negative, whether the emptiness is an emergency, whether it is a drinking state, and the like. However, And information on the physical condition of all the drivers that can be derived from the driver.

For example, the determination unit 120 may determine whether the driver is asleep from at least one of facial expression, rotational angle of the steering wheel, and respiration as shown in Fig. As another example, the determination unit 120 may determine whether the driver's emotional state is based on at least one of facial expression, pulse rate, blood pressure, respiration, tension, and electrocardiogram.

As another example, the determination unit 120 may determine whether the driver is in an emergency situation based on at least one of pulse rate, blood pressure, respiration, tension, electrocardiogram, body temperature, and blood glucose level. As another example, the determination unit 120 may determine whether the driver is in a drinking state from at least one of pulse rate and respiration.

Hereinafter, embodiments for determining respective states will be described.

According to one embodiment, the determination unit 120 can recognize only the face portion of the driver in the image of the driver photographed through the camera 191. [ Accordingly, the determination unit 120 can identify the minutiae and use it to determine the physical condition of the driver. 5, the angle of the eyebrows 301, the height of the eyebrows 301, the position of the eyebrows 301, the position of the eyebrows 301, 302, the size of the mouth 304, the width of the mouth 304, the angle of the tail 304 of the mouth 304, the forehead 305, the forehead wrinkles 300, the viewing angle of the pupil 303, . The determination unit 120 may determine the physical condition such as the feeling of the driver, whether the driver is sleeping or the like, using the identified minutiae.

At this time, the database 150 stores standard data related to facial expression. The standard data related to facial expression refers to data on the average driver 's feelings, sleepiness, etc. according to each feature point. At this time, the determination unit 120 may generate the average body information reflecting the characteristics of the driver through the personal adaptation step of continuously collecting data on the minutiae of the driver and correcting the standard data related to facial expression. The average body information may be stored in database 150. Accordingly, the determination unit 120 can use the calculated value as a basic index for determining the physical condition of the driver. For example, the determination unit 120 may estimate the head angle by comparing the height of the head projected on the camera 191 with the height of the head projected by the camera 191 at a specific time, . 6 corresponds to the head height projected on the camera 191 when the driver normally drives the vehicle, and Fig. 7 corresponds to the head height projected on the current camera 191. The determination unit 120 may be used to estimate the driver's head angle by comparing the head height with the currently projected head height in the normal vehicle operation stored in the database 150. [

On the other hand, when the driver is sleeping, the rotation angle of the steering wheel 12 may be larger than the degree of bending of the road. Or, the angle of rotation of the steering wheel 12 may change from time to time. The determination unit 120 can recognize the lane on the road image photographed through the camera 191. [ Accordingly, when the difference between the angle of rotation of the steering wheel 12 and the angle of the lane exceeds a predetermined level, the determination unit 120 can determine that the driver is sleeping. In addition, the determination unit 120 may compare the angle of the lane detected through the map stored in the navigation with the rotation angle of the steering wheel 12, and may determine that the driver is asleep if the angle difference exceeds a preset level have. In addition, the determination unit 120 may determine that the driver is sleeping when the degree of change of the rotation angle of the steering wheel 12 over time exceeds a predetermined level.

Drowsiness occurs mainly when oxygen is lacking. Therefore, in addition to the facial expression, the rotation angle of the steering wheel 12, and the like, the determination unit 120 analyzes the driver's respirator through a sensor built in the air conditioning system 196. If the carbon dioxide in the vehicle exceeds a certain level, It can be judged more accurately whether or not it is in progress. That is, the judging unit 120 can judge whether the driver is sleeping from any one of the facial expression, the steering angle of the steering wheel 12, or the respiration, but it is possible to judge whether or not the driver is sleeping more accurately have.

On the other hand, the determination unit 120 may analyze the respirator of the driver through the sensor built in the air conditioner 196 and determine that the possibility of drowsiness is high if the amount of carbon dioxide in the vehicle exceeds a certain level. Then, as described later, the control unit 130 can activate the recovery system to induce recovery of the driver. The vehicle 200 according to the disclosed embodiment can detect the driver's situation early and respond quickly to the occurrence of a problem if the driver is expected to cause a problem.

Hereinafter, an embodiment for determining the driver's emotional state will be described.

The determination unit 120 may determine from the at least one of facial expression, pulse rate, blood pressure, respiration, tension, and electrocardiogram (ECG) what the driver's feelings are. As described above, the determination unit 120 can identify the minutiae and determine the emotional state of the driver. For example, when you are emotionally excited or nervous, the driver's eyebrow angle increases and the forehead becomes wrinkled. Accordingly, the determination unit 120 can determine the emotion state of the driver by identifying the change of the minutiae points.

In addition, when you are emotionally excited or tense, the driver's pulse rate goes up. As the physical stress occurs, the sympathetic nervous excitement increases blood pressure and breathing. Accordingly, the determination unit 120 can more accurately determine the emotional state of the driver using the pulse rate, breathing, tension, electrocardiogram, etc. of the driver acquired through the acquisition unit 110 in addition to the facial expression. On the other hand, blood pressure, respiration, and pulse rate are proportional. Knowing either blood pressure, breathing, or pulse rate, other values can be estimated. Therefore, the determination unit 120 can estimate other information by knowing only one of blood pressure, respiration, or pulse rate.

Hereinafter, an embodiment for determining whether the driver is in an emergency situation will be described.

The determination unit 120 may determine whether the driver is in an emergency situation based on at least one of pulse rate, blood pressure, respiration, tension, electrocardiogram, body temperature, and blood glucose level. For example, when the driver's pulse rate, the degree of tension, and the body temperature exceed a preset level or increase at a speed higher than a predetermined level, the determination unit 120 may determine that the driver is in an emergency. As another example, when the driver corresponds to a diabetic patient and the blood sugar level decreases at a rate higher than a predetermined level, the determination unit 120 can determine that the driver is in an emergency situation.

Hereinafter, an embodiment for determining whether the driver is in the drinking state will be described.

The determination unit 120 may determine whether the driver is in the drinking state based on at least one of the pulse rate and the respiration. When alcohol is absorbed into the driver's body, some of it is released into the ethanol component through the respiration and another part of the body is decomposed into water and carbon dioxide. As a result, the driver will emit more carbon dioxide than usual.

The judging unit 120 can sense the ethanol and carbon dioxide emitted from the driver through the air conditioner 196 and judge whether or not the driver is drinking. In one embodiment, the determination unit 120 may sense the rate of change of the amount of ethanol and carbon dioxide discharged through the air conditioning unit 196 to determine whether the driver is drinking or not.

In addition, when the user is in the drinking state, the driver's pulse rate is faster than usual. Accordingly, the judging unit 120 can judge whether or not the driver is in the drinking state through the pulse rate in addition to the breathing, and can also judge whether or not the user is drinking more accurately by combining the breathing and the pulse rate together.

On the other hand, the control unit 140 can control the overall operation of the vehicle 200. Specifically, the control unit 140 can control not only the various modules built in the AVN terminal 100, but also the operations of devices mounted on the vehicle 200 and the like. According to an embodiment, the control unit 140 can be operated by a processor built in the vehicle 200, and can control various modules built in the AVN terminal 100, devices installed in the vehicle 200, A control signal can be generated to control the operation of each of the above-described components.

The control unit 130 can provide the vehicle driving assistance service by controlling the operation of the modules, devices, and the like built in the vehicle 200 based on the result of the driver's physical condition determination. For example, the control unit 130 may control the operation of the components shown in FIG. 3 to thereby provide the vehicle driving assistance service, but the present invention is not limited thereto.

According to one embodiment, the controller 130 can control the operation of modules, devices, and the like in the vehicle 200 according to a preset guide corresponding to the determination result of the driver ' s physical condition. The guide described below includes information on how to control the operation of one or more devices and modules in the vehicle 200 in accordance with the determination result of the driver ' s physical condition.

For example, if it is determined that the physical condition of the driver is sleeping, the control unit 130 may control the vehicle 200 according to a predetermined guide according to the driver's sleepiness or the number of times it is determined that the driver is sleeping have.

The degree of sleepiness of the driver can be judged from the physical condition of the driver. For example, when the degree of winding of the driver's eyelid and the winding time exceed a predetermined level, it is determined that the driver corresponds to the inoperable state, and the control unit 130 determines that the steering wheel 12,. It is possible to induce deceleration and emergency parking of the vehicle 200 by controlling operations of the accelerator 142, the brake 143, the direction indicator 144, the emergency light 145, and the like.

As another example, if the body state is determined not to exceed the preset level and the driver is determined to be in an operable state, the controller 130 controls the operations of the devices in the vehicle 200 to induce the driver to wake up from drowsiness. In one embodiment, when the driver is slightly sleepy, the control unit 130 may open the side window 88 or control the air conditioner 196 to introduce air to induce ventilation so that the driver can avoid drowsiness. In another embodiment, the control unit 130 may inform the driver via the speaker 143 in the vehicle 200 to wake up or display a warning pop-up via the display 101.

As another example, when the driver's feeling is increased as a result of the driver's physical condition, the control unit 130 controls the AVN terminal 100 to output light music through the speaker 143, Or display a pleasant image through the display 101. [ Alternatively, the control unit 130 can induce the driver's recovery by opening the side window 88 or controlling the air conditioning unit 196 to introduce air.

As another example, if it is determined that the driver is in an emergency situation as a result of the determination regarding the physical condition, the control unit 130 controls the steering wheel 12, the accelerator 142, the brake 143, The emergency parking light 144, the emergency light 145, and the like to guide the deceleration and emergency parking of the vehicle 200. [ In addition, the control unit 130 may control the communication unit 140 to transmit information on an emergency situation to a system of a public institution such as a hospital, police, or the like. Accordingly, a quick response to the driver's emergency can be made.

On the other hand, when there is no guide corresponding to the physical condition of the driver in the database, the control unit 130 may control the communication unit 140 to request a guide corresponding to the physical condition of the driver, such as a TM (TeleMatics) center. Accordingly, the controller 130 receives the guide corresponding to the body condition of the driver through the communication unit 140, and can control the vehicle 200 accordingly. The control unit 130 may not request the guide only when there is no guide corresponding to the physical condition of the driver, but may request the update periodically according to a predetermined period. The predetermined period may be set by the designer of the vehicle 200 or the driver of the vehicle 200. [

The communication unit 140 may be connected to an external system via a wireless communication network to exchange various data. A wireless communication network means a communication network capable of sending and receiving signals wirelessly. The communication unit 140 can perform wireless communication with an external system through the mobile communication module. The mobile communication module can transmit and receive a radio signal to at least one of the base station, the external system, and the communication unit 140 on the mobile communication network. Here, a radio signal means a signal including various types of data. That is, the communication unit 140 can exchange signals including various types of data with an external system via a base station.

Meanwhile, the database 150 may store standard data related to facial expression. The standard data associated with the facial expression includes data on the driver ' s physical condition according to each feature point of the driver with the average head position. The standard data related to the facial expression stored in the database 150 may be corrected by reflecting the minutiae change information according to the characteristics of each driver as described above. Accordingly, the data related to the facial expression specific to each driver is stored in the database 150, whereby the physical condition of the driver can be more accurately determined.

The database 150 may also store standard data related to the biometric information. The standard data related to the biometric information includes data on the average pulse rate of the driver, blood pressure, body temperature, respiration, tension, electrocardiogram, body temperature, blood glucose level and the like. The standard data related to the biometric information stored in the database 150 may be corrected by reflecting the data acquired from the driver. Accordingly, the average biometric information reflecting characteristics of individual drivers is stored in the database 150, thereby allowing the driver to more accurately determine the physical condition of the driver.

In addition, the database 150 may store a guide preset according to the body condition. Accordingly, the controller 130 can respond to the driver's body condition more quickly by controlling the modules and devices in the vehicle 200 in accordance with the guide corresponding to the determination result about the body condition. Thus, the vehicle 200 according to the disclosed embodiment can protect the driver's safety by taking measures in advance before the driver faces a dangerous situation. On the other hand, when there is no guide corresponding to the driver's physical condition, the database 150 can be updated from the external system via the communication unit 140. [

Hereinafter, a method of grasping the body condition from the driver's body information will be described, and a flow chart of the operation of the vehicle according to the body condition will be described.

9 to 11 are diagrams showing operation flow charts of the vehicle according to the physical condition of the driver.

9 to 11, the vehicle can recognize the physical condition of the driver by using a sensor in the vehicle, a camera, and the like. For example, the vehicle can determine whether the driver is sleeping, the emotional state, the emergency situation, the drinking state, etc., based on the physical condition of the driver. At this time, in order to grasp the respective situations, not all the body information acquired through various sensors and cameras is required.

For example, in order to determine whether or not the driver is asleep, at least one of physical information of the driver's facial expression, rotational angle of the steering wheel, and respiration is required as described above. Accordingly, the vehicle can determine whether the driver is sleeping by using the information of one of the driver's facial expression, the rotational angle of the steering wheel, and respiration (700). If the driver is not perceived as sleepy, the vehicle can determine what the driver's emotional state is (710). If it is determined that the vehicle is not in a negative emotional state as a result of the determination, the vehicle may be operated so that the driver maintains the operation without separately controlling the operation of the in-vehicle devices (720).

On the other hand, if it is determined that the vehicle is in a negative emotional state as a result of the determination, the vehicle can determine whether the vehicle can be converted into a state ready for operation through recovery (730). If it is determined that the driver's emotional state is excessively energized due to the above-described method and the driver is unable to operate the vehicle, the vehicle may be advised to rest and the driver may be disabled (740). For example, when driving, the vehicle can control the in-vehicle device to induce deceleration and emergency parking of the vehicle. In addition, when the vehicle is not traveling, the vehicle can be controlled not to operate the in-vehicle device. In addition, the vehicle can communicate to the driver to take a break through various devices that can provide information to the driver, such as a display or speaker.

On the other hand, if it is determined that the degree of the driver's emotional state is excessive, the vehicle can grasp the frequency of the emotional state (750). If the frequency of recognition is higher than a predetermined frequency, that is, if the number of times the emotion state is determined to be impossible to recover is higher than a predetermined number N (N 1), the vehicle recommends the driver . For example, a vehicle may communicate danger warning and resting advice to the driver through various devices that can provide information to the driver, such as a display or a speaker.

On the other hand, if it is determined that the driver is sleeping, the vehicle can continuously monitor the driver ' s physical condition to determine the frequency of sleepiness (780). If the frequency of drowsiness is lower than a predetermined number of times, that is, the number of times judged to be a sol is lower than a predetermined number N (N > = 1), the vehicle may recommend that the driver warn the driver of danger warning (770). As described above, the vehicle can transmit the danger warning and the recommendation for rest to the driver through various devices.

If the number of times it is determined to be drowsy is higher than a predetermined number N (N > = 1), the vehicle can operate the recovery system according to the guide (760). The recovery system described below means a system for restoring the driver to an operable state. For example, the vehicle may open the side window 88 or operate the air conditioning system 196 to induce ventilation so that the driver wakes up from drowsiness.

Referring to FIG. 10, the vehicle measures the driver's pulse rate and determines whether the driver's pulse rate is higher than the normal pulse rate of the driver (800). As described above, the vehicle can measure the driver's pulse rate using an infrared sensor. Accordingly, if the pulse rate exceeds a predetermined level, the vehicle may determine whether the rate of increase of the carbon dioxide concentration in the vehicle is high (810). The carbon dioxide concentration in the vehicle can be measured through the air conditioning apparatus as described above.

When the rate of increase of the carbon dioxide concentration in the vehicle exceeds a predetermined level, the vehicle can determine whether the ethanol component in the vehicle is detected. The ethanol component can be detected through a sensor built in the air conditioner. When the ethanol component is detected, the vehicle may determine that the driver is in the drinking state. Accordingly, the vehicle may control the in-vehicle devices to prevent starting and running of the vehicle (830). In addition, the vehicle can lead to call home and substitute operations via speakers, displays, or the like. In the case that the substitute driver is driving, that is, when another driver attempts to drive, the vehicle identifies the driver's face through the camera, or identifies whether it corresponds to another driver using the weight sensor mounted on the seat, So that the operation can be controlled.

On the other hand, if the rate of increase of the concentration of carbon dioxide in the vehicle is lower than a preset level or if the ethanol component in the vehicle is not detected, the vehicle may operate the recovery system (840). For example, when the emotion becomes high and the verbal ability becomes high or the breath sounds rough, the vehicle can operate the recovery system to induce stability of the driver. For example, the vehicle can output pleasant music through the speaker, control the side window to open, or control the cool air to be introduced through the air conditioner.

On the other hand, if the pulse rate of the driver is not higher than a predetermined level in comparison with the normal pulse rate, the detection of the ethanol component can be determined (850). If no ethanol component is detected, the vehicle can determine if the rate of increase of the carbon dioxide concentration is higher than a predetermined level (860). If it is determined that the rate of increase of the carbon dioxide concentration is not high, the vehicle is determined that the driver is not in the drinking state, and then the user checks the emotional state and the like. The operation of the devices can be controlled to restore the driver (840).

On the other hand, referring to FIG. 11, the vehicle may monitor a change in the driver's physical condition (900). For example, the vehicle may continuously monitor changes in the driver ' s physical condition, or it may be repeatedly monitored in accordance with a predetermined cycle, without limitation. The predetermined period may be set by the driver or designer of the vehicle.

When a change in the physical condition of the driver occurs, the vehicle can determine whether the physical change of the driver corresponds to a general change due to the change in feeling (910). As described above, the vehicle can determine the driver's emotional state using at least one of the driver's voice, facial expression, pulse rate, blood pressure, respiration, tension, and electrocardiogram.

If it is determined that the change of the physical condition due to the emotional change is a general level, the vehicle monitors the change of the driver's physical condition again without taking any other action.

However, if it is determined that the change of the physical condition due to the change of the emotion exceeds the preset level, the vehicle is judged whether or not the change corresponds to the emergency situation. If the reason of the change of the physical condition is a simple emotion change, (920). ≪ / RTI > As described above, the vehicle can determine whether the driver is in an emergency situation by using at least one of pulse rate, blood pressure, respiration, tension, electrocardiogram, body temperature, and blood glucose level.

As a result of the judgment, if it is judged that the vehicle is in an emergency situation, the vehicle can control the in-vehicle devices according to the guide set in advance according to the degree of emergency. That is, the vehicle can take measures to prevent the vehicle from being operated and to deal with emergency situations in accordance with a preset guide.

For example, when the driver's pulse rate, the degree of tension, and the body temperature exceed a predetermined level or increase at a speed higher than a preset level, the vehicle may be determined to be in an emergency situation by the driver.

Then, the vehicle can control the in-vehicle devices to take a non-operation measure, and control the in-vehicle devices according to a preset guide for each emergency situation (930). For example, the vehicle may control the devices in the vehicle to induce a deceleration of the vehicle and induce emergency parking while the vehicle is in operation. In addition, when the driver is a diabetic patient, if the blood sugar level decreases at a rate higher than a predetermined level, the vehicle can recognize that the driver is in an emergency.

Accordingly, the vehicle controls the in-vehicle devices to induce the deceleration of the vehicle and induce the emergency parking while the vehicle is in operation, and to transmit the emergency information to the system of the medical institution through the communication module to provide the driver with quick emergency treatment . The database in the vehicle also stores the driver ' s normal health history, and when a change in the physical condition related to the driver occurs, the driver can quickly assure the safety of the driver by quickly responding to the preset guide.

On the other hand, if it is determined that the vehicle is not in an emergency, the vehicle may determine whether the driver can transition from the recovery state to the operational state (940). The vehicle may be monitored 950 to determine whether the number of times that the change in the emotional state is detected as exceeding the predetermined level is N or more, although it is not an emergency. Accordingly, if the number of times that the change of the emotion state is detected to exceed the preset level is N times or more, the vehicle can operate the recovery system to induce the driver's recovery (950). As a result of the monitoring, if the number of sensed changes of the emotional state does not correspond to the emergency situation is less than N times, the vehicle can monitor the driver's physical condition again without taking any action on the driver's running.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like.

Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

10: Dashboard, 11: Center Fesia
12: steering wheel, 13: head lining
21: driver's seat, 22: passenger seat
40: center console, 41: gear operating lever
42: Tray, 43: Center input
80: body, 81: hood, 82: front fender
84: Door, 85: Trunk lid, 86: Quarter panel
87: front window, 88: side window
90: rear window, 91, 92: side mirror
100: AVN terminal, 101: display, 102: navigation input unit
143: speaker, 153: ventilation hole, 190: audio input section

Claims (18)

An acquiring unit for acquiring body information of a driver;
A determining unit for determining a physical condition of the driver based on the acquired physical information of the driver; And
A controller for controlling at least one device in the vehicle based on a preset guide according to a result of the determination;
≪ / RTI > The method according to claim 1,
Wherein,
Wherein the body information of the driver is collected by collecting the body information of the driver and the average body information of the driver is compared with the body information of the driver so as to determine the physical condition of the driver. The method according to claim 1,
Wherein,
A driver's body condition is determined based on at least one of a facial expression of the driver identified by using the camera, a rotation angle of the steering wheel, and a voice of the driver received using the microphone. The method according to claim 1,
Wherein,
At least one of the pulse rate of the driver measured using an infrared sensor mounted on the steering wheel, the blood pressure of the driver measured using the pressure sensor mounted on the steering wheel, and the respiration of the driver sensed using the air conditioner To determine the physical condition of the driver. The method according to claim 1,
Wherein,
An electrocardiogram, a blood glucose level of the driver measured using an infrared photocoupler mounted on the steering wheel, and a temperature sensor mounted on the driver's seat, which are measured using an electrode mounted on the steering wheel, And determining the physical condition of the driver from at least one of the body temperature of the driver measured using the vehicle. The method of claim 3,
Wherein,
The method of claim 1, further comprising: measuring at least one of at least one of eyebrow angle, eyebrow height, eyebrow position, moxibustion degree, mouth size, mouth width, mouth tail angle, eye angle, forehead wrinkle, A vehicle that judges the facial expression of the driver. The method according to claim 1,
Wherein,
Determining whether the driver's emotional state corresponds to one of an emotional state, a drowsy state, an emergency state, and a drinking state of the driver based on the determination result, and based on a predetermined guide corresponding to the determination result, Vehicle to control. 3. The method of claim 2,
Wherein,
And stores the generated average body information of the driver in a database for each driver. 8. The method of claim 7,
Wherein,
And when there is no preset guide corresponding to the determination result, requests the update to the external system. Acquiring body information of a driver;
Determining a physical condition of the driver based on the sensed driver's body information; And
Controlling one or more devices in the vehicle based on a preset guide according to the determination result
And controlling the vehicle. 11. The method of claim 10,
Wherein the determining step comprises:
Wherein the body information of the driver is collected by collecting the body information of the driver and the average body information of the driver is compared with the body information of the driver so as to determine the physical condition of the driver. 11. The method of claim 10,
Wherein the determining step comprises:
And determining whether the driver is drowsy from at least one of the facial expression of the driver identified using the camera, the rotation angle of the steering wheel, and the voice of the driver received using the microphone. 11. The method of claim 10,
Wherein the determining step comprises:
A driver's pulse rate measured using an infrared sensor mounted on a steering wheel, a blood pressure of the driver measured using a pressure sensor mounted on the steering wheel, And determining an emotional state of the driver from at least one of the breathing of the driver, the degree of tension of the driver measured using the electrode mounted on the steering wheel, and the electrocardiogram. 11. The method of claim 10,
Wherein the determining step comprises:
The pulse rate of the driver measured using an infrared sensor mounted on the steering wheel, the blood pressure of the driver measured using the pressure sensor mounted on the steering wheel, the respiration of the driver measured using the air conditioner, The electrocardiogram, the blood glucose level of the driver measured using the infrared photocoupler mounted on the steering wheel, and the temperature sensor mounted on the back of the driver's seat or the bottom of the driver's seat, And judging whether or not the driver is in an emergency situation from at least one of the measured body temperatures of the driver. 11. The method of claim 10,
Wherein the determining step comprises:
And determining whether the driver is in a drinking state based on at least one of the heart rate of the driver measured using an infrared sensor mounted on the steering wheel and the respiration of the driver measured using the air conditioner. 12. The method of claim 11,
Wherein the determining step comprises:
Storing the acquired average body information of the driver in the database for each driver
Further comprising the steps of: 12. The method of claim 11,
Wherein the controlling comprises:
Determining whether the driver's emotional state corresponds to one of an emotional state, a drowsy state, an emergency state, and a drinking state of the driver based on the determination result, and based on a predetermined guide corresponding to the determination result, A method of controlling a vehicle for controlling the vehicle. 18. The method of claim 17,
Wherein the controlling comprises:
And when there is no preset guide corresponding to the determination result, requests an update to the external system.

Images