CN110027567A

CN110027567A - The driving condition of driver determines method, apparatus and storage medium

Info

Publication number: CN110027567A
Application number: CN201910358618.8A
Authority: CN
Inventors: 周倪青; 徐达学; 张萌; 王萍; 王云; 陈海鸥; 陈健昕
Original assignee: SAIC Chery Automobile Co Ltd
Current assignee: Chery Automobile Co Ltd
Priority date: 2019-04-30
Filing date: 2019-04-30
Publication date: 2019-07-19

Abstract

This application discloses the driving conditions of driver a kind of to determine method, apparatus and storage medium, belongs to intelligent automobile technical field.The described method includes: while the car is driving, the driving status parameter for obtaining the automobile, the environmental information that the automobile is presently in and the visual information of driver；Based on the driving status parameter and the environmental information, state-detection threshold value is determined；Based on the visual information and/or driving status parameter and the state-detection threshold value, the driving condition of the driver is determined.The application can dynamically determine status monitoring threshold value based on driving status parameter and environmental information, so as to improve the accuracy and reliability of determining driving condition.

Description

The driving condition of driver determines method, apparatus and storage medium

Technical field

This application involves intelligent automobile technical field, in particular to a kind of driving condition of driver determines method, apparatus And storage medium.

Background technique

As the improvement of people's living standards, automobile becomes essential walking-replacing tool when people's trip gradually.But With increasing for automobile quantity, traffic accident is also more and more frequent to be occurred, and the reason of causing traffic accident to take place frequently includes driving The fatigue driving for the person of sailing.Therefore, in order to avoid traffic accident, it usually needs examined to the driving condition of driver It surveys.

Currently, when detecting the driving condition of driver, it can be based on the monitoring method of physiological driver's index, by wearing The physiological parameters such as formula equipment monitoring electroencephalogram, electrocardiogram, electromyogram, effect of breathing, body temperature are worn, then according to the physiological parameter, Determine the driving condition of driver.Alternatively, vision-based inspection method, monitoring driver head's motion change, body posture, The kinematic parameters such as eyes closed time, and determine according to the kinematic parameter driving condition of driver.Alternatively, the row based on vehicle The detection method of state is sailed, such as position of Vehicular turn, throttle, gear, brake, speed, acceleration, vehicle in lane is monitored Set the driving condition that equal vehicle status parameters judge driver.

But due to driving in the driving condition by determining driver based on the monitoring method of physiological driver's index The person of sailing needs to wear wearable device, and sometimes driver may forget to wear, and leads to not the physiology ginseng for detecting driver Number, so as to cause the driving condition that can not determine driver.The driving condition of driver is determined in vision-based inspection method When, it usually needs accurate information is obtained, causes complicated for operation, reduces the efficiency of determining driver's driving condition.It is being based on When the detection method of the driving status of vehicle determines the driving condition of driver, vehicle running state is easy to be driven by driver The influence of experience and environmental factor leads to the driving condition inaccuracy determined according to the vehicle status parameters of acquisition, reduces really Determine the reliability of driver's driving condition.

Summary of the invention

The driving condition that the embodiment of the present application provides a kind of driver determines method, apparatus and storage medium, for solving The problem of certainly determining driving condition inaccuracy, poor reliability in the related technology.The technical solution is as follows:

In a first aspect, the driving condition for providing a kind of driver determines method, which comprises

While the car is driving, the driving status parameter of the automobile is obtained, the environment letter that the automobile is presently in The visual information of breath and driver；

Based on the driving status parameter and the environmental information, state-detection threshold value is determined；

Based on the visual information and/or driving status parameter and the state-detection threshold value, the driver is determined Driving condition.

Optionally, described to be based on the driving status parameter and the environmental information, determine state-detection threshold value, comprising:

Determine whether the driving status parameter meets driving status condition；

When the driving status parameter meets the driving status condition, determine whether the environmental parameter meets first Running environment condition；

When the environmental parameter is unsatisfactory for the first traveling environmental condition, when adjusting the detection in the state-detection threshold value Long threshold value, the detection duration threshold value are used to limit the duration for the driving condition for detecting the driver；

When the environmental parameter meets the first traveling environmental condition, determine whether the environmental parameter meets second Running environment condition；

When the environmental parameter meets the second running environment condition, the fatigue in the state-detection threshold value is adjusted Detection threshold value, the fatigue detecting threshold value for detect the driver whether fatigue driving.

Optionally, the environmental information includes gas concentration lwevel, humidity value and temperature value in the automobile bodies；

Whether the determination environmental parameter meets the first traveling environmental condition, comprising:

The gas concentration lwevel is compared with the first concentration range, the humidity value is compared with humidity range Compared with, and the temperature value is compared with temperature range；

When the gas concentration lwevel is not located in the first concentration range, and/or, the humidity value is not located at humidity range It is interior, and/or, when the temperature value is not located in temperature range, determine that the environmental parameter is unsatisfactory for first running environment Condition；

When the gas concentration lwevel is located in first concentration range, and the humidity value is located at the humidity range It is interior, and when the temperature value is located in the temperature range, determine that the environmental parameter meets the first traveling environmental condition.

Optionally, the environmental information further includes the alcohol concentration of the driver position and the traveling of the automobile Time；

Whether the determination environmental parameter meets the second running environment condition, comprising:

The alcohol concentration is compared with the second concentration range；

When the alcohol concentration is located in second concentration range, by the running time of the automobile and specified time Section is compared；

When the running time of the automobile is located in the designated time period, determine that the environmental parameter meets described Two running environment conditions.

Optionally, it is described the alcohol concentration is compared with the second concentration range after, further includes:

When except the alcohol concentration being located at second concentration range, determine that the driving condition of the driver is wine It drives；

Prompt information is sent to monitor supervision platform, the prompt information is used to prompt driver's drunk driving of the automobile.

Optionally, the state-detection threshold value includes fatigue detecting threshold value, and the fatigue detecting threshold value includes detection duration Threshold value, frequency threshold value of nodding, frequency threshold value of yawning, duration of diverting attention threshold value, eye-closing period threshold value, eye closing percentage threshold, length Wide proportion threshold value, head angle threshold value and sight angle threshold value；

It is described to be based on the visual information and/or driving status parameter and the state-detection threshold value, it is driven described in determination The driving condition for the person of sailing, comprising:

Image recognition is carried out to the visual information, obtains the facial characteristics of the driver；

Based on the facial characteristics, the detection duration threshold value, the eye closing percentage threshold, the Aspect Ratio threshold Value, the head angle threshold value and the sight angle threshold value, determine the tired information of the driver；

Based on the tired information and/or the driving status parameter and the frequency threshold value of nodding, described yawn Frequency threshold value, divert attention duration threshold value and the eye-closing period threshold value, determine the driving condition of the driver.

Optionally, it is described based on the facial characteristics, it is the detection duration threshold value, the eye closing percentage threshold, described Aspect Ratio threshold value, the head angle threshold value and the sight angle threshold value determine the tired information of the driver, packet It includes:

According to the facial characteristics, determine that eyelid covers the area percentage of pupil, and/or, determine the Aspect Ratio of mouth, And/or determine depression angle when head is overlooked, and/or, determine sight angle；

When the area percentage that the eyelid covers pupil is greater than or equal to the eye closing percentage threshold of the pupil area When, determine that the driver closes one's eyes, and determine eye-closing period of the driver in the detection in long threshold value；And/or

When the Aspect Ratio of the mouth is greater than or equal to the Aspect Ratio threshold value, determine that the driver yawns, And determine the number of yawning of the driver in the detection in long threshold value；And/or

It when the depression angle is greater than or equal to the head angle threshold value, determines that the driver nods, and determines The driver number of nodding in long threshold value in the detection；And/or

When the sight angle is greater than or equal to the sight angle threshold value, the system for distraction of driver is determined, and determine The driver duration of diverting attention in long threshold value in the detection.

Optionally, described based on the tired information and/or the driving status parameter and the number threshold of nodding It is worth, frequency threshold value of yawning, duration of diverting attention threshold value and eye-closing period threshold value, determines the driving condition of the driver, comprising:

When the eye-closing period be greater than or equal to the eye-closing period threshold value, and/or, the number of yawning is greater than or waits In the frequency threshold value of yawning, and/or, the number of nodding is greater than or equal to the frequency threshold value of nodding, and/or, it is described Duration of diverting attention be greater than or equal to it is described divert attention duration threshold value when, determine that the driver is in fatigue driving state；Alternatively,

When the driving status parameter includes the contact area of the steering wheel of the driver and the automobile, the direction When the rotation information for the pressure value and the steering wheel that disk is subject to, if the eye-closing period is greater than or equal to the eye-closing period Threshold value, and/or, the number of yawning is greater than or equal to the frequency threshold value of yawning, and/or, the number of nodding is greater than Or equal to the frequency threshold value of nodding, and/or, the duration of diverting attention be greater than or equal to it is described divert attention duration threshold value when, and/or, The contact area is less than or equal to contact area threshold value, and/or, the pressure value is less than or equal to pressure threshold, and/or, When the rotation information is unsatisfactory for driving rotation condition, determine that the driver is in driving fatigue state.

Second aspect, provides the driving condition determining device of driver a kind of, and described device includes:

Module is obtained, for while the car is driving, driving status parameter, the automobile for obtaining the automobile to be current The visual information of locating environmental information and driver；

First determining module determines state-detection threshold value for being based on the driving status parameter and the environmental information；

Second determining module, for based on the visual information and/or driving status parameter and the state-detection threshold Value, determines the driving condition of the driver.

Optionally, first determining module includes:

First determines submodule, for determining whether the driving status parameter meets driving status condition；

Second determines submodule, described in determining when the driving status parameter meets the driving status condition Whether environmental parameter meets the first traveling environmental condition；

The first adjustment submodule, for adjusting the shape when the environmental parameter is unsatisfactory for the first traveling environmental condition Detection duration threshold value in state detection threshold value, the detection duration threshold value is for limiting the driving condition for detecting the driver Duration；

Third determines submodule, described in determining when the environmental parameter meets the first traveling environmental condition Whether environmental parameter meets the second running environment condition；

Second adjustment submodule, for when the environmental parameter meets the second running environment condition, described in adjustment Fatigue detecting threshold value in state-detection threshold value, the fatigue detecting threshold value for detect the driver whether fatigue driving.

Described second determines that submodule is used for:

The third determines that submodule is used for:

The alcohol concentration is compared with the second concentration range；

Optionally, the third determines that submodule is also used to:

Second determining module includes:

It identifies submodule, for carrying out image recognition to the visual information, obtains the facial characteristics of the driver；

4th determines submodule, for being based on the facial characteristics, the detection duration threshold value, the eye closing percentage threshold Value, the Aspect Ratio threshold value, the head angle threshold value and the sight angle threshold value determine the fatigue letter of the driver Breath；

5th determines submodule, for based on the tired information and/or the driving status parameter and described nodding Frequency threshold value, the frequency threshold value of yawning, divert attention duration threshold value and the eye-closing period threshold value, determine the driver Driving condition.

Optionally, the described 4th determine that submodule is used for:

Optionally, the described 5th determine that submodule is used for:

The third aspect provides a kind of computer readable storage medium, is stored with computer program in the storage medium, The computer program realizes above-mentioned first aspect any method when being executed by processor.

Fourth aspect, provides a kind of automobile, and the automobile includes:

Processor；

Memory for storage processor executable instruction；

Wherein, the processor is configured to the step of executing any one method that above-mentioned first aspect provides.

5th aspect, provides a kind of computer program product comprising instruction, when run on a computer, so that Computer executes the step of any one method that above-mentioned first aspect provides.

Technical solution bring beneficial effect provided by the embodiments of the present application includes at least:

In the embodiment of the present application, the environmental information that the driving status parameter of available automobile, automobile are presently in And the visual information of driver；Based on driving status parameter and environmental information, state-detection threshold value is dynamically determined, and based on view Feel information and/or driving status parameter and state-detection threshold value, determines the driving condition of driver.Due to can be dynamic Status monitoring threshold value is determined, so as to improve the accuracy and reliability of determining driving condition.

Detailed description of the invention

In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.

Fig. 1 is that the driving condition of driver provided by the embodiments of the present application a kind of determines system architecture schematic diagram；

Fig. 2 is that the driving condition of driver provided by the embodiments of the present application a kind of determines method flow diagram；

Fig. 3 is that the driving condition of another driver provided by the embodiments of the present application determines method flow diagram；

Fig. 4 is the driving condition determining device structural schematic diagram of driver provided by the embodiments of the present application a kind of；

Fig. 5 is a kind of first determining module apparatus structure schematic diagram provided by the embodiments of the present application；

Fig. 6 is a kind of second determining module apparatus structure schematic diagram provided by the embodiments of the present application；

Fig. 7 is a kind of structural schematic diagram of automobile provided by the embodiments of the present application.

Specific embodiment

To keep the purposes, technical schemes and advantages of the application clearer, below in conjunction with attached drawing to the application embodiment party Formula is described in further detail.

Before carrying out detailed explanation to the embodiment of the present application, the first application to being related in the embodiment of the present application Scene and system architecture are explained respectively.

Firstly, the application scenarios being related in the embodiment of the present application are introduced.

Currently, in order to avoid driver leads to traffic accident because of fatigue driving or drunk driving in driving, Usually require the driving condition of determining driver.Wherein, when detecting the driving condition of driver, physiological driver can be based on The monitoring method of index, alternatively, vision-based inspection method, alternatively, the detection method of the driving status based on vehicle.But It is, since in the driving condition by determining driver based on the monitoring method of physiological driver's index, driver needs to wear Wearable device is worn, sometimes driver may forget to wear, lead to not the physiological parameter for detecting driver, so as to cause It can not determine the driving condition of driver.When vision-based inspection method determines the driving condition of driver, it usually needs Accurate information is obtained, causes complicated for operation, reduces the efficiency of determining driver's driving condition.In the traveling shape based on vehicle When the detection method of state determines the driving condition of driver, vehicle running state be easy by driver's driving experience and environment because The influence of element leads to the driving condition inaccuracy determined according to the vehicle status parameters of acquisition, reduces determining driver and drive The reliability of state.

Based on such application scenarios, the embodiment of the present application provides one kind being capable of the determining accurate letter of structural reform and reliability The driving condition of driver determines method.

Next, to the invention relates to system architecture be introduced.

Fig. 1 is that a kind of driving condition of driver provided by the embodiments of the present application determines system architecture schematic diagram, referring to figure 1, which includes carbon dioxide sensor 1, alcohol sensor 2, Temperature Humidity Sensor 3, camera 4, steering wheel pressure sensing Device 5, heart rate sensor 6, MCU7 may include data acquisition unit 71 and data processing unit 72, the carbon dioxide sensor 1, Alcohol sensor 2, Temperature Humidity Sensor 3, camera 4, steering wheel sensor 5 and heart rate sensor 6 can be adopted with data respectively Collect unit 71 to connect, data acquisition unit 71 is connect with data processing unit 72.

Wherein, carbon dioxide sensor 1 is used to obtain the gas concentration lwevel in automobile bodies, and alcohol sensor 2 is used for The alcohol concentration of driver position is obtained, Temperature Humidity Sensor 3 is taken the photograph for obtaining humidity value and temperature value in automobile bodies As first 4 visual information due to obtaining driver, steering wheel sensor 5 is for obtaining steering wheel angle angle, steering wheel and driving The pressure value that the contact area and steering wheel for the person of sailing receive, heart rate sensor 6 are used to obtain the heart rate value of driver；Data acquisition Unit 71 is used for from carbon dioxide sensor 1, alcohol sensor 2, Temperature Humidity Sensor 3, camera 4, steering wheel pressure sensing Gas concentration lwevel in automobile bodies, the alcohol concentration of driver position, compartment are obtained in device 5, heart rate sensor 6 respectively Interior humidity value, temperature value, the visual information of driver, steering wheel angle angle, steering wheel and driver contact area, side The heart rate value of the pressure value and driver that are received to disk, and the driving status parameter for the automobile that will acquire, automobile are presently in Environmental information and the visual information of driver be sent to data processing unit 72；Data processing unit 72 is for receiving Driving status parameter, the environmental information that automobile is presently in and the vision of driver for the automobile that data acquisition unit 71 obtains After information, it is based on driving status parameter and environmental information, determines state-detection threshold value；View-based access control model information and/or driving status Parameter and state-detection threshold value, determine the driving condition of driver.

It should be noted that the system further includes vehicle-mounted T-BOX8 and monitor supervision platform 9 referring to Fig. 1.Vehicle-mounted T-BOX8 difference It is connect with data processing unit 72 and monitor supervision platform 9, data processing unit 72 can pass through the driving condition of driver vehicle-mounted T-BOX8 is sent to monitor supervision platform 9.

It, next will be in conjunction with attached drawing to this in the application scenarios to the embodiment of the present application and after system architecture is introduced The driving condition for the driver that application embodiment provides determines that method describes in detail.

Fig. 2 is the flow chart that a kind of driving condition of driver provided by the embodiments of the present application determines method, referring to fig. 2, This method is applied in automobile, includes the following steps.

Step 201: while the car is driving, obtaining the driving status parameter of the automobile, the ring that the automobile is presently in Border information and the visual information of driver.

Step 202: based on the driving status parameter and the environmental information, determining state-detection threshold value.

Step 203: based on the visual information and/or driving status parameter and the state-detection threshold value, determining the driving The driving condition of member.

Optionally, based on the driving status parameter and the environmental information, state-detection threshold value is determined, comprising:

When the driving status parameter meets the driving status condition, determine whether the environmental parameter meets the first traveling ring Border condition；

When the environmental parameter is unsatisfactory for the first traveling environmental condition, the detection duration threshold in the state-detection threshold value is adjusted Value, the detection duration threshold value are used to limit the duration for the driving condition for detecting the driver；

When the environmental parameter meets the first traveling environmental condition, determine whether the environmental parameter meets the second traveling ring Border condition；

When the environmental parameter meets the second running environment condition, the fatigue detecting threshold in the state-detection threshold value is adjusted Value, the fatigue detecting threshold value for detect the driver whether fatigue driving.

Optionally, which includes gas concentration lwevel, humidity value and temperature value in the automobile bodies；

Determine whether the environmental parameter meets the first traveling environmental condition, comprising:

The gas concentration lwevel is compared with the first concentration range, which is compared with humidity range, And the temperature value is compared with temperature range；

When the gas concentration lwevel is not located in the first concentration range, and/or, which is not located in humidity range, And/or the temperature value determines that the environmental parameter is unsatisfactory for the first traveling environmental condition when not being located in temperature range；

When the gas concentration lwevel is located in first concentration range, and the humidity value is located in the humidity range, and should When temperature value is located in the temperature range, determine that the environmental parameter meets the first traveling environmental condition.

Optionally, which further includes the alcohol concentration of the driver position and the running time of the automobile；

Determine whether the environmental parameter meets the second running environment condition, comprising:

The alcohol concentration is compared with the second concentration range；

When the alcohol concentration is located in second concentration range, the running time of the automobile and designated time period are carried out Compare；

When the running time of the automobile is located in the designated time period, determine that the environmental parameter meets the second traveling ring Border condition.

Optionally, after which being compared with the second concentration range, further includes:

When except the alcohol concentration being located at second concentration range, determine that the driving condition of the driver is drunk driving；

Prompt information is sent to monitor supervision platform, which is used to prompt driver's drunk driving of the automobile.

Optionally, which includes fatigue detecting threshold value, the fatigue detecting threshold value include detection duration threshold value, It nods frequency threshold value, frequency threshold value of yawning, duration of diverting attention threshold value, eye-closing period threshold value, eye closing percentage threshold, Aspect Ratio Threshold value, head angle threshold value and sight angle threshold value；

Driving for the driver should be determined based on the visual information and/or driving status parameter and the state-detection threshold value Sail state, comprising:

Based on the facial characteristics, the detection duration threshold value, the eye closing percentage threshold, the Aspect Ratio threshold value, the head Angle threshold and the sight angle threshold value, determine the tired information of the driver；

Based on the fatigue information and/or the driving status parameter and the frequency threshold value of nodding, the number threshold of yawning Value, divert attention duration threshold value and the eye-closing period threshold value, determine the driving condition of the driver.

Optionally, based on the facial characteristics, the detection duration threshold value, the eye closing percentage threshold, the Aspect Ratio threshold value, The head angle threshold value and the sight angle threshold value, determine the tired information of the driver, comprising:

When the area percentage that the eyelid covers pupil is greater than or equal to the eye closing percentage threshold of the pupil area, really The fixed driver closes one's eyes, and determines eye-closing period of the driver in the detection duration threshold value；And/or

It when the Aspect Ratio of the mouth is greater than or equal to the Aspect Ratio threshold value, determines that the driver yawns, and determines Yawn number of the driver in the detection duration threshold value；And/or

It when the depression angle is greater than or equal to the head angle threshold value, determines that the driver nods, and determines the driving Nod number of the member in the detection duration threshold value；And/or

When the sight angle is greater than or equal to the sight angle threshold value, the system for distraction of driver is determined, and determine the driving Divert attention duration of the member in the detection duration threshold value.

Optionally, based on the fatigue information and/or the driving status parameter and the frequency threshold value of nodding, yawn it is secondary Number threshold value, duration of diverting attention threshold value and eye-closing period threshold value, determine the driving condition of the driver, comprising:

When the eye-closing period is greater than or equal to the eye-closing period threshold value, and/or, the number of yawning is more than or equal to this dozen Yawn frequency threshold value, and/or, the number of nodding more than or equal to the frequency threshold value of nodding, and/or, the duration of diverting attention be greater than or Equal to this divert attention duration threshold value when, determine that the driver is in fatigue driving state；Alternatively,

The contact area that includes the steering wheel of the driver and the automobile when the driving status parameter, direction disk are subject to When pressure value and the rotation information of direction disk, if the eye-closing period is greater than or equal to the eye-closing period threshold value, and/or, it should Number of yawning is greater than or equal to the frequency threshold value of yawning, and/or, the number of nodding is more than or equal to the number threshold of nodding Value, and/or, this divert attention duration more than or equal to this divert attention duration threshold value when, and/or, the contact area be less than or equal to contact Area threshold, and/or, which is less than or equal to pressure threshold, and/or, which is unsatisfactory for driving rotation condition When, determine that the driver is in driving fatigue state.

All the above alternatives, can form the alternative embodiment of the application according to any combination, and the application is real It applies example and this is no longer repeated one by one.

Fig. 3 is the flow chart that a kind of driving condition of driver provided by the embodiments of the present application determines method, referring to Fig. 3, This method comprises the following steps.

Step 301: while the car is driving, the environmental information that automobile obtains driving status parameter, automobile is presently in And the visual information of driver.

Since driver is after long-duration driving automobile, the reaction of driver may become blunt, so as to cause traffic Accident occurs.Therefore, in order to determine the driving condition of driver, driver is avoided to lead to that traffic thing will occur because of fatigue driving Therefore automobile needs to need to obtain driving status parameter, automobile in the process of moving current in the driving condition for determining driver The visual information of locating environmental information and driver.

It should be noted that the driving information may include travel speed, driving mode, driver and the automobile of automobile The rotation information etc. of pressure value and steering wheel that the contact area of steering wheel, steering wheel are subject to；Environmental information may include automobile Gas concentration lwevel, humidity value, temperature value, the alcohol concentration of driver position, running time of automobile etc. in compartment.

Wherein, automobile can obtain the gas concentration lwevel in automobile bodies by the carbon dioxide sensor of installation；With/ Or, obtaining the alcohol concentration of driver position by the alcohol sensor of installation；And/or it is passed by the temperature and humidity of installation Sensor obtains humidity value and temperature value in automobile bodies；And/or it is presently in by the light intensity sensor acquisition automobile of installation The intensity of illumination of environment determines the automobile at the appointed time interior traveling of section, that is to say, vapour when intensity of illumination is less than intensity threshold Vehicle can determine that be currently at traveling on daytime still travels at night according to intensity of illumination.Alternatively, automobile can be can pass through The time that car-mounted terminal is shown determines specific running time.

In addition, due under normal conditions, for physiological parameters such as the hearts rate that obtains driver, it usually needs driver Wearable device is worn, driver may be allowed to interfere, and driver may also can forget therefore wearing wearable device is Guarantee to get the physiological parameter of driver, heart rate sensor can be set in the steering wheel of automobile, work as driver When holding steering wheel, the heart rate information of the available driver of heart rate sensor in steering wheel, meanwhile, the pressure in steering wheel Sensor and area transducer can obtain the pressure value that steering wheel is subject to and the contact area with driver respectively.

It should be noted that the designated time period can be arranged in advance, for example, the designated time period can be for late 7 points extremely 7 points early, late 8 points to early 7 points etc..

Furthermore automobile can obtain the view for sailing state parameter, the environmental information that automobile is presently in and driver in real time Feel information, can also obtain when the running car time reaching traveling duration threshold value and sail state parameter, the ring that automobile is presently in Border information and the visual information of driver, can also be every the environment letter that time interval sails state parameter, automobile is presently in The visual information of breath and driver.The traveling duration threshold value and time interval can be arranged in advance, for example, the traveling duration threshold Value can be 2 hours, 3 hours etc., and time interval can be 30 minutes, 1 hour etc..

Step 302: automobile is based on driving status parameter and environmental information, determines state-detection threshold value.

Since driver will not usually match very much in daytime driving automobile, but logical produce more is held when driving a car at night It is easily tired out, the driving condition of driver is measured by identical state-detection threshold value, may result in determining driving condition Accuracy is not high.Therefore, in order to improve the accuracy of determining driver status, automobile can be based on driving status parameter and environment Information determines state-detection threshold value.

It should be noted that state-detection threshold value may include detection duration threshold value and fatigue detecting threshold value, when the detection Long threshold value is used to limit the duration of the driving condition of detection driver, and fatigue detecting threshold value for detecting driver, whether drive by fatigue It sails.The fatigue detecting threshold value may include nod frequency threshold value, frequency threshold value of yawning, duration of diverting attention threshold value, eye-closing period threshold Value, eye closing percentage threshold, Aspect Ratio threshold value, head angle threshold value and sight angle threshold value.

Wherein, automobile is based on driving status parameter and environmental information, determines that the operation of state-detection threshold value can be with are as follows: determine Whether driving status parameter meets driving status condition；When driving status parameter meets driving status condition, determine that environment is joined Whether number meets the first traveling environmental condition；When environmental parameter is unsatisfactory for the first traveling environmental condition, state-detection threshold is adjusted Detection duration threshold value in value；When environmental parameter meets the first traveling environmental condition, determine whether environmental parameter meets second Running environment condition；When environmental parameter meets the second running environment condition, the fatigue detecting threshold in state-detection threshold value is adjusted Value, the fatigue detecting threshold value for detect driver whether fatigue driving.

It should be noted that the driving status parameter may include the travel speed of automobile, therefore, when the traveling speed of automobile When degree is greater than or equal to threshold speed, determine that driving condition parameter meets driving status condition.The threshold speed can be set in advance It sets, for example, the threshold speed can be 15,000 ms/h, 16,000 ms/h etc..

In addition, since environmental information may include the information such as gas concentration lwevel in automobile bodies, humidity value and temperature value, Therefore, automobile determine whether environmental parameter meets the operation of running environment condition can be with are as follows: gas concentration lwevel is dense with first Degree range is compared, and humidity value is compared with humidity range, and temperature value is compared with temperature range；Work as dioxy Change concentration of carbon not being located in the first concentration range, and/or, humidity value is not located in humidity range, and/or, temperature value is not located at When in temperature range, determine that environmental parameter is unsatisfactory for the first traveling environmental condition；When gas concentration lwevel is located at the first concentration model In enclosing, and humidity value is located in humidity range, and when temperature value is located in temperature range, by alcohol concentration and the second concentration range It is compared；When alcohol concentration is located in the second concentration range, determine that environmental parameter meets the first traveling environmental condition.

Since environmental information further includes the alcohol concentration of driver position and the running time of automobile, automobile Determining whether environmental parameter meets the operation of the second running environment condition can be with are as follows: by the running time and designated time period of automobile It is compared；When the running time of automobile is located in designated time period, determine that environmental parameter meets the second running environment condition.

Since gas concentration lwevel, humidity value, temperature value may influence the driving condition of driver in compartment, for example, In carbon dioxide, denseer and humidity is larger, in the higher environment of temperature, and driver is easier to enter fatigue state, therefore, when Gas concentration lwevel is not located in the first concentration range, and/or, humidity value is not located in humidity range, and/or, temperature value is not When in temperature range, determines that environmental parameter is unsatisfactory for the first traveling environmental condition, can shorten judge that driver is at this time The duration of no fatigue driving, that is to say, adjustment detection duration threshold value.

Due to being located in the first concentration range when gas concentration lwevel, and humidity value is located in humidity range, and temperature value When in temperature range, illustrates that driver's current environment is not easy that driver is made to enter fatigue state, can determine other Influence of the factor to driver.Therefore, alcohol concentration can be compared with the second concentration range；When alcohol concentration is located at the When in two concentration ranges, illustrating driver, there is no drunk drivings, at this point it is possible to continue to determine influence of the other factors to driver. Therefore, the running time of automobile can be compared with designated time period；It can be seen from the above, designated time period can be at night Period, for example, 7 points to early 7 points of evening, it is also to be easily accessible fatigue state when driver drives at night, in order to accurately true The driving condition for determining driver needs to shorten fatigue detecting threshold value, therefore, when the running time of automobile is located in designated time period When, it can determine that environmental parameter meets the second running environment condition, adjust fatigue detecting threshold value, and execute following step 303 Operation.

It should be noted that the first concentration range, the second concentration range, temperature range and humidity range can be set in advance It sets, for example, first concentration range can be 500PPM (parts permillion) -700PPM etc., the second concentration range 1.59kg/m3 (kilograms per cubic meter) -3kg/m3 etc., temperature range can be 10 degrees Celsius -25 degrees Celsius etc., humidity range 40%-45% etc..

Further, after alcohol concentration is compared by automobile with the second concentration range, alcohol concentration may for positioned at Except second concentration range, automobile can determine that the driving condition of driver is drunk driving at this time, and send and prompt to monitor supervision platform Information, the prompt information are used to prompt driver's drunk driving of the automobile.

It should be noted that the monitor supervision platform can be the platform of traffic administration department, may include in the prompt information The information such as license plate number, the vehicle location of automobile will be prompted to information and be sent to monitor supervision platform, so as to so that traffic administration department is fast Speed positioning drunk driver, reduces traffic accident.

In addition, after running time is compared by automobile with designated time period, when the running time of automobile be not located at it is specified When in the period, it is determined that environmental parameter is unsatisfactory for the second running environment condition.Determine that environmental parameter is unsatisfactory for first in automobile Running environment condition, automobile can not change fatigue detecting threshold value set in advance, and execute the operation of following step 303.When When environmental parameter is unsatisfactory for the second running environment condition, automobile can not change detection duration threshold value set in advance, and execute The operation of following step 303.

Step 303: automobile view-based access control model information and/or driving status parameter and state-detection threshold value determine driver Driving condition.

Since the visual information of driver and/or the driving status parameter of automobile can reflect the driving condition of driver, Therefore, automobile can determine the driving of driver with view-based access control model information and/or driving status parameter and state-detection threshold value State.And since state-detection threshold value includes fatigue detecting threshold value, fatigue detecting threshold value includes detection duration threshold value, number of nodding Threshold value, frequency threshold value of yawning, duration of diverting attention threshold value, eye-closing period threshold value, eye closing percentage threshold, Aspect Ratio threshold value, head Portion's angle threshold and sight angle threshold value.Therefore, automobile view-based access control model information and/or driving status parameter and state-detection Threshold value, determines that the operation of the driving condition of driver can be with are as follows: carries out image recognition to visual information, obtains the face of driver Feature；Based on facial characteristics, detection duration threshold value, eye closing percentage threshold, Aspect Ratio threshold value, head angle threshold value and sight Angle threshold determines the tired information of the driver；Based on tired information and/or driving status parameter, and number threshold of nodding It is worth, frequency threshold value of yawning, duration of diverting attention threshold value and eye-closing period threshold value, determines the driving condition of driver.

Wherein, visual information can be input in identification model by automobile, acquire driver's by identification model Facial characteristics, the identification model can be Adaboost classifier.Alternatively, passing through the characteristic point of ASM model inspection face, obtain Human face characteristic point, according to the DBN (Deep Belief Network, deepness belief network) of face characteristic tracking and Expression Recognition Model obtains facial characteristics.The facial characteristics may include facial expression, face action, face feature point etc..

In addition, automobile is based on facial characteristics, detection duration threshold value, eye closing percentage threshold, Aspect Ratio threshold value, head angle Threshold value and sight angle threshold value are spent, determines that the operation of the tired information of driver can be with are as follows: according to facial characteristics, determine that eyelid hides The firmly area of pupil, and/or, determine the Aspect Ratio of mouth, and/or, determine depression angle when head is overlooked, and/or, Determine sight angle；When the area that eyelid covers pupil is greater than or equal to eye closing percentage threshold, determine that driver closes one's eyes, and Determine eye-closing period of the driver when detecting in long threshold value；And/or when the Aspect Ratio of mouth is greater than or equal to Aspect Ratio threshold It when value, determines that driver yawns, and determines yawn number of the driver when detecting in long threshold value；And/or work as depression angle It when degree is greater than or equal to head angle threshold value, determines that driver nods, and determines driver's nodding in long threshold value when detecting Number；And/or when sight angle is greater than or equal to sight angle threshold value, system for distraction of driver is determined, and determine that driver is examining Survey the duration of diverting attention in duration threshold value.

It since driver is in fatigue, often yawns, nod, close one's eyes, divert attention, therefore, which can wrap Driver is included to yawn number, number of nodding, eye-closing period, duration of diverting attention.Automobile can be based on facial characteristics, detection duration threshold Value, eye closing percentage threshold, Aspect Ratio threshold value, head angle threshold value and sight angle threshold value determine that driver grows when detecting Number of yawning, number of nodding in threshold value, eye-closing period, duration of diverting attention.

It should be noted that detection duration threshold value and/or eye closing percentage threshold, Aspect Ratio threshold value, head angle threshold Value and sight angle threshold value can be threshold value set in advance, be also possible to the threshold after being adjusted according to numerical value set in advance Value, for example, detection duration threshold value can be 3 seconds, 5 seconds etc., Aspect Ratio threshold value can be 0.7,0.8 etc., eye closing percentage It can be 70%, 80 etc. than threshold value, which can be 30 degree, 40 degree etc., and sight angle threshold value can be 10 degree, 15 degree etc., and according to sight offset direction difference, sight angle threshold value can not be identical, for example, the view of horizontal direction Line angle threshold can be 15 degree, and the sight angle of vertical direction can be 10 degree.

In addition, automobile is based on tired information and/or driving status parameter, and frequency threshold value of nodding, number threshold of yawning It is worth, duration of diverting attention threshold value and eye-closing period threshold value, determines that the operation of the driving condition of driver can be with are as follows: when eye-closing period is greater than Or it is equal to eye-closing period threshold value, and/or, number of yawning is greater than or equal to frequency threshold value of yawning, and/or, number of nodding is big In or equal to nodding frequency threshold value, and/or, duration of diverting attention is greater than or equal to when diverting attention duration threshold value, determines that driver is in tired Labor driving condition；Alternatively, working as the contact area for the steering wheel that driving status parameter includes driver and automobile, steering wheel is subject to When pressure value and the rotation information of steering wheel, if eye-closing period is greater than or equal to eye-closing period threshold value, and/or, it yawns secondary Number is greater than or equal to frequency threshold value of yawning, and/or, number of nodding is greater than or equal to frequency threshold value of nodding, and/or, when diverting attention It is long to be greater than or equal to when diverting attention duration threshold value, and/or, contact area is less than or equal to contact area threshold value, and/or, pressure value Less than or equal to pressure threshold, and/or, when rotation information is unsatisfactory for driving rotation condition, determine that driver is in driving fatigue State.

It should be noted that frequency threshold value of nodding, frequency threshold value of yawning, duration of diverting attention threshold value and eye-closing period threshold value can Think threshold value set in advance, is also possible to the threshold value after being adjusted according to threshold value set in advance, the frequency threshold value of nodding Can be 10 times, 5 times etc., this yawn frequency threshold value can for 10 times, 5 times etc., duration of diverting attention threshold value can for 5 seconds, 10 seconds etc., or to detect 50%, 70% etc. of duration threshold value.Eye-closing period threshold value can be 5 seconds, 10 seconds, Huo Zhewei Detect 50%, 70 etc. of duration threshold value.

In one possible implementation, it due to being travelled except automobile at the appointed time section, that is to say, automobile is white Its traveling, and automobile can permit driver and generate certain feeling of fatigue, therefore, automobile can in automatic driving mode downward driving To determine the frequency threshold value of nodding, frequency threshold value of yawning, duration of diverting attention threshold value and eye-closing period threshold value for threshold set in advance Value, and work as eye-closing period and be greater than or equal to eye-closing period threshold value, and/or, number of yawning is greater than or equal to number threshold of yawning Value, and/or, number of nodding is greater than or equal to frequency threshold value of nodding, and/or, duration of diverting attention is greater than or equal to duration threshold value of diverting attention When, automobile can determine that driver is in fatigue driving state.And when automobile at the appointed time within travel, and automobile is automatic When driving mode downward driving, since night driver sense tired out is heavier, automobile can determine the frequency threshold value of nodding, beat Yawn frequency threshold value, duration of diverting attention threshold value and eye-closing period threshold value are the threshold value after being adjusted according to threshold value set in advance, And work as eye-closing period and be greater than or equal to eye-closing period threshold value, and/or, number of yawning is greater than or equal to frequency threshold value of yawning, And/or number of nodding is greater than or equal to and nods frequency threshold value, and/or, duration of diverting attention is greater than or equal to when diverting attention duration threshold value, Automobile can determine that driver is in fatigue driving state.

In alternatively possible implementation, travels, that is to say except automobile at the appointed time section, automobile is on daytime Traveling, and automobile, in pilot steering mode downward driving, automobile can determine frequency threshold value of nodding, frequency threshold value of yawning, divide Refreshing duration threshold value and eye-closing period threshold value are threshold value set in advance, and when driving status parameter includes the side of driver and automobile When the rotation information of the pressure value and steering wheel that are subject to the contact area of disk, steering wheel, if eye-closing period is greater than or equal to Eye-closing period threshold value, and/or, number of yawning is greater than or equal to frequency threshold value of yawning, and/or, number of nodding is greater than or waits In frequency threshold value of nodding, and/or, duration of diverting attention be greater than or equal to divert attention duration threshold value when, and/or, contact area is less than or waits In contact area threshold value, and/or, pressure value is less than or equal to pressure threshold, and/or, rotation information is unsatisfactory for driving rotation strip When part, determine that driver is in driving fatigue state.

It in alternatively possible implementation, travels, that is to say when in automobile at the appointed time section, automobile is in night row It sails, and automobile, in pilot steering mode downward driving, automobile can determine frequency threshold value of nodding, frequency threshold value of yawning, divert attention Duration threshold value and eye-closing period threshold value are the threshold value after being adjusted according to threshold value set in advance, when driving status parameter includes When the rotation information of the contact area of the steering wheel of driver and automobile, the pressure value that steering wheel is subject to and steering wheel, if closed It is at the moment long more than or equal to eye-closing period threshold value, and/or, number of yawning is greater than or equal to frequency threshold value of yawning, and/or, Number of nodding, which is greater than or equal to, nods frequency threshold value, and/or, duration of diverting attention is greater than or equal to when diverting attention duration threshold value, and/or, Contact area is less than or equal to contact area threshold value, and/or, pressure value is less than or equal to pressure threshold, and/or, rotation information When being unsatisfactory for driving rotation condition, determine that driver is in driving fatigue state.

In addition, when being in fatigue driving state due to driver, driver can can one hand hold steering wheel or both hands are held The contact area of steering wheel, steering wheel and driver reduce, and the pressure value being subject to reduces, meanwhile, steering wheel may driven The person of sailing controls lower fine rotation, and therefore, automobile may be used also after the tired information to driver is compared with fatigue detecting threshold value To determine whether contact area is less than or equal to contact area threshold value, and/or, whether pressure value is less than or equal to pressure threshold, And/or whether rotation information meets driving rotation condition, and is less than or equal to contact area threshold value in contact area, and/or, Pressure value is less than or equal to pressure threshold, and/or, when rotation information meets driving rotation condition, determines that driver is in and drive Fatigue state.

It should be noted that contact area threshold value, pressure threshold and rotation condition can be arranged in advance, for example, this connects Touching area threshold can be that pressure threshold can be 10N (newton), 15N etc., and driving rotation condition can be to grow when detecting Steering wheel does not rotate in threshold value and/or steering wheel rotational angle is greater than or equal to rotational angle threshold value etc., the angle of rotation Degree threshold value can be arranged in advance, for example, the rotational angle threshold value can be 20 degree, 30 degree etc..

It further, can also include heart rate sensor in steering wheel, when driver holds heart rate sensor, heart rate is passed Sensor can acquire the heart rate of driver, therefore, automobile can also contact area be less than or equal to contact area threshold value, and/ Or, pressure value is less than or equal to pressure threshold, and/or, after rotation information meets driving rotation condition, compare the heart rate of driver Size between heart rate threshold determines that driver drives in fatigue when the heart rate of driver is less than or equal to heart rate threshold State is sailed, otherwise, it determines driver is not at fatigue driving state.

It should be noted that the heart rate threshold can be arranged in advance, for example, the heart rate threshold can be 70 beats/min, 80 Beat/min etc..

Step 304: when driver is in fatigue driving state, automobile reminds driver.

When due to driving a car in the case that driver is in fatigue driving state, it is likely that can be led because slow in reacting Driving technology decline is caused, to cause traffic accident.Therefore, in order to reduce the risk that traffic accident occurs, work as driving When member is in fatigue driving state, automobile can be reminded driver.

Wherein, automobile can be reminded by playing prompting message, early warning the tinkle of bells and/or shaking the modes such as seat, safety belt Driver is sure not fatigue driving.

In the embodiment of the present application, the environment letter that the driving status parameter of the available automobile of automobile, automobile are presently in The visual information of breath and driver；Based on driving status parameter and environmental information, state-detection threshold value, and base are dynamically determined In visual information and/or driving status parameter and state-detection threshold value, the driving condition of driver is determined.Due to that can move The determination status monitoring threshold value of state, so as to improve the accuracy and reliability of determining driving condition.

After the driving condition to driver provided by the embodiments of the present application determines that method is explained, connect down Come, the driving condition determining device of driver provided by the embodiments of the present application is introduced.

Fig. 4 is a kind of block diagram of the driving condition determining device for driver that the embodiment of the present disclosure provides, referring to fig. 4, should Device being implemented in combination with by software, hardware or both.The device includes: to obtain module 401, the first determining module 402 With the second determining module 403.

Module 401 is obtained, for while the car is driving, obtains the driving status parameter of the automobile, the automobile The visual information of the environmental information and driver that are presently in；

First determining module 402 determines state-detection threshold for being based on the driving status parameter and the environmental information Value；

Second determining module 403, for based on the visual information and/or the inspection of driving status parameter and the state Threshold value is surveyed, determines the driving condition of the driver.

Optionally, referring to Fig. 5, first determining module 402 includes:

First determines submodule 4021, for determining whether the driving status parameter meets driving status condition；

Second determines submodule 4022, for determining when the driving status parameter meets the driving status condition Whether the environmental parameter meets the first traveling environmental condition；

The first adjustment submodule 4023, for adjusting institute when the environmental parameter is unsatisfactory for the first traveling environmental condition The detection duration threshold value in state-detection threshold value is stated, the detection duration threshold value is for limiting the driving shape for detecting the driver The duration of state；

Third determines submodule 4024, for determining when the environmental parameter meets the first traveling environmental condition Whether the environmental parameter meets the second running environment condition；

Second adjustment submodule 4025, for adjusting when the environmental parameter meets the second running environment condition Fatigue detecting threshold value in the state-detection threshold value, the fatigue detecting threshold value for detecting the driver, whether drive by fatigue It sails.

Described second determines that submodule 4022 is used for:

The third determines that submodule 4024 is used for:

The alcohol concentration is compared with the second concentration range；

Optionally, the third determines that submodule 4024 is also used to:

Referring to Fig. 6, second determining module 403 includes:

Identify submodule 4031, for carrying out image recognition to the visual information, the face for obtaining the driver is special Sign；

4th determines submodule 4032, for being based on the facial characteristics, the detection duration threshold value, the eye closing percentage Than threshold value, the Aspect Ratio threshold value, the head angle threshold value and the sight angle threshold value, determine that the driver's is tired Labor information；

5th determines submodule 4033, for based on the tired information and/or the driving status parameter and described Nod frequency threshold value, the frequency threshold value of yawning, divert attention duration threshold value and the eye-closing period threshold value, determine described in drive The driving condition for the person of sailing.

Optionally, the described 4th determine that submodule 4032 is used for:

Optionally, the described 5th determine that submodule 4033 is used for:

In conclusion in the embodiment of the present application, the driving status parameter of the available automobile of automobile, automobile are presently in Environmental information and driver visual information；Based on driving status parameter and environmental information, state-detection is dynamically determined Threshold value, and view-based access control model information and/or driving status parameter and state-detection threshold value, determine the driving condition of driver.By In can dynamically determine status monitoring threshold value, so as to improve the accuracy and reliability of determining driving condition.

It should be understood that the driving condition determining device of driver provided by the above embodiment is determining driving for driver When sailing state, only the example of the division of the above functional modules, in practical application, can according to need and will be above-mentioned Function distribution is completed by different functional modules, i.e., the internal structure of device is divided into different functional modules, with complete with The all or part of function of upper description.In addition, the driving condition determining device of driver provided by the above embodiment and driving The driving condition of member determines that embodiment of the method belongs to same design, and specific implementation process is detailed in embodiment of the method, here no longer It repeats.

Fig. 7 shows the structural block diagram of the automobile 700 of one exemplary embodiment of the application offer.

In general, automobile 700 includes: processor 701 and memory 702.

Processor 701 may include one or more processing cores, such as 4 core processors, 8 core processors etc..Place Reason device 701 can use DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed Logic array) at least one of example, in hardware realize.Processor 701 also may include primary processor and coprocessor, master Processor is the processor for being handled data in the awake state, also referred to as CPU (Central Processing Unit, central processing unit)；Coprocessor is the low power processor for being handled data in the standby state.? In some embodiments, processor 701 can be integrated with GPU (Graphics Processing Unit, image processor), GPU is used to be responsible for the rendering and drafting of content to be shown needed for display screen.In some embodiments, processor 701 can also be wrapped AI (Artificial Intelligence, artificial intelligence) processor is included, the AI processor is for handling related machine learning Calculating operation.

Memory 702 may include one or more computer readable storage mediums, which can To be non-transient.Memory 702 may also include high-speed random access memory and nonvolatile memory, such as one Or multiple disk storage equipments, flash memory device.In some embodiments, the non-transient computer in memory 702 can Storage medium is read for storing at least one instruction, at least one instruction performed by processor 701 for realizing this Shen Please in the driving condition of driver that provides of embodiment of the method determine method.

In some embodiments, automobile 700 is also optional includes: peripheral device interface 703 and at least one peripheral equipment. It can be connected by bus or signal wire between processor 701, memory 702 and peripheral device interface 703.Each peripheral equipment It can be connected by bus, signal wire or circuit board with peripheral device interface 703.Specifically, peripheral equipment includes: radio circuit 704, at least one of touch display screen 705, camera 706, voicefrequency circuit 707, positioning component 708 and power supply 709.

Peripheral device interface 703 can be used for I/O (Input/Output, input/output) is relevant outside at least one Peripheral equipment is connected to processor 701 and memory 702.In some embodiments, processor 701, memory 702 and peripheral equipment Interface 703 is integrated on same chip or circuit board；In some other embodiments, processor 701, memory 702 and outer Any one or two in peripheral equipment interface 703 can realize on individual chip or circuit board, the present embodiment to this not It is limited.

Radio circuit 704 is for receiving and emitting RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal.It penetrates Frequency circuit 704 is communicated by electromagnetic signal with communication network and other communication equipments.Radio circuit 704 turns electric signal It is changed to electromagnetic signal to be sent, alternatively, the electromagnetic signal received is converted to electric signal.Optionally, radio circuit 704 wraps It includes: antenna system, RF transceiver, one or more amplifiers, tuner, oscillator, digital signal processor, codec chip Group, user identity module card etc..Radio circuit 704 can be carried out by least one wireless communication protocol with other terminals Communication.The wireless communication protocol includes but is not limited to: Metropolitan Area Network (MAN), each third generation mobile communication network (2G, 3G, 4G and 5G), wireless office Domain net and/or WiFi (Wireless Fidelity, Wireless Fidelity) network.In some embodiments, radio circuit 704 may be used also To include the related circuit of NFC (Near Field Communication, wireless near field communication), the application is not subject to this It limits.

Display screen 705 is for showing UI (User Interface, user interface).The UI may include figure, text, figure Mark, video and its their any combination.When display screen 705 is touch display screen, display screen 705 also there is acquisition to show The ability of the touch signal on the surface or surface of screen 705.The touch signal can be used as control signal and be input to processor 701 are handled.At this point, display screen 705 can be also used for providing virtual push button and/or dummy keyboard, also referred to as soft button and/or Soft keyboard.In some embodiments, display screen 705 can be one, and the front panel of automobile 700 is arranged；In other embodiments In, display screen 705 can be at least two, be separately positioned on the different surfaces of automobile 700 or in foldover design；In still other reality It applies in example, display screen 705 can be flexible display screen, be arranged on the curved surface of automobile 700 or on fold plane.Even, it shows Display screen 705 can also be arranged to non-rectangle irregular figure, namely abnormity screen.Display screen 705 can use LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) Etc. materials preparation.

CCD camera assembly 706 is for acquiring image or video.Optionally, CCD camera assembly 706 include front camera and Rear camera.In general, the front panel of terminal is arranged in front camera, the back side of terminal is arranged in rear camera.One In a little embodiments, rear camera at least two is main camera, depth of field camera, wide-angle camera, focal length camera shooting respectively Any one in head, to realize that main camera and the fusion of depth of field camera realize background blurring function, main camera and wide-angle Camera fusion realizes that pan-shot and VR (Virtual Reality, virtual reality) shooting function or other fusions are clapped Camera shooting function.

Voicefrequency circuit 707 may include microphone and loudspeaker.Microphone is used to acquire the sound wave of user and environment, and will Sound wave, which is converted to electric signal and is input to processor 701, to be handled, or is input to radio circuit 704 to realize voice communication. For stereo acquisition or the purpose of noise reduction, microphone can be separately positioned on the different parts of automobile 700 to be multiple.Mike Wind can also be array microphone or omnidirectional's acquisition type microphone.Loudspeaker is then used to that processor 701 or radio circuit will to be come from 704 electric signal is converted to sound wave.Loudspeaker can be traditional wafer speaker, be also possible to piezoelectric ceramic loudspeaker.When When loudspeaker is piezoelectric ceramic loudspeaker, the audible sound wave of the mankind can be not only converted electrical signals to, it can also be by telecommunications Number the sound wave that the mankind do not hear is converted to carry out the purposes such as ranging.In some embodiments, voicefrequency circuit 707 can also include Earphone jack.

Positioning component 708 is used to position the current geographic position of automobile 700, to realize navigation or LBS (Location Based Service, location based service).Positioning component 708 can be the GPS (Global based on the U.S. Positioning System, global positioning system), the dipper system of China, Russia Gray receive this system or European Union The positioning component of Galileo system.

Power supply 709 is used to be powered for the various components in automobile 700.Power supply 709 can be alternating current, direct current, Disposable battery or rechargeable battery.When power supply 709 includes rechargeable battery, which can support wired charging Or wireless charging.The rechargeable battery can be also used for supporting fast charge technology.

In some embodiments, automobile 700 further includes having one or more sensors 710.

It that is to say, the embodiment of the present application provides not only a kind of automobile, including processor and can hold for storage processor The memory of row instruction, wherein processor is configured as executing the method in Fig. 2 and embodiment shown in Fig. 3, moreover, this Shen Please embodiment additionally provide a kind of computer readable storage medium, be stored with computer program in the storage medium, the computer The driving condition that Fig. 2 and the driver in embodiment shown in Fig. 3 may be implemented when program is executed by processor determines method.

It will be understood by those skilled in the art that structure shown in Fig. 7 does not constitute the restriction to automobile 700, can wrap It includes than illustrating more or fewer components, perhaps combine certain components or is arranged using different components.

Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..

The foregoing is merely the preferred embodiments of the application, not to limit the application, it is all in spirit herein and Within principle, any modification, equivalent replacement, improvement and so on be should be included within the scope of protection of this application.

Claims

1. a kind of driving condition of driver determines method, which is characterized in that the described method includes:

While the car is driving, obtain the driving status parameter of the automobile, environmental information that the automobile is presently in And the visual information of driver；

Based on the visual information and/or driving status parameter and the state-detection threshold value, driving for the driver is determined Sail state.

2. the method as described in claim 1, which is characterized in that described to be believed based on the driving status parameter and the environment Breath, determines state-detection threshold value, comprising:

When the driving status parameter meets the driving status condition, determine whether the environmental parameter meets the first traveling Environmental condition；

When the environmental parameter meets the first traveling environmental condition, determine whether the environmental parameter meets the second traveling Environmental condition；

When the environmental parameter meets the second running environment condition, the fatigue detecting in the state-detection threshold value is adjusted Threshold value, the fatigue detecting threshold value for detect the driver whether fatigue driving.

3. method according to claim 2, which is characterized in that the environmental information includes carbon dioxide in the automobile bodies Concentration, humidity value and temperature value；

The gas concentration lwevel is compared with the first concentration range, the humidity value is compared with humidity range, And the temperature value is compared with temperature range；

When the gas concentration lwevel is not located in the first concentration range, and/or, the humidity value is not located in humidity range, And/or the temperature value determines that the environmental parameter is unsatisfactory for the first running environment item when not being located in temperature range Part；

When the gas concentration lwevel is located in first concentration range, and the humidity value is located in the humidity range, And the temperature value determines that the environmental parameter meets the first traveling environmental condition when being located in the temperature range.

4. method as claimed in claim 2 or claim 3, which is characterized in that the environmental information further includes that the driver institute is in place The running time of the alcohol concentration and the automobile set；

The alcohol concentration is compared with the second concentration range；

When the alcohol concentration is located in second concentration range, by the running time of the automobile and designated time period into Row compares；

When the running time of the automobile is located in the designated time period, determine that the environmental parameter meets second row Sail environmental condition.

5. method as claimed in claim 4, which is characterized in that described to compare the alcohol concentration and the second concentration range After relatively, further includes:

6. the method as described in claim 1, which is characterized in that the state-detection threshold value includes fatigue detecting threshold value, described When fatigue detecting threshold value includes detection duration threshold value, frequency threshold value of nodding, frequency threshold value of yawning, duration of diverting attention threshold value, eye closing Long threshold value, eye closing percentage threshold, Aspect Ratio threshold value, head angle threshold value and sight angle threshold value；

It is described to be based on the visual information and/or driving status parameter and the state-detection threshold value, determine the driver Driving condition, comprising:

Based on the facial characteristics, the detection duration threshold value, the eye closing percentage threshold, the Aspect Ratio threshold value, institute Head angle threshold value and the sight angle threshold value are stated, determines the tired information of the driver；

Based on the tired information and/or the driving status parameter and the frequency threshold value of nodding, the number of yawning Threshold value, divert attention duration threshold value and the eye-closing period threshold value, determine the driving condition of the driver.

7. method as claimed in claim 6, which is characterized in that it is described based on the facial characteristics, the detection duration threshold value, The eye closing percentage threshold, the Aspect Ratio threshold value, the head angle threshold value and the sight angle threshold value, determine institute State the tired information of driver, comprising:

According to the facial characteristics, determine that eyelid covers the area percentage of pupil, and/or, determine the Aspect Ratio of mouth, and/ Or, determine depression angle when head is overlooked, and/or, determine sight angle；

When the area percentage that the eyelid covers pupil is greater than or equal to the eye closing percentage threshold of the pupil area, really The fixed driver closes one's eyes, and determines eye-closing period of the driver in the detection in long threshold value；And/or

When the Aspect Ratio of the mouth is greater than or equal to the Aspect Ratio threshold value, determine that the driver yawns, and really The fixed driver number of yawning in long threshold value in the detection；And/or

When the depression angle is greater than or equal to the head angle threshold value, determine that the driver nods, and described in determination Driver's number of nodding in long threshold value in the detection；And/or

When the sight angle is greater than or equal to the sight angle threshold value, the system for distraction of driver is determined, and described in determination Driver's duration of diverting attention in long threshold value in the detection.

8. method according to claim 6 or 7, which is characterized in that described based on the tired information and/or the traveling shape State parameter and the frequency threshold value of nodding, frequency threshold value of yawning, duration of diverting attention threshold value and eye-closing period threshold value, determine institute State the driving condition of driver, comprising:

When the eye-closing period is greater than or equal to the eye-closing period threshold value, and/or, the number of yawning is more than or equal to institute Frequency threshold value of yawning is stated, and/or, the number of nodding is greater than or equal to the frequency threshold value of nodding, and/or, it is described to divert attention Duration be greater than or equal to it is described divert attention duration threshold value when, determine that the driver is in fatigue driving state；Alternatively,

When the driving status parameter include the contact area of the steering wheel of the driver and the automobile, the steering wheel by When the rotation information of the pressure value and the steering wheel that arrive, if the eye-closing period is greater than or equal to the eye-closing period threshold Value, and/or, the number of yawning is greater than or equal to the frequency threshold value of yawning, and/or, the number of nodding be greater than or Equal to the frequency threshold value of nodding, and/or, the duration of diverting attention be greater than or equal to it is described divert attention duration threshold value when, and/or, institute Contact area is stated less than or equal to contact area threshold value, and/or, the pressure value is less than or equal to pressure threshold, and/or, institute State rotation information be unsatisfactory for drive rotation condition when, determine that the driver is in driving fatigue state.

9. the driving condition determining device of driver a kind of, which is characterized in that described device includes:

Module is obtained, for while the car is driving, obtaining the driving status parameter of the automobile, the automobile is presently in Environmental information and driver visual information；

Second determining module, for being based on the visual information and/or driving status parameter and the state-detection threshold value, Determine the driving condition of the driver.

10. a kind of computer readable storage medium, which is characterized in that computer program is stored in the storage medium, it is described Method described in any one of claims 1-8 is realized when computer program is executed by processor.