CN109409259A - Drive monitoring method, device, equipment and computer-readable medium - Google Patents
Drive monitoring method, device, equipment and computer-readable medium Download PDFInfo
- Publication number
- CN109409259A CN109409259A CN201811182108.1A CN201811182108A CN109409259A CN 109409259 A CN109409259 A CN 109409259A CN 201811182108 A CN201811182108 A CN 201811182108A CN 109409259 A CN109409259 A CN 109409259A
- Authority
- CN
- China
- Prior art keywords
- driving
- detection model
- probability value
- face
- lip
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
Abstract
The present invention proposes a kind of driving monitoring method, device, equipment and computer-readable medium, which comprises the image on acquisition operator seat；Acquired image is sequentially input into face location detection model, fatigue detecting model and lip and moves detection model, the probability value that detection model exports driving of currently causing danger respectively is moved by the face location detection model, fatigue detecting model and lip；When any probability value of the dangerous driving of output reaches given threshold, issue warning signal.The embodiment of the present invention by detecting face location, face degree of fatigue and lip motion situation on operator seat one by one, and judgement is currently dangerous driving, so as to reduce the probability that driver causes danger in driving procedure.
Description
Technical field
The present invention relates to technical field of face recognition more particularly to a kind of driving monitoring method and devices, equipment and calculating
Machine readable medium.
Background technique
As motor vehicles are growing day by day, the frequency that traffic accident occurs is also increasing.Especially for public transport, bus etc.
Vehicle in use is easy to injure the life security of passenger if driver leads to over fatigue because of long drives.
Currently, when monitoring the harmfulness in driving procedure, it is general by monitoring vehicle speed in the process of moving or
The mode of the physiological signal of person driver is monitored early warning to driving.However, it is relatively high by the False Rate of monitoring travel speed,
And the implementation cost for monitoring driver's physiological signal mode is high.
Summary of the invention
The embodiment of the present invention provides a kind of driving monitoring method, device, equipment and computer-readable medium, to solve or delay
Solve one or more technical problems in the prior art.
In a first aspect, the embodiment of the invention provides a kind of driving monitoring methods, comprising:
Acquire the image on operator seat；
Acquired image is sequentially input into face location detection model, fatigue detecting model and lip and moves detection model, by
The face location detection model, fatigue detecting model and lip move the probability that detection model exports driving of currently causing danger respectively
Value；
When any probability value of the dangerous driving of output reaches given threshold, issue warning signal.
It is described that acquired image is input to face location detection model in a kind of embodiment of first aspect,
In the step of exporting the probability value for driving of currently causing danger by the face location detection model, comprising:
It calculates and occurs the face rotation that operator seat does not have face, operator seat to have multiple faces, operator seat within a preset time
Turn the ratio for accounting for all images quantity with the amount of images that the face of operator seat is blocked, current produce is calculated according to the ratio
The probability value of raw dangerous driving.
It is described that acquired image is input to fatigue detecting model in a kind of embodiment of first aspect, by institute
In the step of stating the probability value of the current driving of causing danger of fatigue detecting model output, comprising:
The ratio that the amount of images for occurring closing one's eyes within a preset time accounts for all images quantity is calculated, according to the ratio
Example calculates the current probability value for generating dangerous driving.
It is described that acquired image is input to the dynamic detection model of lip in a kind of embodiment of first aspect, by institute
It states in the step of lip moves the probability value of the current driving of causing danger of detection model output, comprising:
It calculates within a preset time and the ratio that the amount of images that lip opens accounts for all images quantity occurs, according to described
Ratio calculate the current probability value for generating dangerous driving.
In a kind of embodiment of first aspect, this method comprises:
Driver's identity is authenticated according to the face information on operator seat.
In a kind of embodiment of first aspect, this method comprises:
According to the travel speed generating probability regulation coefficient of vehicle, to the face location detection model, fatigue detecting mould
The probability value that type and lip move detection model output is adjusted.
Second aspect, the embodiment of the invention provides a kind of driving monitoring devices, comprising:
Image capture module, for acquiring the image on operator seat；
Probability evaluation entity, for acquired image to be sequentially input face location detection model, fatigue detecting model
Detection model is moved with lip, detection model is moved by the face location detection model, fatigue detecting model and lip and is exported respectively currently
It causes danger the probability value of driving；
Warning module, for issuing warning signal when any probability value of the dangerous driving of output reaches given threshold.
In a kind of embodiment of second aspect, the probability evaluation entity includes:
There is operator seat not have face, operator seat to have more for calculating within a preset time in face location computing module
The amount of images that the face of face, the face rotation of operator seat and operator seat is blocked accounts for the ratio of all images quantity, root
The current probability value for generating dangerous driving is calculated according to the ratio.
In a kind of embodiment of second aspect, the probability evaluation entity includes:
Fatigue mechanisms module accounts for all images quantity for calculating the amount of images for occurring closing one's eyes within a preset time
Ratio calculates the current probability value for generating dangerous driving according to the ratio.
In a kind of embodiment of second aspect, the probability evaluation entity includes:
Lip moves computing module, accounts for all images number for calculating the amount of images for occurring lip opening within a preset time
The ratio of amount calculates the current probability value for generating dangerous driving according to the ratio.
In a kind of embodiment of second aspect, which includes:
Authentication module, for being authenticated according to the face information on operator seat to driver's identity.
In a kind of embodiment of second aspect, which includes:
Module is adjusted, for the travel speed generating probability regulation coefficient according to vehicle, mould is detected to the face location
The probability value that type, fatigue detecting model and lip move detection model output is adjusted.
The third aspect includes processor and memory, institute in the structure of driving monitoring device in a possible design
Memory is stated for storing the program for supporting driving monitoring device to execute driving monitoring method in above-mentioned first aspect, the processing
Device is configurable for executing the program stored in the memory.The driving monitoring device can also include communication interface,
For driving monitoring device and other equipment or communication.
Fourth aspect, the embodiment of the invention provides a kind of computer-readable mediums, are used for memory of driving monitoring device institute
Computer software instructions comprising for executing program involved in the driving monitoring method of above-mentioned first aspect.
The embodiment of the present invention by detecting face location, face degree of fatigue and lip motion feelings on operator seat one by one
Condition, judgement is currently dangerous driving, so as to reduce the probability that driver causes danger in driving procedure.
Above-mentioned general introduction is merely to illustrate that the purpose of book, it is not intended to be limited in any way.Except foregoing description
Schematical aspect, except embodiment and feature, by reference to attached drawing and the following detailed description, the present invention is further
Aspect, embodiment and feature, which will be, to be readily apparent that.
Detailed description of the invention
In the accompanying drawings, unless specified otherwise herein, otherwise indicate the same or similar through the identical appended drawing reference of multiple attached drawings
Component or element.What these attached drawings were not necessarily to scale.It should be understood that these attached drawings depict only according to the present invention
Disclosed some embodiments, and should not serve to limit the scope of the present invention.
Fig. 1 is the flow chart of the driving monitoring method of one embodiment of the invention；
Fig. 2 is the flow chart of the driving monitoring method of another embodiment of the present invention；
Fig. 3 is the connection block diagram of the driving monitoring device of one embodiment of the invention；
Fig. 4 is the connection block diagram of the probability evaluation entity of one embodiment of the invention；
Fig. 5 is the connection block diagram of the driving monitoring device of another embodiment of the present invention；
Fig. 6 is the connection block diagram of the driving monitoring device of another embodiment of the present invention；
Fig. 7 is the driving monitoring device block diagram of another embodiment of the present invention.
Specific embodiment
Hereinafter, certain exemplary embodiments are simply just described.As one skilled in the art will recognize that
Like that, without departing from the spirit or scope of the present invention, described embodiment can be modified by various different modes.
Therefore, attached drawing and description are considered essentially illustrative rather than restrictive.The embodiment of the present invention mainly provides one kind
The logical method and device for driving monitoring is described by the expansion that following embodiment carries out technical solution separately below.
The present invention provides a kind of driving monitoring method and device, the driving of the embodiment of the present invention described in detail below is monitored
The specific process flow and principle of method and apparatus.
As shown in Figure 1, its flow chart for the driving monitoring method of the embodiment of the present invention.The driving of the embodiment of the present invention is supervised
Prosecutor method may comprise steps of:
S110: the image on acquisition operator seat.
During running car, the image on current operator seat can be acquired in real time, by equipment such as cameras to obtain
The case where taking current driving prevents current driver from abnormal situation occur.For example the abnormal case being likely to occur includes: to drive
No driver on position is sailed, occurs multiple drivers on operator seat, drivers from dozing, speak, the situations such as rotary head.
S120: acquired image is sequentially input into the dynamic detection mould of face location detection model, fatigue detecting model and lip
Type moves detection model by the face location detection model, fatigue detecting model and lip and exports driving of currently causing danger respectively
Probability value.
In this step, the image of acquisition is divided into the prediction that three parts carry out dangerous driving.Firstly, first judgement is current
Whether the face location on steering position meets the specification of driving.Then, it is tired then successively to judge whether driver spirit occurs
Labor and whether talk the case where, the mode detected individually below to these three models is introduced:
In one embodiment, the face location detection model is carrying out dangerous driving probability to the image of input
When estimating, first calculates and occur the face rotation that operator seat does not have face, operator seat to have multiple faces, operator seat within a preset time
Turn the ratio for accounting for all images quantity with the amount of images that the face of operator seat is blocked, is then worked as according to the ratio calculating
The preceding probability value for generating dangerous driving.
For example, the preset time is 1 second, the image of multiple operator seats of continuous acquisition in 1 second, such as when 100 open.So
The image of acquisition is inputted into the face location detection model again afterwards, then operator seat, which occurs, in judgement does not have face, on operator seat
There are multiple faces, the face rotation of operator seat, the amount of images for the case where operator seat face is blocked, it is different if there is these
The image of reason condition is skillfully 20, then the ratio for showing that abnormal conditions image accounts for all images quantity is 20%, namely is shown
There is the malposition of driver in 0.2 second time.The probability for generating dangerous driving is finally calculated further according to this ratio
Value, specific calculation can be adjusted according to the actual situation.Such as in one embodiment, it is assumed that on operator seat
If the dangerous probability of driver's malposition no in 1 second is 100%, then if the image of abnormal conditions accounts for entirely
The ratio of portion's image is 20%, then can simply be scaled the dangerous probability of appearance is 20%.
After the detection for completing face location, the image that will test complete face is input to fatigue detecting model, by institute
State the probability value of the current driving of causing danger of fatigue detecting model output.In one embodiment, fatigue detecting model can be with
The time span of eye closing is used to determine whether can first calculate for fatigue driving and occur the image closed one's eyes within a preset time
Quantity accounts for the ratio of all images quantity, then calculates the current probability value for generating dangerous driving further according to the ratio.
Similarly, for example, the preset time be 1 second, the image of multiple operator seats of continuous acquisition in 1 second, for example, when 100
?.Image if there is eye closing is skillfully 20, then shows that the abnormal conditions image closed one's eyes accounts for the ratio of all images quantity
Be 20%, namely show driver in the time for having 0.2 second in closed-eye state.It finally calculates and produces further according to this ratio
The probability value of raw dangerous driving, specific calculation can be adjusted according to the actual situation.Assuming that the driving on operator seat
Personnel are if the dangerous probability that eye-closing period reaches 1 second is 100%, then if the image of abnormal conditions accounts for the ratio of all images
Example is 20%, then can simply be scaled the dangerous probability of appearance is 20%.
After completing fatigue strength detection, the image for the complete face that will test is input to lip and moves detection model, by described
Lip moves the probability value of the current driving of causing danger of detection model output.In one embodiment, the dynamic detection model of the lip can
First to calculate the ratio for occurring the amount of images that lip opens within a preset time and accounting for all images quantity, then further according to institute
The ratio stated calculates the current probability value for generating dangerous driving.
Similarly, such as the preset time is 10 seconds, the image of multiple operator seats of continuous acquisition in 10 seconds, such as when
1000.If the image that lip opens skillfully is 200, the abnormal conditions image for showing that lip opens accounts for all images number
The ratio of amount is 20%, namely shows that the lip of driver in the time for having 2 seconds is in open configuration.Finally further according to this
Ratio calculates the probability value for generating dangerous driving, and specific calculation can be adjusted according to the actual situation.Assuming that driving
Driver on position is if the dangerous probability that the duration spoken reaches 10 seconds is 100%, then if the image of abnormal conditions
The ratio for accounting for all images is 20%, then can simply be scaled the dangerous probability of appearance is 20%.
In one embodiment, the face location detection model, fatigue detecting model and lip move detection model can be with
It is constructed using convolutional neural networks (CNN, convolutional neural network) model.
In one embodiment, when calculating the probability calculation of dangerous driving, it can be combined with current vehicle speed and adjusted
It is whole, for example a probability regulation coefficient can be generated according to current vehicle speed, it is calculated by the probability regulation coefficient and by model
Probability value is multiplied.For example, showing that red lights may be being waited if current vehicle speed is 0, then calculating the probability of dangerous driving then
Adjustment can be corresponded to, to prevent from reporting by mistake.In addition, show to be currently at high-speed travel state if current vehicle speed is 100km/h,
It then can suitably increase regulation coefficient.
S130: it when any probability value of the dangerous driving of output reaches given threshold, issues warning signal.
Such as a probability threshold value can be set, such as 70%.If the probability for driving of causing danger reaches 70%, issue
Pre-warning signal, such as can be made a sound by devices such as alarms to remind driver.
As shown in Fig. 2, in another embodiment, the driving monitoring method can further include:
Step S140: driver's identity is authenticated according to the face information on operator seat.According to the people of operator seat
Face information can authenticate the identity of driver, to verify whether the driver has qualified driver's license etc., to prevent
The case where only driving without a license appearance.In addition, when traffic accident occurs, it helps the identity identification of accident responsibility people.
The embodiment of the present invention by detecting face location, face degree of fatigue and lip motion feelings on operator seat one by one
Condition, judgement is currently dangerous driving, so as to reduce the probability that driver causes danger in driving procedure.
As shown in figure 3, the present invention additionally provides a kind of driving monitoring device in another embodiment, comprising:
Image capture module 110, for acquiring the image on operator seat.The image capture module 110 can use
Camera etc. has the device of camera function.
Probability evaluation entity 120, for acquired image to be sequentially input face location detection model, fatigue detecting mould
Type and lip move detection model, are moved detection model by the face location detection model, fatigue detecting model and lip and are exported respectively and worked as
Before cause danger the probability value of driving.The probability evaluation entity 120 can have data analysis function using computer, mobile phone etc.
Equipment.
Warning module 130, for when any probability value of the dangerous driving of output reaches given threshold, issuing early warning letter
Number.The warning module 130 can be using equipment such as alarms.
As shown in figure 4, the probability evaluation entity 120 includes:
Face location computing module 121 does not have face, operator seat to have for there is operator seat in calculating within a preset time
The amount of images that the face of multiple faces, the face rotation of operator seat and operator seat is blocked accounts for the ratio of all images quantity,
The current probability value for generating dangerous driving is calculated according to the ratio.
Fatigue mechanisms module 122 accounts for all images number for calculating the amount of images for occurring closing one's eyes within a preset time
The ratio of amount calculates the current probability value for generating dangerous driving according to the ratio.
Lip moves computing module 123, accounts for whole figures for calculating the amount of images for occurring lip opening within a preset time
As the ratio of quantity, the current probability value for generating dangerous driving is calculated according to the ratio.
As shown in figure 5, in another embodiment, the driving monitoring device can also include: adjustment module 140, use
In the travel speed generating probability regulation coefficient according to vehicle, to the face location detection model, fatigue detecting model and lip
The probability value of dynamic detection model output is adjusted.
As shown in fig. 6, in another embodiment, the driving monitoring device further include:
Authentication module 150, for being authenticated according to the face information on operator seat to driver's identity.
The driving monitoring device of the present embodiment is similar with the principle of driving monitoring method of above-described embodiment, therefore no longer superfluous
It states.
In another embodiment, the present invention also provides a kind of driving monitoring devices, as shown in fig. 7, the equipment includes: to deposit
Reservoir 510 and processor 520 are stored with the computer program that can be run on processor 520 in memory 510.The processing
Device 520 realizes the driving monitoring method in above-described embodiment when executing the computer program.The memory 510 and processor
520 quantity can be one or more.
The equipment further include:
Communication interface 530 carries out data interaction for being communicated with external device.
Memory 510 may include high speed RAM memory, it is also possible to further include nonvolatile memory (non-
Volatile memory), a for example, at least magnetic disk storage.
If memory 510, processor 520 and the independent realization of communication interface 530, memory 510,520 and of processor
Communication interface 530 can be connected with each other by bus and complete mutual communication.The bus can be Industry Standard Architecture
Structure (ISA, Industry Standard Architecture) bus, external equipment interconnection (PCI, Peripheral
Component) bus or extended industry-standard architecture (EISA, Extended Industry Standard
Component) bus etc..The bus can be divided into address bus, data/address bus, control bus etc..For convenient for expression, Fig. 7
In only indicated with a thick line, it is not intended that an only bus or a type of bus.
Optionally, in specific implementation, if memory 510, processor 520 and communication interface 530 are integrated in one piece of core
On piece, then memory 510, processor 520 and communication interface 530 can complete mutual communication by internal interface.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.Moreover, particular features, structures, materials, or characteristics described
It may be combined in any suitable manner in any one or more of the embodiments or examples.In addition, without conflicting with each other, this
The technical staff in field can be by the spy of different embodiments or examples described in this specification and different embodiments or examples
Sign is combined.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic." first " is defined as a result, the feature of " second " can be expressed or hidden
It include at least one this feature containing ground.In the description of the present invention, the meaning of " plurality " is two or more, unless otherwise
Clear specific restriction.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.
Computer-readable medium described in the embodiment of the present invention can be computer-readable signal media or computer can
Read storage medium either the two any combination.The more specific example of computer readable storage medium is at least (non-poor
Property list to the greatest extent) include the following: there is the electrical connection section (electronic device) of one or more wirings, portable computer diskette box (magnetic
Device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash
Memory), fiber device and portable read-only memory (CDROM).In addition, computer readable storage medium even can be with
It is the paper or other suitable media that can print described program on it, because can be for example by paper or the progress of other media
Optical scanner is then edited, interpreted or is handled when necessary with other suitable methods and is described electronically to obtain
Program is then stored in computer storage.
In embodiments of the present invention, computer-readable signal media may include in a base band or as carrier wave a part
The data-signal of propagation, wherein carrying computer-readable program code.The data-signal of this propagation can use a variety of
Form, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media is also
It can be any computer-readable medium other than computer readable storage medium, which can send, pass
It broadcasts or transmits for instruction execution system, input method or device use or program in connection.Computer can
The program code for reading to include on medium can transmit with any suitable medium, including but not limited to: wirelessly, electric wire, optical cable, penetrate
Frequently (Radio Frequency, RF) etc. or above-mentioned any appropriate combination.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In readable storage medium storing program for executing.The storage medium can be read-only memory, disk or CD etc..
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in its various change or replacement,
These should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the guarantor of the claim
It protects subject to range.
Claims (14)
1. a kind of driving monitoring method characterized by comprising
Acquire the image on operator seat；
Acquired image is sequentially input into face location detection model, fatigue detecting model and lip and moves detection model, by described
Face location detection model, fatigue detecting model and lip move the probability value that detection model exports driving of currently causing danger respectively；
When any probability value of the dangerous driving of output reaches given threshold, issue warning signal.
2. the method according to claim 1, wherein described be input to face location detection for acquired image
Model, by the face location detection model output currently cause danger driving probability value the step of in, comprising:
Calculate within a preset time in occur operator seat do not have face, operator seat have multiple faces, operator seat face rotation and
The amount of images that the face of operator seat is blocked accounts for the ratio of all images quantity, calculates current generate according to the ratio and endangers
The probability value nearly driven.
3. the method according to claim 1, wherein described be input to fatigue detecting mould for acquired image
Type, by the fatigue detecting model output currently cause danger driving probability value the step of in, comprising:
The ratio that the amount of images for occurring closing one's eyes within a preset time accounts for all images quantity is calculated, according to the ratio meter
Calculate the current probability value for generating dangerous driving.
4. the method according to claim 1, wherein described be input to the dynamic detection mould of lip for acquired image
Type is moved in the step of detection model exports the probability value for driving of currently causing danger by the lip, comprising:
It calculates within a preset time and the ratio that the amount of images that lip opens accounts for all images quantity occurs, according to the ratio
Example calculates the current probability value for generating dangerous driving.
5. the method according to claim 1, wherein this method comprises:
Driver's identity is authenticated according to the face information on operator seat.
6. the method according to claim 1, wherein this method comprises:
According to the travel speed generating probability regulation coefficient of vehicle, to the face location detection model, fatigue detecting model and
The probability value that lip moves detection model output is adjusted.
7. a kind of driving monitoring device characterized by comprising
Image capture module, for acquiring the image on operator seat；
Probability evaluation entity, for acquired image to be sequentially input face location detection model, fatigue detecting model and lip
Dynamic detection model moves detection model by the face location detection model, fatigue detecting model and lip and exports current generation respectively
The probability value of dangerous driving；
Warning module, for issuing warning signal when any probability value of the dangerous driving of output reaches given threshold.
8. device according to claim 7, which is characterized in that the probability evaluation entity includes:
Face location computing module does not have face, operator seat to have multiple people for there is operator seat in calculating within a preset time
The amount of images that the face of face, the face rotation of operator seat and operator seat is blocked accounts for the ratio of all images quantity, according to institute
The ratio stated calculates the current probability value for generating dangerous driving.
9. device according to claim 7, which is characterized in that the probability evaluation entity includes:
Fatigue mechanisms module accounts for the ratio of all images quantity for calculating the amount of images for occurring closing one's eyes within a preset time
Example calculates the current probability value for generating dangerous driving according to the ratio.
10. device according to claim 7, which is characterized in that the probability evaluation entity includes:
Lip moves computing module, accounts for all images quantity for calculating the amount of images for occurring lip opening within a preset time
Ratio calculates the current probability value for generating dangerous driving according to the ratio.
11. device according to claim 7, which is characterized in that the device includes:
Authentication module, for being authenticated according to the face information on operator seat to driver's identity.
12. device according to claim 7, which is characterized in that the device includes:
Module is adjusted, for the travel speed generating probability regulation coefficient according to vehicle, to the face location detection model, tired
The probability value that labor detection model and lip move detection model output is adjusted.
13. a kind of driving monitoring device, which is characterized in that the equipment includes:
One or more processors；
Storage device, for storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processors
Realize such as driving monitoring method as claimed in any one of claims 1 to 6.
14. a kind of computer-readable medium, is stored with computer program, which is characterized in that when the program is executed by processor
Realize such as driving monitoring method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811182108.1A CN109409259A (en) | 2018-10-11 | 2018-10-11 | Drive monitoring method, device, equipment and computer-readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811182108.1A CN109409259A (en) | 2018-10-11 | 2018-10-11 | Drive monitoring method, device, equipment and computer-readable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109409259A true CN109409259A (en) | 2019-03-01 |
Family
ID=65466975
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811182108.1A Pending CN109409259A (en) | 2018-10-11 | 2018-10-11 | Drive monitoring method, device, equipment and computer-readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109409259A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020258719A1 (en) * | 2019-06-28 | 2020-12-30 | 深圳市商汤科技有限公司 | Method, apparatus and device for detecting on-duty state of driver, and computer storage medium |
| CN112714720A (en) * | 2020-12-16 | 2021-04-27 | 华为技术有限公司 | Rearview mirror control method and related equipment |
| CN113283286A (en) * | 2021-03-24 | 2021-08-20 | 上海高德威智能交通系统有限公司 | Driver abnormal behavior detection method and device |
| CN113313019A (en) * | 2021-05-27 | 2021-08-27 | 展讯通信(天津)有限公司 | Distracted driving detection method, system and related equipment |
| WO2022041498A1 (en) * | 2020-08-24 | 2022-03-03 | 王晓翔 | Data analytics-based behavior prediction method, vehicle control method, and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104637246A (en) * | 2015-02-02 | 2015-05-20 | 合肥工业大学 | Driver multi-behavior early warning system and danger evaluation method |
| CN104809445A (en) * | 2015-05-07 | 2015-07-29 | 吉林大学 | Fatigue driving detection method based on eye and mouth states |
| CN107301384A (en) * | 2017-06-09 | 2017-10-27 | 湖北天业云商网络科技有限公司 | A kind of driver takes phone behavioral value method and system |
| CN107358218A (en) * | 2017-07-24 | 2017-11-17 | 英锐科技(深圳)有限公司 | Fatigue detection method and the fatigue detecting system using this method |
-
2018
- 2018-10-11 CN CN201811182108.1A patent/CN109409259A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104637246A (en) * | 2015-02-02 | 2015-05-20 | 合肥工业大学 | Driver multi-behavior early warning system and danger evaluation method |
| CN104809445A (en) * | 2015-05-07 | 2015-07-29 | 吉林大学 | Fatigue driving detection method based on eye and mouth states |
| CN107301384A (en) * | 2017-06-09 | 2017-10-27 | 湖北天业云商网络科技有限公司 | A kind of driver takes phone behavioral value method and system |
| CN107358218A (en) * | 2017-07-24 | 2017-11-17 | 英锐科技(深圳)有限公司 | Fatigue detection method and the fatigue detecting system using this method |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020258719A1 (en) * | 2019-06-28 | 2020-12-30 | 深圳市商汤科技有限公司 | Method, apparatus and device for detecting on-duty state of driver, and computer storage medium |
| US11423676B2 (en) | 2019-06-28 | 2022-08-23 | Shenzhen Sensetime Technology Co., Ltd. | Method and apparatus for detecting on-duty state of driver, device, and computer storage medium |
| WO2022041498A1 (en) * | 2020-08-24 | 2022-03-03 | 王晓翔 | Data analytics-based behavior prediction method, vehicle control method, and system |
| CN112714720A (en) * | 2020-12-16 | 2021-04-27 | 华为技术有限公司 | Rearview mirror control method and related equipment |
| WO2022126419A1 (en) * | 2020-12-16 | 2022-06-23 | 华为技术有限公司 | Rear-view mirror control method and related device |
| CN112714720B (en) * | 2020-12-16 | 2022-09-16 | 华为技术有限公司 | Rearview mirror control method and related equipment |
| CN113283286A (en) * | 2021-03-24 | 2021-08-20 | 上海高德威智能交通系统有限公司 | Driver abnormal behavior detection method and device |
| CN113283286B (en) * | 2021-03-24 | 2023-11-21 | 上海高德威智能交通系统有限公司 | Driver abnormal behavior detection method and device |
| CN113313019A (en) * | 2021-05-27 | 2021-08-27 | 展讯通信(天津)有限公司 | Distracted driving detection method, system and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109409259A (en) | Drive monitoring method, device, equipment and computer-readable medium | |
| CN111469802B (en) | Seat belt state determination system and method | |
| Kaplan et al. | Driver behavior analysis for safe driving: A survey | |
| US10322728B1 (en) | Method for distress and road rage detection | |
| US10279804B2 (en) | Method for smartphone-based accident detection | |
| CN112622917B (en) | System and method for authenticating an occupant of a vehicle | |
| CN109658740A (en) | Exchange method and device between vehicle | |
| CN107729870A (en) | The method and apparatus of in-car safety monitoring based on computer vision | |
| CN109872510A (en) | Interior Smoke Detection and reporting system and method for Car sharing and the shared vehicle of seating | |
| CN107848478A (en) | The automatic identification of low speed collision and assessment | |
| US20160159217A1 (en) | System and method for determining drowsy state of driver | |
| CN109960407A (en) | A kind of method, computer installation and the computer readable storage medium of on-vehicle machines people active interaction | |
| CN104751600A (en) | Anti-fatigue driving safety equipment based on iris recognition and application method thereof | |
| CN107415861A (en) | It is used for detecting the method and apparatus that use of the driver to the equipment of electronics for vehicle | |
| CN107351761A (en) | Opening door of vehicle method for early warning and opening door of vehicle prior-warning device | |
| CN110126730A (en) | Vehicle lane change based reminding method and system | |
| CN106809214A (en) | A kind of rear-end collision method for early warning, device and electronic equipment | |
| CN109801475A (en) | Method for detecting fatigue driving, device and computer readable storage medium | |
| CN107284449A (en) | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing | |
| CN106904122A (en) | Vehicle speech sound alarming method and apparatus | |
| CN108839614A (en) | A kind of vehicle safety deceleration system for electric vehicle | |
| CN110293912A (en) | Show control method, system, terminal and the storage medium of equipment supporter | |
| CN108062520A (en) | A kind of driver identification system and method | |
| CN112298172A (en) | Vehicle-mounted active safety system, method and storage medium | |
| JP2021163096A (en) | Object detection method, object detection apparatus, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190301 |
|
| RJ01 | Rejection of invention patent application after publication |