CN110059650A - Information processing method, device, computer storage medium and electronic equipment - Google Patents
Information processing method, device, computer storage medium and electronic equipment Download PDFInfo
- Publication number
- CN110059650A CN110059650A CN201910332887.7A CN201910332887A CN110059650A CN 110059650 A CN110059650 A CN 110059650A CN 201910332887 A CN201910332887 A CN 201910332887A CN 110059650 A CN110059650 A CN 110059650A
- Authority
- CN
- China
- Prior art keywords
- information
- driver
- facial expression
- response
- processing method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Traffic Control Systems (AREA)
Abstract
This disclosure relates to safe driving of vehicle and intelligent management control technology field, a kind of information processing method and device, computer storage medium, electronic equipment are provided, wherein information processing method includes: the driving behavior information for monitoring driver；In response to monitoring the driving behavior information of the first preset kind, the facial expression information of the driver is identified；In response to identifying the facial expression information of the second preset kind, assisting automobile driver information is provided.The information processing method that the disclosure provides can either monitor the driving behavior information and facial expression information of driver in time, promptly and accurately find security risk.When determining that driver drives in violation of rules and regulations under negative emotions, assisting automobile driver information is provided to remind or alert driver, can reduce the occurrence frequency of safety accident, is conducive to the safe driving of vehicle.
Description
Technical field
This disclosure relates to safe driving of vehicle and intelligent management control technology field, in particular to a kind of information processing side
Method, information processing unit, computer storage medium and electronic equipment.
Background technique
With economic rapid development, vehicle fleet size also increases therewith.Wherein, safe driving is then the weight in driving conditions
In it is weight.In vehicle travel process, it may cause that insecurity factor is numerous, for example, contending with for driver overtakes other vehicles by force, becomes carelessly
The hazardous acts such as road, in another example the behaviors such as driver's fatigue driving.As it can be seen that the conjunction rule of driver drive and avoid security risk
Emphasis, to need to be monitored to the driving behavior of driver, to reduce the probability of happening of safety accident.
It is existing in the related technology, road be arranged camera, monitor whether the vehicle passed by exceeds the speed limit to judge driver
With the presence or absence of unsafe driving.Higher speed downward driving duration is maintained alternatively, determining by multiple cameras, and then to judge to drive
The person of sailing is with the presence or absence of unsafe driving etc..Different types of punishment is carried out for the vehicle of violation traveling, to promote driver
Consciously close rule traveling.
However, the method supervisory efficiency of the driving behavior of existing monitoring management driver is low.
It should be noted that information disclosed in above-mentioned background technology part is only used for reinforcing the reason to the background of the disclosure
Solution.
Summary of the invention
The disclosure is designed to provide a kind of information processing method, information processing unit, computer storage medium and electricity
Sub- equipment, and then the supervisory efficiency to driver is improved at least to a certain extent.
Other characteristics and advantages of the disclosure will be apparent from by the following detailed description, or partially by the disclosure
Practice and acquistion.
According to the disclosure in a first aspect, providing a kind of information processing method, comprising:
Monitor the driving behavior information of driver；
In response to monitoring the driving behavior information of the first preset kind, the facial expression information of the driver is identified；
In response to identifying the facial expression information of the second preset kind, assisting automobile driver information is provided.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on,
Monitor the driving behavior information of driver, comprising:
By onboard diagnostic system (On-Board Diagnostics referred to as: OBD) monitoring fuel system, temperature system,
One or more of ignition system, dynamical system, exhaust gas control auxiliary device system obtain running state information；
Wherein, the running state information includes: anxious acceleration information, anxious deceleration, global positioning system (Global
Positioning System, referred to as: GPS) information, fault code indications, one or more of fuel consumption information.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, in response to monitoring the driving of the first preset kind
Behavioural information identifies the facial expression information of the driver, comprising:
In response to monitoring one or more of described running state information beyond corresponding preset range, triggering is opened
Camera system, and the facial expression information of the driver is obtained and identified by the camera system.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, identify the facial expression information of the driver, are wrapped
It includes
The original image of the driver is acquired by camera system, and the original image is sent to cloud；
Pass through the cloud:
The original image, which is scanned, based on local binary pattern obtains response image；
Human face region is obtained in the response image by adaptive Ensemble Learning Algorithms；
Facial key feature points are positioned based on the human face region, according to the identification of the profile information of key feature points
The facial expression information of driver.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, institute is identified according to the profile information of key feature points
State the facial expression information of driver, comprising:
According to the profile information of history facial key features point and corresponding expression label training expression classifier；
Based on the expression classifier, the corresponding expression label of profile information of the key point of the driver, root are obtained
The facial expression information for identifying the driver is determined according to the expression label.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, in response to identifying the face of the second preset kind
Expression information provides assisting automobile driver information, comprising:
In response to identifying the facial expression of following one or more of types: indignation, is detested, surprised, frightened sadness, mentions
For assisting automobile driver information.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, assisting automobile driver information is provided, comprising:
After sending the first prompting message, interval preset duration obtains the facial expression information of the driver again；
Belong to second preset kind in response to the facial expression information of the driver, sends described first again and mention
Awake information；
When number in response to sending first prompting message reaches preset times, the first prompting message is sent.
According to the second aspect of the disclosure, a kind of information processing unit is provided, comprising:
Onboard diagnostics module, for monitoring the driving behavior information of driver；
Expression Recognition module identifies the driving for the driving behavior information in response to monitoring the first preset kind
The facial expression information of person；
Reminding module provides assisting automobile driver information for the facial expression information in response to identifying the second preset kind.
According to the third aspect of the disclosure, a kind of computer storage medium is provided, is stored thereon with computer program, it is described
Information processing method described in above-mentioned first aspect is realized when computer program is executed by processor.
According to the fourth aspect of the disclosure, a kind of electronic equipment is provided, comprising: processor；And memory, for storing
The executable instruction of the processor；Wherein, the processor is configured to above-mentioned to execute via the executable instruction is executed
Information processing method described in first aspect.
As shown from the above technical solution, the information processing method in disclosure exemplary embodiment, information processing unit, meter
Calculation machine storage medium and electronic equipment at least have following advantages and good effect:
On the one hand, in the technical solution provided by some embodiments of the present disclosure, the driving row of real-time monitoring driver
It is information to find violation driving behavior in time.When the driving behavior information for monitoring the first preset kind (drives row in violation of rules and regulations
For, such as: hypervelocity turns to and does not play lamp behavior), also identify the current facial expression information of driver.Based on driving behavior information
The facial expression information two aspect information current with driver, be conducive to accurately to determine driver whether under negative emotions in violation of rules and regulations
It drives.Compared to existing the relevant technologies, technical solution provided in this embodiment provides an efficient driving monitoring method, energy
The enough driving behavior information and facial expression information for monitoring driver in time, to timely and accurately find security risk.
On the other hand, in the technical solution provided by some embodiments of the present disclosure, when determining driver in negative feelings
When driving in violation of rules and regulations under thread, assisting automobile driver information is provided to remind or alert driver.Compared to existing the relevant technologies, this implementation
The technical solution that example provides provides the management control method of an intelligence, can reduce the occurrence frequency of safety accident, is conducive to
The safe driving of vehicle.
The disclosure it should be understood that more than general description and following detailed description be only exemplary and explanatory
, it does not limit the disclosure.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.It should be evident that the accompanying drawings in the following description is only the disclosure
Some embodiments for those of ordinary skill in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 shows the flow diagram of information processing method in one exemplary embodiment of the disclosure；
Fig. 2 shows the information exchange figures according to the expression recognition method of the disclosure one embodiment；
Fig. 3 shows the process signal of the determination method of the profile information of the key feature points according to one embodiment of the disclosure
Figure；
Fig. 4 shows the flow diagram of the determination method of the assisting automobile driver information according to one embodiment of the disclosure；
Fig. 5 shows the structural schematic diagram of information processing unit in one exemplary embodiment of the disclosure；
Fig. 6 shows the structural schematic diagram of computer storage medium in disclosure exemplary embodiment；And
Fig. 7 shows the structural schematic diagram of electronic equipment in disclosure exemplary embodiment.
Specific embodiment
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein；On the contrary, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Described feature, knot
Structure or characteristic can be incorporated in any suitable manner in one or more embodiments.In the following description, it provides perhaps
More details fully understand embodiment of the present disclosure to provide.It will be appreciated, however, by one skilled in the art that can
It is omitted with technical solution of the disclosure one or more in the specific detail, or others side can be used
Method, constituent element, device, step etc..In other cases, be not shown in detail or describe known solution to avoid a presumptuous guest usurps the role of the host and
So that all aspects of this disclosure thicken.
In this specification using term "one", " one ", "the" and " described " to indicate there are one or more elements/
Component part/etc.；Term " comprising " and " having " is to indicate the open meaning being included and refer in addition to listing
Element/component part/also may be present except waiting other element/component part/etc.；Term " first " and " second " etc. are only made
It is used for label, is not the quantity limitation to its object.
In addition, attached drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical attached drawing mark in figure
Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams shown in the drawings are function
Energy entity, not necessarily must be corresponding with physically or logically independent entity.
In embodiment of the disclosure, a kind of information processing method is provided firstly, is improved at least to a certain extent
To the supervisory efficiency of driver.
Fig. 1 shows the flow diagram of information processing method in one exemplary embodiment of the disclosure, the information processing method
Executing subject can be equipment with calculation processing function, such as server etc..
With reference to Fig. 1, according to the information processing method of one embodiment of the disclosure the following steps are included:
Step S110 monitors the driving behavior information of driver；
Step S120 identifies the face of the driver in response to monitoring the driving behavior information of the first preset kind
Expression information；And
Step S130, Ying Yu identify the facial expression information of the second preset kind, provide assisting automobile driver information.
In technical solution provided by embodiment shown in Fig. 1, on the one hand, the driving behavior information of real-time monitoring driver
To find violation driving behavior in time.When monitor the first preset kind driving behavior information (i.e. violation driving behavior, such as:
Hypervelocity turns to and does not play the behaviors such as lamp), also identify the current facial expression information of driver.Based on driving behavior information and driving
The current two aspect information of facial expression information of person, is conducive to accurately determine whether driver drives in violation of rules and regulations under negative emotions.
Compared to existing the relevant technologies, technical solution provided in this embodiment provides an efficient driving monitoring method, Neng Gouji
When monitor the driving behavior information and facial expression information of driver, to timely and accurately find security risk.
On the other hand, in the technical solution provided by some embodiments of the present disclosure, when determining driver in negative feelings
When driving in violation of rules and regulations under thread, assisting automobile driver information is provided to remind or alert driver.Compared to existing the relevant technologies, this implementation
The technical solution that example provides provides the management control method of an intelligence, can reduce the occurrence frequency of safety accident, is conducive to
The safe driving of vehicle.
The specific embodiment of step each in embodiment illustrated in fig. 1 is described in detail below:
In the exemplary embodiment, a kind of specific embodiment party of the driving behavior information of driver is monitored in step S110
Formula may is that auxiliary by the fuel system of OBD real-time monitoring vehicle, temperature system, ignition system, dynamical system, exhaust gas control
One or more of apparatus system is helped to obtain running state information.Wherein, vehicle is obtained in real time by carrying OBD in vehicle
Running state information, without separately increasing component and can promptly and accurately determine running state information.
Illustratively, by onboard sensor obtain fuel system, temperature system, ignition system, dynamical system and
State parameters, the further OBD such as exhaust gas control auxiliary device system obtain running state information by CAN bus.Above-mentioned operation
Status information includes: anxious acceleration information, anxious deceleration, GPS information, fault code indications, fuel consumption information etc..
In exemplary embodiment, the driving behavior information of the first preset kind can be above-mentioned operation shape in step S120
One or more of state information exceeds the driving behavior information of corresponding preset range.For example, anxious acceleration information has exceeded and adds
Fast threshold value, anxious deceleration has exceeded deceleration threshold value, GPS information has exceeded default geographic range, fault code indications show vehicle
Failure etc..Further, in response to monitoring that one or more of above-mentioned running state information exceeds corresponding preset range,
Camera system is opened in triggering, and the facial expression information of the driver is obtained and identified by camera system.OBD is first passed through to sentence
Disconnected running state information exceeds corresponding preset range, and illustrating the driving behavior of driver, there may be in violation of rules and regulations, it is necessary into one
Step obtains the current facial expression information of driver to determine driver's mood.On the other hand, technical side provided in this embodiment
The facial expression information of current drivers is not obtained in case always, thus while ensuring to driver's effective monitoring, also
Save the occupied overhead of Expression Recognition.
In exemplary embodiment, Fig. 2 shows the information exchanges according to the expression recognition method of the disclosure one embodiment
Figure.With reference to Fig. 2, expression recognition method provided in this embodiment is completed jointly by client camera system 21 and cloud 22.Show
Example property, camera system 21 can be set in vehicle cab, can effectively take the head of driver.
In step S210, in response to detecting that the driving behavior information of the first preset kind, camera system are triggered out
It opens.
In step S211, photographic device acquires the original image of the driver.And original image is sent to cloud
22.Illustratively, client camera system is uploaded to cloud server every one second one original image of candid photograph, so that cloud service
Feedback identifying result after the completion of device processing.
Beyond the clouds in 22, following steps S220- step S222 is executed.
In step S220, according to the profile information of history facial key features point and corresponding expression label training table
Feelings classifier.
In the exemplary embodiment, facial key features point refers to eyes, nose, corners of the mouth point, eyebrow etc..Expression label
Refer to happy, indignation, it is sad, detest, be surprised, frightened and neutral etc..Illustrative facial key features point ground profile information
To the corresponding relationship of expression label are as follows: the corners of the mouth raises up, eyes are winding to be happy, and it is indignation etc. that circle is stared in corners of the mouth drop-down, eyes.
In the exemplary embodiment, collect a large amount of history facial key features points profile information and corresponding expression
Label train classification models, expression classifier is obtained when prediction accuracy reaches preset standard.Illustratively, known using priori
Know training expression classifier, expression classification is realized at rule using minimum two.
In step S221, the profile letter that the original image received obtains the key feature points of the driver is handled
Breath.
In the exemplary embodiment, Fig. 3 shows the profile information of the key feature points according to one embodiment of the disclosure
Determination method flow diagram, specifically can be used for the specific embodiment of interpretation procedure S221.With reference to Fig. 3, this method
Including step S310- step S330.
In step s310, the original image is scanned based on local binary pattern and obtains response image.In step
In S320, human face region is obtained in the response image by adaptive Ensemble Learning Algorithms.
In the exemplary embodiment, the above-mentioned original image of local binary pattern progressive scan is primarily based on to be responded
Then image is detected in response image using AdaBoost algorithm with the presence or absence of face.If it exists, then it is calculated using AdaBoost
Method separates human face region from above-mentioned original image.
In step S330, facial key feature points are positioned based on the human face region, according to the wheel of key feature points
Wide information identifies the facial expression information of the driver.
In the exemplary embodiment, facial key features point: eyes, nose is obtained from the corresponding image of human face region
Point, corners of the mouth point, eyebrow etc., after being positioned according to above-mentioned key feature points to face, according to the profile information of key feature points
Identify the current face expression information of driver.
In the exemplary embodiment, in order to avoid the accidental expression shape change of driver leads to the problem for identifying inaccuracy,
The profile information of the key point of multiple (e.g., the 50) faces continuously identified is normalized, and by the pass after normalization
The profile information of key point inputs above-mentioned expression classifier.
With continued reference to Fig. 2, in step S222, it is based on above-mentioned expression classifier, identifies the facial expression of the driver
Information.
In the exemplary embodiment, by the current face expression of driver determining in Fig. 2 and embodiment shown in Fig. 3
After information, judge whether current face expression information belongs to the second preset kind.Illustratively, if expression classifier it is defeated
Out include following several types: happy, indignation, is detested, is surprised, frightened and neutral sadness.It then will wherein may cause driving
Person leads to the indignation driven in violation of rules and regulations, sadness, detest, above-mentioned second preset kind of surprised, frightened conduct with mood.
Illustratively, it is not belonging to above-mentioned second preset kind in response to current face expression information, then camera system continues
The corresponding original image of driver is obtained, with the identification of the facial expression of further progress driver.
It continues to refer to figure 1, in step s 130, in response to identifying the facial expression information of the second preset kind, provides
Assisting automobile driver information.
In the exemplary embodiment, Fig. 4 shows the determination side of the assisting automobile driver information according to one embodiment of the disclosure
The flow diagram of method can be used as a kind of specific embodiment of step S130.With reference to Fig. 4, the method comprising the steps of
S410- step S460.
In step S410, the first reminder message is sent.
In the exemplary embodiment, above-mentioned first reminder message, which can be, reminds driver the prompting messages such as attentively to drive
Stablize the mood of driver, promotes its extensive compound gauge driving condition as early as possible.Illustratively, when judgement driver is in anger instantly
Anger mood and when carrying out anxious acceleration and deceleration, the risky operation such as lamp not being beaten in lane change " please be kept closing rule and driven by voice reminder driver
Sail, thanks " etc., to stablize driver's mood safe driving.
In the step s 420, interval preset duration obtains the facial expression information of the driver again.It and is step
In S430, judge whether the facial expression star of the driver belongs to second preset kind.
In the exemplary embodiment, the facial expression information of driver is obtained, repeatedly to determine whether driver still protects
Hold irregularity driving condition.If it is not, illustrating driver's recovered conjunction rule driving condition, then thereby executing step S440 closing
The photographic device.If so, illustrating driver's extensive compound gauge driving condition not yet, to be performed simultaneously step 410 to continue
The first prompting message is sent to driver, in addition, also executing step S450.
In step S450, judge that sending described first reminds whether new number reaches preset times.
In the exemplary embodiment, it reminds new number to be not up to preset times if sending described first, executes step
Rapid 410 to continue to send the first prompting message to driver.
In the exemplary embodiment, it reminds new number to have reached preset times if sending described first, illustrates
Driver has continued to drive the long period in violation of rules and regulations, and to avoid the occurrence of safety accident, Ying Zhihang step S460 sends second and reminds
Message.Illustratively, above-mentioned second reminder message can be severe warning message.In car operation company, Operations Leader can
To get off rapidly to set the mind at rest or open vehicle to safety area with mandatum alterius driver and backhaul by phonetic warning driver
Vehicle etc. is sought, to ensure driving safety.
The Installation practice of the disclosure introduced below can be used for executing the above-mentioned information processing method of the disclosure.
Fig. 5 shows the structural schematic diagram of information processing unit in one exemplary embodiment of the disclosure.As shown in figure 5, above-mentioned
Information processing unit 500 includes: onboard diagnostics module 501, Expression Recognition module 502 and reminding module 503.
Wherein, above-mentioned onboard diagnostics module 501, for monitoring the driving behavior information of driver；
Above-mentioned Expression Recognition module 502 identifies institute for the driving behavior information in response to monitoring the first preset kind
State the facial expression information of driver；
Above-mentioned reminding module 503 provides driving and mentions for the facial expression information in response to identifying the second preset kind
Awake information.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, above-mentioned onboard diagnostics module 501 is specifically used for:
Fuel system, temperature system, ignition system, dynamical system, exhaust gas is monitored by OBD to control in auxiliary device system
One or more of obtain running state informations；
Wherein, the running state information include: it is anxious accelerate information, anxious deceleration, global position system GPS information,
One or more of fault code indications, fuel consumption information.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, above-mentioned Expression Recognition module 502 is specifically used for:
In response to monitoring one or more of described running state information beyond corresponding preset range, triggering is opened
Camera system, and the facial expression information of the driver is obtained and identified by the camera system.
In an exemplary embodiment of the disclosure, aforementioned schemes, above-mentioned Expression Recognition module 502, comprising: client are based on
The cloud and.
Wherein the client is used for:
The original image of the driver is acquired by camera system, and the original image is sent to cloud；
The cloud includes: response image acquiring unit, human face region acquiring unit and recognition unit.
Wherein defeated response image acquiring unit is used at once: being scanned the original image based on local binary pattern and is obtained
Response image；
Above-mentioned human face region acquiring unit is used for: obtaining people in the response image by adaptive Ensemble Learning Algorithms
Face region；
Above-mentioned recognition unit is used for: facial key feature points is positioned based on the human face region, according to key feature points
Profile information identify the facial expression information of the driver.
In an exemplary embodiment of the disclosure, be based on aforementioned schemes, above-mentioned recognition unit include: classifier subelement and
Expression label obtains subelement.
Wherein, above-mentioned classifier subelement is specifically used for: according to the profile information of history facial key features point and right
The expression label training expression classifier answered；
Above-mentioned expression label obtains subelement and is used for: based on the expression classifier, obtaining the key point of the driver
The corresponding expression label of profile information, the facial expression information for identifying the driver is determined according to the expression label.
In an exemplary embodiment of the disclosure, aforementioned schemes are based on, above-mentioned reminding module 503 is specifically used for: in response to
Identify the facial expression of following one or more of types: indignation, is detested, is surprised, frightened sadness, and assisting automobile driver information is provided.
In an exemplary embodiment of the disclosure, aforementioned schemes, above-mentioned reminding module 503, comprising: facial expression obtains are based on
Take unit, reminding unit.
Wherein, after above-mentioned reminding unit sends the first prompting message, above-mentioned facial expression acquiring unit interval is default
Duration obtains the facial expression information of the driver again；
Above-mentioned reminding unit is also used to: belonging to the described second default class in response to the facial expression information of the driver
Type sends first prompting message again；
Above-mentioned reminding unit is also used to: when the number in response to sending first prompting message reaches preset times, hair
Send the second prompting message.
The detail of each module has carried out in corresponding information processing method in detail in above- mentioned information processing unit
Thin description, therefore details are not described herein again.
It should be noted that although being referred to several modules or list for acting the equipment executed in the above detailed description
Member, but this division is not enforceable.In fact, according to embodiment of the present disclosure, it is above-described two or more
Module or the feature and function of unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block or unit can be to be embodied by multiple modules or unit with further division.
In addition, although describing each step of method in the disclosure in the accompanying drawings with particular order, this does not really want
These steps must be executed in this particular order by asking or implying, or having to carry out step shown in whole could realize
Desired result.Additional or alternative, it is convenient to omit multiple steps are merged into a step and executed by certain steps, and/
Or a step is decomposed into execution of multiple steps etc..
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can also be realized by software realization in such a way that software is in conjunction with necessary hardware.Therefore, according to the disclosure
The technical solution of embodiment can be embodied in the form of software products, which can store non-volatile at one
Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are so that a calculating
Equipment (can be personal computer, server, mobile terminal or network equipment etc.) is executed according to disclosure embodiment
Method.
In disclosure illustrative embodiments, a kind of computer storage Jie that can be realized the above method is additionally provided
Matter.It is stored thereon with the program product that can be realized this specification above method.In some possible embodiments, the disclosure
Various aspects are also implemented as a kind of form of program product comprising program code, when described program product is set in terminal
When standby upper operation, said program code is retouched in above-mentioned " illustrative methods " part of this specification for executing the terminal device
The step of illustrative embodiments various according to the disclosure stated.
Refering to what is shown in Fig. 6, describing the program product for realizing the above method according to embodiment of the present disclosure
600, can using portable compact disc read only memory (CD-ROM) and including program code, and can in terminal device,
Such as it is run on PC.However, the program product of the disclosure is without being limited thereto, in this document, readable storage medium storing program for executing can be with
To be any include or the tangible medium of storage program, the program can be commanded execution system, device or device use or
It is in connection.
Described program product can be using any combination of one or more readable mediums.Readable medium can be readable letter
Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or
System, device or the device of semiconductor, or any above combination.The more specific example of readable storage medium storing program for executing is (non exhaustive
List) include: electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only
Memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory
(CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
In carry readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal,
Optical signal or above-mentioned any appropriate combination.Readable signal medium can also be any readable Jie other than readable storage medium storing program for executing
Matter, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or and its
The program of combined use.
The program code for including on readable medium can transmit with any suitable medium, including but not limited to wirelessly, have
Line, optical cable, RF etc. or above-mentioned any appropriate combination.
Can with any combination of one or more programming languages come write for execute the disclosure operation program
Code, described program design language include object oriented program language-Java, C++ etc., further include conventional
Procedural programming language-such as " C " language or similar programming language.Program code can be fully in user
It calculates and executes in equipment, partly executes on a user device, being executed as an independent software package, partially in user's calculating
Upper side point is executed on a remote computing or is executed in remote computing device or server completely.It is being related to far
Journey calculates in the situation of equipment, and remote computing device can pass through the network of any kind, including local area network (LAN) or wide area network
(WAN), it is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize ISP
To be connected by internet).
In addition, in an exemplary embodiment of the disclosure, additionally providing a kind of electronic equipment that can be realized the above method.
Person of ordinary skill in the field it is understood that various aspects of the disclosure can be implemented as system, method or
Program product.Therefore, various aspects of the disclosure can be with specific implementation is as follows, it may be assumed that complete hardware embodiment, complete
The embodiment combined in terms of full Software Implementation (including firmware, microcode etc.) or hardware and software, can unite here
Referred to as circuit, " module " or " system ".
The electronic equipment 700 of this embodiment according to the disclosure is described referring to Fig. 7.The electronics that Fig. 7 is shown
Equipment 700 is only an example, should not function to the embodiment of the present disclosure and use scope bring any restrictions.
As shown in fig. 7, electronic equipment 700 is showed in the form of universal computing device.The component of electronic equipment 700 can wrap
It includes but is not limited to: at least one above-mentioned processing unit 710, at least one above-mentioned storage unit 720, the different system components of connection
The bus 730 of (including storage unit 720 and processing unit 710).
Wherein, the storage unit is stored with program code, and said program code can be held by the processing unit 710
Row, so that various according to the disclosure described in the execution of the processing unit 710 above-mentioned " illustrative methods " part of this specification
The step of illustrative embodiments.For example, the processing unit 710 can execute as shown in Figure 1: step S110, monitoring
The driving behavior information of driver；Step S120, in response to monitoring the driving behavior information of the first preset kind, described in identification
The facial expression information of driver；Step S130 provides driving in response to identifying the facial expression information of the second preset kind
Prompting message.
Storage unit 720 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit
(RAM) 7201 and/or cache memory unit 7202, it can further include read-only memory unit (ROM) 7203.
Storage unit 720 can also include program/utility with one group of (at least one) program module 7205
7204, such program module 7205 includes but is not limited to: operating system, one or more application program, other program moulds
It may include the realization of network environment in block and program data, each of these examples or certain combination.
Bus 730 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage
Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in a variety of bus structures
Local bus.
Electronic equipment 700 can also be with one or more external equipments 800 (such as keyboard, sensing equipment, bluetooth equipment
Deng) communication, can also be enabled a user to one or more equipment interact with the electronic equipment 700 communicate, and/or with make
Any equipment (such as the router, modulation /demodulation that the electronic equipment 700 can be communicated with one or more of the other calculating equipment
Device etc.) communication.This communication can be carried out by input/output (I/O) interface 750.Also, electronic equipment 700 can be with
By network adapter 760 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network,
Such as internet) communication.As shown, network adapter 760 is communicated by bus 730 with other modules of electronic equipment 700.
It should be understood that although not shown in the drawings, other hardware and/or software module can not used in conjunction with electronic equipment 700, including but not
Be limited to: microcode, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and
Data backup storage system etc..
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can also be realized by software realization in such a way that software is in conjunction with necessary hardware.Therefore, according to the disclosure
The technical solution of embodiment can be embodied in the form of software products, which can store non-volatile at one
Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are so that a calculating
Equipment (can be personal computer, server, terminal installation or network equipment etc.) is executed according to disclosure embodiment
Method.
In addition, above-mentioned attached drawing is only the schematic theory of the processing according to included by the method for disclosure exemplary embodiment
It is bright, rather than limit purpose.It can be readily appreciated that the time that above-mentioned processing shown in the drawings did not indicated or limited these processing is suitable
Sequence.In addition, be also easy to understand, these processing, which can be, for example either synchronously or asynchronously to be executed in multiple modules.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure
His embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Adaptive change follow the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure or
Conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by claim
It points out.
Claims (10)
1. a kind of information processing method characterized by comprising
Monitor the driving behavior information of driver；
In response to monitoring the driving behavior information of the first preset kind, the facial expression information of the driver is identified；
In response to identifying the facial expression information of the second preset kind, assisting automobile driver information is provided.
2. information processing method according to claim 1, which is characterized in that
Monitor the driving behavior information of driver, comprising:
Fuel system, temperature system, ignition system, dynamical system, exhaust gas control auxiliary dress are monitored by onboard diagnostic system OBD
It sets one or more of system and obtains running state information；
Wherein, the running state information includes: anxious acceleration information, anxious deceleration, global position system GPS information, failure
One or more of code information, fuel consumption information.
3. information processing method according to claim 2, which is characterized in that in response to monitoring driving for the first preset kind
Behavioural information is sailed, identifies the facial expression information of the driver, comprising:
In response to monitoring one or more of described running state information beyond corresponding preset range, camera shooting is opened in triggering
System, and the facial expression information of the driver is obtained and identified by the camera system.
4. information processing method as claimed in any of claims 1 to 3, which is characterized in that identify the driver
Facial expression information, comprising:
The original image of the driver is acquired by camera system, and the original image is sent to cloud；
Pass through the cloud:
The original image, which is scanned, based on local binary pattern obtains response image；
Human face region is obtained in the response image by adaptive Ensemble Learning Algorithms；
Facial key feature points are positioned based on the human face region, to identify the driving according to the profile information of key feature points
The facial expression information of person.
5. information processing method according to claim 4, which is characterized in that identified according to the profile information of key feature points
The facial expression information of the driver, comprising:
According to the profile information of history facial key features point and corresponding expression label training expression classifier；
Based on the expression classifier, the corresponding expression label of profile information of the key point of the driver is obtained, according to institute
It states expression label and determines the facial expression information for identifying the driver.
6. information processing method as claimed in any of claims 1 to 3, which is characterized in that in response to identifying
The facial expression information of two preset kinds provides assisting automobile driver information, comprising:
In response to identifying the facial expression of following one or more of types: indignation, is detested, surprised, frightened sadness, provides and drives
Sail prompting message.
7. information processing method according to claim 6, which is characterized in that provide assisting automobile driver information, comprising:
After sending the first prompting message, interval preset duration obtains the facial expression information of the driver again；
Belong to second preset kind in response to the facial expression information of the driver, sends described first again and remind letter
Breath；
When number in response to sending first prompting message reaches preset times, the second prompting message is sent.
8. a kind of information processing unit characterized by comprising
Onboard diagnostics module, for monitoring the driving behavior information of driver；
Expression Recognition module identifies the driver's for the driving behavior information in response to monitoring the first preset kind
Facial expression information；
Reminding module provides assisting automobile driver information for the facial expression information in response to identifying the second preset kind.
9. a kind of computer storage medium, is stored thereon with computer program, which is characterized in that the computer program is processed
Information processing method described in any one of claim 1 to 7 is realized when device executes.
10. a kind of electronic equipment characterized by comprising
Processor；And
Memory, for storing the executable instruction of the processor；
Wherein, the processor is configured to come any one of perform claim requirement 1 to 7 institute via the execution executable instruction
The information processing method stated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910332887.7A CN110059650A (en) | 2019-04-24 | 2019-04-24 | Information processing method, device, computer storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910332887.7A CN110059650A (en) | 2019-04-24 | 2019-04-24 | Information processing method, device, computer storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110059650A true CN110059650A (en) | 2019-07-26 |
Family
ID=67320400
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910332887.7A Pending CN110059650A (en) | 2019-04-24 | 2019-04-24 | Information processing method, device, computer storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110059650A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110826436A (en) * | 2019-10-23 | 2020-02-21 | 上海能塔智能科技有限公司 | Emotion data transmission and processing method and device, terminal device and cloud platform |
| CN114842571A (en) * | 2021-02-02 | 2022-08-02 | 深圳市易流科技股份有限公司 | Method and device for determining driving behavior data |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106114515A (en) * | 2016-06-29 | 2016-11-16 | 北京奇虎科技有限公司 | Car steering behavior based reminding method and system |
| CN106485191A (en) * | 2015-09-02 | 2017-03-08 | 腾讯科技（深圳）有限公司 | A kind of method for detecting fatigue state of driver and system |
| CN106627589A (en) * | 2016-12-27 | 2017-05-10 | 科世达（上海）管理有限公司 | Vehicle driving safety auxiliary method and system and vehicle |
| CN108268838A (en) * | 2018-01-02 | 2018-07-10 | 中国科学院福建物质结构研究所 | Facial expression recognizing method and facial expression recognition system |
| CN108372785A (en) * | 2018-04-25 | 2018-08-07 | 吉林大学 | A kind of non-security driving detection device of the automobile based on image recognition and detection method |
| CN108437993A (en) * | 2018-04-28 | 2018-08-24 | 广东轻工职业技术学院 | A kind of road anger vehicle drive automatically control system and method |
| CN108764034A (en) * | 2018-04-18 | 2018-11-06 | 浙江零跑科技有限公司 | A kind of driving behavior method for early warning of diverting attention based on driver's cabin near infrared camera |
| CN109328155A (en) * | 2016-06-24 | 2019-02-12 | 微软技术许可有限责任公司 | Situational awareness personal assistant |
| CN109572705A (en) * | 2018-12-11 | 2019-04-05 | 武汉格罗夫氢能汽车有限公司 | A kind of driver's motion management method, equipment and storage equipment |
-
2019
- 2019-04-24 CN CN201910332887.7A patent/CN110059650A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106485191A (en) * | 2015-09-02 | 2017-03-08 | 腾讯科技（深圳）有限公司 | A kind of method for detecting fatigue state of driver and system |
| CN109328155A (en) * | 2016-06-24 | 2019-02-12 | 微软技术许可有限责任公司 | Situational awareness personal assistant |
| CN106114515A (en) * | 2016-06-29 | 2016-11-16 | 北京奇虎科技有限公司 | Car steering behavior based reminding method and system |
| CN106627589A (en) * | 2016-12-27 | 2017-05-10 | 科世达（上海）管理有限公司 | Vehicle driving safety auxiliary method and system and vehicle |
| CN108268838A (en) * | 2018-01-02 | 2018-07-10 | 中国科学院福建物质结构研究所 | Facial expression recognizing method and facial expression recognition system |
| CN108764034A (en) * | 2018-04-18 | 2018-11-06 | 浙江零跑科技有限公司 | A kind of driving behavior method for early warning of diverting attention based on driver's cabin near infrared camera |
| CN108372785A (en) * | 2018-04-25 | 2018-08-07 | 吉林大学 | A kind of non-security driving detection device of the automobile based on image recognition and detection method |
| CN108437993A (en) * | 2018-04-28 | 2018-08-24 | 广东轻工职业技术学院 | A kind of road anger vehicle drive automatically control system and method |
| CN109572705A (en) * | 2018-12-11 | 2019-04-05 | 武汉格罗夫氢能汽车有限公司 | A kind of driver's motion management method, equipment and storage equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110826436A (en) * | 2019-10-23 | 2020-02-21 | 上海能塔智能科技有限公司 | Emotion data transmission and processing method and device, terminal device and cloud platform |
| CN114842571A (en) * | 2021-02-02 | 2022-08-02 | 深圳市易流科技股份有限公司 | Method and device for determining driving behavior data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3675121B1 (en) | Computer-implemented interaction with a user | |
| Semmens et al. | Is now a good time? An empirical study of vehicle-driver communication timing | |
| JP7053432B2 (en) | Control equipment, agent equipment and programs | |
| US10243867B2 (en) | Vehicle security system | |
| EP3647147B1 (en) | Method and apparatus for eveluating vehicle, device and computer readable storage medium | |
| CN110473310A (en) | Running car data record method, system, equipment and storage medium | |
| CN111092988A (en) | Control device, agent device, and computer-readable storage medium | |
| CN110059650A (en) | Information processing method, device, computer storage medium and electronic equipment | |
| CN110458604A (en) | A kind of net about driver's evaluation method, device, equipment and storage medium | |
| CN106448063A (en) | Traffic safety supervision method, device and system | |
| CN112885031A (en) | Intelligent alarm system and method based on Internet of vehicles | |
| CN112329963A (en) | Data processing method, data processing apparatus, storage medium, and electronic device | |
| Zhang et al. | Human-machine interaction for autonomous vehicles: A review | |
| CN115731534A (en) | Detection and mitigation of inappropriate behavior by an autonomous vehicle occupant | |
| CN114360204A (en) | Block chain-based networked automobile information safety communication system | |
| JP2020080116A (en) | Control device, agent apparatus, and program | |
| WO2024041003A1 (en) | Electric vehicle parking anomaly identification method and apparatus | |
| CN114084144A (en) | Method and system for determining driver's mood in conjunction with driving environment | |
| CN111461368B (en) | Abnormal order processing method, device, equipment and computer readable storage medium | |
| US11932285B2 (en) | Communication prioritization in vehicles with automated driver assistance | |
| CN113312958B (en) | Method and device for adjusting dispatch priority based on driver state | |
| CN113183983A (en) | Method, apparatus, electronic device, storage medium, and program product for controlling vehicle | |
| JP6819529B2 (en) | Information processing equipment, information processing system, and information processing method | |
| CN112016316A (en) | Identification method and system | |
| CN109017756A (en) | A kind of driver behavior control method and car networking system based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190726 |