WO2015192618A1

WO2015192618A1 - Driving monitoring method and device and computer storage medium

Info

Publication number: WO2015192618A1
Application number: PCT/CN2014/093839
Authority: WO
Inventors: 党松
Original assignee: 西安中兴新软件有限责任公司
Priority date: 2014-06-19
Filing date: 2014-12-15
Publication date: 2015-12-23
Also published as: CN105292124A

Abstract

A driving monitoring method, which comprises: monitoring real-time information when a user drives (101); and comparing the monitored real-time information with stored driving reference information, and determining according to the comparison result whether to initiate a prompt (102). Also provided is a driving monitoring device, which comprises a monitoring module (72) and an information processing module (73).

Description

Driving monitoring method and device, computer storage medium

Technical field

The present invention relates to the field of terminals, and in particular, to a method and device for monitoring safe driving, and a computer storage medium.

Background technique

With the advent of the automobile era, the contradiction between the growing number of cars and the increasingly congested roads has intensified, and the traffic accidents that follow have emerged endlessly. According to the statistics of the transportation department, most of the traffic accidents are caused by the driver's own factors, and the ten accidents are nine times faster. The driver's irritability is the main cause of car speeding, which can cause unnecessary traffic accidents to a large extent.

Although there are now methods for using mobile terminals to alleviate user emotions, and some methods for safe driving monitoring of automobiles, these methods have significant limitations in monitoring dangerous driving. Using mobile terminals to alleviate emotions requires the user to wear a sensory receiver. Many people are discouraged from the configuration of the receiver and the wearing of the receiver. The above-mentioned safe driving monitoring is only started from the expression, ignoring the important factor of sound, and can not monitor more comprehensively. The current driving situation; and the above two methods, the lack of comparison data collection process, the driver's emotional judgment is not accurate enough.

Summary of the invention

In order to solve the existing problems, embodiments of the present invention are expected to provide a driving monitoring method and apparatus, and a computer storage medium.

The technical solution of the embodiment of the present invention is implemented as follows:

Embodiments of the present invention provide a driving monitoring method, including:

Monitor real-time information when users are driving; monitor real-time information and stored driving references The information is compared and the reminder is determined based on the comparison result.

The embodiment of the invention further provides a driving monitoring device, the device comprising: a monitoring module and an information processing module; wherein

a monitoring module configured to monitor real-time information when the user is driving;

The information processing module is configured to compare the monitored real-time information with the stored driving reference information, and determine whether to issue a reminder according to the comparison result.

Embodiments of the present invention provide a computer storage medium in which a computer program for executing the above-described driving monitoring method is stored.

The driving monitoring method and device and the computer storage medium provided by the embodiments of the present invention monitor real-time information when the user is driving; compare the monitored real-time information with the stored driving reference information, and determine whether to issue a reminder according to the comparison result; Through the driving reference information, the driver's emotions can be more accurately evaluated and judged. The speed information of the vehicle can also be monitored. According to the driver's mood and the vehicle speed, it is judged whether it is dangerous driving, and the driver is promptly reminded when the danger is predicted. Attention to relieve the driver's mood and eliminate dangerous driving behavior, thus improving the safety of driving.

DRAWINGS

1 is a schematic flowchart of a safe driving monitoring method according to an embodiment of the present invention;

FIG. 2 is a flowchart of a specific execution procedure of step 101 according to an embodiment of the present invention;

FIG. 3 is a flowchart of a specific execution procedure of step 102 according to an embodiment of the present disclosure;

4 is a schematic flowchart of collecting and processing an expression image according to an embodiment of the present invention;

FIG. 5 is a schematic flowchart of collecting and processing a sound according to an embodiment of the present invention;

FIG. 6 is a schematic flowchart of collecting and processing acceleration information according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a safe driving monitoring apparatus according to an embodiment of the present invention; FIG.

FIG. 8 is a schematic structural diagram of an information collection module according to an embodiment of the present invention.

detailed description

In the embodiment of the present invention, the driving monitoring device monitors real-time information when the user drives; compares the monitored real-time information with the stored driving reference information, and determines whether to issue a reminder according to the comparison result.

The invention will be further described in detail below with reference to the drawings and specific embodiments.

FIG. 1 is a flowchart of a safe driving monitoring method according to an embodiment of the present invention, where the method includes the following steps:

Step 100: Enter a learning mode, collect driving reference information, and store; wherein the driving reference information includes: an irritable or angry expression image, and/or an irritating or angry voice, and/or speed threshold information;

Specifically, as shown in FIG. 2, this step includes several steps:

Step 100a: The device enters a learning mode.

Step 100b: Turn on the front camera to prompt the user to open the learning mode, and ask the user to input the irritating or angry expression information that may appear in the driving; the camera captures the irritated or angry expression that appears in the driving of the user's face to generate an expression image;

The expression image may also be displayed on the screen; waiting for the user to confirm whether to store;

Step 100c: The user makes a selection according to the storage option on the screen. When the selection is YES, the current expression image is stored; when no is selected, the current expression is discarded; multiple expressions may be input according to the user's needs; after the expression entry is completed, step 100d is performed. ;

Step 100d: Turn on the microphone, prompt the user to enter the irritating or angry words that appear in the driving, and use the microphone to record the irritating or angry voice that appears in the user's driving;

The sound can also be simulated and displayed by using a spectrum or the like, waiting for the user to confirm whether to store;

Step 100e: when the user selects to save the recording, the current sound is stored; when the user does not save, the current sound is discarded; and multiple sounds can be recorded according to the user's needs;

The steps of the above-mentioned expression input and sound input are not sequential, and only one or both of them can be collected. Here, for the sake of clarity, the steps are described;

Step 100f: performing digital analysis processing on the collected expression image and/or sound to obtain first digital image information and/or first digital sound information; and the first digital image information and/or the first digital sound information Encoded and stored in the database;

When the expression image is digitized, important information in each expression image can be extracted, such as eyebrows, eyes, mouth and the like;

When the sound is digitized, important factors in the sound can also be analyzed, such as pitch, pitch, and so on.

Step 101: Monitor real-time information when the user drives;

Specifically, as shown in FIG. 3, this step includes the following specific steps:

Step 101a: during driving, the device captures the expression and/or sound of the driver according to a preset frequency;

Specifically, the camera captures the driver's expression according to the preset frequency, such as 20 times/minute, and the microphone collects the driver's voice according to the preset frequency, such as 20 times/minute;

The step further includes: detecting, by the acceleration sensor, current acceleration information of the vehicle, where the acceleration information includes: detecting an instantaneous value a _{hi of the} horizontal acceleration and an instantaneous value a _{vi of the} vertical acceleration;

Recording the collected expression image and/or sound information and/or acceleration information;

Here, the recorded acceleration information is absolute value information without direction.

Step 101b: Record the expression image and/or sound information and/or acceleration information collected in step 101a.

Step 102: Comparing the monitored real-time information with the stored driving reference information, and determining whether to issue a reminder according to the comparison result;

Specifically, the comparison includes: expression contrast and/or sound contrast and/or speed comparison;

First, the recorded real-time expression image and/or sound information recorded in the above manner is digitized to obtain second digital image information and/or second digital sound information; wherein the specific process of the digitization process and the most in step 100f Be consistent, in order to get more accurate emotional judgment results;

Secondly, comparing the similarity between the second digital image information and the stored first digital image information, when the similarity is greater than the expression similarity threshold S _f , indicating that the current mood of the driver is in an irritated, angry state, and issuing a safe driving reminder;

Comparing the second digital sound information with the stored first digital sound information, when the similarity is greater than the sound similarity threshold S _v , indicating that the current mood of the driver is in an irritated, angry state, and issuing a safe driving reminder;

The expression similarity threshold S _f and/or the sound similarity threshold S _v is a threshold value of normal mood and irritability and anger obtained by the designer according to the emotion analysis, and is pre-stored in the device;

When the expression similarity is greater than the expression similarity threshold S _f and/or the sound similarity is greater than the sound similar threshold S _v , the driver may be considered to be more irritable or angry, and the security reminder issued by the device may be a sound and/or an image; For example, you can remind the driver to “monitor that you are in a bad mood now, which may affect your safe driving. Please be careful and slow, pay attention to safety”; the device screen can also draw a pattern that can relieve the driver's mood at this time. , for example, a smiley face; at the same time, the device can soothe the driver's emotions by playing some light music;

The speed comparison is: comparing the speed threshold information with the detected acceleration information, and when the detected acceleration information is greater than the speed threshold information, indicating that the current driving condition is not good, issuing a safe driving reminder;

The speed threshold information includes: a horizontal acceleration instantaneous value threshold a _hm , a vertical acceleration instantaneous value threshold a _vm , a horizontal acceleration integrated value threshold a _ha and a vertical acceleration integrated value threshold; the above thresholds are set according to the safe driving speed , pre-stored in the device;

Specifically, the comparing speed threshold information and the detected acceleration information when detected When the acceleration information is greater than the speed threshold information, a safe driving reminder is issued, including:

Comparing the instantaneous value of the threshold level of instantaneous acceleration a _hm monitoring module and horizontal accelerations detected magnitude value of a _hi, when the instantaneous value of the horizontal acceleration of a _hi large, indicates current vehicle speed is too fast, safe driving issue reminders;

Comparing the horizontal acceleration cumulative value a _h with the stored horizontal acceleration cumulative value threshold a _ha , when the horizontal acceleration integrated value a _{h is} large, indicating that the current vehicle speed is too fast, and issuing a safe driving reminder;

Comparing the instantaneous value of the vertical acceleration threshold value of the instantaneous a _vm monitoring vertical acceleration value to a _vi, when the instantaneous value of the vertical acceleration a _vi large, safe driving issue reminders;

Comparing the vertical acceleration cumulative value a _v with the stored vertical acceleration cumulative value threshold a _va , and issuing a safe driving reminder when the vertical acceleration cumulative value a _{v is} large;

Wherein, the horizontal acceleration cumulative value a _h is the sum of the instantaneous values a _hi of the horizontal acceleration in the specified time interval:

The vertical acceleration cumulative value a _v is the sum of the instantaneous values a _vi of the vertical acceleration in the specified time interval:

Wherein, the specified time interval is set by the designer or the user in advance, and may be any time;

When the horizontal acceleration cumulative value a _{h is} greater than the horizontal acceleration cumulative threshold a _ha and/or the vertical acceleration cumulative value a _{v is} greater than the vertical acceleration cumulative threshold a _va , it can be considered that the vehicle has experienced excessive driving behavior for a period of time, and the device can pass Sound and image information alert the driver; for example, the driver can be alerted to “monitor that the current driving condition of the vehicle is too intense, whether it is because you are upset. Please be careful and slow, pay attention to safety”; You can draw a pattern that can soothe the driver's mood, such as a smiley face. At the same time, the device can relax the driver's emotions by playing some light music.

The above safe driving monitoring methods also include:

Step 103: Returning the user to the user, providing a user evaluation interface, correcting the stored threshold information according to the evaluation result of the user, or reminding the user to select to re-enter the learning mode, and collecting driving Reference information and storage;

The threshold information includes: an expression similarity threshold, a sound similarity threshold, and a speed threshold information.

Specifically, through the screen display and the sound reminder, the user can score the accuracy and timeliness of the safe driving reminder; for example, the score can be divided into 1 to 10 points, and the device passes the user's rating to the preset each. The item threshold is corrected; when the score is too low, for example, less than 5 points, the user is reminded whether to restart the learning process.

The flow of the above steps 102 and 103 can be specifically represented by the flowcharts shown in FIG. 4 to FIG. 6;

Figure 4 shows the specific process of collecting and processing an expression image;

The driver's expression is collected according to the preset frequency, and the second digital image information is obtained by digitizing, and the similarity is compared with the first digital image information stored in the learning mode to determine whether the similarity is greater than the previously set expression similarity threshold S. _f . When it is greater than, the driver is reminded to pay attention to safety; when it is not greater than, the expression is collected and processed again.

Figure 5 shows the specific process of collecting and processing sounds;

The driver's voice is collected according to the preset frequency, and the second digital sound information is obtained by digitizing, and the similarity is compared with the first digital sound information stored in the learning mode to determine whether the similarity is greater than a previously set sound similarity threshold S. _v . When it is greater than, the driver is reminded to pay attention to safety; when it is not greater than, the sound is collected and processed again.

Figure 6 shows the specific process of collecting and processing acceleration information;

Instantaneous frequency detector according to a preset level of vehicle acceleration value a _Hi; horizontal acceleration process comprises two elements: a) determining an instantaneous acceleration value a _Hi level and the instantaneous value of the horizontal acceleration threshold a size of _hm, when _Hi is larger than a a _hm , remind the driver to pay attention to safety, when a _{hi is} not greater than a _hm , continue to detect the instantaneous value of the horizontal acceleration a _hi ; 2) determine the horizontal acceleration cumulative value a _h , and determine the horizontal acceleration cumulative value a _h and The horizontal acceleration cumulative value threshold a _ha , when a _{h is} greater than a _ha , reminds the driver to pay attention to safety, when a _{h is} not greater than a _ha , continue to determine the horizontal acceleration cumulative value a _h ;

According to the instantaneous frequency of the vertical acceleration of the vehicle is detected a preset value of a _vi; vertical acceleration process comprises two elements: a) determining the instantaneous value of the vertical acceleration and the vertical acceleration a _vi instantaneous value of the threshold size of a _vm, is greater than when a _vi a _vm , reminding the driver to pay attention to safety, when a _{vi is} not greater than a _vm , continue to detect the instantaneous value of the vertical acceleration a _vi ; 2) determine the vertical acceleration cumulative value a _v , and determine the vertical acceleration cumulative value a _v and vertical acceleration cumulative value of a _va threshold size, when greater than a _va a _v, alert drivers pay attention to safety, when not more than a _va a _v, proceed to determine the cumulative value of the vertical acceleration threshold value a _va.

In the above-mentioned collection and processing flow shown in FIG. 4 to FIG. 6 , one or more of the actual driving monitoring may be selected; after the driving is finished, the user is returned to the user, and the user scores the score according to the score result. Various threshold information is obtained to correct or restart the learning mode.

The structure of the driving monitoring device provided by the embodiment of the present invention is as shown in FIG. 7. The device includes: a monitoring module 72 and an information processing module 73;

The monitoring module 72 is configured to monitor real-time information when the user is driving;

The information processing module 73 is configured to compare the monitored real-time information with the stored driving reference information, and determine whether to issue a reminder according to the comparison result;

The device further includes: an information collecting module 70 and a storage module 71; wherein

The information collecting module 70 is configured to collect the driving reference information in the learning mode before monitoring the real-time information of the user while driving;

The storage module 71 is configured to store the collected driving reference information;

Wherein the driving reference information includes: an irritable or angry expression image, and/or an irritable or angry voice, and/or speed threshold information;

As shown in FIG. 8, the information collection module 70 includes: an image acquisition module 80 and a sound collection module 81;

The image acquisition module 80 is configured to capture an expression image of the irritability or anger that occurs in the driving that the user exhibits;

In practical applications, image acquisition can be achieved by a camera;

The sound collection module 81 is configured to record the irritating or angry sound that the user may exhibit during driving;

In practice, a microphone can be used to achieve image acquisition;

The information processing module 73 is specifically configured to digitize the expression image and/or sound, and store the obtained first digital image information and/or first digital sound information to the storage module 71; the storage module 71 can be established. Database to store the above information for easy searching;

Wherein, when the expression image is digitized, important information in each expression image may be extracted, such as: eyebrows, eyes, mouth, and the like;

When digitizing the sound, it is also possible to analyze and deal with important factors in the sound, such as pitch, pitch, etc.

The monitoring device of FIG. 7 further includes an acceleration detecting module 74 configured to detect current acceleration information of the vehicle, wherein the acceleration information is absolute value information without direction, including: instantaneous value of horizontal acceleration a _vi and vertical Instantaneous value of acceleration a _vi ; the module consists of an acceleration sensor and peripheral components;

The monitoring module 72 is specifically configured to capture the driver's expression according to the preset frequency by the image acquisition module 80 in the control information collection module 70, and/or the sound collection module 81 in the control information collection module 70 according to the preset frequency. Acquiring the driver's voice, and/or controlling the acceleration detection module 74 to detect the current acceleration information of the vehicle; recording the collected expression image, and/or sound information, and/or acceleration information; here, the recorded acceleration information is Is the absolute value information without direction.

The above-mentioned frequency of capturing expressions and collecting sounds may be the same or inconsistent, and the driver may set according to driving habits; for example, 20 times/minute;

The recording may be storing the above information to the storage module 71;

The monitoring module 72 can be implemented by a chip with control capability in the device, in practice There are many hardware chips for implementing this function, which are selected by the designer according to the design requirements of the product;

The information processing module 73 is further configured to digitize the recorded monitored real-time expression image and/or sound information to obtain second digital image information and/or second digital sound information; first digital image information stored in the information image similarity comparison, when the similarity is larger than the threshold value similar to the expression S _f, safe driving reminders sent; and / or the first digital audio information of the second digital sound information stored Performing a similarity comparison, when the similarity is greater than the sound similarity threshold S _v , issuing a safe driving reminder; and/or comparing the speed threshold information with the acceleration information detected by the monitoring module, when the detected acceleration information is greater than the speed threshold Send a safe driving reminder when the information is available;

The expression similarity threshold S _f and the sound similarity threshold S _v are threshold values of normal mood and irritability or anger generated by the designer according to the emotion analysis, and are pre-stored in the device;

The speed threshold information is stored in the storage module 71;

The speed threshold information includes: a horizontal acceleration instantaneous value threshold a _hm , a vertical acceleration instantaneous value threshold a _vm , a horizontal acceleration integrated value threshold a _{ha ,} and a vertical acceleration integrated value threshold a _va ;

And comparing the speed threshold information with the acceleration information detected by the monitoring module, when the detected acceleration information is greater than the speed threshold information, issuing a safe driving reminder, including:

Comparing the horizontal acceleration instantaneous value threshold a _hm with the instantaneous value a _hi of the horizontal acceleration detected by the monitoring module 72, and issuing a safe driving reminder when the instantaneous value a _{hi of the} horizontal acceleration is large;

Comparing the horizontal acceleration cumulative value a _h with the horizontal acceleration cumulative value threshold a _ha , when the horizontal acceleration integrated value a _{h is} large, issuing a safe driving reminder;

The vertical acceleration integrated value a _v detected by the comparison monitoring module 72 is compared with the vertical acceleration integrated value threshold a _va , and when the vertical acceleration integrated value a _{v is} large, a safe driving reminder is issued;

The information processing module 73 may be implemented by a chip with strong information processing capability in the device, or may be implemented by a main chip; and selecting a suitable chip according to a specific internal hardware design of the product;

The monitoring device of FIG. 7 further includes: a monitoring correction module 75 and a control module 76;

The monitoring correction module 75 is configured to provide an evaluation interface for the user after the monitoring is completed, correct the threshold information stored in the storage module according to the evaluation result of the user, or remind the user to select to re-enter the learning mode, collect the driving reference information, and store the information;

The threshold information includes: an expression similarity threshold, a sound similarity threshold, and a speed threshold information;

Specifically, the monitoring and correction module 75 allows the user to score the accuracy and timeliness of the safe driving reminder through the screen display and the sound reminder. For example, the score can be divided into 1 to 10 points, and the device corrects the preset threshold by the user's score. When the score is too low, for example, less than 5 points, the user is reminded whether to restart the learning process;

The monitoring and correction module 75 can be implemented by a main chip or an information processing chip;

The control module 76 is configured to control and manage an execution process of each module in the monitoring device;

Control module 76 is typically implemented by the most capable chip in the device to ensure control, management stability, and timing accuracy.

The driving monitoring method according to the embodiment of the present invention may also be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a stand-alone product. Based on such understanding, those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media containing computer usable program code, including but not limited to a USB flash drive, Mobile hard disk, read-only memory (ROM, Read-Only Memory), disk storage, CD-ROM, optical storage, and the like.

Correspondingly, the embodiment of the present invention further provides a computer storage medium, wherein a computer program is stored, and the computer program is used to execute the driving monitoring method of the embodiment of the present invention.

The above is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in Within the scope of protection of the present invention.

Industrial applicability

In the embodiment of the present invention, the device enters the learning mode, collects the driving reference information, and stores it; makes a reference for judging the driver's emotion, and increases the accuracy of the judgment; monitors the real-time information of the user while driving; and stores the stored driving reference information and monitoring The real-time information is compared, and the reminder is determined according to the comparison result; comparing the emotion data of the driver monitored in real time with the reference in the database can more accurately determine the emotion, and at the same time, the driving state of the vehicle is also added to the judgment. Whether driving is a safety factor, it is more comprehensive to monitor whether the driving process is safe.

Claims

A driving monitoring method, the method comprising:

Monitor real-time information when the user is driving; compare the monitored real-time information with the stored driving reference information, and determine whether to issue a reminder based on the comparison result.
The method according to claim 1, wherein before monitoring the real-time information of the user while driving, the method further comprises: collecting driving reference information in the learning mode, and storing;

The driving reference information includes an irritated or angry facial expression image and/or annoying or angry sound and/or speed threshold information.
The method according to claim 2, wherein said collecting an irritated or angry expression image and/or an annoying or angry sound, and storing comprises: capturing, by the camera, an expression of irritability or anger that occurs in driving exhibited by the user An image, digitizing the emoticon image, storing the obtained first digital image information; and/or recording a irritating or angry sound that occurs in driving by the user using a microphone, digitizing the sound, and obtaining the A digital sound information storage.
The method according to claim 1, wherein said monitoring real-time information of a user while driving comprises: capturing a driver's expression at a preset frequency, and/or collecting a driver's voice at a preset frequency, and/or And detecting the current acceleration information of the vehicle by an acceleration sensor, recording the collected expression image, and/or sound information, and/or acceleration information; wherein the acceleration information includes an instantaneous value a hi and a vertical acceleration of the horizontal acceleration The instantaneous value a vi .
The method according to claim 4, wherein the comparing the stored driving reference information with the monitored real-time information, determining whether to issue the reminder according to the comparison result comprises: digitizing the recorded monitored expression image, and obtaining Second digital image information; comparing the similarity between the second digital image information and the stored first digital image information, and issuing a safe driving reminder when the similarity is greater than the expression similarity threshold.
The method according to claim 4, wherein said comparing said stored driving reference information with the monitored real-time information, determining whether to issue a reminder based on the comparison result comprises: The recorded sound information is digitized to obtain second digital sound information, and the second digital sound information is compared with the stored first digital sound information, and when the similarity is greater than the sound similar threshold, a safe driving reminder is issued. .
The method according to claim 4, wherein said comparing said stored driving reference information with the monitored real-time information, and issuing a reminder according to the comparison result comprises: comparing the speed threshold information with the detected acceleration information, when detected When the acceleration information is greater than the speed threshold information, a safe driving reminder is issued.
The method according to claim 7, wherein the speed threshold information comprises: a horizontal acceleration instantaneous value threshold a hm , a vertical acceleration instantaneous value threshold a vm , a horizontal acceleration integrated value threshold a ha , and a vertical acceleration integrated value threshold a va ;

The comparing the speed threshold information and the detected acceleration information, when the detected acceleration information is greater than the speed threshold information, issuing a safe driving reminder, including:

Comparing the instantaneous value of the horizontal acceleration threshold value of the instantaneous acceleration a hm level monitored values a hi, when the instantaneous level of acceleration is greater a hi, issued alert safe driving;

Comparing the horizontal acceleration cumulative value a h with the horizontal acceleration cumulative value threshold a ha , when the horizontal acceleration integrated value a h is large, issuing a safe driving reminder;

Comparing the instantaneous value of the vertical acceleration threshold value of the instantaneous a vm monitoring vertical acceleration value to a vi, when the instantaneous value of the vertical acceleration a vi large, safe driving issue reminders;

Comparing the vertical acceleration cumulative value a v with the stored vertical acceleration cumulative value threshold a va , when the vertical acceleration cumulative value a v is large, issuing a safe driving reminder;

Wherein, the horizontal acceleration cumulative value a h is the sum of the instantaneous values a hi of the horizontal acceleration in the specified time interval:
The vertical acceleration cumulative value a v is the sum of the instantaneous values a vi of the vertical acceleration in the specified time interval:
The method according to claim 1, wherein the method further comprises: returning to the user, providing a user evaluation interface, and correcting or reminding the threshold information according to the evaluation result of the user. The user chooses to re-enter the learning mode, collect driving reference information, and store;

The threshold information includes: an expression similarity threshold, a sound similarity threshold, and a speed threshold information.
A driving monitoring device, the device comprising: a monitoring module and an information processing module; wherein

a monitoring module configured to monitor real-time information when the user is driving;

The information processing module is configured to compare the monitored real-time information with the stored driving reference information, and determine whether to issue a reminder according to the comparison result.
The device according to claim 10, wherein the device further comprises: an information collecting module and a storage module; wherein

The information collecting module is configured to collect the driving reference information in the learning mode before monitoring the real-time information of the user while driving;

a storage module configured to store the collected driving reference information;

The driving reference information includes: an irritable or angry expression image, and/or an irritating or angry sound, and/or speed threshold information.
The device according to claim 11, wherein the information collection module comprises: an image acquisition module and a sound collection module; wherein

An image acquisition module configured to capture an image of an irritated or angry expression that appears to the user during driving;

A sound collection module configured to record the irritating or angry sounds that the user may experience while driving.
The apparatus of claim 12, wherein the information processing module is configured to digitize the emoticon image and/or sound and store the obtained first digital image information and/or first digital sound information to a storage Module.
The apparatus according to claim 13, wherein the apparatus further comprises: an acceleration detecting module configured to detect current acceleration information of the vehicle, wherein the acceleration information includes an instantaneous value a hi of the horizontal acceleration and an instantaneous value a of the vertical acceleration Vi ;

The monitoring module is configured to control an image acquisition module in the information collection module to capture a driver's expression according to a preset frequency, and/or a sound collection module of the control information collection module to collect a driver's voice according to a preset frequency, and And/or controlling the acceleration detection module to detect current acceleration information of the vehicle; recording the collected expression image, and/or sound information, and/or acceleration information.
The apparatus according to claim 14, wherein said information processing module is configured to digitize the recorded monitored expression image and/or sound information to obtain second digital image information and/or second digital sound information. Comparing the second digital image information with the stored first digital image information for similarity, issuing a safe driving reminder when the similarity is greater than the expression similarity threshold; and/or storing the second digital sound information with the stored The first digital sound information performs a similarity comparison, and when the similarity is greater than the sound similarity threshold, issues a safe driving reminder; and/or compares the speed threshold information with the acceleration information detected by the monitoring module, when the detected acceleration information is greater than A safe driving reminder is issued when the speed threshold information is described.
The apparatus according to claim 15, wherein the speed threshold information comprises: a horizontal acceleration instantaneous value threshold a hm , a vertical acceleration instantaneous value threshold a vm , a horizontal acceleration integrated value threshold a ha , and a vertical acceleration integrated value threshold a va ;

And comparing the speed threshold information with the acceleration information detected by the monitoring module, when the detected acceleration information is greater than the speed threshold information, issuing a safe driving reminder, including:

Comparing the horizontal acceleration instantaneous value threshold a hm with the instantaneous value a hi of the horizontal acceleration detected by the monitoring module, and issuing a safe driving reminder when the instantaneous value a hi of the horizontal acceleration is large;

Comparing the horizontal acceleration cumulative value a h with the stored horizontal acceleration cumulative value threshold a ha , when the horizontal acceleration cumulative value a h is large, issuing a safe driving reminder;

Comparing the instantaneous value of the vertical acceleration threshold value and the vertical acceleration a vm instantaneous value of a vi, when the instantaneous value of the vertical acceleration of a vi large, safe driving issue reminders;

Comparing the vertical acceleration cumulative value a v with the stored vertical acceleration cumulative value threshold a va , when the vertical acceleration cumulative value a v is large, issuing a safe driving reminder;

Wherein, the horizontal acceleration cumulative value a h is the sum of the instantaneous values a hi of the horizontal acceleration in the specified time interval:
The vertical acceleration cumulative value a v is the sum of the instantaneous values a vi of the vertical acceleration in the specified time interval:
The apparatus of claim 10, wherein the apparatus further comprises: a monitoring correction module and a control module;

The monitoring correction module is configured to provide an evaluation interface for the user after the monitoring is finished, correct the threshold information stored in the storage module according to the evaluation result of the user, or remind the user to select to re-enter the learning mode, collect the driving reference information, and store the information;

The threshold information includes: an expression similarity threshold, a sound similarity threshold, and a speed threshold information;

The control module is configured to control and manage an execution flow of each module in the monitoring device.
A computer storage medium storing therein a computer program for performing the driving monitoring method according to any one of claims 1 to 9.