CN113129551A - Method, system, medium and equipment for automatically alarming through micro-expression of driver - Google Patents
Method, system, medium and equipment for automatically alarming through micro-expression of driver Download PDFInfo
- Publication number
- CN113129551A CN113129551A CN202110308531.7A CN202110308531A CN113129551A CN 113129551 A CN113129551 A CN 113129551A CN 202110308531 A CN202110308531 A CN 202110308531A CN 113129551 A CN113129551 A CN 113129551A
- Authority
- CN
- China
- Prior art keywords
- micro
- driver
- information
- expression
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000014509 gene expression Effects 0.000 claims abstract description 43
- 230000003213 activating effect Effects 0.000 claims abstract description 22
- 230000009471 action Effects 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 claims description 4
- 230000003321 amplification Effects 0.000 claims description 4
- 238000012937 correction Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 4
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 4
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000012549 training Methods 0.000 claims description 4
- 230000004913 activation Effects 0.000 claims description 3
- 238000013499 data model Methods 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000008921 facial expression Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
- G08B21/0208—Combination with audio or video communication, e.g. combination with "baby phone" function
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0269—System arrangements wherein the object is to detect the exact location of child or item using a navigation satellite system, e.g. GPS
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/028—Communication between parent and child units via remote transmission means, e.g. satellite network
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Child & Adolescent Psychology (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Emergency Management (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Radar, Positioning & Navigation (AREA)
- Theoretical Computer Science (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a method, a system, a medium and equipment for automatically alarming through micro-expression of a driver, wherein the method comprises the following steps: presetting preset voice information for activating a camera and preset micro-expression information for alarming; setting alarm information and safety decision; acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver; analyzing and identifying micro-expression information of a driver; and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm. The invention can realize the secret alarm by the combination of voice and micro expression under the condition that the alarm can not be given by the conventional means when the driver is hijacked, and can give an alarm timely and accurately under the condition of ensuring the safety of the driver so as to improve the safety of the driver.
Description
Technical Field
The invention relates to the technical field of alarm by detecting micro expression, in particular to a method, a system, a medium and equipment for automatically alarming through the micro expression of a driver.
Background
With the development of technology, in order to address the occurrence of various accidents, the alarm mechanism is continuously improved. The traditional alarm mode is manual alarm, namely voice call alarm is carried out through networking in a telephone mode and the like, but the traditional alarm mode is not suitable for many situations. When the victim can not simply and effectively alarm in the first time, tragedy happens. Once an accident occurs, voice alarm is inconvenient, and further expansion of loss can be caused.
In order to improve the flexibility of alarm and adapt to special situations, a method for alarming by identifying the action of a user appears, and the invention patent in China with the publication number of CN110996052A discloses an emergency alarm method based on image identification, which comprises the following steps: acquiring an image shot by a camera; analyzing the shot image to obtain a judgment area image, wherein the judgment area image comprises a face area image and/or a hand area image; identifying the action features in the judgment area image, and determining the user action features corresponding to the judgment area image; judging whether the user action characteristics are preset alarm actions or not; if yes, an alarm action is triggered.
In view of the above prior art, the applicant has found that when a driver of an automobile is hijacked by passengers, the driver may be inconvenient to make a specific alarm action in order not to be found by a hijacker, and if the driver makes the alarm action and the hijacker finds the alarm action, an over-excitation behavior of the hijacker may be caused, which endangers the personal safety of the driver. Therefore, the prior art is not suitable for the situation that the drivers of the taxi, the network taxi appointment and the like are hijacked, and therefore, an alarming method which is suitable for safely and secretly alarming when the drivers of the taxi are hijacked is urgently needed to be invented so as to ensure the safety of the drivers.
Disclosure of Invention
In order to overcome the technical defect that the prior art is not suitable for the hijacked driver to carry out safe and secret alarm, the invention provides an alarm method, a system, a medium and equipment for ensuring the safety of the driver without being discovered by the hijacked driver by identifying the micro expression of the driver.
In order to solve the problems, the invention is realized according to the following technical scheme:
the invention relates to a method for automatically giving an alarm through micro-expression of a driver, which comprises the following steps:
presetting preset voice information for activating a camera and preset micro-expression information for alarming;
setting alarm information and safety decision;
acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver;
analyzing and identifying micro-expression information of a driver;
and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
Preferably, in the analyzing and recognizing the micro-expression information of the driver, the analyzing and recognizing step specifically includes: face preprocessing, time domain image interpolation, action amplification and feature extraction.
Preferably, after the preset micro-expression information is acquired, network judgment is further performed, and the method specifically includes: carrying out network judgment; if the network connection is normal, the security decision is transmitted to a background through the network so as to carry out feedback correction of the security decision; and if the network connection is abnormal, directly executing a safety decision.
Preferably, the acquiring and analyzing the micro-expression information of the driver further comprises: and if the preset micro-expression information is not acquired, closing the camera after the preset time of the system.
Preferably, the preset micro-expression information is subjected to machine learning and big data model training through a background, so that the accuracy of analysis and recognition is improved.
Preferably, the preset micro-expression information consists of a plurality of micro-expressions arranged in sequence.
Preferably, the set alarm information comprises a name, an identification number, a mobile phone number, hijacked condition description information, a license plate number, vehicle information, a working unit, a designated alarm number and an alarm mailbox.
The invention also discloses a system for automatically alarming through the micro-expression of the driver, which comprises the following components:
the system comprises a first preset module, a second preset module and a third preset module, wherein the first preset module is used for presetting preset voice information for activating a camera and preset micro-expression information for alarming;
the second preset module is used for setting alarm information and safety decision;
the voice activation module is used for acquiring preset voice information and activating the camera to acquire micro-expression information of a driver;
the expression recognition module is used for analyzing and recognizing micro expression information of a driver;
and the decision execution module is used for executing a safety decision if the preset micro-expression information is obtained, and uploading the alarm information to alarm.
The invention also discloses a non-transitory computer readable storage medium storing computer instructions, wherein the computer instructions are used for causing a computer to execute the method for automatically alarming through the micro expression of the driver.
The invention also discloses an electronic device, comprising:
the system comprises at least one processor and a memory which is in communication connection with the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so as to enable the at least one processor to execute the method for automatically alarming through micro-expression of a driver.
Compared with the prior art, the invention has the beneficial effects that:
according to the invention, the voice information and the micro expression information of the driver are preset, when the driver is hijacked, the driver can automatically activate the camera of the equipment in the vehicle by sending out the specific preset voice information, and the camera starts to capture the micro expression of the face of the driver. Then, the driver can make preset micro expression information through the face, and after analysis and identification, corresponding decision is automatically executed, so that the alarm is finished under the condition of not arousing the attention of the hijacker, the safety of the driver can be effectively ensured, the action amplitude of the micro expression is small while the alarm is timely carried out, the emotion of the hijacker is not stimulated, and the invention has safety and timeliness at the same time.
Drawings
Embodiments of the invention are described in further detail below with reference to the attached drawing figures, wherein:
FIG. 1 is a schematic flow chart of the main process of the method for automatic alarm by driver micro-expression of the present invention;
FIG. 2 is a schematic overall flow chart of the method of the present invention for automatic warning through driver micro-expression;
fig. 3 is a schematic diagram of the system for automatic warning by driver micro-expression of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Referring to fig. 1 to 2, preferred steps of the method for automatically alarming by a micro-expression of a driver according to the present invention are schematically shown.
The invention needs to set a mobile device or a vehicle-mounted device with a camera and a voice receiving function on the vehicle as a driver terminal implemented by the invention, and the driver terminal needs to download a corresponding application program so as to realize the method of the invention. In use, the driver's terminal needs to be placed in the vehicle with the camera oriented towards the driver's face. The driver terminal can be a vehicle-mounted entertainment device, a vehicle-mounted alarm device, a smart phone, a smart watch, a tablet computer and the like. The driver terminal needs to be in network connection with the background server through a network so as to perform information interaction related to the micro-meter information police, and perform background big data identification training on the micro-expression of the driver so as to reduce the false alarm rate.
In a first aspect, the invention discloses a method for automatically giving an alarm through a micro-expression of a driver, which specifically comprises the following steps:
step S1: presetting preset voice information for activating a camera and preset micro-expression information for alarming.
Specifically, a driver opens a corresponding application program through a driver terminal, enters a preset voice information interface, and sets preset voice information. After the driver speaks the corresponding voice, the voice recognition of the driver is obtained, the number of the drivers can be increased at any time, and the voice recognition of a plurality of drivers can be carried out by recording for many times. Then, the driver sets specific voice, the application program guides the driver to set voice information which is difficult to conjecture alarm, and after repeated entry, recognition test is carried out to ensure the stability of successful entry and recognition. And then guiding the driver to enter an application program, presetting an interface of the micro expression information, putting the corresponding micro expression out by the driver through a camera for presetting, and forming the preset micro expression information after repeated confirmation for many times.
Preferably, in this embodiment, the preset micro-expression information is composed of a plurality of micro-expressions arranged in sequence. The micro expressions arranged in sequence can form a set of dynamic micro expressions in a specific sequence, and can greatly reduce the false alarm condition, thereby reducing the occupation of alarm resources and improving the overall accuracy of automatic alarm of the micro expressions.
Meanwhile, machine learning and big data model training are carried out on the preset micro-expression information through a background, so that the accuracy of analysis and recognition is improved. In order to improve the accuracy, in the driving process of a driver, the camera can be automatically opened after a certain characteristic time interval so as to automatically acquire the current face of the driver and further correct the face of the driver, thereby improving the recognition accuracy of the micro-expression.
Step S2: setting alarm information and safety decision.
Specifically, a driver presets alarm information and safety decisions through a driver terminal. When the alarm information is an automatic alarm, the information sent to the outside generally includes specific information of a driver and specific information of a vehicle. And then presetting a safety decision, wherein the safety decision is a specific step decision adopted when an alarm is automatically given out after preset micro-expression information is sensed, the specific content of the safety decision comprises an alarm object, an alarm mode, alarm times, an alarm channel and the like, and the corresponding safety decision can be set according to specific conditions, so that the alarm is given out through different carriers, such as network information, short message information, broadcast signal information and the like, and the probability of signal blockage when the alarm is located in a remote area is reduced. And a safety decision can be set, and signals are sent to corresponding units or emergency contacts while alarming, so that the communication of information can be ensured by multi-party alarming.
Preferably, the set alarm information includes a name, an identification number, a mobile phone number, hijacked condition description information, a license plate number, vehicle information, a work unit, a designated alarm number, and an alarm mailbox. The method has the advantages that personal detailed information of a driver and information of a vehicle are obtained, and the positioning information of a driver terminal is combined, so that the driver can automatically give an alarm in a comprehensive manner without further description by the driver, the speed of locking the position of the driver by a police can be increased, and the position accuracy and the timeliness of rescue of the police rescue after the alarm are improved. In addition, the content of the sent information can be preset so as to specifically set alarm information corresponding to the driver, and the information used in the alarm can be text information, voice information or video information.
Step S3: and acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver.
Specifically, the driver terminal continuously acquires the sound in the vehicle, and when the preset voice information sent by the user is recognized, the camera of the driver terminal is started through the control application program, so that the driver terminal acquires the micro expression of the face of the driver, and further acquires the key confirmation information of the alarm. According to the invention, specific voice information is preset to wake up the camera, so that micro expression recognition alarm can be realized in time, micro expression monitoring is not required at all times, the use time of the camera can be reduced, the energy consumption of a driver terminal is reduced, the performance occupation of an application program in the driver terminal is reduced, and the privacy of a driver is protected.
The invention creatively carries out pre-alarming through the preset voice and is matched with the subsequent micro-expression recognition, can realize high accuracy and carry out safe and secret alarming, and is suitable for carrying out safe and timely alarming under the condition that a driver is hijacked.
Step S4: and analyzing and identifying the micro-expression information of the driver.
Specifically, a camera is turned on at a driver terminal, current image information is acquired, and after micro-expression of a driver is identified, the micro-expression is compared with preset micro-expression information. And if the micro expression of the driver hits the micro expressions of a plurality of sequences in the preset micro expression information, further alarm processing is carried out.
In this embodiment, preferably, in analyzing and recognizing the micro-expression information of the driver, the step of analyzing and recognizing specifically includes: face preprocessing, time domain image interpolation, action amplification and feature extraction.
The face preprocessing step is to identify whether the face is a preset face of a driver, and then divide the face into solid geometric blocks so as to conveniently acquire the change of the micro expression of the face. The time domain image interpolation step is to intelligently interpolate the acquired image, so that higher fluency can be realized by using higher frame number, and the micro expression of a driver can be better distinguished. The action amplification step is to amplify the change amplitude of the facial expression of the driver, so that the micro-expression change in the facial expression can be captured, analyzed and recognized more easily, and the recognition of the micro-expression is facilitated. The characteristic extraction step is to extract local characteristics of the micro expression changes, so that the overall operation efficiency is improved, and the characteristic changes of the micro expression can be identified more quickly. The invention can improve the accuracy and the efficiency of micro-expression recognition by processing and then recognizing the micro-expressions.
Step S5: and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
Specifically, when a driver terminal acquires corresponding preset micro-expression information, alarming operation is carried out, a preset safety decision is executed, GPS positioning information of a current vehicle is acquired, a current picture acquired by a camera is captured, then the positioning information and the captured image are combined with preset alarm information, the information is sent to a corresponding alarm position through a network according to the specific safety decision, alarming with specific information is carried out, and a preset alarm short message is sent, so that timely alarming can be realized in a place with unstable network connection.
Preferably, the method further comprises the following steps: and if the preset micro-expression information is not acquired, closing the camera after the preset time of the system. If the driver sends out preset voice information inadvertently, the camera is automatically opened, but the preset micro expression information cannot be acquired for a long time, the false alarm is judged, the camera is automatically closed after the preset time, the micro expression recognition is automatically stopped, and the driver terminal is prevented from being occupied for a long time.
Further, it comprises the sub-step S51: after the preset micro-expression information is obtained, network judgment is further performed, and the method specifically comprises the following steps:
carrying out network judgment; if the network connection is normal, the security decision is transmitted to a background through the network so as to carry out feedback correction of the security decision; and if the network connection is abnormal, directly executing a safety decision.
Specifically, if the network connection is normal, after the preset micro-expression information is successfully acquired and identified, the video is sent to a background server, so that the background can perform further manual judgment, and check the safety decision preset by the current driver terminal, and if a missing or unreasonable place appears, the background terminal performs further intelligent check and supplementary correction, and then assists the driver terminal in executing the safety decision. If the network connection is abnormal, the driver terminal directly executes the safety decision without passing through the background, and automatically executes the corresponding alarm action in the safety decision so as to avoid delaying the alarm.
According to the invention, the voice information and the micro expression information of the driver are preset, when the driver is hijacked, the driver can automatically activate the camera of the equipment in the vehicle by sending out the specific preset voice information, and the camera starts to capture the micro expression of the face of the driver. Then, the driver can make preset micro expression information through the face, and after analysis and identification, corresponding decision is automatically executed, so that the alarm is finished under the condition of not arousing the attention of the hijacker, the safety of the driver can be effectively ensured, the action amplitude of the micro expression is small while the alarm is timely carried out, the emotion of the hijacker is not stimulated, and the invention has safety and timeliness at the same time.
Other steps of the method for automatically alarming by the driver micro-expression described in the embodiment are referred to in the prior art.
In a second aspect, as shown in fig. 3, the present invention further discloses an automatic alarm system through a driver micro-expression, which specifically comprises:
the first presetting module M1 is used for presetting the preset voice information for activating the camera and the preset micro-expression information for alarming.
And the second preset module M2 is used for setting alarm information and safety decisions.
And the voice activation module M3 is used for acquiring preset voice information and activating the camera to acquire micro expression information of the driver.
And the expression recognition module M4 is used for analyzing and recognizing the micro expression information of the driver.
And the decision execution module M5 is used for executing a safety decision if the preset micro expression information is acquired, and uploading the alarm information to alarm.
In a third aspect, the present invention further discloses a storage medium storing a computer program, where the computer program, when executed by a processor, specifically implements the following steps: presetting preset voice information for activating a camera and preset micro-expression information for alarming; setting alarm information and safety decision; acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver; analyzing and identifying micro-expression information of a driver; and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
In a fourth aspect, the present invention further discloses an electronic device, at least one processor, and a memory communicatively connected to the at least one processor, where the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, where the at least one processor, when executing the instructions, specifically implements the following steps: presetting preset voice information for activating a camera and preset micro-expression information for alarming; setting alarm information and safety decision; acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver; analyzing and identifying micro-expression information of a driver; and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText transfer protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a Local Area Network (LAN), a Wide Area Network (WAN), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The storage medium may be included in the electronic device; or may exist separately without being assembled into the electronic device.
The storage medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: presetting preset voice information for activating a camera and preset micro-expression information for alarming; setting alarm information and safety decision; acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver; analyzing and identifying micro-expression information of a driver; and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
Alternatively, the storage medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: presetting preset voice information for activating a camera and preset micro-expression information for alarming; setting alarm information and safety decision; acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver; analyzing and identifying micro-expression information of a driver; and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It should be noted that the storage media described above in this disclosure can be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any storage medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way, so that any modification, equivalent change and modification made to the above embodiment according to the technical spirit of the present invention are within the scope of the technical solution of the present invention.
Claims (10)
1. A method for automatically alarming through micro-expression of a driver is characterized by comprising the following steps:
presetting preset voice information for activating a camera and preset micro-expression information for alarming;
setting alarm information and safety decision;
acquiring preset voice information, and activating a camera to acquire micro-expression information of a driver;
analyzing and identifying micro-expression information of a driver;
and if the preset micro-expression information is acquired, executing a safety decision, and uploading the alarm information to alarm.
2. The method as claimed in claim 1, wherein the step of analyzing and recognizing the micro-expression information of the driver comprises:
face preprocessing, time domain image interpolation, action amplification and feature extraction.
3. The method for automatically giving an alarm through the micro expression of the driver as claimed in claim 1, wherein after the preset micro expression information is obtained, a network judgment is further performed, and specifically comprises:
carrying out network judgment;
if the network connection is normal, the security decision is transmitted to a background through the network so as to carry out feedback correction of the security decision;
and if the network connection is abnormal, directly executing a safety decision.
4. The method of claim 3, wherein the obtaining and analyzing the micro-expression information of the driver further comprises:
and if the preset micro-expression information is not acquired, closing the camera after the preset time of the system.
5. The method of claim 1 for automatic warning by driver micro-expression, characterized in that:
and the preset micro-expression information is subjected to machine learning and big data model training through a background so as to improve the accuracy of analysis and identification.
6. The method of claim 1 for automatic warning by driver micro-expression, characterized in that:
the preset micro expression information is composed of a plurality of micro expressions which are sequentially arranged.
7. The method of claim 1 for automatic warning by driver micro-expression, characterized in that:
the set alarm information comprises a name, an identity card number, a mobile phone number, hijacked condition description information, a license plate number, vehicle information, a working unit, a designated alarm number and an alarm mailbox.
8. A system for automatically alarming through micro-expression of a driver is characterized by comprising:
the system comprises a first preset module, a second preset module and a third preset module, wherein the first preset module is used for presetting preset voice information for activating a camera and preset micro-expression information for alarming;
the second preset module is used for setting alarm information and safety decision;
the voice activation module is used for acquiring preset voice information and activating the camera to acquire micro-expression information of a driver;
the expression recognition module is used for analyzing and recognizing micro expression information of a driver;
and the decision execution module is used for executing a safety decision if the preset micro-expression information is obtained, and uploading the alarm information to alarm.
9. A non-transitory computer readable storage medium storing computer instructions for causing a computer to execute the method of automatically alerting by a driver microexpression of any one of claims 1 to 7.
10. An electronic device, comprising:
at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of automatically alerting by driver microexpression according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110308531.7A CN113129551A (en) | 2021-03-23 | 2021-03-23 | Method, system, medium and equipment for automatically alarming through micro-expression of driver |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110308531.7A CN113129551A (en) | 2021-03-23 | 2021-03-23 | Method, system, medium and equipment for automatically alarming through micro-expression of driver |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113129551A true CN113129551A (en) | 2021-07-16 |
Family
ID=76773824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110308531.7A Pending CN113129551A (en) | 2021-03-23 | 2021-03-23 | Method, system, medium and equipment for automatically alarming through micro-expression of driver |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113129551A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114022870A (en) * | 2021-09-24 | 2022-02-08 | 合众新能源汽车有限公司 | Method and device for transmitting distress signal of automobile |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961669A (en) * | 2018-07-19 | 2018-12-07 | 上海小蚁科技有限公司 | The safe early warning method and device, storage medium, server of net about vehicle |
| CN109360304A (en) * | 2018-09-20 | 2019-02-19 | 智慧互通科技有限公司 | A kind of method and device that parking lot vehicle is let pass |
| CN110121715A (en) * | 2019-02-19 | 2019-08-13 | 深圳市汇顶科技股份有限公司 | Calling method, device, electronic equipment and storage medium based on Expression Recognition |
| CN110399793A (en) * | 2019-06-19 | 2019-11-01 | 深圳壹账通智能科技有限公司 | Driving behavior method for early warning, device and computer equipment based on image recognition |
| CN110469234A (en) * | 2019-08-31 | 2019-11-19 | 荆门市南博智能科技有限公司 | A kind of intelligent and safe safety device |
-
2021
- 2021-03-23 CN CN202110308531.7A patent/CN113129551A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961669A (en) * | 2018-07-19 | 2018-12-07 | 上海小蚁科技有限公司 | The safe early warning method and device, storage medium, server of net about vehicle |
| CN109360304A (en) * | 2018-09-20 | 2019-02-19 | 智慧互通科技有限公司 | A kind of method and device that parking lot vehicle is let pass |
| CN110121715A (en) * | 2019-02-19 | 2019-08-13 | 深圳市汇顶科技股份有限公司 | Calling method, device, electronic equipment and storage medium based on Expression Recognition |
| CN110399793A (en) * | 2019-06-19 | 2019-11-01 | 深圳壹账通智能科技有限公司 | Driving behavior method for early warning, device and computer equipment based on image recognition |
| CN110469234A (en) * | 2019-08-31 | 2019-11-19 | 荆门市南博智能科技有限公司 | A kind of intelligent and safe safety device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114022870A (en) * | 2021-09-24 | 2022-02-08 | 合众新能源汽车有限公司 | Method and device for transmitting distress signal of automobile |
| CN114022870B (en) * | 2021-09-24 | 2024-05-07 | 合众新能源汽车股份有限公司 | Method and device for transmitting distress signal of automobile |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10783455B2 (en) | Bot-based data collection for detecting phone solicitations | |
| US10810510B2 (en) | Conversation and context aware fraud and abuse prevention agent | |
| CN109902575B (en) | Anti-walking method and device based on unmanned vehicle and related equipment | |
| JP2019537760A (en) | Video-based data acquisition, image capture and analysis configuration | |
| US20140071273A1 (en) | Recognition Based Security | |
| CN108182944A (en) | Control the method, apparatus and intelligent terminal of intelligent terminal | |
| JP7160454B2 (en) | Method, apparatus and system, electronic device, computer readable storage medium and computer program for outputting information | |
| US20170118583A1 (en) | Method and device for controlling of opening and closing automobile door lock through bluetooth technology | |
| CN106920171A (en) | The method and device that car accident is settled a claim online | |
| CA3054923A1 (en) | System and method to perform safety operations in association with a network service | |
| US11095924B1 (en) | Method and device for providing a time-compressed preview of a pre-buffered video during a push-to-video communication session | |
| CN105989267B (en) | Safety protection method and device based on voiceprint recognition | |
| CN104751086A (en) | Terminal anti-theft method | |
| CN107371144B (en) | Method and device for intelligently sending information | |
| CN113129551A (en) | Method, system, medium and equipment for automatically alarming through micro-expression of driver | |
| WO2018208394A1 (en) | Emergency call detection system | |
| CN105517193A (en) | Method for building connection and device | |
| CN110059619B (en) | Automatic alarm method and device based on image recognition | |
| CN115499539B (en) | Vehicle, and vehicle user privacy processing method and device | |
| US11304045B1 (en) | Emergency communication service for mobile devices | |
| CN102625084A (en) | Intelligent television monitoring system | |
| CN111489276B (en) | Personnel management method and related device | |
| CN110267199B (en) | Data processing method and terminal equipment | |
| US11322137B2 (en) | Video camera | |
| EP3422343A1 (en) | System and method for automatically terminating a voice call |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210716 |
|
| RJ01 | Rejection of invention patent application after publication |