CN113391695A - Low-power-consumption face recognition method based on TinyML - Google Patents
Low-power-consumption face recognition method based on TinyML Download PDFInfo
- Publication number
- CN113391695A CN113391695A CN202110652053.1A CN202110652053A CN113391695A CN 113391695 A CN113391695 A CN 113391695A CN 202110652053 A CN202110652053 A CN 202110652053A CN 113391695 A CN113391695 A CN 113391695A
- Authority
- CN
- China
- Prior art keywords
- model
- face
- face recognition
- data
- consumption
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Databases & Information Systems (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
The invention provides a low-power-consumption face recognition method based on TinyML, which adopts equipment comprising a development board loaded with a microprocessor, a camera and a server. The face recognition model is responsible for processing the received video stream data, extracting face features, respectively calculating similarity with the face database data, comparing with a preset threshold, outputting a comparison result, and executing subsequent actions according to the comparison result. The invention reduces the equipment cost, has low operation power consumption, can operate the face recognition model only under the condition of the existence of pedestrians, can effectively reduce the operation power consumption of the face recognition model, and is suitable for long-time operation.
Description
Technical Field
The invention relates to a low-power-consumption face recognition method based on TinyML, and belongs to the technical field of face recognition.
Background
The face recognition application is explosively increased in recent years due to the development of digitalization and intellectualization and the general improvement of face recognition accuracy, and the face recognition application plays an important role in aspects such as intelligent security and protection, intelligent payment and the like. In the application similar to intelligent entrance guard, the camera continuously captures video stream data in real time, and the human face recognition model receives the real-time data and then performs human face recognition. And extracting the face features through the neural network model, comparing the face features with data in the database, and if the face data exist in the database, successfully identifying the face features, and further executing actions such as door opening and the like. At present, the mainstream face recognition models adopt a deep learning-based method and deeper neural network models, so that the model complexity is higher. In addition, data collected by the camera in most time is pedestrian-free, and data without human face is recognized in most time by the human face recognition model, so that waste of model operation resources is caused. In order to reduce the power consumption of equipment, one method is to use radar to perform living body detection, for example, after a living body target is captured by the radar, the data is transmitted to a face recognition model. This approach requires additional radar, increasing equipment costs.
Disclosure of Invention
The invention aims to provide a low-power-consumption face recognition method based on TinyML, which has low operation power consumption and is suitable for long-time continuous operation.
In order to achieve the purpose, the invention is realized by the following technical scheme:
a low-power-consumption face recognition method based on TinyML comprises the following steps:
a) training and deploying a pedestrian detection model, collecting data to train the pedestrian detection model, and quantizing and compressing the model so as to deploy the model on a microprocessor development board;
b) constructing a face database, collecting face data, and extracting and storing face features;
c) deploying a face recognition model, and deploying the face recognition model with higher operation power consumption to a server;
d) the camera collects face data, collects the data in real time and inputs video stream to the microprocessor development board;
e) running a pedestrian detection model, detecting whether data comprises pedestrians or not after the development board receives video stream data, if so, transmitting the data to a server, and if not, ending the flow;
f) the face recognition model is operated, after the server receives face data from the development board, the face recognition model is operated, when the similarity of the calculated face is higher than a set threshold value, a door opening action is executed, otherwise, the flow is ended;
preferably, the face recognition model in step f specifically comprises the following steps that the face recognition model is responsible for processing received video stream data, extracting face features, respectively calculating similarity with face database data, comparing with a preset threshold value, and outputting a comparison result.
Preferably, the pedestrian detection model is actually a two-classification model, that is, whether the predicted image includes a pedestrian or not, the training data is collected to train the model, the capacity of the model is reduced through a model quantization and compression mode, and the model is deployed on a microprocessor development board.
Preferably, the face recognition model adopts a neural network model to extract the face features, and stores the face features in a face database.
The invention has the advantages that: the invention reduces the equipment cost, has low operation power consumption, can operate the face recognition model only under the condition of the existence of pedestrians, can effectively reduce the operation power consumption of the face recognition model, and is suitable for long-time operation.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a schematic view of the flow structure of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
A low-power-consumption face recognition method based on TinyML is used for reducing the power consumption of continuous operation of a face recognition model. The adopted equipment comprises a development board loaded with a microprocessor, a camera and a server, and the technical scheme is that a pedestrian detection model is operated on the development board, a face recognition model is operated on the server, after video stream data is received, the pedestrian detection model is operated firstly, if a pedestrian is detected, the face recognition model is operated, otherwise, the face recognition model is not operated. The pedestrian detection model is actually a two-classification model, namely whether the predicted image comprises pedestrians or not, collects training data to train the model, reduces the capacity of the model through model quantization and compression, and deploys the model on a microprocessor development board. In addition, a face database is required to be constructed, face data are collected and preprocessed, face features are extracted by adopting a neural network model and stored in the face database. The face recognition model is responsible for processing the received video stream data, extracting face features, respectively calculating similarity with the face database data, comparing with a preset threshold, outputting a comparison result, and executing subsequent actions according to the comparison result.
The method specifically comprises the following steps:
a) training and deploying a pedestrian detection model, collecting data to train the pedestrian detection model, and quantizing and compressing the model so as to deploy the model on a microprocessor development board;
b) constructing a face database, collecting face data, and extracting and storing face features;
c) deploying a face recognition model, and deploying the face recognition model with higher operation power consumption to a server;
d) the camera collects face data, collects the data in real time and inputs video stream to the microprocessor development board;
e) running a pedestrian detection model, detecting whether data comprises pedestrians or not after the development board receives video stream data, if so, transmitting the data to a server, and if not, ending the flow;
f) the face recognition model is operated, after the server receives face data from the development board, the face recognition model is operated, when the similarity of the calculated face is higher than a set threshold value, a door opening action is executed, otherwise, the flow is ended;
and f, the face recognition model in the step f is specifically used for processing the received video stream data, extracting face features, respectively calculating similarity with the data of the face database, comparing with a preset threshold value, and outputting a comparison result.
The pedestrian detection model is actually a two-classification model, namely whether the predicted image comprises pedestrians or not, collects training data to train the model, reduces the capacity of the model through a model quantization and compression mode, and deploys the model to a microprocessor development board.
The face recognition model adopts a neural network model to extract face features and stores the face features in a face database.
The invention reduces the equipment cost, has low operation power consumption, can operate the face recognition model only under the condition of the existence of pedestrians, can effectively reduce the operation power consumption of the face recognition model, and is suitable for long-time operation.
Claims (4)
1. A low-power-consumption face recognition method based on TinyML is characterized by comprising the following steps:
a) training and deploying a pedestrian detection model, collecting data to train the pedestrian detection model, and quantizing and compressing the model so as to deploy the model on a microprocessor development board;
b) constructing a face database, collecting face data, and extracting and storing face features;
c) deploying a face recognition model, and deploying the face recognition model with higher operation power consumption to a server;
d) the camera collects face data, collects the data in real time and inputs video stream to the microprocessor development board;
e) running a pedestrian detection model, detecting whether data comprises pedestrians or not after the development board receives video stream data, if so, transmitting the data to a server, and if not, ending the flow;
f) and (4) operating the face recognition model, operating the face recognition model after the server receives the face data from the development board, executing a door opening action when the similarity of the calculated face is higher than a set threshold value, and otherwise ending the flow.
2. The TinyML-based low-power-consumption face recognition method as claimed in claim 1, wherein the face recognition model in step f specifically comprises the steps of processing received video stream data, extracting face features, calculating similarity with face database data respectively, comparing with a preset threshold, and outputting a comparison result.
3. The TinyML-based low-power-consumption face recognition method as claimed in claim 1, wherein the pedestrian detection model is actually a two-class model, i.e. whether the predicted image includes a pedestrian or not, training data is collected to train the model, the capacity of the model is reduced through model quantization and compression, and the model is deployed on a microprocessor development board.
4. The TinyML-based low-power-consumption face recognition method as claimed in claim 1, wherein the face recognition model adopts a neural network model to extract face features, and stores the face features in a face database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110652053.1A CN113391695A (en) | 2021-06-11 | 2021-06-11 | Low-power-consumption face recognition method based on TinyML |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110652053.1A CN113391695A (en) | 2021-06-11 | 2021-06-11 | Low-power-consumption face recognition method based on TinyML |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113391695A true CN113391695A (en) | 2021-09-14 |
Family
ID=77620541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110652053.1A Pending CN113391695A (en) | 2021-06-11 | 2021-06-11 | Low-power-consumption face recognition method based on TinyML |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113391695A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114783087A (en) * | 2022-04-19 | 2022-07-22 | 山东浪潮科学研究院有限公司 | Method and system for creating intelligent door lock |
| CN114879673A (en) * | 2022-05-11 | 2022-08-09 | 山东浪潮科学研究院有限公司 | Visual navigation device based on TinyML technology |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130311807A1 (en) * | 2012-05-15 | 2013-11-21 | Lg Innotek Co., Ltd. | Display apparatus and power saving method thereof |
| CN107315993A (en) * | 2017-05-10 | 2017-11-03 | 苏州天平先进数字科技有限公司 | A kind of peephole system and its face identification method based on recognition of face |
| US20180018524A1 (en) * | 2015-12-16 | 2018-01-18 | Intel Corporation | Fully convolutional pyramid networks for pedestrian detection |
| CN109829521A (en) * | 2018-12-14 | 2019-05-31 | 顺丰科技有限公司 | A kind of self-service machine management method, device and equipment, storage medium |
| CN110647797A (en) * | 2019-08-05 | 2020-01-03 | 深圳市大拿科技有限公司 | Visitor detection method and device |
| CN111325133A (en) * | 2020-02-17 | 2020-06-23 | 深圳龙安电力科技有限公司 | Image processing system based on artificial intelligence recognition |
| CN111583480A (en) * | 2020-06-02 | 2020-08-25 | 北京时代凌宇科技股份有限公司 | Access control face recognition device and access control system |
| CN111783674A (en) * | 2020-07-02 | 2020-10-16 | 厦门市美亚柏科信息股份有限公司 | Face recognition method and system based on AR glasses |
| CN112597861A (en) * | 2020-12-16 | 2021-04-02 | 南京甄视智能科技有限公司 | Mixed-mode face recognition method and system supporting high-frequency use of buffer mechanism |
| CN112698711A (en) * | 2020-12-23 | 2021-04-23 | 深圳市凯迪仕智能科技有限公司 | Intelligent detection method and intelligent lock |
-
2021
- 2021-06-11 CN CN202110652053.1A patent/CN113391695A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130311807A1 (en) * | 2012-05-15 | 2013-11-21 | Lg Innotek Co., Ltd. | Display apparatus and power saving method thereof |
| US20180018524A1 (en) * | 2015-12-16 | 2018-01-18 | Intel Corporation | Fully convolutional pyramid networks for pedestrian detection |
| CN107315993A (en) * | 2017-05-10 | 2017-11-03 | 苏州天平先进数字科技有限公司 | A kind of peephole system and its face identification method based on recognition of face |
| CN109829521A (en) * | 2018-12-14 | 2019-05-31 | 顺丰科技有限公司 | A kind of self-service machine management method, device and equipment, storage medium |
| CN110647797A (en) * | 2019-08-05 | 2020-01-03 | 深圳市大拿科技有限公司 | Visitor detection method and device |
| CN111325133A (en) * | 2020-02-17 | 2020-06-23 | 深圳龙安电力科技有限公司 | Image processing system based on artificial intelligence recognition |
| CN111583480A (en) * | 2020-06-02 | 2020-08-25 | 北京时代凌宇科技股份有限公司 | Access control face recognition device and access control system |
| CN111783674A (en) * | 2020-07-02 | 2020-10-16 | 厦门市美亚柏科信息股份有限公司 | Face recognition method and system based on AR glasses |
| CN112597861A (en) * | 2020-12-16 | 2021-04-02 | 南京甄视智能科技有限公司 | Mixed-mode face recognition method and system supporting high-frequency use of buffer mechanism |
| CN112698711A (en) * | 2020-12-23 | 2021-04-23 | 深圳市凯迪仕智能科技有限公司 | Intelligent detection method and intelligent lock |
Non-Patent Citations (1)
| Title |
|---|
| SEDIGH GHAMARI ET AL.: ""Quantization-Guided Training for Compact TinyML Models"", 《ARXIV:2103.06231V1》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114783087A (en) * | 2022-04-19 | 2022-07-22 | 山东浪潮科学研究院有限公司 | Method and system for creating intelligent door lock |
| CN114879673A (en) * | 2022-05-11 | 2022-08-09 | 山东浪潮科学研究院有限公司 | Visual navigation device based on TinyML technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200250435A1 (en) | Activity recognition method and system | |
| CN108090458B (en) | Human body falling detection method and device | |
| CN110569720B (en) | Audio and video intelligent identification processing method based on audio and video processing system | |
| CN113391695A (en) | Low-power-consumption face recognition method based on TinyML | |
| CN108364374A (en) | Face access control device based on deep learning and method | |
| CN106328134A (en) | Prison voice data identification and monitoring early warning system | |
| CN101211483A (en) | Unattended bank safe precaution method | |
| CN113052029A (en) | Abnormal behavior supervision method and device based on action recognition and storage medium | |
| CN101404107A (en) | Internet bar monitoring and warning system based on human face recognition technology | |
| CN102917207A (en) | Motion sequence based abnormal motion vision monitoring system | |
| CN101739557B (en) | Motion cycle analysis-based method and device for identifying abnormal human behavior | |
| CN112634561A (en) | Safety alarm method and system based on image recognition | |
| CN103605971A (en) | Method and device for capturing face images | |
| CN110188715A (en) | A kind of video human face biopsy method of multi frame detection ballot | |
| CN107786848A (en) | The method, apparatus of moving object detection and action recognition, terminal and storage medium | |
| CN107016361A (en) | Recognition methods and device based on video analysis | |
| CN105741503B (en) | A kind of parking lot real time early warning method under existing monitoring device | |
| CN114187561A (en) | Abnormal behavior identification method and device, terminal equipment and storage medium | |
| Ibitoye | A brief review of convolutional neural network techniques for masked face recognition | |
| CN110807356A (en) | Living body detection method based on image lip language identification verification code | |
| CN110065867B (en) | Method and system for evaluating elevator comfort level based on audio and video | |
| CN104463143A (en) | Identification system based on image processing | |
| CN115641701A (en) | Event reminding method, device, equipment and storage medium | |
| CN115424170A (en) | Garbage throwing detection system and method | |
| CN113645439B (en) | Event detection method and system, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210914 |
|
| RJ01 | Rejection of invention patent application after publication |