CN102970411B - Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection - Google Patents

Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection Download PDF

Info

Publication number
CN102970411B
CN102970411B CN201210409592.3A CN201210409592A CN102970411B CN 102970411 B CN102970411 B CN 102970411B CN 201210409592 A CN201210409592 A CN 201210409592A CN 102970411 B CN102970411 B CN 102970411B
Authority
CN
China
Prior art keywords
mobile phone
face
smart mobile
video image
screen locking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210409592.3A
Other languages
Chinese (zh)
Other versions
CN102970411A (en
Inventor
刘远民
杨卫国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Konka Group Co Ltd
Original Assignee
Konka Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Konka Group Co Ltd filed Critical Konka Group Co Ltd
Priority to CN201210409592.3A priority Critical patent/CN102970411B/en
Publication of CN102970411A publication Critical patent/CN102970411A/en
Application granted granted Critical
Publication of CN102970411B publication Critical patent/CN102970411B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

The invention discloses a kind of smart mobile phone screen locking solution lock control methods based on Face datection.The method that the present invention carries out screen locking unlock to smart mobile phone specifically includes:When screen locking or unlock need to be carried out to smart mobile phone, receive user's screen locking or unlock operational order, control automatically turn on mobile phone camera, the video image in front of mobile phone is obtained by mobile phone camera.Recognition of face is carried out to the video image of acquisition using face recognition technology, current face is identified from video image.Certification is compared with the benchmark face model stored in database in the current face that will identify that, when judging that current face is identical with the benchmark face model stored in database, then controls screen lock or unlock by the control unit of smart mobile phone.The present invention increases the smart mobile phone screen locking unlocked state based on Face datection in smart mobile phone, and user can be made to prevent the inconvenience that maloperation is brought when using the smart mobile phone and save unnecessary energy consumption.

Description

Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection
Technical field
The present invention relates to smart mobile phone field more particularly to a kind of smart mobile phone screen locking unlocks based on Face datection Control method and smart mobile phone.
Background technology
Smart mobile phone(Smartphone), refer to " as PC, have independent operating system, can by with Family voluntarily install the third party service providers such as software, game offer program, by this class method come constantly to the function of mobile phone into Row expands, and the general name of so a kind of mobile phone of wireless network access can be realized by mobile communication network ".
With the power of the universal of smart mobile phone concept, the quickening of manufacturer terminal intellectual product line layout and telecom operators It pushes away, smart mobile phone market access overgrowing phase.It is shown according to the research report that the world is issued a few days ago, China's smart mobile phone in 2011 Annual sales volume about 70,000,000, occupation rate of market is 27%.The mechanism predicts that the sales volume market accounting of smart mobile phone in 2012 is about It is 45%, rose 18% compared with 2011.The half of the country that smart mobile phone will occupy mobile phone market has replaced the trend of functional mobile phone Irreversible, the time of mobile phone market change of dynasties is at hand.
The appearance of smart mobile phone brings new experience, but since its generally use touch screen is as human-computer interaction for user Interface and switch key control screen, therefore often bring many problems, and such as most male user likes mobile phone to be put into In pocket, often due to other reasons, such as on foot when or the when of squeezing oneself into a croweded bus may often encounter switch button, so as to be in mobile phone Open state, the serious stand-by time for influencing mobile phone, in addition, when mobile phone is in open state, touch screen and clothes rub Wiping frequently can lead to some maloperations, most commonly automatic dialing phone and sends short messages, causes inconvenience to the user.
Therefore, the prior art has yet to be improved and developed.
Invention content
The technical problem to be solved in the present invention is, for the drawbacks described above of the prior art, provides a kind of based on face inspection The smart mobile phone screen locking solution lock control method and smart mobile phone of survey, in order to solve these problems, the present invention is for touch screen intelligence The characteristics of mobile phone, it is proposed that towards Face datection algorithm and the screen locking technology of smart mobile phone, on the one hand playing reduces mobile phone energy consumption Effect, on the other hand can reduce the embarrassment that mobile phone misoperation is brought.
The technical proposal for solving the technical problem of the invention is as follows:
A kind of smart mobile phone screen locking solution lock control method based on Face datection, wherein, including being solved to smart mobile phone The step of lock, described the step of being unlocked to smart mobile phone, specifically include:
A1, when that need to be unlocked to smart mobile phone, receive user unlock operational order, control automatically turn on cell-phone camera Head obtains the first video image in front of mobile phone by mobile phone camera;
A2, recognition of face is carried out to first video image using face recognition technology, from first video image In identify current face;
Certification is compared with the benchmark face model stored in database in A3, the current face that will identify that, judgement is It is no identical;
A4, when judging that the current face is identical with the benchmark face model stored in database, and receive corresponding Unlock operation button, then pass through the control unit of smart mobile phone carry out joint coordination control unlocking screen.
The smart mobile phone screen locking solution lock control method based on Face datection, wherein, it is described to smart mobile phone into It is further included before the step of row unlock:
The operational order that the smart mobile phone receives user shoots and stores the benchmark face mould unlocked for screen locking in advance Type and the operation button for pre-setting the joint screen locking unlock together with the benchmark face model.
The smart mobile phone screen locking solution lock control method based on Face datection, wherein, it further includes to smart mobile phone The step of carrying out screen locking, described the step of carrying out screen locking to smart mobile phone, specifically include:
B1, when need to smart mobile phone carry out screen locking when, receive user's screen locking operational order, control automatically turn on cell-phone camera Head obtains the second video image in front of mobile phone by mobile phone camera;
B2, recognition of face is carried out to second video image using face recognition technology, from second video image In identify face for screen locking;
B3, it will identify that the face of the screen locking for screen locking is compared with the benchmark face model stored in database and recognize Card, judges whether identical;
It is B4, described identical with the benchmark face model stored in database for the face of screen locking when judging, and receive To corresponding screen locking operation button, then joint coordination is carried out by the control unit of smart mobile phone and control screen lock.
The smart mobile phone screen locking solution lock control method based on Face datection, wherein, the step A2 is specifically included:
A21, smart mobile phone illumination compensation unit to first video image carry out illumination compensation;
A22, the color compensating of smart mobile phone and correction unit by the first video image of illumination compensation to carrying out color Compensation and correction;
A23, smart mobile phone image denoising unit to by color compensating with correction the first video image carry out noise reduction Processing;
A24, smart mobile phone feature extraction unit to Jing Guo noise reduction process the first video image extraction image in use To characterize the Harr-Like features of benchmark face and the SIFT feature for recognition of face;
A25, smart mobile phone grader unit using trained Adaboost graders to represent face Harr- Like features complete two classification, realize Face datection, to detect current face from first video image, with SIFT spies Sign identifies face.
The smart mobile phone screen locking solution lock control method based on Face datection, wherein, the step B2 is specifically included:
B21, smart mobile phone illumination compensation unit to second video image carry out illumination compensation;
B22, the color compensating of smart mobile phone and correction unit by the second video image of illumination compensation to carrying out color Compensation and correction;
B23, smart mobile phone image denoising unit to by color compensating with correction the second video image carry out noise reduction Processing;
B24, smart mobile phone feature extraction unit to Jing Guo noise reduction process the second video image extraction image in use To characterize the Harr-Like features of benchmark face and the SIFT feature for recognition of face;
B25, smart mobile phone grader unit using trained Adaboost graders to represent face Harr- Like features complete two classification, realize Face datection, recognition of face are completed with SIFT feature, with from first video image It detects current face, face is identified with SIFT feature.
A kind of smart mobile phone using any of the above-described screen locking solution lock control method, wherein, including:
First image collection module unlocks operational order, control for when that need to be unlocked to smart mobile phone, receiving user System automatically turns on mobile phone camera, and the first video image in front of mobile phone is obtained by mobile phone camera;
First identification module, for using face recognition technology to first video image carry out recognition of face, from institute It states in the first video image and identifies current face;
First multilevel iudge module, for the current face that will identify that and the benchmark face model stored in database into Row compares certification, judges whether identical;
Control unlock control module, for when the benchmark face model for judging to store in the current face and database It is identical, and receive corresponding unlock operation button, then carrying out joint coordination by the control unit of smart mobile phone controls screen Unlock.
The smart mobile phone, wherein, it further includes:
Module is pre-set, shoots in advance for receiving the operational order of user and stores the benchmark people unlocked for screen locking Face model and the operation button for pre-setting the joint screen locking unlock together with the benchmark face model.
The smart mobile phone, wherein, it further includes:
Second image collection module unlocks operational order, control for when that need to carry out screen locking to smart mobile phone, receiving user System automatically turns on mobile phone camera, and the second video image in front of mobile phone is obtained by mobile phone camera;
Second identification module, for using face recognition technology to second video image carry out recognition of face, from institute State the face identified in the second video image for screen locking;
Second multilevel iudge module will identify that the benchmark face stored in the face and database of the screen locking for screen locking Certification is compared in model, judges whether identical;
Screen locking control module, when the benchmark face model phase judged the face for screen locking and stored in database Together, and corresponding screen locking operation button is received, then carrying out joint coordination by the control unit of smart mobile phone controls screen lock Screen.
The smart mobile phone, wherein, first identification module includes:
Illumination compensation unit:For carrying out illumination compensation to first video image;
Color compensating and correction:For to carrying out color compensating and correction by the first video image of illumination compensation;
Image denoising unit:For to carrying out noise reduction process by color compensating and the first video image of correction;
Feature extraction unit:For to characterizing benchmark in the first video image extraction image Jing Guo noise reduction process The Harr-Like features and the SIFT feature for recognition of face of face;
Grader unit:For complete to the Harr-Like features for representing face using trained Adaboost graders Into two classification, realize Face datection, to detect current face from first video image, people is identified with SIFT feature Face.
Smart mobile phone screen locking solution lock control method and smart mobile phone provided by the present invention based on Face datection, due to The smart mobile phone screen locking unlocking function based on Face datection is increased in smart mobile phone, user can be made to use the smart mobile phone When need by the method that recognition of face certification and combination button are combined to smart mobile phone carry out screen locking and unlock operate, so as to It is effective to prevent because inconvenience that user misoperation is brought and saving unnecessary energy consumption.
Description of the drawings
Fig. 1 is that smart mobile phone is unlocked in the smart mobile phone solution lock control method the present invention is based on Face datection The flow chart of preferred embodiment.
Fig. 2 is to carry out the preferable of screen locking to smart mobile phone the present invention is based on the smart mobile phone screen locking control method of Face datection The flow chart of embodiment.
Fig. 3 is that smart mobile phone is unlocked in the smart mobile phone solution lock control method the present invention is based on Face datection First video image identification of preferred embodiment goes out the flow chart of face method.
Fig. 4 is that smart mobile phone screen locking control method of the specific embodiment of the invention based on Face datection carries out smart mobile phone Second video image identification of the preferred embodiment of screen locking goes out the flow chart of face method.
Fig. 5 is the functional schematic block diagram of smart mobile phone embodiment of the present invention.
Fig. 6 is the functional schematic block diagram of the first identification module of smart mobile phone embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, clear and definite, develop simultaneously embodiment pair referring to the drawings The present invention is further described.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and does not have to It is of the invention in limiting.
A kind of smart mobile phone screen locking solution lock control method based on Face datection provided in an embodiment of the present invention, including to intelligence Can mobile phone the step of being unlocked and the step of carry out screen locking to smart mobile phone, the wherein described step being unlocked to smart mobile phone Suddenly, refer to Fig. 1, Fig. 1 be in the smart mobile phone screen locking solution lock control method the present invention is based on Face datection to smart mobile phone into The flow chart of the preferred embodiment of row unlock.As shown in Figure 1, the embodiment that the present invention is unlocked smart mobile phone include it is following Step:
The operational order that S110, the smart mobile phone receive user shoots and stores the benchmark people unlocked for screen locking in advance Face model and the operation button for pre-setting the joint screen locking unlock together with the benchmark face model.
Smart phone user shoots the benchmark face model unlocked for screen locking using smart mobile phone first, and general shooting is certainly Oneself facial image, a benchmark face model is provided according to the facial image of reception in smart mobile phone automatically, and sets in advance The operation button unlocked for this benchmark face model together joint screen locking is put, this button can be the common screen locking unlock of mobile phone Button, naturally it is also possible to be the combination button of two buttons of certain in mobile phone key or three buttons, when smart phone user needs When being unlocked to mobile phone, smart mobile phone is by the facial image received and basic faceform's phase for being stored in smart mobile phone Compare, the result compared for after identical, user smart mobile phone is carried out by pressing pre-set combination button screen locking or Unlock.Preferably, it is smart phone user front clearly face's video image for setting the image of basic faceform.
S120, when that need to be unlocked to smart mobile phone, receive user unlock operational order, control automatically turn on mobile phone take the photograph As head, the first video image in front of mobile phone is obtained by mobile phone camera.
When smart phone user is when needing to be unlocked mobile phone, user presses the release tab of smart mobile phone first, Then smart mobile phone automatically controls unlatching mobile phone camera, by camera obtain mobile phone in front of facial video image, i.e., first Video image.Preferably, this image is the front video image of user's face.
S130, recognition of face is carried out to first video image using face recognition technology, from the first video figure Current face is identified as in.
Smart mobile phone carries out recognition of face using face recognition technology to the facial video image in front of the mobile phone that receives, Recognition of face is carried out to the first video image, current face is identified in the image shot from camera.Carrying out face knowledge When other, as shown in figure 3, comprising the following specific steps that:
S111, smart mobile phone illumination compensation unit to first video image carry out illumination compensation.
Due to the influence of illumination, there are many uncertainties in Static Human Face image acquisition procedures, such as:Light intensity, light source side To, color etc..These uncertain factors so that the gray scale depth of face-image is uneven, and partially contrast is larger for face, So as to the effect for influencing detection and finally identifying, it is therefore necessary to current face's video images to shooting to use illumination compensation skill Art carries out illumination compensation, is to carry out illumination compensation to the first video image, so as to enable smart mobile phone from the video figure obtained Facial image is correctly identified as in.Specific illumination compensation technology is to belong to the prior art, therefore details are not described herein.
S122, the color compensating of smart mobile phone and correction unit by the first video image of illumination compensation to carrying out color Compensation and correction.
Since the diversity of human face posture and the variation of facial non-rigid determine the complexity of face pattern, face may be with Different visual angles occur in the picture, in order to realize the robustness of detection method(Due to inaccurate characteristic or the parameter of making of measurement Actual value can deviate its design value(Nominal value), robustness refer to measurement it is inaccurate under conditions of, detection method maintain The characteristic of its certain performance.), also need to consider face in the background of various complexity, when different directions, angle, scale The different presentations shown.And since different faces has very big change in shape, size, color, quality etc. The property changed, same face have randomness in certain local features(Such as glasses, beard, hair style), it is also possible to by certain objects Block, cause it is certain for detecting and the face characteristics that need to extract are invisible, but also there is different expressions face and Time interval generates variation of face etc., and it is therefore necessary to use color compensating with correcting unit to by the first of illumination compensation Video image carries out color compensating and correction using color compensating and alignment technique.Wherein, specific color compensating and correction skill Art is to belong to the prior art, therefore details are not described herein.
S133, smart mobile phone image denoising unit to by color compensating with correction the first video image carry out noise reduction Processing.
Since the digital picture in reality is subjected to imaging device and external environmental noise in digitlization and transmission process The influences such as interference, so the first video image of camera shooting is there may be various noises, in order to make intelligent hand Function preferably sets out the facial image in the first video image, and it is therefore necessary to use image denoising unit to the first video Image carries out image denoising.
S144, smart mobile phone feature extraction unit to Jing Guo noise reduction process the first video image extraction image in use To characterize the Harr-Like features of benchmark face and the SIFT feature for recognition of face.
In this step, need to characterizing benchmark face in the first video image extraction image Jing Guo noise reduction process Harr-Like features and the SIFT feature for recognition of face.Smart mobile phone is to carrying out above-mentioned processed first video figure As using the Adaboost algorithm of the prior art based on Harr type features(Adaboost algorithm is Freund et al. propositions A kind of Boost algorithms, its target is automatically to pick out several Weak Classifiers from Weak Classifier space to be integrated into one Strong classifier.Weak Classifier refers to some rectangular characteristics that can most represent face, and principle is some weaker classification Method merges one strong sorting technique of composition)Harr-Like feature extractions are carried out, so as to the grader for next step Feature vector is provided, and uses Harr-Like character representation faces.First gone out in video image using Harr-Like feature extractions Extract some simple face characteristics, all image-regions for including face found out from picture, by the image-region of face with Non-face image-region separates.Wherein, extract in image to the Harr-Like features that characterize benchmark face and for people The SIFT feature of face identification is to belong to the prior art, therefore details are not described herein.
S155, smart mobile phone grader unit using trained Adaboost graders to represent face Harr- Like features complete two classification, realize Face datection, to detect current face from first video image, with SIFT spies Sign identifies face.
It is specifically:Using the grader unit in smart mobile phone using trained Adaboost graders to representing people The Harr-Like features of face complete two classification, and the region of face in video image and non-face region are accurately divided into two To detect current face from first video image, face is identified with SIFT feature for class.
After completing to identify current face in first video image in step S130, S140 is entered step.
Certification is compared with the benchmark face model stored in database in S140, the current face that will identify that, judges It is whether identical.
It stores the current face identified from the first video image that smart mobile phone is shot and in smart mobile phone Certification is compared in benchmark face model, according to similitude judge whether be same person face.Such as:If similitude is high Regarded as in 80% identical, by recognition of face certification, similitude is regarded as differing less than 80%, authentification failure.Certification Smart mobile phone is further unlocked by can then carry out the step in S150, intelligence cannot be returned if if certification It can the initial standby mode of mobile phone.
S150, when judging that the current face is identical with the benchmark face model stored in database, and receives phase The unlock operation button answered then carries out joint coordination by the control unit of smart mobile phone and controls unlocking screen.
It is identical when judging face in the first video image with the benchmark face model stored in smartphone data library , then smart mobile phone operates smart mobile phone according to pre-set combination button in step S110, and smart mobile phone is connect After receiving corresponding unlock operation, joint coordination is carried out by the control unit of smart mobile phone and controls unlocking screen.I.e. the present invention is real It applies in example in unlock, the combination coordinated using recognition of face with release tab is unlocked.
Further, as shown in Fig. 2, further including the step of carrying out screen locking to smart mobile phone in the method for the present invention embodiment, The step of its progress screen locking, specifically includes:
The operational order that S210, the smart mobile phone receive user shoots and stores the benchmark people unlocked for screen locking in advance Face model and the operation button for pre-setting the joint screen locking unlock together with the benchmark face model.The same step of concrete operations S110 is similar.
S220, when need to smart mobile phone carry out screen locking when, receive user unlock operational order, control automatically turn on mobile phone take the photograph As head, the second video image of video image in front of mobile phone is obtained by mobile phone camera.
When smart phone user needs to carry out screen locking to smart mobile phone, the screen locking operational order of smart mobile phone is first pressed. Smart mobile phone then automatically turns on mobile phone camera, the video image of user's face is carried in front of shooting smart mobile phone, i.e., second regards Frequency image.Preferably, this image is the front digital video image of user.Concrete operation step is the same as step S120.
S230, recognition of face is carried out to second video image using face recognition technology, from the second video figure The face for screen locking is identified as in.
Smart mobile phone carries out recognition of face using face recognition technology to the facial video image in front of the mobile phone that receives, Recognition of face is carried out to the second video image, current face is identified in the image shot from camera.Carrying out face knowledge When other, smart mobile phone proceeds as follows step:
S211, smart mobile phone illumination compensation unit to second video image carry out illumination compensation.
Due to same step S111, smart mobile phone needs to carry out illumination compensation to the second video image of shooting.
S222, the color compensating of smart mobile phone and correction unit by the second video image of illumination compensation to carrying out color Compensation and correction.
Due to same step S122, smart mobile phone needs to carry out color compensating and school to the second video image of shooting Just.
S233, smart mobile phone image denoising unit to by color compensating with correction the second video image carry out noise reduction Processing.
Due to same step S233, smart mobile phone needs to carry out at image denoising the second video image of shooting Reason.
S244, smart mobile phone feature extraction unit to Jing Guo noise reduction process the second video image extraction image in use To characterize the Harr-Like features of benchmark face and the SIFT feature for recognition of face.
Smart mobile phone carries out simple face characteristic extraction to carrying out above-mentioned processed second video image, so as under The grader of one step provides feature vector, and uses Harr-Like character representation faces.
S255, smart mobile phone grader unit using trained Adaboost graders to represent face Harr- Like features complete two classification, realize Face datection, recognition of face are completed with SIFT feature, with from first video image It detects current face, face is identified with SIFT feature.
When complete step S230 using face recognition technology to second video image progress recognition of face, from described After the face for screen locking is identified in second video image, it is transferred to step S240.
S240, it will identify that certification is compared with the benchmark face model stored in database for the face of screen locking, Judge whether identical;
The face that Adaboost algorithm in above-mentioned steps is detected and the benchmark face stored in smartphone data library Model carries out comparison certification, according to the two similitude judge whether be same person face.Recognize if similitude is higher than 80% It is set to identical, by recognition of face certification, similitude is regarded as differing less than 80%, authentification failure.
It is S250, described identical with the benchmark face model stored in database for the face of screen locking when judging, and connect Corresponding screen locking operation button is received, then carrying out joint coordination by the control unit of smart mobile phone controls screen lock.
When Face datection certification passes through, then smart phone user is according to pre-set screen locking combination button, to intelligent hand Machine carries out screen locking operation.
Therefore the present invention by imaging sensor obtain image information, by illumination compensation technology, color compensating with Alignment technique, Harr-Like Feature Extraction Technologies, SIFT feature extractive technique, Adaboost sorting techniques, screen locking control skill Art.So as to which face datection application under complicated background environment, is on the one hand solved the energy consumption problem of mobile phone, on the other hand reduce The inconvenience that the maloperation of mobile phone is brought.
Based on above method embodiment, the present invention also provides a kind of using such as above-described embodiment screen locking solution lock control method Smart mobile phone, as shown in figure 5, the smart mobile phone is specifically included with lower module:
Module 310 is pre-set, shoots in advance for receiving the operational order of user and stores the base unlocked for screen locking Quasi- faceform and the operation button for pre-setting the joint screen locking unlock together with benchmark face model.Specific such as above-mentioned step Described in rapid S110.
First image collection module 320 refers to for when that need to be unlocked to smart mobile phone, receiving user and unlocking to operate It enables, control automatically turns on mobile phone camera, and the first video image in front of mobile phone is obtained by mobile phone camera.Specifically, the One image collection module, also includes image sensor cell, for obtaining visual information.Specifically such as above-mentioned steps S120 institutes It states.
First identification module 330, for using face recognition technology to first video image carry out recognition of face, from Current face is identified in first video image.As shown in fig. 6, the first picture recognition module 130 specifically further include with Lower each unit module:Illumination compensation unit 131, for carrying out illumination compensation to first video image.Color compensating and school Positive 132, for carrying out color compensating and correction by the first video image of illumination compensation.Image denoising unit 133, is used for To carrying out noise reduction process by color compensating and the first video image of correction.Feature extraction unit 134, for passing through noise reduction In the first video image extraction image of processing to the Harr-Like features that characterize benchmark face and for recognition of face SIFT feature.Grader unit 135, for special to the Harr-Like for representing face using trained Adaboost graders Sign completes two classification, realizes Face datection, recognition of face is completed with SIFT feature, to be detected from first video image Current face identifies face with SIFT feature.Specifically as described in above-mentioned steps S130.
First multilevel iudge module 340, for the current face that will identify that and the benchmark face mould stored in database Certification is compared in type, judges whether identical.Specifically as described in above-mentioned steps S140.
Control module 350 is unlocked, for when the benchmark face model for judging to store in the current face and database It is identical, and receive corresponding unlock operation button, then carrying out joint coordination by the control unit of smart mobile phone controls screen Unlock, specifically as described in above-mentioned steps S150.
Example is further carried out, as shown in figure 5, smart mobile phone of the present invention is specifically further included with lower module,
Second image collection module 350 refers to for when that need to carry out screen locking to smart mobile phone, receiving user's screen locking operation It enables, control automatically turns on mobile phone camera, and the second video image in front of mobile phone is obtained by mobile phone camera.Second image obtains Modulus block, also comprising an image sensor cell, for obtaining visual information.Specifically as described in above-mentioned steps S220.
Second identification module 360, for using face recognition technology to second video image carry out recognition of face, from The face for screen locking is identified in second video image.
Second multilevel iudge module 370 will identify that the benchmark stored in the face and database of the screen locking for screen locking Certification is compared in faceform, judges whether identical.Specifically as described in above-mentioned steps S240.
Screen locking control module 380, when the benchmark face mould for judging to store in the face and database for screen locking Type is identical, and receives corresponding screen locking operation button, then carries out joint coordination control flow by the control unit of smart mobile phone Curtain screen locking.Specifically as described in above-mentioned steps S250.
In conclusion the present invention mainly solves the problems, such as Face datection and the intelligence of Mobile phone screen and power supply under complex background Switch problem.The present invention is using the image sensing and processing unit on Smartphone device, by reducing light to illumination compensation According to influence, improve picture quality using color compensating and correcting algorithm, in order to further improve picture quality, reduce mobile phone The influence of front camera noise, introduces noise reduction algorithm, is carried in order to which the detection for realizing to face employs Harr-Like features Algorithm is taken, the good Adaboost graders of real-time performance are employed in the context of detection of face, so as to solve under complex environment Intelligent human-face test problems, finally using Face datection result and with button carry out joint coordination control screen, realize intelligence Screen locking and intelligent power control.
It should be understood that the application of the present invention is not limited to the above, it for those of ordinary skills, can To be improved or converted according to the above description, all these modifications and variations should all belong to the guarantor of appended claims of the present invention Protect range.

Claims (5)

1. a kind of smart mobile phone screen locking solution lock control method based on Face datection, which is characterized in that including to smart mobile phone into The step of row unlock, described the step of being unlocked to smart mobile phone, specifically includes:
A1, when that need to be unlocked to smart mobile phone, receive user unlock operational order, control automatically turn on mobile phone camera, The first video image in front of mobile phone is obtained by mobile phone camera;
A2, recognition of face is carried out to first video image using face recognition technology, known from first video image Current face is not gone out;
Certification is compared with the benchmark face model stored in database in A3, the current face that will identify that, judges whether phase Together;By the current face identified from the first video image that smart mobile phone is shot and the benchmark people stored in smart mobile phone Face model is compared, according to similitude judge whether be same person face, if similitude higher than regarding as phase if 80% Together, by recognition of face certification, difference, authentification failure are regarded as if similitude is less than 80%;
A4, when judging that the current face is identical with the benchmark face model stored in database, and receives corresponding solution Operation button is locked, then carrying out joint coordination by the control unit of smart mobile phone controls unlocking screen;
It is further included before described the step of being unlocked to smart mobile phone:
The operational order that the smart mobile phone receives user shoots and stores the benchmark face model unlocked for screen locking in advance, with And pre-set the operation button that joint screen locking unlocks together with the benchmark face model;The image of the benchmark face model is Smart phone user front clearly face's video image;
The operation button is the common screen locking release tab of smart mobile phone or is two or three in smart mobile phone button Combination button;
The step A2 is specifically included:
A21, smart mobile phone illumination compensation unit to first video image carry out illumination compensation;
A22, the color compensating of smart mobile phone and correction unit by the first video image of illumination compensation to carrying out color compensating With correction;
A23, smart mobile phone image denoising unit to by color compensating with correction the first video image carry out noise reduction process;
A24, smart mobile phone feature extraction unit to Jing Guo noise reduction process the first video image extraction image in table The Harr-Like features and the SIFT feature for recognition of face for levying benchmark face;
A25, the grader unit of smart mobile phone are special to the Harr-Like for representing face using trained Adaboost graders Sign completes two classification, realizes Face datection, to detect current face from first video image, is identified with SIFT feature Go out face.
2. the smart mobile phone screen locking solution lock control method according to claim 1 based on Face datection, which is characterized in that its The step of screen locking is carried out to smart mobile phone is further included, described the step of carrying out screen locking to smart mobile phone specifically includes:
B1, when need to smart mobile phone carry out screen locking when, receive user's screen locking operational order, control automatically turn on mobile phone camera, The second video image in front of mobile phone is obtained by mobile phone camera;
B2, recognition of face is carried out to second video image using face recognition technology, known from second video image Do not go out the face for screen locking;
B3, it will identify that certification is compared with the benchmark face model stored in database in the face of the screen locking for screen locking, Judge whether identical;
It is B4, described identical with the benchmark face model stored in database for the face of screen locking when judging, and receive phase The screen locking operation button answered then carries out joint coordination by the control unit of smart mobile phone and controls screen lock.
3. the smart mobile phone screen locking solution lock control method according to claim 2 based on Face datection, which is characterized in that institute Step B2 is stated to specifically include:
B21, smart mobile phone illumination compensation unit to second video image carry out illumination compensation;
B22, the color compensating of smart mobile phone and correction unit by the second video image of illumination compensation to carrying out color compensating With correction;
B23, smart mobile phone image denoising unit to by color compensating with correction the second video image carry out noise reduction process;
B24, smart mobile phone feature extraction unit to Jing Guo noise reduction process the second video image extraction image in table The Harr-Like features and the SIFT feature for recognition of face for levying benchmark face;
B25, the grader unit of smart mobile phone are special to the Harr-Like for representing face using trained Adaboost graders Sign completes two classification, realizes Face datection, recognition of face is completed with SIFT feature, to be detected from first video image Current face identifies face with SIFT feature.
A kind of 4. smart mobile phone using the screen locking solution lock control method as described in claim any one of 1-3, which is characterized in that packet It includes:
Module is pre-set, shoots in advance for receiving the operational order of user and stores the benchmark face mould unlocked for screen locking Type and the operation button for pre-setting the joint screen locking unlock together with the benchmark face model;
First image collection module unlocks operational order for when that need to be unlocked to smart mobile phone, receiving user, and control is certainly It is dynamic to open mobile phone camera, the first video image in front of mobile phone is obtained by mobile phone camera;
First identification module, for carrying out recognition of face to first video image using face recognition technology, from described the Current face is identified in one video image;
First multilevel iudge module is compared for the current face that will identify that and the benchmark face model stored in database To certification, judge whether identical;By the current face identified from the first video image that smart mobile phone is shot and intelligence The benchmark face model stored in mobile phone is compared, according to similitude judge whether be same person face, if similar Property is regarded as identical higher than 80%, by recognition of face certification, difference is regarded as if similitude is less than 80%, certification is lost It loses;
Control unlock control module, judges the current face and the benchmark face model phase stored in database for working as Together, and corresponding unlock operation button is received, then carrying out joint coordination by the control unit of smart mobile phone controls screen solution Lock;The image of the benchmark face model is smart phone user front clearly face's video image;
The operation button is the common screen locking release tab of smart mobile phone or is two or three in smart mobile phone button Combination button;
First identification module includes:
Illumination compensation unit:For carrying out illumination compensation to first video image;
Color compensating and correction:For to carrying out color compensating and correction by the first video image of illumination compensation;
Image denoising unit:For to carrying out noise reduction process by color compensating and the first video image of correction;
Feature extraction unit:For to characterizing benchmark face in the first video image extraction image Jing Guo noise reduction process Harr-Like features and the SIFT feature for recognition of face;
Grader unit:For completing two to the Harr-Like features of expression face using trained Adaboost graders Classification realizes Face datection, to detect current face from first video image, face is identified with SIFT feature.
5. smart mobile phone according to claim 4, which is characterized in that it is further included:
Second image collection module unlocks operational order for when that need to carry out screen locking to smart mobile phone, receiving user, and control is certainly It is dynamic to open mobile phone camera, the second video image in front of mobile phone is obtained by mobile phone camera;
Second identification module, for carrying out recognition of face to second video image using face recognition technology, from described the The face for screen locking is identified in two video images;
Second multilevel iudge module will identify that the benchmark face model stored in the face and database of the screen locking for screen locking Certification is compared, judges whether identical;
It is screen locking control module, described identical with the benchmark face model stored in database for the face of screen locking when judging, And receive corresponding screen locking operation button, then carrying out joint coordination by the control unit of smart mobile phone controls screen lock.
CN201210409592.3A 2012-10-24 2012-10-24 Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection Active CN102970411B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210409592.3A CN102970411B (en) 2012-10-24 2012-10-24 Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210409592.3A CN102970411B (en) 2012-10-24 2012-10-24 Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection

Publications (2)

Publication Number Publication Date
CN102970411A CN102970411A (en) 2013-03-13
CN102970411B true CN102970411B (en) 2018-06-26

Family

ID=47800287

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210409592.3A Active CN102970411B (en) 2012-10-24 2012-10-24 Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection

Country Status (1)

Country Link
CN (1) CN102970411B (en)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103186793A (en) * 2013-03-26 2013-07-03 北京小米科技有限责任公司 Mobile terminal screen unlocking method and device
CN103268188A (en) * 2013-05-27 2013-08-28 华为终端有限公司 Setting method, unlocking method and device based on picture characteristic elements
US9721107B2 (en) * 2013-06-08 2017-08-01 Apple Inc. Using biometric verification to grant access to redacted content
TWI594629B (en) * 2013-11-01 2017-08-01 佳世達科技股份有限公司 Photographic apparatus with illumination supplement adjustment function and method using the same
CN103617385B (en) * 2013-11-27 2016-04-06 福州瑞芯微电子股份有限公司 Realize terminal and the method for unlocking screen
CN103986873B (en) * 2014-05-28 2017-12-01 广州视源电子科技股份有限公司 A kind of display device image pickup method and display device
CN104036171A (en) * 2014-06-20 2014-09-10 北京金山安全软件有限公司 Method for protecting mobile equipment and mobile equipment
CN104461351B (en) * 2014-11-12 2019-10-22 深圳市金立通信设备有限公司 A kind of method of terminal unlocking
CN104461350B (en) * 2014-11-12 2019-10-22 深圳市金立通信设备有限公司 A kind of terminal
WO2016074248A1 (en) * 2014-11-15 2016-05-19 深圳市三木通信技术有限公司 Verification application method and apparatus based on face recognition
CN104541230B (en) * 2014-11-15 2017-07-04 深圳市三木智能技术有限公司 Video verification prevents the method and device of mobile phone misoperation
CN105681896B (en) * 2014-11-20 2019-11-12 乐金电子(中国)研究开发中心有限公司 A kind of intelligent TV set and its solution screen method
CN105611344B (en) * 2014-11-20 2019-11-05 乐金电子(中国)研究开发中心有限公司 A kind of intelligent TV set and its screen locking method
CN105787308A (en) * 2014-12-22 2016-07-20 中兴通讯股份有限公司 Terminal and terminal unlocking method
CN104679240B (en) * 2015-01-26 2018-01-12 深圳市金立通信设备有限公司 A kind of method of terminal control
CN104679217A (en) * 2015-01-26 2015-06-03 深圳市金立通信设备有限公司 Terminal
CN105512541A (en) * 2015-12-07 2016-04-20 魅族科技(中国)有限公司 Screen unlocking method, data encryption and decryption methods as well as related devices
CN106534576A (en) * 2016-12-07 2017-03-22 深圳市传奇数码有限公司 Side face unlocking method applied to mobile phone
CN106650385B (en) * 2016-12-29 2019-11-12 北京金山安全软件有限公司 Unlocking method and device and electronic equipment
CN106845438A (en) * 2017-02-13 2017-06-13 联想(北京)有限公司 A kind of face identification method, device and electronic equipment
CN108875331B (en) * 2017-08-01 2022-08-19 北京旷视科技有限公司 Face unlocking method, device and system and storage medium
TWI645340B (en) * 2017-08-24 2018-12-21 遠傳電信股份有限公司 Face recognition authentication system and method thereof
CN107657221B (en) 2017-09-12 2021-08-24 Oppo广东移动通信有限公司 Face information acquisition method and related equipment
CN107491684A (en) * 2017-09-22 2017-12-19 广东巽元科技有限公司 A kind of screen control device and its control method based on recognition of face
CN107679482B (en) * 2017-09-27 2021-04-09 Oppo广东移动通信有限公司 Unlocking control method and related product
CN107862311A (en) * 2017-10-27 2018-03-30 上海京颐科技股份有限公司 User profile acquisition method and device, computer-readable recording medium
CN108509781B (en) * 2018-03-27 2023-04-07 百度在线网络技术(北京)有限公司 Method and device for unlocking
CN108984214A (en) * 2018-06-12 2018-12-11 Oppo广东移动通信有限公司 terminal state control method, device, mobile terminal and storage medium
WO2020077523A1 (en) * 2018-10-16 2020-04-23 华为技术有限公司 Method used for recognizing user behavior, chip and terminal
CN111340195B (en) * 2020-03-09 2023-08-22 创新奇智(上海)科技有限公司 Training method and device for network model, image processing method and storage medium
CN111835987A (en) * 2020-06-08 2020-10-27 广东以诺通讯有限公司 Video generation method based on face recognition
CN113483470A (en) * 2021-06-08 2021-10-08 杭州裕达自动化科技有限公司 Intelligent control method for refrigeration host in central air-conditioning monitoring system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101393598A (en) * 2007-09-21 2009-03-25 希姆通信息技术(上海)有限公司 Starting and unblock method decided by human face identification by utilizing mobile phone cam
CN102722662A (en) * 2012-05-14 2012-10-10 深圳职业技术学院 Computer sound control screen lock and unlock system and method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100389388C (en) * 2006-06-15 2008-05-21 北京中星微电子有限公司 Screen protection method and apparatus based on human face identification
CN101296457A (en) * 2008-06-25 2008-10-29 深圳华为通信技术有限公司 Screen operation method and device
CN102117117A (en) * 2010-01-06 2011-07-06 致伸科技股份有限公司 System and method for control through identifying user posture by image extraction device
CN202009428U (en) * 2011-03-01 2011-10-12 深圳市华域无线技术有限公司 Mobile phone capable of being unlocked through face recognition
CN102737194A (en) * 2012-06-18 2012-10-17 上海斐讯数据通信技术有限公司 Mobile terminal with fingerprint unlocking function and fingerprint unlocking method of mobile terminal

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101393598A (en) * 2007-09-21 2009-03-25 希姆通信息技术(上海)有限公司 Starting and unblock method decided by human face identification by utilizing mobile phone cam
CN102722662A (en) * 2012-05-14 2012-10-10 深圳职业技术学院 Computer sound control screen lock and unlock system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
《为什么解锁时必须先滑动解锁后才能图案解锁?》;sk18550151;《http://bbs.gfan.com/android-4257627-1-1.html》;20120521;第1页 *

Also Published As

Publication number Publication date
CN102970411A (en) 2013-03-13

Similar Documents

Publication Publication Date Title
CN102970411B (en) Smart mobile phone screen locking solution lock control method and smart mobile phone based on Face datection
CN105631403B (en) Face identification method and device
CN107423699B (en) Biopsy method and Related product
CN104408402B (en) Face identification method and device
WO2019080797A1 (en) Living body detection method, terminal, and storage medium
CN109639982A (en) A kind of image denoising method, device, storage medium and terminal
CN107463818B (en) Unlocking control method and related product
US20120051605A1 (en) Method and apparatus of a gesture based biometric system
CN109348135A (en) Photographic method, device, storage medium and terminal device
CN104408404B (en) Face identification method and device
CN104715232B (en) Fake finger identification device and method
CN109858439A (en) A kind of biopsy method and device based on face
CN105513067B (en) A kind of Approach for detecting image sharpness and device
CN108259746B (en) Image color detection method and mobile terminal
CN107451444B (en) Solve lock control method and Related product
CN204791017U (en) Mobile terminal users authentication device based on many biological characteristics mode
CN111461097A (en) Method, apparatus, electronic device and medium for recognizing image information
CN108494968A (en) Intelligent prompt method, device, storage medium and intelligent terminal
CN106503534B (en) Information processing method and terminal
CN107633499A (en) Image processing method and related product
CN110851067A (en) Screen display mode switching method and device and electronic equipment
WO2019024718A1 (en) Anti-counterfeiting processing method, anti-counterfeiting processing apparatus and electronic device
CN110765924A (en) Living body detection method and device and computer-readable storage medium
CN105138956B (en) Method for detecting human face and device
CN106096043A (en) A kind of photographic method and mobile terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant