CN110290267A - A kind of mobile phone control method and system based on human face expression - Google Patents
A kind of mobile phone control method and system based on human face expression Download PDFInfo
- Publication number
- CN110290267A CN110290267A CN201910554833.5A CN201910554833A CN110290267A CN 110290267 A CN110290267 A CN 110290267A CN 201910554833 A CN201910554833 A CN 201910554833A CN 110290267 A CN110290267 A CN 110290267A
- Authority
- CN
- China
- Prior art keywords
- face
- mobile phone
- app
- expression
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Environmental & Geological Engineering (AREA)
- Telephone Function (AREA)
Abstract
The invention belongs to cell phone intelligent identification technology fields, provide a kind of mobile phone control method and system based on human face expression, and method includes incuding mobile phone current state；If it is determined that mobile phone is to be used or is currently being used, then user's face image is acquired；It is analyzed according to the face-image and obtains facial expression information；The facial expression information and face preset in advance are compared；If similarity is greater than preset threshold, further judge that cell phone apparatus is display launcher main interface or some interface app；It transfers system operatio instruction corresponding to the face preset in advance if showing launcher main interface to operate system level, if showing, some interface app transfers the app operational order corresponding to the face preset in advance and operates the app；If similarity is less than preset threshold, return resurveys user's face image.To be implemented without both hands, the effect of mobile phone is controled and operated by facial expression.
Description
Technical field
The invention belongs to cell phone intelligent identification field more particularly to a kind of mobile phone control method based on human face expression and it is
System.
Background technique
Mobile phone belongs to mobile terminal, is the mobile phone that can be held in the hand.There is mobile telephone in early stage because head is larger
Be commonly called as, be developed to the 4G epoch at present.In April, 1973, American Engineering technician " Martin library pa " invention in the world first
Portion pushes civilian mobile phone to, and " Martin library pa " is also referred to as modern " father of mobile phone " from this.Until now, mobile phone becomes people
Very important tool in life, and as Swiss Army Knife general utility functions diversification, and bring good days experience.It is existing
The control of stage mobile phone must also rely on gesture operation or remote command, and present mobile phone becomes greatly, one-handed performance
Operating handset is detached from the operation of mobile phone and relies on both hands with regard to relatively difficult under mobile phone or the occupied situation of both hands
It is a problem to be solved.
To sum up, it now needs one kind and is able to solve above-mentioned technical problem, human face expression intelligent control mobile phone operation can be passed through
Scheme.
Summary of the invention
Place in view of above-mentioned deficiencies of the prior art, the purpose of the present invention is to provide a kind of mobile phones based on human face expression
Control method and system, it is intended to solve the problems, such as that the prior art is unable to both hands disengaging mobile phone and operates to mobile phone.
In order to achieve the above object, this invention takes following technical schemes:
A kind of mobile phone control method based on human face expression characterized by comprising
Incude mobile phone current state；
If it is determined that mobile phone is to be used or is currently being used, then user's face image is acquired；
It is analyzed according to the face-image and obtains facial expression information；
The facial expression information and face preset in advance are compared；
If similarity be greater than preset threshold, further judge cell phone apparatus be show launcher main interface or some
The interface app；
System operatio instruction corresponding to the face preset in advance is transferred if showing launcher main interface to being
System level is operated, and the app operational order corresponding to the face preset in advance is transferred if showing some interface app
The app is operated；
If similarity is less than preset threshold, return resurveys user's face image.
Preferably, the method for the face preset in advance includes:
Mode is pre-seted into Expression Recognition；
System level setting, a variety of human face expressions of typing are selected, and add operational order for each expression；
The setting of app application, a variety of human face expressions of typing are selected, and add operational order for each expression.
Preferably, a variety of human face expressions of the typing, and operational order is added for each expression, wherein each face
Expression typing five times.
In addition, the present invention also provides a kind of cellphone control systems based on human face expression, comprising:
Mobile phone state induction module is used to incude mobile phone current state；
Image capture module is used to acquire user's face image；
Image processing module is used to analyze acquisition facial expression information according to the face-image；
Image comparison module is used to compare the facial expression information and face preset in advance, and judges similar
Degree；
Interface judgment module is used to judge that cell phone apparatus to be display launcher main interface or some interface a pp；
Module is transferred in instruction, is used to transfer system operatio corresponding to the face preset in advance and is instructed to system layer
Face is operated, and is transferred the app operational order corresponding to the face preset in advance and operated to the app.
Compared with prior art, beneficial effects of the present invention:
A kind of mobile phone control method and system based on human face expression provided by the invention, method include incuding mobile phone
Current state；If it is determined that mobile phone is to be used or is currently being used, then user's face image is acquired；According to the face-image point
Analysis obtains facial expression information；The facial expression information and face preset in advance are compared；If similarity is greater than default threshold
Value then further judges that cell phone apparatus is display launcher main interface or some interface app；If showing the main boundary launcher
Face is then transferred system operatio instruction corresponding to the face preset in advance and is operated to system level, if showing some a
It then transfers the app operational order corresponding to the face preset in advance and the app is operated in the interface pp；If similarity is small
In preset threshold, then returns and resurvey user's face image.To being implemented without both hands, controlled by facial expression and
The effect of operating handset.
Detailed description of the invention
Fig. 1 is the flow diagram of the mobile phone control method of the invention based on human face expression；
Fig. 2 is the schematic block diagram of the cellphone control system of the invention based on human face expression.
Specific embodiment
To make the purpose of the present invention, technical solution and effect clearer, clear and definite, right as follows in conjunction with drawings and embodiments
The present invention is further described.It should be appreciated that described herein, specific examples are only used to explain the present invention, is not used to
Limit the present invention.
As shown in attached drawing 1-2, a kind of mobile phone control method based on human face expression provided by the invention, which is characterized in that
It include: induction mobile phone current state；If it is determined that mobile phone is to be used or is currently being used, then user's face image is acquired；According to
The face-image analysis obtains facial expression information；The facial expression information and face preset in advance are compared；If phase
It is greater than preset threshold like degree, then further judges that cell phone apparatus is display launcher main interface or some interface app；If aobvious
Show that launc her main interface is then transferred system operatio instruction corresponding to the face preset in advance and grasped to system level
Make, the ap p operational order corresponding to the face preset in advance is transferred if showing some interface app, the app is carried out
Operation；If similarity is less than preset threshold, return resurveys user's face image.
Specifically, the corresponding operational order of some facial expressions is arranged in advance in mobile phone, for example mentioned in system setting
Preceding setting wink one's left eye out music, blink right eye and open call model, inner setting can also be applied at some, for example right eye is blinked in music
Play, wink one's left eye the operation such as pause, after setting, whenever needing operating handset, the front camera of mobile phone is by user
Facial expression real-time capture, then according to picture detail comparison extract blink or choose eyebrow or dynamic ear, according to this
A little operational orders open respective operations.
In addition, mobile phone state incudes in the following way, when mobile phone passes through gravity sensing or thermal sensing, thermal sensation
The technology that should be used in mobile phone with gravity sensing does not just say that some mobile phones have had this function excessively here, sense by
It picks up (behavior that one hand picks up equipment when action) or senses temperature-sensitive source close to how many distance when being face-up horizontally arranged
It can voluntarily adjust (horizontal positioned on the table or the first-class behavior of bed), it was demonstrated that mobile phone is to be used or user is used,
Cell phone processor should be passed to by the signal that induction is learnt at this time, cell phone processor transmission instruction is opened front camera and captured
Face, the face preset according to catcher's face and in advance compare, if similarity reaches 95%, to turn out expression consistent,
At this time if launcher main interface is topmost shown in equipment, then just reading and the associated instruction of this expression,
For example open app or carry out sending short message or call etc., it is read if topmost some app is shown in mobile phone
Operation app instruction corresponding with this expression；
For example: in setting in advance I wink one's left eye be arranged to the palm read app, then read in the palm and add one in a pp
It is a to wink one's left eye or other expressions turn over downwards one page (key in similar devices volume down key and volume), when equipment is not on the table beating
When opening any app, blinks lower left eye system and open the palm and read ap p, the part that then last time sees is opened together, under blinking again after finishing watching
Left eye jumps lower one page automatically.
How to judge that equipment top layer is desktop system or some app application, scheme can be taken, and each
Equipment can all have similar scheme:
ActivityManager=(ActivityManager) getSystemService (ACTIVITY_SERVIC
E)；
List<RunningTaskInfo>tasks=activityManager.getRunningTasks (1)；
// get uppermost process
RunningTaskInfo taskInfo=tasks.get (0)；
// get the packet name of top application program
String packageName=taskInfo.topActivity.getPackageName ()；
The method that the algorithm of picture recognition uses spot detection, mainly including the use of Gauss-Laplace detection
Method (LOG), and the method (DOH) using pixel Hessian matrix (second-order differential) and its determinant.Utilize Gauss
Drawing common Lars (Laplace of Gaussian, LOG) operator detection image spot is a kind of very common method, for
Two-dimensional Gaussian function:Its standardization Gauss draws general transformation are as follows:Because the laplace kernel of two-dimensional Gaussian function is very
As a spot, it is possible to find out the mottled structure in image using convolution.Do H method is exactly to utilize picture point
Second-order differential Hessian matrix:And value DoH (the Determinant of of its determinant
Hessian): The value of Hessian matrix determinant,
Equally also reflect the structural information of image local.Compared with LoG, DoH has preferably the spot of the slim-lined construction in image
Inhibiting effect.
Preferably, the method for the face preset in advance includes:
Mode is pre-seted into Expression Recognition；
System level setting, a variety of human face expressions of typing are selected, and add operational order for each expression；
The setting of app application, a variety of human face expressions of typing are selected, and add operational order for each expression.
It should be noted that a variety of human face expressions in system level setting and app application setting up procedure are can be with
It is shared, for example the expression laughed at of grinning can be arranged to open call model in pre-seting, while certain app also can be set into
Using, such as the next track or last track or pause of music player software.
Preferably, a variety of human face expressions of the typing, and operational order is added for each expression, wherein each face
Expression typing five times.Because the same human face expression is on subtle or differentiated, therefore the multiple typing of the same expression, so that
It is more stable during Expression Recognition, it is unlikely to Expression Recognition mistake.
In addition, the present invention also provides a kind of cellphone control systems based on human face expression, comprising:
Mobile phone state induction module is used to incude mobile phone current state；Mobile phone is judged by gravity sensing and thermoinduction
Whether current state is to be used or is currently being used.Image capture module is used to acquire user's face image；At image
Module is managed, is used to analyze acquisition facial expression information according to the face-image；Image comparison module is used for the face
Portion's expression information and face preset in advance compare, and judge similarity；Interface judgment module is used to judge that cell phone apparatus to be
Show lau ncher main interface or some interface app；Module is transferred in instruction, is used to transfer the face preset in advance
Corresponding system operatio instruction operates system level, and transferring should corresponding to the face preset in advance
App operational order operates the app.
On the basis of the present invention, it is also necessary to which explanation can also be pair on the basis of based on human face expression control
It answers expression that corresponding voice recognition instruction is added, voice is added in original basis and obtains module and speech recognition match module, from
And it realizes voice and adds the mode of expression co- controlling mobile phone.
To sum up, working principle of the present invention is as follows:
A kind of mobile phone control method and system based on human face expression provided by the invention, method are that induction mobile phone is current
State；If it is determined that mobile phone is to be used or is currently being used, then user's face image is acquired；It is obtained according to face-image analysis
Take facial expression information；The facial expression information and face preset in advance are compared；If similarity is greater than preset threshold,
Further judge that cell phone apparatus is display launcher main interface or some interface app；If showing launcher main interface
It transfers system operatio instruction corresponding to the face preset in advance to operate system level, if showing some a pp circle
It then transfers the app operational order corresponding to the face preset in advance and the app is operated in face；If similarity is less than pre-
If threshold value, then returns and resurvey user's face image.During specifically used, the hand for pre-seting expression is being pre-set
Machine, induction mobile phone are in state just to be used, the signal of induction are sent to system processor, system processor receives this
Instruction is sent after signal allows mobile phone to enter expression control model, and starts the face-image that front camera obtains user, passes through
Analysis face-image compares to obtain specific facial expression information with the expression information pre-seted in advance, and similarity is greater than
Preset threshold then transfers the instruction of system level or the instruction of app application according to the judgement of mobile phone current interface, if being less than
Preset threshold is then returned directly to front camera and reacquires face-image.
It, can according to the technique and scheme of the present invention and its hair it is understood that for those of ordinary skills
Bright design is subject to equivalent substitution or change, and all these changes or replacement all should belong to the guarantor of appended claims of the invention
Protect range.
Claims (4)
1. a kind of mobile phone control method based on human face expression characterized by comprising
Incude mobile phone current state；
If it is determined that mobile phone is to be used or is currently being used, then user's face image is acquired；
It is analyzed according to the face-image and obtains facial expression information；
The facial expression information and face preset in advance are compared；
If similarity is greater than preset threshold, further judge that cell phone apparatus is display launcher main interface or some app
Interface；
System operatio corresponding to the face preset in advance is transferred if showing launcher main interface to instruct to system layer
Face is operated, and the app operational order corresponding to the face preset in advance is transferred if showing some interface app to this
App is operated；
If similarity is less than preset threshold, return resurveys user's face image.
2. the mobile phone control method according to claim 1 based on human face expression, which is characterized in that described preset in advance
The method of face includes:
Mode is pre-seted into Expression Recognition；
System level setting, a variety of human face expressions of typing are selected, and add operational order for each expression；
The setting of app application, a variety of human face expressions of typing are selected, and add operational order for each expression.
3. the mobile phone control method according to claim 2 based on human face expression, which is characterized in that a variety of people of typing
Face expression, and operational order is added for each expression, wherein each human face expression typing five times.
4. a kind of cellphone control system based on human face expression characterized by comprising
Mobile phone state induction module is used to incude mobile phone current state；
Image capture module is used to acquire user's face image；
Image processing module is used to analyze acquisition facial expression information according to the face-image；
Image comparison module is used to compare the facial expression information and face preset in advance, and judges similarity；
Interface judgment module is used to judge that cell phone apparatus to be display launcher main interface or some interface app；
Module is transferred in instruction, be used to transfer system operatio instruction corresponding to the face preset in advance to system level into
Row operation, and transfer the app operational order corresponding to the face preset in advance and the app is operated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910554833.5A CN110290267A (en) | 2019-06-25 | 2019-06-25 | A kind of mobile phone control method and system based on human face expression |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910554833.5A CN110290267A (en) | 2019-06-25 | 2019-06-25 | A kind of mobile phone control method and system based on human face expression |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110290267A true CN110290267A (en) | 2019-09-27 |
Family
ID=68005532
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910554833.5A Pending CN110290267A (en) | 2019-06-25 | 2019-06-25 | A kind of mobile phone control method and system based on human face expression |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110290267A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112101215A (en) * | 2020-09-15 | 2020-12-18 | Oppo广东移动通信有限公司 | Face input method, terminal equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105242942A (en) * | 2015-09-17 | 2016-01-13 | 小米科技有限责任公司 | Application control method and apparatus |
| US20170024005A1 (en) * | 2015-07-20 | 2017-01-26 | Chiun Mai Communication Systems, Inc. | Electronic device and facial expression operation method |
| CN107329760A (en) * | 2017-06-30 | 2017-11-07 | 珠海市魅族科技有限公司 | Information cuing method, device, terminal and storage medium |
| CN107479801A (en) * | 2017-07-31 | 2017-12-15 | 广东欧珀移动通信有限公司 | Displaying method of terminal, device and terminal based on user's expression |
| CN108804893A (en) * | 2018-03-30 | 2018-11-13 | 百度在线网络技术（北京）有限公司 | A kind of control method, device and server based on recognition of face |
-
2019
- 2019-06-25 CN CN201910554833.5A patent/CN110290267A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170024005A1 (en) * | 2015-07-20 | 2017-01-26 | Chiun Mai Communication Systems, Inc. | Electronic device and facial expression operation method |
| CN105242942A (en) * | 2015-09-17 | 2016-01-13 | 小米科技有限责任公司 | Application control method and apparatus |
| CN107329760A (en) * | 2017-06-30 | 2017-11-07 | 珠海市魅族科技有限公司 | Information cuing method, device, terminal and storage medium |
| CN107479801A (en) * | 2017-07-31 | 2017-12-15 | 广东欧珀移动通信有限公司 | Displaying method of terminal, device and terminal based on user's expression |
| CN108804893A (en) * | 2018-03-30 | 2018-11-13 | 百度在线网络技术（北京）有限公司 | A kind of control method, device and server based on recognition of face |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112101215A (en) * | 2020-09-15 | 2020-12-18 | Oppo广东移动通信有限公司 | Face input method, terminal equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105700363B (en) | A kind of awakening method and system of smart home device phonetic controller | |
| CN105487673B (en) | A kind of man-machine interactive system, method and device | |
| CN105487652B (en) | Display device and its control method | |
| CN106557678B (en) | A kind of intelligent terminal mode switching method and its device | |
| CN107450729B (en) | Robot interactive method and device | |
| CN108616712B (en) | Camera-based interface operation method, device, equipment and storage medium | |
| CN109819342A (en) | Barrage contents controlling method, device, computer equipment and storage medium | |
| CN102932212A (en) | Intelligent household control system based on multichannel interaction manner | |
| CN106454071A (en) | Terminal and automatic shooting method based on gestures | |
| CN107943955A (en) | A kind of clothing information collecting device, information management system and method | |
| CN204791017U (en) | Mobile terminal users authentication device based on many biological characteristics mode | |
| CN107078917A (en) | Trustship videoconference | |
| CN103472915B (en) | reading control method based on pupil tracking, reading control device and display device | |
| CN110430323B (en) | Multitask intelligent coordination method, device and system | |
| WO2021042518A1 (en) | Face recognition-based font adjustment method, apparatus, device, and medium | |
| JP2017182531A (en) | Information processor, information processing method, and program | |
| CN105630157A (en) | Control method, control device, terminal and control system | |
| CN110290267A (en) | A kind of mobile phone control method and system based on human face expression | |
| US10088897B2 (en) | Method and electronic device for improving performance of non-contact type recognition function | |
| CN108650556A (en) | A kind of barrage input method and device | |
| CN104348969A (en) | Method for operating mobile phone by stare of line of sight | |
| CN106325481A (en) | A non-contact type control system and method and a mobile terminal | |
| CN107613124A (en) | Unlocking method, smart machine and the storage medium of smart machine | |
| CN106934334A (en) | A kind of gesture motion recognition methods and smart machine | |
| CN108008804A (en) | The screen control method and device of smart machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190927 |
|
| RJ01 | Rejection of invention patent application after publication |