CN109343710A - Message back method and apparatus - Google Patents

Message back method and apparatus Download PDF

Info

Publication number
CN109343710A
CN109343710A CN201811142247.1A CN201811142247A CN109343710A CN 109343710 A CN109343710 A CN 109343710A CN 201811142247 A CN201811142247 A CN 201811142247A CN 109343710 A CN109343710 A CN 109343710A
Authority
CN
China
Prior art keywords
user
active user
new information
face
multiple image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811142247.1A
Other languages
Chinese (zh)
Inventor
侯恩星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201811142247.1A priority Critical patent/CN109343710A/en
Publication of CN109343710A publication Critical patent/CN109343710A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Security & Cryptography (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure provides a kind of message back method and apparatus;Wherein, which comprises the event that new information is shown in response to detecting obtains the multiple image of active user;The multiple image is analyzed, whether the movement for obtaining the physical feeling of active user meets the analysis result of predetermined way;When the movement of the physical feeling of the analysis result expression active user meets predetermined way, the response events to the new information are triggered.Thus the disclosure realizes that user is not necessarily to that the new information could be responded by the operation for clicking screen, relatively reduces the operation difficulty of user response new information.

Description

Message back method and apparatus
Technical field
This disclosure relates to message processing technique field more particularly to message back method and apparatus.
Background technique
It in the use process of electronic equipment, inevitably will appear prompting message situation, leave a question open for example, user opens safety Webpage when or user clicked during using application program a certain control some link when or user downloading file Or when application program installation kit, the system of electronic equipment generally can all pop up corresponding message box, with to user it is some prompt or Warning.
After the message box occurs, user is needed to be replied accordingly, system can just continue subsequent operation.Its In, system confirms control and cancellation control by showing in message box, or confirmation control and closing control, provides finger for user Enable the approach of input.Control needed for needing accurately to click by finger or stylus or mouse to user, could complete to disappear Breath is replied.
In such event, due to that must realize message back by clicking operation, then click can not be executed with hand in user When operation, the difficulty that user replies message frame is relatively increased, causes system latency time longer, influences message back effect Rate.
Summary of the invention
To overcome the problems in correlation technique, present disclose provides message back method and apparatus.
According to the first aspect of the embodiments of the present disclosure, a kind of message back method is provided, which comprises
The event that new information is shown in response to detecting, obtains the multiple image of active user;
The multiple image is analyzed, whether the movement for obtaining the physical feeling of active user meets predetermined way Analyze result;
When the movement of the physical feeling of the analysis result expression active user meets predetermined way, triggering is to described new The response events of message.
The disclosure is by when new information is shown as a result, analysis corresponding to the movement based on user's current body position As a result determine whether to respond new information, to reply or check new information;Realize that user is not necessarily to the operation energy by clicking screen The new information is responded, the operation difficulty of new information described in user response is relatively reduced, avoids system latency time longer, Be conducive to improve message response efficiency, optimize user experience.Furthermore it is also possible to solve because of the too small institute of effective click on area of control Caused by it is excessively high to the accuracy requirement of clicking operation, click difficulty increase the problem of.
Optionally, the step of multiple image being analyzed, comprising:
Identify that the specific characteristic in the multiple image, the specific characteristic are used to characterize the physical feeling of user;
Change in location of the specific characteristic in multiple image is analyzed, the analysis result is generated.
The disclosure is analyzed by the change in location based on specific characteristic in multiple image as a result, advantageously reducing The operand of image recognition improves image recognition efficiency and reduces requirement of the image recognition operation to hardware environment.
Optionally, the step of multiple image being analyzed, further includes: the multiple image is unidentified to be arrived when being based on When the specific characteristic, information of user's adjustment relative to the position of camera is reminded in output.
The disclosure is opposite by reminding user to adjust the corresponding physical feeling of specific characteristic when specific characteristic is not detected In the position of camera, is conducive to the usable value for improving image obtained, improves to a certain extent in the case Image recognition efficiency.
Optionally, the physical feeling is head, and the movement of the predetermined way includes nodding and/or shaking the head.
The disclosure is limited to head by the physical feeling for being characterized specific characteristic, and movement is limited to nod or be shaken Head can simplify operation and image recognition operand that user replies message.
Optionally, the multiple image is analyzed, obtain the physical feeling of active user movement whether meet it is pre- Determine the analysis result of mode, comprising:
Identify that the specific characteristic in the multiple image, the specific characteristic are used to characterize the head of user;
Change in location of the specific characteristic in multiple image is analyzed, whether the headwork for obtaining active user meets The analysis result of predetermined way;And
Judge whether the specific characteristic matches with the face characteristic of user bound in current device, obtains recognition of face As a result;
When the movement of the physical feeling of the analysis result expression active user meets predetermined way, triggering is to described new The response events of message, comprising:
When the analysis result indicates that the movement on the head of active user meets predetermined way, and the face recognition result When indicating that active user's face is matched with the face characteristic of user bound in current device, the response to the new information is triggered Event.
The disclosure herein in connection with face recognition result by determining whether to trigger to new information on the basis of analyzing result Response events realize no matter whether equipment is locked, only equipment owner are allowed to check or respond message, improve safety Property.
Optionally, under screen locking pattern, the message back method of the disclosure further include:
When the analysis result indicates that the movement on the head of active user meets predetermined way, and the face recognition result When indicating that active user's face is matched with the face characteristic of user bound in current device, solves lock screen and trigger to new information Response events;
When the analysis result indicates that predetermined way, and the recognition of face knot are closed in the performance of a different dive on the head of active user When fruit indicates that active user's face is matched with the face characteristic of user bound in current device, solves lock screen but do not trigger to new The response events of message;Interface after the screen is unlocked is screen main interface.
The disclosure is by meeting the feelings of predetermined way in recognition of face success and headwork in the case where equipment locks Under condition, i.e. triggering facilitates user's checking or responding to new information to the response events of new information after unlock, is conducive to improve To the response efficiency of new information under screen locking.
According to the second aspect of an embodiment of the present disclosure, a kind of message back device is provided, comprising:
Module is obtained, is configured as: showing the event of new information in response to detecting, obtains the multiframe figure of active user Picture;
Processing module is configured as: being analyzed the multiple image, is obtained the movement of the physical feeling of active user Whether the analysis result of predetermined way is met;
Trigger module is configured as: when it is described analysis result indicate active user physical feeling movement meet it is predetermined When mode, the response events to the new information are triggered.
According to the third aspect of an embodiment of the present disclosure, a kind of electronic equipment is provided, comprising:
Processor;
Memory, for storing the computer program that can be executed by the processor;
Display, for showing new information;
Wherein, the step of any one of aforementioned the method is realized when the processor executes described program, and realize to institute State the control of the display state of display.
According to a fourth aspect of embodiments of the present disclosure, a kind of computer readable storage medium is provided, calculating is stored thereon with Machine program, the step of any one of aforementioned the method is realized when described program is executed by processor.
Since the device, electronic equipment and computer readable storage medium of the disclosure all cover the message back of the disclosure Method, therefore the device of the disclosure, electronic equipment and computer readable storage medium all include produced by aforementioned messages answering method Advantageous effects, details are not described herein.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.
Detailed description of the invention
Fig. 1 is a kind of disclosure flow chart of message back method shown according to an exemplary embodiment;
Fig. 2 is a kind of exhibition method schematic diagram of disclosure new information shown according to an exemplary embodiment;
Fig. 3 is interface schematic diagram when disclosure new information shown according to an exemplary embodiment is shown;
Fig. 4 is the interface schematic diagram after disclosure response new information shown according to an exemplary embodiment;
Fig. 5 is the interface schematic diagram when new information that the disclosure is shown according to another exemplary embodiment is shown;
Fig. 6 is the interface schematic diagram after the response new information that the disclosure is shown according to another exemplary embodiment;
Fig. 7 is the disclosure interface schematic diagram shown according to an exemplary embodiment being not responding to after new information;
Fig. 8 is the flow chart that the disclosure multiple image shown according to an exemplary embodiment to acquisition is analyzed;
Fig. 9 is interface signal when showing new information under disclosure screen lock state shown according to an exemplary embodiment Figure;
Figure 10 is to be not responding to the interface after new information after disclosure screen shown according to an exemplary embodiment is unlocked Schematic diagram;
Figure 11 is a kind of disclosure structure of the electronic equipment of message back device shown according to an exemplary embodiment Block diagram.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
It is only to be not intended to be limiting the disclosure merely for for the purpose of describing particular embodiments in the term that the disclosure uses. The "an" of the singular used in disclosure and the accompanying claims book, " described " and "the" are also intended to including majority Form, unless the context clearly indicates other meaning.It is also understood that term "and/or" used herein refers to and wraps It may be combined containing one or more associated any or all of project listed.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the disclosure A little information should not necessarily be limited by these terms.These terms are only used to for same type of information being distinguished from each other out.For example, not departing from In the case where disclosure range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ... When " or " in response to determination ".
Embodiment of the disclosure proposes a kind of new message back method, by being worked as based on user when new information is shown Analysis result corresponding to the movement of preceding physical feeling determines whether to respond new information, to reply or check new information;It realizes and uses Family is not necessarily to respond to the new information by the operation for clicking screen, relatively reduces the behaviour of new information described in user response Make difficulty, avoid system latency time longer, is conducive to improve message response efficiency, optimizes user experience.
As shown in Figure 1, Fig. 1 is a kind of disclosure process of message back method shown according to an exemplary embodiment Figure, the method can be used in terminal, comprising the following steps:
S100 shows the event of new information in response to detecting, obtains the multiple image of active user;
S200 analyzes the multiple image obtained in S100, obtain the physical feeling of active user movement whether Meet the analysis result of predetermined way;
S300, the analysis result obtained in the S200 indicate that the movement of the physical feeling of active user meets predetermined way When, trigger the response events to the new information.
Above-mentioned new information may include following one: the alert message or reminder message shown in a manner of pop-up is shown in The message on message column.Option is provided for user in short, needing to interact with user, and according to the user's choice after instruction progress The message of continuous processing can be used as above-mentioned new information.
Following situations can be considered using the event for detecting displaying new information: receive in terminal applies using PUSH message Or contact person's chat messages, or when detecting that web site url safety leaves a question open.For example, the case where user allows applicative notifications Under, 1) for news category application, the media event of server-side transmission generally can be all received, then is received newly in news category application After news event, new media event can be shown by the display screen of terminal, be equivalent to application at this time and detected displaying new information Event;2) for social category application, such as wechat, when receiving the new information of good friend, social category application can pass through the display of terminal Screen display new information, is equivalent at this time using the event for detecting displaying new information;3) it needs to open in all types of External linkage or by browser application open link when, apply when the safety for detecting current link leaves a question open, can pass through The display screen of terminal shows alert messages, is equivalent at this time using the event for detecting displaying new information.Wherein, when new information is When PUSH message or good friend's message, the new information can be shown in message column, it can also the exhibition in a manner of pop-up or message box Show the new information.And when new information is alert messages, the new information is shown in a manner of pop-up or message box;Message box or bullet It can be with the confirmation control and cancellation control of the remaining reply new information, as shown in Fig. 2, Fig. 2 is that the disclosure is shown according to one in window Example property implements a kind of exhibition method schematic diagram of the new information exemplified.
The multiple image can notify the operating system tune of equipment by applying when detecting the event for showing new information It is obtained with photographing module.
Predetermined way includes at least one of: for indicating that user needs to respond or check that the first of new information makes a reservation for move Make, for indicating that user does not need to respond or check the second predetermined action of new information.
In the present embodiment, the operation and image recognition operand, physical feeling replied message for simplified user can be head Portion is based on this, and the movement of predetermined way may include nodding and/or shaking the head.It follows that first predetermined action can be It nods, second predetermined action can be to shake the head.Or the combinative movement to nod and shaking the head, it is not intended to limit here.
However, physical feeling can be not limited to head in other variant embodiments, the movement of predetermined way is also not necessarily limited to It nods or shakes the head, for example, physical feeling can be replaced with to eye or mouth or shoulder.It correspondingly, need to be according to selected body Position and the movement for changing predetermined way --- when physical feeling is eye, the movement of predetermined way may include blink or close Eye;When physical feeling is mouth, the movement of predetermined way may include shutting up or opening one's mouth;When physical feeling is shoulder, in advance The movement for determining mode may include shrugging or pressing wing.
Above-mentioned analysis result can also be provided obtained by being analyzed by multiple image of the application based on acquisition by operating system Image processing module based on acquisition multiple image analyze gained.With the first predetermined action for nodding and shake the head second predetermined For movement, when the movement for recognizing user's head based on multiple image is to nod, analysis result is " nodding ";When based on more The movement of frame image recognition to user's head is when shaking the head, and analysis result is " shaking the head ";User is recognized when being based on multiple image The movement on head be it is static or in addition to nodding and shaking the head other movement when, analysis result can be " other ".
Hereinafter, movement in a predefined manner includes the first predetermined action and the second predetermined action, the first predetermined action are point Head and the second predetermined action are an illustratively wherein application example of disclosure the method for shaking the head:
When application receives PUSH message or good friend's message, or detect that web site url safety leaves a question open and by new information exhibition When being shown in the display screen of terminal, using the currently detected event for showing new information is considered as, so that operating system be notified to call The multiple image of photographing module acquisition active user.Operating system carries out figure by multiple image of the image processing module to acquisition As after identifying processing, will analysis result be sent to application (or the multiple image that operating system will acquire is sent to application, by Image recognition is carried out using to multiple image, obtains analysis result), determine whether triggering to newly disappearing based on the analysis results by application The response events of breath, or the response mode to new information.
After obtaining analysis result, determine whether that triggering disappears to PUSH message or good friend's message or warning based on the analysis results One of response events, including following scenario described of breath:
1) when analyzing result is " nodding ", indicate that the movement of the physical feeling of active user meets predetermined way, at this time Determine the response events of triggering new information.For example, when new information is PUSH message, in front stage operation and displaying and PUSH message Associated application interface, as shown in Figure 3 and Figure 4, when Fig. 3 is that disclosure new information shown according to an exemplary embodiment is shown Interface schematic diagram, Fig. 4 be the disclosure it is shown according to an exemplary embodiment response new information after interface schematic diagram;Its In, refer to that place is new information at the A of Fig. 3.When new information is good friend's message, in front stage operation and show and good friend's message pass Good friend's chat interface of connection;When new information is alert messages, the link that current interface is switched to alert messages direction is closed The interface of connection, as shown in Figure 5 and Figure 6, Fig. 5 are the boundaries when new information that the disclosure is shown according to another exemplary embodiment is shown Face schematic diagram;Fig. 6 is the interface schematic diagram after the response new information that the disclosure is shown according to another exemplary embodiment.Wherein, When the new information is alert messages, the effect for functioning as confirmation control of the analysis result as " nodding ".
2) when the analysis result is " shaking the head ", indicate that the movement of the physical feeling of active user meets predetermined way, The response events for not triggering new information are determined at this time, and current interface no longer shows new information.For example, when new information is that push disappears Breath or good friend's message or when alert messages, keep current operating conditions, and update message column or current interface so that message column or Current interface no longer shows new information, and as shown in Figure 3 and Figure 7, Fig. 7, which is that the disclosure is shown according to an exemplary embodiment, not to be rung Interface schematic diagram after answering new information.Wherein, when new information is alert messages, the effect phase of the analysis result as " shaking the head " When in the effect for cancelling control.
3) when the analysis result is " other ", indicate that predetermined party is closed in the performance of a different dive of the physical feeling of active user Formula does not trigger the response events to new information at this time, can keep current operating conditions and not execute any operation.For example, working as When new information is alert messages, the analysis result as " other " indicates that user does not make any response to this, will be current Interface keeps display new information.
In one embodiment, as shown in figure 8, Fig. 8 is that the disclosure is shown according to an exemplary embodiment to the more of acquisition The flow chart that frame image is analyzed.The step S200 may comprise steps of:
S201 identifies that the specific characteristic in multiple image, the specific characteristic are used to characterize the physical feeling of user.
S202 analyzes change in location of the specific characteristic identified in S201 in multiple image, generates analysis result.
Wherein, specific characteristic includes at least following one: facial contour feature point, eye feature point, mouth feature point, eyebrow Hair characteristic point, nose characteristic point.Wherein, the quantity of characteristic point is at least one.
In the step S201, after the specific characteristic for identifying every frame image, specific characteristic is recorded in the position of every frame image It sets.
Optionally, in the step S202, according to time sequencing, position of the specific characteristic in multiple image is analyzed Change procedure namely motion profile, to generate analysis result.
Hereinafter, movement in a predefined manner is to nod or illustrate for shaking the head the generating process of analysis result: when based on more The length travel of frame image recognition to the position of specific characteristic is greater than lateral displacement, and the length travel is greater than preset longitudinal threshold When value, the analysis result of generation is " nodding ".When the lateral displacement for the location parameter for recognizing specific characteristic based on multiple image Greater than length travel, and when the lateral displacement is greater than preset lateral threshold value, the analysis result of generation is " shaking the head ".Wherein, by When user nods, the motion amplitude of specific characteristic in the longitudinal direction on head is greater than motion amplitude horizontally;And it is shaking When head, the motion amplitude of specific characteristic horizontally on head is greater than motion amplitude in the longitudinal direction.It therefore, can be according to finger Determine the position of feature length travel and lateral displacement and generate analysis result.In addition, longitudinal threshold value and lateral threshold value can by with It presets or is empirically or experimentally preset by developer according to the actual situation in family.
The disclosure is analyzed by the change in location based on specific characteristic in multiple image as a result, being conducive to as a result, Reduce the operand of image recognition, improve image recognition efficiency and reduces requirement of the image recognition operation to hardware environment.
In one embodiment, based on the basis of embodiment shown in Fig. 8, the step S200 can also include following step It is rapid:
S203, when based on multiple image it is unidentified to the specific characteristic when, output reminds user that adjustment is relative to camera shooting The information of the position of head.
In this step, remind user's adjustment that can pass through voice module or display screen relative to the information of the position of camera Output.For example, by taking physical feeling is head as an example, when based on multiple image it is unidentified to specific characteristic when, voice module plays Content and the content that shows of display screen can be " head please be directed at camera ", to prompt user's adjustment relative to camera Position.
The disclosure is when being not detected specific characteristic as a result, by reminding user to adjust the corresponding body of specific characteristic Position of the position relative to camera, is conducive to the usable value for improving image obtained, is improved to a certain extent in this feelings Image recognition efficiency under condition.
In one embodiment, it is based on aforementioned any embodiment, the step S200 may comprise steps of:
S20a identifies that the specific characteristic in multiple image, the specific characteristic are used to characterize the head of user;
S20b analyzes change in location of the specific characteristic identified in S20a in multiple image, obtains the head of active user Portion acts the analysis result for whether meeting predetermined way;
S20c, judge user bound in the specific characteristic identified in S20a and current device face characteristic whether Match, obtains face recognition result.
The realization principle of the step S20a and S20b please respectively referring to the aforementioned explanation to the step S201 and S202, This will not be repeated here.Wherein, the face characteristic of active user can by application or operating system in multiple image any frame or Multiple image obtains after carrying out recognition of face processing.
Based on this, the being adapted to property of step S300 the following steps are included:
S301, when analysis result indicates that the movement on the head of active user meets predetermined way, and face recognition result table When showing that active user's face is matched with the face characteristic of user bound in current device, the response events to new information are triggered.
For example, when analysis result is " nodding " and face recognition result is " matching ", just response of the triggering to new information Event.
The disclosure herein in connection with face recognition result by determining whether triggering to new on the basis of analyzing result as a result, The response events of message realize no matter whether equipment is locked, only equipment owner are allowed to check or respond message, mentioned High security.
In one embodiment, to improve the response efficiency to new information under screen locking pattern, it is based on abovementioned steps S200 packet This embodiment of step S20a~S20c is included, under screen locking pattern, the message back method of the disclosure is further comprising the steps of:
S401: when analysis result indicates that the movement on the head of active user meets predetermined way, and face recognition result table When showing that active user's face is matched with the face characteristic of user bound in current device, solves lock screen and trigger to new information Response events;
S402: when analysis result indicates that predetermined way, and face recognition result are closed in the performance of a different dive on the head of active user It indicates active user's face when matching with the face characteristic of user bound in current device, solution lock screen but does not trigger to newly disappearing The response events of breath;Interface after screen is unlocked can be screen main interface.
Further, when analysis result indicates that the movement on the head of active user meets predetermined way, and recognition of face knot When fruit indicates that the face characteristic of user bound in active user's face and current device mismatches, alternatively, when analysis result table Show that predetermined way is closed in the performance of a different dive on the head of active user, and face recognition result indicates active user's face and current device When the face characteristic of bound user mismatches, lock screen is neither solved, does not also trigger the response events to new information.
In this embodiment, to simplify calculation step, preferably to improve image recognition efficiency, predetermined way can also be only Including for indicating that user needs to respond or check the predetermined action of new information, for example, nodding.
Before executing the step S401 and step S402, the step S100 and S200 need to be first carried out.Hereinafter, Briefly explain an application example of the message back method in the present embodiment:
As shown in figure 9, Fig. 9 is when showing new information under disclosure screen lock state shown according to an exemplary embodiment Interface schematic diagram, wherein place shown in B is new information in Fig. 9.In the case where screen locking, when detecting new information exhibition When the event shown, the multiple image of active user is obtained, and handle multiple image, obtains analysis result and recognition of face As a result.Wherein, when face recognition result is " matching ", then the event of unlocking screen can be triggered;Meanwhile if analysis result is " nodding ", then it represents that the headwork of user meets predetermined way, and the response events to new information are triggered after unlocking screen, And the associated interface of interface new information after being unlocked screen, as shown in Figure 4;If analyzing result is other than " nodding " When as a result, then it represents that the headwork of user does not meet predetermined way, does not trigger the response thing to new information after unlocking screen Part, the interface after screen is unlocked is screen main interface, and as shown in Figure 10, Figure 10 is that the disclosure is shown according to an exemplary embodiment Screen out is not responding to the interface schematic diagram after new information after being unlocked.However, when face recognition result is " mismatch ", nothing By how result is analyzed, all keeps screen locking and do not trigger the response events to new information.
The disclosure is by meeting predetermined party in recognition of face success and headwork in the case where equipment locks as a result, In the case where formula, i.e. triggering facilitates user's checking or responding to new information, is conducive to the response events of new information after unlock It improves under screen locking to the response efficiency of new information.
Corresponding with the embodiment of aforementioned messages answering method, the disclosure also provides a kind of message back device, is applied to In terminal, comprising:
Module is obtained, is configured as: showing the event of new information in response to detecting, obtains the multiframe figure of active user Picture;
Processing module is configured as: being analyzed the multiple image, is obtained the movement of the physical feeling of active user Whether the analysis result of predetermined way is met;
Trigger module is configured as: when it is described analysis result indicate active user physical feeling movement meet it is predetermined When mode, the response events to the new information are triggered.
In one embodiment, the processing module includes:
It identifies submodule, is configured as: identifying the specific characteristic in the multiple image, the specific characteristic is for characterizing The physical feeling of user.
Submodule is analyzed, is configured as: analyzing change in location of the specific characteristic in multiple image, generates described point Analyse result.
In one embodiment, it is based on the basis of previous embodiment, the processing module further include:
Remind submodule, be configured as: when based on the multiple image it is unidentified to the specific characteristic when, output is reminded User adjusts the information of the position relative to camera.
In one embodiment, the physical feeling is head, and the movement of the predetermined way includes nodding and/or shaking the head.
In another embodiment, the processing module includes:
It identifies submodule, is configured as: identifying the specific characteristic in the multiple image, the specific characteristic is for characterizing The head of user;
Submodule is analyzed, is configured as: being analyzed change in location of the specific characteristic in multiple image, currently used Whether the headwork at family meets the analysis result of predetermined way;
Recognition of face submodule, is configured as: judging the face of user bound in the specific characteristic and current device Whether feature matches, and obtains face recognition result.
The trigger module be also configured to when it is described analysis result indicate active user head movement meet it is predetermined Mode, and the face recognition result indicates that active user's face is matched with the face characteristic of user bound in current device When, trigger the response events to the new information.
In one embodiment, it is based on the basis of previous embodiment, the message back device further include:
First condition module, is configured as: under screen locking pattern, when the analysis result indicates the head of active user Movement meets predetermined way, and the face recognition result indicates the people of user bound in active user's face and current device When face characteristic matching, solves lock screen and trigger the response events to new information.
Second condition module, is configured as: under screen locking pattern, when the analysis result indicates the head of active user Predetermined way is closed in performance of a different dive, and the face recognition result indicates user's bound in active user's face and current device When face characteristic matches, solves lock screen but do not trigger the response events to new information;Interface after the screen is unlocked is screen Curtain main interface.
Due in the described device of the disclosure modules or submodule it is corresponding with message back method above-mentioned, therefore can The described device of the disclosure is illustrated according to message back method above-mentioned, herein without repeating.
Corresponding with the embodiment of aforementioned messages answering method, the disclosure additionally provides a kind of electronics of message back device Equipment, the electronic equipment include:
Processor;
Memory, for storing the computer program that can be executed by the processor;
Display, for showing new information;
Wherein, the step of the message back method of aforementioned any embodiment is realized when the processor executes described program Suddenly, and control to the display state of the display is realized.Wherein, the step includes:
The event that new information is shown in response to detecting, obtains the multiple image of active user;
The multiple image is analyzed, whether the movement for obtaining the physical feeling of active user meets predetermined way Analyze result;
When the movement of the physical feeling of the analysis result expression active user meets predetermined way, triggering is to described new The response events of message.
As shown in figure 11, Figure 11 is a kind of disclosure electronics of message back device shown according to an exemplary embodiment The structural block diagram of equipment.The electronic equipment 500 can be computer, mobile phone, digital broadcast terminal, and information receiving and transmitting is set It is standby, game console, tablet device, Medical Devices, body-building equipment, the terminal devices such as personal digital assistant.
Referring to Fig.1 1, electronic equipment 500 may include following one or more components: processing component 501, memory 502, Power supply module 503, multimedia component 504, audio component 505, the interface 506 of input/output (I/O), sensor module 507, And communication component 508.
The integrated operation of the usual controlling electronic devices 500 of processing component 501, such as with display, call, data are logical Letter, camera operation and record operate associated operation.Processing component 501 may include one or more processors 509 to hold Row instruction, to perform all or part of the steps of the methods described above.In addition, processing component 501 may include one or more moulds Block, convenient for the interaction between processing component 501 and other components.For example, processing component 501 may include multi-media module, with Facilitate the interaction between multimedia component 504 and processing component 501.
Memory 502 is configured as storing various types of data to support the operation in electronic equipment 500.These data Example include any application or method for being operated on electronic equipment 500 instruction, contact data, telephone directory Data, message, picture, video etc..Memory 502 can by any kind of volatibility or non-volatile memory device or it Combination realize, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM) is erasable Except programmable read only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, fastly Flash memory, disk or CD.
Power supply module 503 provides electric power for the various assemblies of electronic equipment 500.Power supply module 503 may include power supply pipe Reason system, one or more power supplys and other generates, managees, and distributes the associated component of electric power with for electronic equipment 500.
Multimedia component 504 includes the screen of one output interface of offer between the electronic equipment 500 and user. The screen may include touch panel (TP), be implemented as touch screen, to receive input signal from the user.Touch panel Including one or more touch sensors to sense the gesture on touch, slide, and touch panel.The touch sensor can be with The boundary of a touch or slide action is not only sensed, but also detects duration associated with the touch or slide operation and pressure Power.In some embodiments, multimedia component 504 includes a front camera and/or rear camera.Work as electronic equipment 500 are in operation mode, and such as in a shooting mode or a video mode, front camera and/or rear camera can receive outside Multi-medium data.Each front camera and rear camera can be a fixed optical lens system or have focal length And optical zoom ability.
Audio component 505 is configured as output and/or input audio signal.For example, audio component 505 includes a Mike Wind (MIC), when electronic equipment 500 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone It is configured as receiving external audio signal.The received audio signal can be further stored in memory 502 or via logical Believe that component 508 is sent.In some embodiments, audio component 505 further includes a loudspeaker, is used for output audio signal.
I/O interface 502 provides interface between processing component 501 and peripheral interface module, and above-mentioned peripheral interface module can To be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and lock Determine button.
Sensor module 507 includes one or more sensors, for providing the state of various aspects for electronic equipment 500 Assessment.For example, sensor module 507 can detecte the state that opens/closes of electronic equipment 500, the relative positioning of component, example As the component be electronic equipment 500 display and keypad, sensor module 507 can also detect electronic equipment 500 or The position change of 500 1 components of electronic equipment, the existence or non-existence that user contacts with electronic equipment 500, electronic equipment 500 The temperature change of orientation or acceleration/deceleration and electronic equipment 500.Sensor module 507 may include proximity sensor, be configured For detecting the presence of nearby objects without any physical contact.Sensor module 507 can also include optical sensor, Such as CMOS or ccd image sensor, for being used in imaging applications.In some embodiments, which may be used also To include acceleration transducer, gyro sensor, Magnetic Sensor, pressure sensor, temperature sensor, photoelectric sensor or GPS sensor.
Communication component 508 is configured to facilitate the communication of wired or wireless way between electronic equipment 500 and other equipment. Electronic equipment 500 can access the wireless network based on communication standard, such as WiFi, 2G, 3G or 4G or their combination.One In a exemplary embodiment, communication component 508 via broadcast channel receive broadcast singal from external broadcasting management system or Broadcast related information.In one exemplary embodiment, the communication component 508 further includes near-field communication (NFC) module, to promote Into short range communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wide can be based in NFC module Band (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, electronic equipment 500 can be by one or more application specific integrated circuit (ASIC), number Word signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electron component are realized, for executing the above method.
The function of each unit and the realization process of effect are specifically detailed in the above method corresponding step in above-mentioned electronic equipment Rapid realization process, details are not described herein.
For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality Apply the part explanation of example.For electronic equipment embodiment, electronic equipment embodiment described above is only to show Meaning property, wherein the unit as illustrated by the separation member may or may not be physically separated, as list The component of member display may or may not be physical unit, it can and it is in one place, or may be distributed over In multiple network units.Some or all of the modules therein can be selected to realize disclosure scheme according to the actual needs Purpose.Those of ordinary skill in the art can understand and implement without creative efforts.
Corresponding with the embodiment of aforementioned messages answering method, the disclosure also provides a kind of computer readable storage medium, It is stored thereon with computer program, which realizes the message back side when being executed by the processor 509 of above-mentioned electronic equipment The step of method, comprising:
The event that new information is shown in response to detecting, obtains the multiple image of active user;
The multiple image is analyzed, whether the movement for obtaining the physical feeling of active user meets predetermined way Analyze result;
When the movement of the physical feeling of the analysis result expression active user meets predetermined way, triggering is to described new The response events of message.
It wherein includes storage medium (the including but not limited to disk of program code that the disclosure, which can be used in one or more, Memory, CD-ROM, optical memory etc.) on the form of computer program product implemented.Computer-usable storage medium packet Permanent and non-permanent, removable and non-removable media is included, can be accomplished by any method or technique information storage.Letter Breath can be computer readable instructions, data structure, the module of program or other data.The example packet of the storage medium of computer Include but be not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), Other kinds of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices or any other non-biography Defeated medium, can be used for storage can be accessed by a computing device information.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure Its embodiment.The disclosure is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.
The foregoing is merely the preferred embodiments of the disclosure, not to limit the disclosure, all essences in the disclosure Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of disclosure protection.

Claims (12)

1. a kind of message back method, which is characterized in that the described method includes:
The event that new information is shown in response to detecting, obtains the multiple image of active user;
The multiple image is analyzed, whether the movement for obtaining the physical feeling of active user meets the analysis of predetermined way As a result;
When the movement of the physical feeling of the analysis result expression active user meets predetermined way, trigger to the new information Response events.
2. the method according to claim 1, wherein the step of analyzing the multiple image, comprising:
Identify that the specific characteristic in the multiple image, the specific characteristic are used to characterize the physical feeling of user;
Change in location of the specific characteristic in multiple image is analyzed, the analysis result is generated.
3. according to the method described in claim 2, it is characterized in that, the step of analyzing the multiple image, further includes:
When based on the multiple image it is unidentified to the specific characteristic when, output reminds user to adjust the position relative to camera The information set.
4. the predetermined way moves the method according to claim 1, wherein the physical feeling is head Make to include nodding and/or shaking the head.
5. according to the method described in claim 4, obtaining active user it is characterized in that, analyze the multiple image The movement of physical feeling whether meet the analysis result of predetermined way, comprising:
Identify that the specific characteristic in the multiple image, the specific characteristic are used to characterize the head of user;
Analyze change in location of the specific characteristic in multiple image, obtain active user headwork whether meet it is predetermined The analysis result of mode;And
Judge whether the specific characteristic matches with the face characteristic of user bound in current device, obtains recognition of face knot Fruit;
When the movement of the physical feeling of the analysis result expression active user meets predetermined way, trigger to the new information Response events, comprising:
When the analysis result indicates that the movement on the head of active user meets predetermined way, and face recognition result expression When active user's face is matched with the face characteristic of user bound in current device, the response thing to the new information is triggered Part.
6. according to the method described in claim 5, it is characterized in that, under screen locking pattern, the method also includes:
When the analysis result indicates that the movement on the head of active user meets predetermined way, and face recognition result expression When active user's face is matched with the face characteristic of user bound in current device, solves lock screen and trigger the sound to new information Answer event;
When the analysis result indicates that predetermined way, and the face recognition result table are closed in the performance of a different dive on the head of active user When showing that active user's face is matched with the face characteristic of user bound in current device, solves lock screen but do not trigger to new information Response events;Interface after the screen is unlocked is screen main interface.
7. a kind of message back device characterized by comprising
Module is obtained, is configured as: showing the event of new information in response to detecting, obtains the multiple image of active user;
Processing module is configured as: the multiple image is analyzed, obtain the physical feeling of active user movement whether Meet the analysis result of predetermined way;
Trigger module is configured as: when the analysis result indicates that the movement of the physical feeling of active user meets predetermined way When, trigger the response events to the new information.
8. device according to claim 7, which is characterized in that the processing module includes:
It identifies submodule, is configured as: identifying the specific characteristic in the multiple image, the specific characteristic is for characterizing user Physical feeling;
Submodule is analyzed, is configured as: analyzing change in location of the specific characteristic in multiple image, generates the analysis knot Fruit.
9. device according to claim 8, which is characterized in that the processing module further include:
Remind submodule, be configured as: when based on the multiple image it is unidentified to the specific characteristic when, user is reminded in output Adjust the information of the position relative to camera.
10. device according to claim 7, which is characterized in that the physical feeling is head, and the predetermined way moves Make to include nodding and/or shaking the head.
11. device according to claim 10, which is characterized in that the processing module includes:
It identifies submodule, is configured as: identifying the specific characteristic in the multiple image, the specific characteristic is for characterizing user Head;
Submodule is analyzed, is configured as: being analyzed change in location of the specific characteristic in multiple image, obtain active user's Whether headwork meets the analysis result of predetermined way;
Recognition of face submodule, is configured as: judging the face characteristic of user bound in the specific characteristic and current device Whether match, obtains face recognition result;
The trigger module is also configured to
When the analysis result indicates that the movement on the head of active user meets predetermined way, and face recognition result expression When active user's face is matched with the face characteristic of user bound in current device, the response thing to the new information is triggered Part.
12. device according to claim 11, which is characterized in that further include:
First condition module, is configured as: under screen locking pattern, when the analysis result indicates the movement on the head of active user Meet predetermined way, and the face recognition result indicates that the face of user bound in active user's face and current device is special When sign matching, solves lock screen and trigger the response events to new information;
Second condition module, is configured as: under screen locking pattern, when the analysis result indicates the movement on the head of active user Predetermined way is not met, and the face recognition result indicates the face of user bound in active user's face and current device When characteristic matching, solves lock screen but do not trigger the response events to new information;
Interface after the screen is unlocked is screen main interface.
CN201811142247.1A 2018-09-28 2018-09-28 Message back method and apparatus Pending CN109343710A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811142247.1A CN109343710A (en) 2018-09-28 2018-09-28 Message back method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811142247.1A CN109343710A (en) 2018-09-28 2018-09-28 Message back method and apparatus

Publications (1)

Publication Number Publication Date
CN109343710A true CN109343710A (en) 2019-02-15

Family

ID=65307497

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811142247.1A Pending CN109343710A (en) 2018-09-28 2018-09-28 Message back method and apparatus

Country Status (1)

Country Link
CN (1) CN109343710A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112748970A (en) * 2019-10-31 2021-05-04 华为技术有限公司 Message display method and terminal equipment
CN113285867A (en) * 2021-04-28 2021-08-20 青岛海尔科技有限公司 Method, system, device and equipment for message reminding

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003228449A (en) * 2002-02-01 2003-08-15 Sharp Corp Interactive apparatus and recording medium with recorded program
CN103002099A (en) * 2012-11-06 2013-03-27 广东欧珀移动通信有限公司 Method and device for operating 'yes or no' dialog box
CN104836897A (en) * 2015-03-31 2015-08-12 小米科技有限责任公司 Method and device for controlling terminal communication through wearable device
CN108521505A (en) * 2018-03-27 2018-09-11 维沃移动通信有限公司 A kind of incoming call processing method and mobile terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003228449A (en) * 2002-02-01 2003-08-15 Sharp Corp Interactive apparatus and recording medium with recorded program
CN103002099A (en) * 2012-11-06 2013-03-27 广东欧珀移动通信有限公司 Method and device for operating 'yes or no' dialog box
CN104836897A (en) * 2015-03-31 2015-08-12 小米科技有限责任公司 Method and device for controlling terminal communication through wearable device
CN108521505A (en) * 2018-03-27 2018-09-11 维沃移动通信有限公司 A kind of incoming call processing method and mobile terminal

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112748970A (en) * 2019-10-31 2021-05-04 华为技术有限公司 Message display method and terminal equipment
CN112748970B (en) * 2019-10-31 2023-11-21 华为技术有限公司 Message display method and terminal equipment
CN113285867A (en) * 2021-04-28 2021-08-20 青岛海尔科技有限公司 Method, system, device and equipment for message reminding
CN113285867B (en) * 2021-04-28 2023-08-22 青岛海尔科技有限公司 Method, system, device and equipment for message reminding

Similar Documents

Publication Publication Date Title
CN104063655B (en) A kind of method and apparatus handling child mode
CN105120122A (en) Alarm method and device
CN105049269B (en) information feedback method and device
CN104767860B (en) Income prompting method, device and terminal
CN108668080A (en) Prompt method and device, the electronic equipment of camera lens degree of fouling
CN109842612B (en) Log security analysis method and device based on graph library model and storage medium
CN105677023B (en) Information demonstrating method and device
US20140120872A1 (en) Systems and methods for altering the properties of a mobile device in response to a make ready signal
CN105141758A (en) Terminal control method and device
CN108536996A (en) Method, apparatus, storage medium and intelligent baby bed are slept in automatic roars of laughter
CN109039877A (en) A kind of method, apparatus, electronic equipment and storage medium showing unread message quantity
WO2018141409A1 (en) Initiating a control operation in response to a head gesture
CN106021077A (en) Warning method and device of terminal
CN109903765A (en) Sound control method and device
CN110135349A (en) Recognition methods, device, equipment and storage medium
CN109343710A (en) Message back method and apparatus
CN106453058A (en) Information pushing method and apparatus
CN104378596B (en) A kind of method and device carrying out distance communicating with picture pick-up device
CN106534551B (en) Information display method and device
CN104364736A (en) Electronic device
CN106375178A (en) Message display method and device based on instant messaging
CN106774815B (en) Touch gestures determine method and device
WO2021244058A1 (en) Process execution method, device, and readable medium
CN104363166B (en) Instant communicating method, device and intelligent terminal
CN109450894A (en) Information interacting method, device, system, server user's terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination