WO2017185728A1 - 按键操作的识别方法和装置 - Google Patents

按键操作的识别方法和装置 Download PDF

Info

Publication number
WO2017185728A1
WO2017185728A1 PCT/CN2016/106970 CN2016106970W WO2017185728A1 WO 2017185728 A1 WO2017185728 A1 WO 2017185728A1 CN 2016106970 W CN2016106970 W CN 2016106970W WO 2017185728 A1 WO2017185728 A1 WO 2017185728A1
Authority
WO
WIPO (PCT)
Prior art keywords
mobile terminal
button
determining
state value
key operation
Prior art date
Application number
PCT/CN2016/106970
Other languages
English (en)
French (fr)
Inventor
赵金
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017185728A1 publication Critical patent/WO2017185728A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Definitions

  • the present invention relates to the field of communications, and in particular to a method and apparatus for identifying a button operation.
  • the user In the process of using the mobile terminal normally, the user often accidentally touches the button of the mobile terminal (for example, an external physical button), causing trouble to the user, for example, in the most commonly used mobile terminal, the mobile phone, when the external physical button of the mobile phone is relatively soft and In the case of the side of the phone, sometimes when the user walks with the phone, the user accidentally presses the physical button. In this case, the mobile phone often restarts, shuts down or the volume is inexplicably increased or decreased without the user's knowledge, which causes great trouble for the user to use the mobile phone.
  • the usual practice is that the physical operation of the external physical button of the mobile phone is through physical protection measures.
  • the manner provided above is performed by means of hardware.
  • the measures improved by the above hardware methods can solve the inconvenience caused by the physical button mis-touch to a certain extent, for the designer, it is often necessary to consider the cost problem caused by changing the hardware structure.
  • the use of hardware is obviously not as flexible as software processing.
  • the use of a protective cover, or increase the hardness of the physical button, increase the keystrokes of the physical button and other hardware methods will also cause the appearance of the mobile phone is not beautiful, affecting the user experience.
  • the embodiment of the invention provides a method and a device for identifying a button operation, so as to at least solve the problem that the design cost of the mobile terminal is high, the processing method is inflexible, and the user experience is poor, which is caused by the hardware method for solving the problem of the user operating the button. problem.
  • a method for identifying a key operation comprising: receiving a button trigger message for a mobile terminal; acquiring a status value of the mobile terminal, and detecting a facial feature of the current user, wherein the The state value is used to indicate the motion state of the mobile terminal relative to the current user; determine whether the state value is less than a preset threshold, and whether the facial feature is detected; and determine, according to the determination result, that the button trigger message corresponds to Whether the button operation is a valid button operation.
  • the method includes: indicating, in the determining result, that the state value is less than the preset threshold, and detecting the Determining that the button operation is an effective button operation when the facial feature is determined; determining that the button operation is an invalid button when the determination result indicates that the state value is greater than the preset threshold and/or the facial feature is not detected operating.
  • the method further includes: performing a button operation corresponding to the button trigger message.
  • the determining whether the status value is less than a preset threshold, and whether the facial feature is detected includes: detecting a facial feature of the current user when the status value is less than the preset threshold.
  • the acquiring the state value of the mobile terminal includes: acquiring an acceleration value collected by the mobile terminal by using a gravity sensor, and using the acceleration value as the state value.
  • the method further includes: acquiring eyeprint information of the current user; Matching with the eyelet information saved in the mobile terminal; determining, according to the matching result, whether the button operation corresponding to the button trigger message is a valid button operation.
  • a device for identifying a button operation comprising: a receiving module configured to receive a button trigger message for the mobile terminal; and a first acquiring module configured to acquire a status value of the mobile terminal And detecting a facial feature of the current user; wherein the state value is used to indicate a motion state of the mobile terminal relative to the current user; and the determining module is configured to determine whether the state value is less than a preset threshold, and whether Detected And a determining module, configured to determine, according to the determination result, whether the key operation corresponding to the button trigger message is a valid key operation.
  • the determining module is further configured to: when the determination result indicates that the state value is less than the preset threshold, and when the facial feature is detected, determine that the button operation is an effective button operation; When the determination result indicates that the state value is greater than the preset threshold and/or the facial feature is not detected, determining that the button operation is an invalid button operation.
  • the device further includes: a second acquiring module, configured to acquire the eye pattern information of the current user; and a matching module configured to match the eye pattern information and the eye pattern information saved in the mobile terminal.
  • a second acquiring module configured to acquire the eye pattern information of the current user
  • a matching module configured to match the eye pattern information and the eye pattern information saved in the mobile terminal.
  • a mobile terminal including: a gravity sensor, an image capturing device, and a processor; the gravity sensor is configured to collect an acceleration value of the mobile terminal, and the acceleration value is Transmitting to the processor as a status value, wherein the status value is used to indicate a motion state of the mobile terminal relative to the current user; the image collection device is configured to collect a facial feature of the current user; The processor is configured to receive a button trigger message for the mobile terminal, acquire the state value sent by the gravity sensor, and detect the facial feature; determine whether the state value is less than a preset threshold and whether it is detected The facial feature determines whether the key operation corresponding to the button trigger message is a valid key operation according to the determination result.
  • a storage medium is also provided.
  • the storage medium is configured to store program code for: receiving a button trigger message for the mobile terminal; acquiring a status value of the mobile terminal, and detecting a facial feature of the current user, wherein the status value is for indicating a state of the movement of the mobile terminal relative to the current user; determining whether the state value is less than a preset threshold, and whether the facial feature is detected; determining, according to the determination result, whether the button operation corresponding to the button trigger message is Effective key operation.
  • the storage medium is further configured to store program code for: acquiring the eyeprint information of the current user; matching the eyeprint information with the eyeprint information saved in the mobile terminal; The matching result determines that the button operation corresponding to the button trigger message is No is a valid button operation.
  • the button operation is a valid button by determining whether the state value for indicating the motion state of the mobile terminal with respect to the current user is less than a preset threshold and whether the facial feature of the current user is detected.
  • the software can be used to judge whether the current key operation is effective, so that the problem of high design cost, inflexible processing mode and poor user experience caused by the hardware problem of solving the user's misoperation key problem caused by the related art can be solved. Achieve simple and flexible implementation, low cost and good user experience.
  • FIG. 1 is a block diagram showing the hardware structure of a mobile terminal for identifying a key operation method according to an embodiment of the present invention
  • FIG. 2 is a flow chart of a method for identifying a key operation according to an embodiment of the present invention
  • FIG. 3 is a flow chart of another method for identifying a key operation according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of still another method for identifying a button operation according to an embodiment of the present invention.
  • FIG. 5 is a structural block diagram of an apparatus for identifying a key operation according to an alternative embodiment of the present invention.
  • FIG. 6 is a block diagram showing the structure of another type of key recognition device according to an alternative embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a mobile terminal according to an alternative embodiment of the present invention.
  • FIG. 1 is a hardware structural block diagram of a mobile terminal for identifying a key operation method according to an embodiment of the present invention.
  • the mobile terminal 10 may include one or more (only one shown) processor 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA).
  • FIG. 1 is merely illustrative and does not limit the structure of the above electronic device.
  • the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.
  • the memory 104 can be used to store software programs and modules of the application software, such as program instructions/modules corresponding to the identification method of the key operation in the embodiment of the present invention, and the processor 102 executes by executing the software program and the module stored in the memory 104.
  • Memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory; in some examples, memory 104 may further include processing relative to processing
  • the memory 102 is remotely set up and can be connected to the mobile terminal 10 via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Transmission device 106 is for receiving or transmitting data via a network.
  • the above-described network specific example may include a wireless network provided by a communication provider of the mobile terminal 10.
  • the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet.
  • the transmission device 106 can be a radio frequency (RF) module for passing Communicate wirelessly with the Internet.
  • NIC Network Interface Controller
  • RF radio frequency
  • FIG. 2 is a flowchart of a method for identifying a button operation according to an embodiment of the present invention. As shown in FIG. Including steps S202-S208:
  • Step S202 receiving a button trigger message for the mobile terminal
  • the button trigger message here may be a trigger message for a physical button or a trigger message for a virtual button.
  • Step S204 Acquire a state value of the mobile terminal, and detect a facial feature of the current user, where the state value is used to indicate a motion state of the mobile terminal relative to the current user;
  • the state value of the mobile terminal may be an acceleration value or a moving rate, etc., wherein for the former, the following form may be expressed: the acceleration value of the mobile terminal relative to the user motion is collected by using a gravity sensor inside the mobile terminal.
  • the facial features may be automatically triggered by the software, that is, the user does not need to manually turn on, but automatically triggers the movement after receiving the button triggering message for the mobile terminal.
  • the software that is, the user does not need to manually turn on, but automatically triggers the movement after receiving the button triggering message for the mobile terminal.
  • the facial features of the current user may be acquired by using an image capturing device (eg, a front camera), and the facial features are detected.
  • the image acquisition device can collect facial feature parameters such as gray feature points, light intensity, and angle of the current user's face; and can also collect the contour of the current user's face; or collect facial features such as facial features, tibia, and chin. And the relative positional relationship between the plurality of face parts.
  • Step S206 determining whether the state value is less than a preset threshold, and whether the facial feature is detected.
  • the two determining conditions in the foregoing determining process (that is, whether the state value is less than a preset threshold; whether the facial feature is detected) need to be considered together to determine a button corresponding to the button trigger message. Whether the operation is a valid button operation.
  • the preset threshold can be regarded as a state value when the mobile terminal is in a stationary state or in a motion state in which the acceleration is low. It should be noted that the preset threshold is not a fixed value, but can be flexibly set according to actual conditions, for example, a value adjusted according to user operation habits.
  • the detected facial feature is a complete facial image
  • the face recognition parameter is collected to reach a threshold for identifying a complete facial image, or the collected facial contour is complete, or multiple facial regions are successfully collected. And the relative positional relationship is reasonable, then it can be considered that the facial features are detected.
  • the step of determining whether the state value is less than a preset threshold and determining whether the facial feature is detected has no obvious sequence.
  • it may be determined whether the state value is less than a preset threshold, and then determining whether the facial feature is detected; or determining whether the facial feature is detected, and determining whether the state value is smaller than
  • the threshold is preset; of course, the two judgment processes can also be performed simultaneously.
  • it is determined whether the state value is less than a preset threshold, and then determining whether the facial feature is detected, so that when the mobile terminal frequently detects facial features, The problem of wasting resources. For example, saving memory usage of the mobile terminal processor; and reducing power consumption when detecting facial features.
  • Step S208 determining, according to the determination result, whether the button operation corresponding to the button trigger message is a valid button operation.
  • FIG. 3 is a flowchart of another method for identifying a key operation according to an embodiment of the present invention.
  • step S208 may be implemented by using steps S302-S304 in FIG. 3:
  • Step S302 when the determination result indicates that the state value is less than the preset threshold, and the facial feature is detected, determining that the button operation is an effective button operation;
  • the mobile terminal After the determining that the button operation is an effective button operation, the mobile terminal performs a button operation corresponding to the button trigger message, that is, the button operation instruction is sent to the button.
  • Step S304 determining that the button operation is an invalid button operation when the determination result indicates that the state value is greater than the preset threshold and/or the facial feature is not detected.
  • the mobile terminal After determining that the button operation is an invalid button operation, the mobile terminal will not perform any button operation, and the button will not receive the button operation instruction issued by the mobile terminal at the same time.
  • the present embodiment further provides a security-based key operation recognition method.
  • 4 is a flow chart of still another method of identifying a button operation in accordance with an embodiment of the present invention. As shown in FIG. 4, after step 206, the method further includes:
  • Step S402 acquiring eyelet information of the current user
  • the eyeprint information of the current user may be collected by an eyeprint collecting device (for example, a front camera).
  • an eyeprint collecting device for example, a front camera
  • Step S404 matching the eye pattern information with the eye pattern information saved in the mobile terminal
  • the eye pattern information stored in the memory of the mobile terminal is legal eye pattern information collected by the eye pattern collecting device.
  • the legal eye pattern information is eye pattern information of a legitimate user who is allowed to access the mobile terminal and is saved inside the mobile terminal.
  • Step S406 determining, according to the matching result, whether the button operation corresponding to the button trigger message is a valid button operation
  • step S406 the following steps may be taken to implement:
  • the button operation is an invalid key operation.
  • the mobile terminal When the user using the mobile terminal is walking, the user accidentally touches a button on the mobile terminal; in this case, the mobile terminal receives the button trigger message triggered by the button; at this time, the mobile terminal The state value of the mobile terminal in the current user's hand is obtained; at the same time, the relationship between the current state value and the preset threshold value is judged; it is easy to understand that the user often changes the motion state during the walking process, so the mobile The status value of the terminal during the movement is greater than the preset threshold; in this scenario, the mobile terminal does not detect the current user's facial features, but determines that the current key operation is an invalid key operation; therefore, the key is also The button operation instruction issued by the mobile terminal will not be received.
  • the mobile terminal When the user does not need to use the mobile terminal, the mobile terminal is often placed in the pocket of the clothes or the backpack carried; in this case, the keys of the mobile terminal are easily triggered by the items carried in the pocket or the backpack.
  • the button when the current user changes his or her own posture, the button may be triggered by mistake; if the current user is walking, then reference may be made to scene one, because the state value is greater than the preset threshold, the facial features of the current user are not detected. In the case, it is determined that the current key operation is an invalid key operation. If the current user is in a stationary state or a very slow motion state, the state value of the mobile terminal is less than a preset threshold.
  • the image acquisition device will then collect the facial features of the current user; since the mobile terminal is located in a pocket or backpack, the mobile terminal does not detect the facial features of the current user. In this scenario, the mobile terminal determines that the current key operation is an invalid key operation; therefore, the key does not receive the key operation indication issued by the mobile terminal.
  • the mobile terminal When a user uses a mobile terminal, the mobile terminal may be lost or the mobile terminal may be stolen by others when the user is not paying attention; in general, the operation of turning on and unlocking the screen is implemented by operating a button; The user and the legitimate user can also satisfy the condition that the state value of the mobile terminal is less than the preset threshold and the facial feature is detected; at this time, the eye pattern collecting device collects the eye pattern information of the current user; the mobile terminal according to the collected Eye pattern The information matches the legal eye pattern information stored in itself. When the collected eye pattern information is inconsistent with the legal eye pattern information stored in the mobile terminal, the mobile terminal determines that the current user is an illegal user. In this scenario, the mobile terminal determines that the current key operation is an invalid key operation. The button will not receive the button operation instruction issued by the mobile terminal. Therefore, the operation of turning on the button and unlocking the screen will not be triggered, thereby preventing the illegal user from using the mobile terminal and improving the security of the mobile terminal.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
  • an identification device for the operation of the button is provided, and the device is used to implement the above-mentioned embodiments and preferred embodiments, and the detailed description thereof has been omitted.
  • the term “module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 5 is a structural block diagram of an apparatus for identifying a key operation according to an embodiment of the present invention. As shown in FIG. 5, the apparatus includes a receiving module 52, a first obtaining module 54, a determining module 56, and a determining module 58:
  • the receiving module 52 is configured to receive a button trigger message for the mobile terminal
  • the first obtaining module 54 is connected to the receiving module 52, configured to acquire a state value of the mobile terminal, and detect a facial feature of the current user, where the state value is used to indicate that the mobile terminal is relative to the current user State of motion;
  • the state value of the mobile terminal can be regarded as collecting an acceleration value of the mobile terminal relative to the user motion by using a gravity sensor inside the first acquisition module 54.
  • the first acquiring module automatically detects the facial feature of the current user, and does not require other instructions of the user to trigger.
  • the first obtaining module 54 further includes: an image capturing device (not shown in the figure, such as a front camera) configured to collect facial features of the current user for detection.
  • the image acquisition device can collect facial recognition parameters such as gray feature points, light intensity, and angle of the current user; and can also collect the contour of the current user's face; or collect facial features such as facial features, tibia, chin, and the like. The relative positional relationship between the facial parts.
  • the determining module 56 is connected to the first obtaining module 54 and configured to determine whether the state value is less than a preset threshold, and whether the facial feature is detected;
  • the preset threshold can be regarded as a state value when the mobile terminal is in a stationary state or in a low-speed motion state. It should be noted that the preset threshold is not a fixed value, but can be flexibly set according to actual conditions, for example, a value adjusted according to user operation habits.
  • the detected facial feature is a complete facial image
  • the face recognition parameter is collected to reach a threshold for identifying a complete facial image, Or if the acquired face contour is complete, or multiple face parts are successfully collected and the relative positional relationship is reasonable, then it can be considered that the facial features are detected.
  • the determining module 56 further includes a state value determining unit and a detecting unit.
  • the state value determining unit is configured to determine whether the state value is less than a preset threshold, and the detecting unit is configured to determine whether the facial feature is detected.
  • the connection relationship between the state value judging unit and the detecting unit can be adjusted according to the needs of the user. That is, the state value may be first input to the state value judging unit, and then the detecting unit may determine whether the facial feature is detected, or the detecting unit may first determine whether the facial feature is detected, and then input the state value to the state value judging unit, and simultaneously It is also possible to determine, by the detecting unit, whether the facial feature is detected and the state value is first input to the state value determining unit.
  • this embodiment it is determined whether the state value is less than a preset threshold. And then to determine whether the facial features are detected. This can avoid the problem of wasting resources when the mobile terminal frequently detects facial features. For example, saving memory usage of the mobile terminal processor; and reducing power consumption when detecting facial features.
  • the determining module 58 is connected to the determining module 56, and is configured to determine, according to the determining result, whether the button operation corresponding to the button triggering message is a valid button operation.
  • the determining module 58 instructs the button operation to be a valid button operation. At this time, the determining module 58 will perform a button operation corresponding to the button trigger message, that is, the button operation instruction is sent to the button.
  • the determining module 58 instructs the button operation to be an invalid key operation. At this time, the determination module 58 will not perform any key operation, and the key will not receive the key operation indication issued by the determination module.
  • FIG. 6 is a structural block diagram of another type of key operation identifying apparatus according to an embodiment of the present invention. As shown in FIG. 6, the apparatus includes a second acquiring module 62 and matching, in addition to all the modules shown in FIG. Module 64:
  • the second obtaining module 62 is connected to the determining module 56, and configured to acquire the eye pattern information of the current user;
  • the second obtaining module 62 further includes an eye pattern collecting device (for example, a front camera) configured to collect eye contour information of the current user.
  • an eye pattern collecting device for example, a front camera
  • the matching module 64 is connected to the second obtaining module 62 and the determining module 58 and configured to match the eye pattern information and the eye pattern information saved in the mobile terminal.
  • the matching module 64 further includes: a storage unit.
  • the storage unit is configured to store legal eye pattern information.
  • the legal eye pattern information is eye pattern information of a legitimate user who is allowed to access the mobile terminal.
  • the matching module 64 sends the matching result to the determining module 58.
  • the determining module 58 determines whether the key operation corresponding to the button trigger message is a valid key operation.
  • the matching result indicates that the eye pattern information is consistent with the eye pattern information saved in the storage unit
  • the determining module 58 determines that the button operation is a valid button operation; and the matching result indicates that the eye pattern information is saved in the storage unit
  • the determination module 58 determines that the key operation is an invalid key operation.
  • the mobile terminal can be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, an applause computer, and a mobile Internet device (Mobile Internet Devices). , MID), PAD and other terminal devices. 5 and 6 do not limit the structure of the above electronic device.
  • the mobile terminal may also include more or fewer components (such as a network interface, display device, etc.) than shown in Figures 5 and 6, or have a different configuration than that shown in Figures 5 and 6.
  • each of the above modules can be implemented by software or hardware.
  • the latter can be implemented in the following manner, but is not limited thereto: the above modules are all located in the same processor; or, the above modules are respectively located in different processors in any combination.
  • FIG. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. As shown in FIG. 7, the mobile terminal 70 includes: a gravity sensor 702, an image collection device 704, and a processor 706:
  • the gravity sensor 702 is configured to collect an acceleration value of the mobile terminal, and send the acceleration value to the processor as a status value, where the status value is used to indicate that the mobile terminal is relative to the current The state of motion of the user;
  • the image collection device 704 is configured to collect facial features of the current user
  • the image collection device 704 can collect facial feature parameters such as gray feature points, light intensity, and angle of the current user; and can also collect the contour of the current user's face; or collect facial features, tibia, chin, and the like. The relative positional relationship between the face part and the plurality of face parts.
  • the processor 706 is connected to the gravity sensor 702 and the image collection device 704, configured to receive a button trigger message for the mobile terminal, acquire the status value sent by the gravity sensor, and detect the facial feature; Whether the state value is less than the preset threshold and whether the facial feature is detected; determining whether the key operation corresponding to the button trigger message is a valid key operation according to the determination result.
  • the preset threshold can be regarded as a state value when the mobile terminal is in a stationary state or in a low-speed motion state. It should be noted that the preset threshold is not a fixed value, but can be flexibly set according to actual conditions, for example, a value adjusted according to user operation habits.
  • the detected facial features are complete If the face image is collected, for example, the face recognition parameter is reached to reach the threshold for identifying the complete face image, or the collected face contour is complete, or the plurality of face parts are successfully collected and the relative positional relationship is reasonable, then it can be considered that the detected Facial features.
  • the processor 706 may first determine whether the status value is less than a preset threshold, and then determine whether the facial feature is detected; or determine whether the facial feature is detected, and then determine the status. Whether the value is less than a preset threshold; at the same time, the two judging processes can also be performed simultaneously.
  • the processor in this embodiment first determines whether the state value is less than a preset threshold, and then determines whether the facial feature is detected. This can avoid the problem of wasting resources when the mobile terminal frequently detects facial features. For example, saving memory usage of the mobile terminal processor; and reducing power consumption when detecting facial features.
  • the processor 706 may indicate that the button operation is a valid key operation. At this time, the processor 706 will perform a key operation corresponding to the button trigger message, that is, the button operation instruction is sent to the button.
  • the processor 706 may indicate that the key operation is an invalid key operation. At this time, the processor 706 will not perform any key operation, and the button will not receive the key operation indication issued by the determining module.
  • the processor 706 is further configured to: store a program for acquiring the eyeprint information of the current user and matching the eyeprint information with the eyeprint information saved in the mobile terminal, And determining, when the matching result indicates that the eye pattern information is consistent with the eye pattern information saved in the storage unit, the button operation is an effective button operation; and the matching result indicates that the eye pattern information is saved in the storage unit When the eye pattern information is inconsistent, it is determined that the key operation is an invalid key operation.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • the storage medium is further arranged to store program code for performing the following steps:
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the processor performs, according to the stored program code in the storage medium, whether the state value is less than a preset threshold, and whether the facial feature is detected; and the determining result indicates When the state value is less than the preset threshold, and the facial feature is detected, determining that the button operation is a valid button operation; and the determining result indicates that the state value is greater than the preset threshold and/or is not detected In the facial feature, it is determined that the button operation is an invalid button operation.
  • the processor executes according to the stored program code in the storage medium. Determining, according to the matching result, whether the button operation corresponding to the button trigger message is a valid button operation; and determining, when the matching result indicates that the eye pattern information is consistent with the eye pattern information saved in the mobile terminal; The operation is an effective key operation; when the matching result indicates that the eye pattern information is inconsistent with the eye pattern information saved in the mobile terminal, determining that the key operation is an invalid key operation.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the technical solution provided by the embodiment of the present invention can be applied to the identification process of the button operation, because it can determine whether the state value for indicating the motion state of the mobile terminal relative to the current user is less than a preset threshold and whether the current is detected.
  • the user's facial features are used to determine whether the key operation is a valid key. Therefore, the software can be used to determine whether the current key operation is effective, thereby solving the problem of the mobile terminal design cost caused by the related art using the hardware method to solve the user's misoperation key problem.
  • High, inflexible processing and poor user experience which can achieve simple and flexible implementation, low cost and good user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

一种按键操作的识别方法和装置，其中，该方法包括：接收针对移动终端的按键触发消息（S202）；获取所述移动终端的状态值，以及检测当前用户的面部特征，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态（S204）；判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征（S206）；依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作（S208）。该方法解决了相关技术存在的利用硬件方式解决用户误操作按键问题时所造成的移动终端设计成本高，处理方式不灵活以及用户体验差的问题，从而能够达到实现方式简单灵活，成本低以及用户体验性好的效果。

Description

按键操作的识别方法和装置 技术领域
本发明涉及通信领域，具体而言，涉及一种按键操作的识别的方法和装置。
背景技术
在用户平常使用移动终端过程当中，往往会误触移动终端的按键(例如外部实体按键)，给用户造成困扰，例如以最常用的移动终端，手机而言，当手机外部实体按键比较偏软并且在手机侧面的情况下，有时候在手拿着手机走路时，用户不小心就会按着实体按键。在这种情况下，手机往往会在用户不知情的情况下重启，关机或者音量莫名的增大或减小，给用户使用手机造成了极大的困扰。在相关技术当中通常的做法是通过手机外部实体按键误操作的方式都是通过实体保护措施。例如，例如加保护套，或者加重实体按键的硬度，增长实体按键的键程等方式来防止用户误操作实体按键，上述提供的方式都是属于通过硬件的方式来进行。通过上述硬件方式改进的措施虽然在一定程度上能够解决实体按键误触导致的不方便问题，但是对于设计者而言，往往还需要考虑通过改变硬件结构导致的成本问题。同时利用硬件方式明显不如软件方式处理更加灵活。此外，利用加保护套，或者加重实体按键的硬度，增长实体按键的键程等硬件方式还会造成手机外观结构不美观，影响用户体验的问题。
发明内容
本发明实施例提供了一种按键操作的识别方法和装置，以至少解决相关技术中利用硬件方式解决用户误操作按键问题时所造成的移动终端设计成本高，处理方式不灵活以及用户体验差的问题。
根据本发明的一个实施例，提供了一种按键操作的识别方法，包括：接收针对移动终端的按键触发消息；获取所述移动终端的状态值，以及检测当前用户的面部特征，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，所述依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作，包括：在所述判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定所述按键操作为有效按键操作；在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定所述按键操作为无效按键操作。
可选地，在所述确定所述按键操作为有效按键操作之后，所述方法还包括：执行与所述按键触发消息对应的按键操作。
可选地，所述判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征，包括：在所述状态值小于所述预设阈值时，检测所述当前用户的面部特征。
可选地，所述获取所述移动终端的状态值，包括：获取所述移动终端通过重力传感器采集的加速度值，将所述加速度值作为所述状态值。
可选地，在所述判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征之后，所述方法还包括：获取所述当前用户的眼纹信息；将所述眼纹信息与所述移动终端中保存的眼纹信息进行匹配；依据匹配结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
根据本发明的另一个实施例，提供了一种按键操作的识别装置，包括：接收模块，设置为接收针对移动终端的按键触发消息；第一获取模块，设置为获取所述移动终端的状态值，以及检测当前用户的面部特征；其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；判断模块，设置为判断所述状态值是否小于预设阈值，以及是否检测到所述 面部特征；确定模块，设置为根据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，所述确定模块，还设置为在所述判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定所述按键操作为有效按键操作；以及在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定所述按键操作为无效按键操作。
可选地，所述装置还包括：第二获取模块，设置为获取所述当前用户的眼纹信息；匹配模块，设置为匹配所述眼纹信息与所述移动终端中保存的眼纹信息。
根据本发明的再一个实施例，提供了一种移动终端，包括：重力传感器，图像采集装置以及处理器；所述重力传感器，设置为采集所述移动终端的加速度值，并将所述加速度值作为状态值发送给所述处理器处理，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；所述图像采集装置，设置为采集当前用户的面部特征；所述处理器，设置为接收针对所述移动终端的按键触发消息，获取所述重力传感器发送的所述状态值，并且检测所述面部特征；判断所述状态值是否小于预设阈值以及是否检测到所述面部特征；依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
根据本发明的又一个实施例，还提供了一种存储介质。该存储介质设置为存储用于执行以下步骤的程序代码：接收针对移动终端的按键触发消息；获取所述移动终端的状态值，以及检测当前用户的面部特征，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，存储介质还设置为存储用于执行以下步骤的程序代码：获取所述当前用户的眼纹信息；将所述眼纹信息与所述移动终端中保存的眼纹信息进行匹配；依据匹配结果确定所述按键触发消息所对应的按键操作是 否为有效按键操作。
通过本发明，由于可以通过判断用于指示移动终端相对于所述当前用户的运动状态的状态值是否小于预设阈值以及是否检测到当前用户的面部特征来判断按键操作是否为有效按键，因此，可以通过软件来判断当前按键操作是否有效，从而可以解决相关技术存在的利用硬件方式解决用户误操作按键问题时所造成的移动终端设计成本高，处理方式不灵活以及用户体验差的问题，从而能够达到实现方式简单灵活，成本低以及用户体验性好的效果。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：
图1是根据本发明实施例的一种按键操作的识别方法的移动终端的硬件结构框图；
图2是根据本发明实施例的一种按键操作的识别方法的流程图；
图3是根据本发明实施例的另一种按键操作的识别方法的流程图；
图4是根据本发明实施例的再一种按键操作的识别方法的流程图；
图5是根据本发明可选实施例的一种按键操作的识别装置的结构框图；
图6是根据本发明可选实施例的另一种按键操作的识别装置的结构框图；
图7是根据本发明可选实施例的一种移动终端的结构示意图。
具体实施方式
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语 “第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。
实施例1
本申请实施例一所提供的方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在移动终端上为例，图1是本发明实施例的一种按键操作的识别方法的移动终端的硬件结构框图。如图1所示，移动终端10可以包括一个或多个(图中仅示出一个)处理器102(处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)、用于存储数据的存储器104、以及用于通信功能的传输装置106。本领域普通技术人员可以理解，图1所示的结构仅为示意，其并不对上述电子装置的结构造成限定。例如，移动终端10还可包括比图1中所示更多或者更少的组件，或者具有与图1所示不同的配置。
存储器104可用于存储应用软件的软件程序以及模块，如本发明实施例中的按键操作的识别方法对应的程序指令/模块，处理器102通过运行存储在存储器104内的软件程序以及模块，从而执行各种功能应用以及数据处理，即实现上述的方法。存储器104可包括高速随机存储器，还可包括非易失性存储器，如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器；在一些实例中，存储器104可进一步包括相对于处理器102远程设置的存储器，这些远程存储器可以通过网络连接至移动终端10。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
传输装置106用于经由一个网络接收或者发送数据。上述的网络具体实例可包括移动终端10的通信供应商提供的无线网络。在一个实例中，传输装置106包括一个网络适配器(Network Interface Controller，NIC)，其可通过基站与其他网络设备相连从而可与互联网进行通讯。在一个实例中，传输装置106可以为射频(Radio Frequency，RF)模块，其用于通过 无线方式与互联网进行通讯。
在本实施例中提供了一种运行于上述移动终端上的按键操作的识别方法，图2是根据本发明实施例的一种按键操作的识别方法的流程图，如图2所示，该流程包括步骤S202-S208：
步骤S202，接收针对移动终端的按键触发消息；
此处的按键触发消息可以为针对实体按键的触发消息，也可以为虚拟按键的触发消息。
步骤S204，获取所述移动终端的状态值，以及检测当前用户的面部特征，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；
可选地，所述移动终端的状态值可以为加速度值或移动速率等，其中对于前者，可以表现为以下形式：通过利用移动终端内部的重力传感器采集移动终端相对于用户运动的加速度值。
为提高识别效率，在检测当前用户的面部特征的操作时，可以由软件自动触发采集上述面部特征，即无需用户手动开启，而在接收到所述针对移动终端的按键触发消息后，自动触发移动终端的上述检测操作。
可选地，在检测当前用户的面部特征的过程当中，可以通过利用图像采集装置(例如前置摄像头)采集当前用户的面部特征，并对该面部特征进行检测。例如，图像采集装置可以采集当前用户面部的灰度特征点，光线强度，角度等人脸识别参数；还可以采集当前用户的人脸轮廓；也可以采集五官，颧骨，下巴等多个面部部位以及多个面部部位之间的相对位置关系。
步骤S206，判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征。
需要说明的是，上述判断过程中的两个判断条件(即所述状态值是否小于预设阈值；是否检测到所述面部特征)需要一起进行考虑，以判断所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，由于对于一般用户而言，在正常使用移动终端以及操作按键的时候，移动终端往往是处于静止状态或者速度很慢的运动状态。因此，该预设阈值可以被看作是当移动终端处于静止状态或以加速度较低的运动状态时的状态值。需要指出的是，该预设阈值并不是一个固定的数值，而是可以根据实际情况灵活设定，例如依据用户操作习惯进行调整的数值。
由于对于一般用户而言，在正常使用移动终端以及操作按键的时候，往往用户会正对着屏幕去操作。因此，当检测到的所述面部特征是完整的人脸图像的话，例如采集到人脸识别参数达到识别完整人脸图像的阈值，或采集到的人脸轮廓完整，或者多个面部部位采集成功并且相对位置关系合理，那么就可以认为，检测到了面部特征。
可选地，判断所述状态值是否小于预设阈值以及判断是否检测到所述面部特征的步骤并没有明显的先后顺序。在流程处理当中，可以先判断所述状态值是否小于预设阈值，再去判断是否检测到所述面部特征；也可以先判断是否检测到所述面部特征，再去判断所述状态值是否小于预设阈值；当然也可以同时进行所述两种判断过程。当然，作为一种比较优选的实施方式，本实施例中采取先判断所述状态值是否小于预设阈值，再去判断是否检测到所述面部特征，这样可以避免在移动终端频繁检测面部特征时，浪费资源的问题。例如，节省移动终端处理器的使用内存；以及减少检测面部特征时电量的消耗。
步骤S208，依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
图3是根据本发明实施例的另一种按键操作的识别方法的流程图，可选地，对于步骤S208可以采用图3中的步骤S302-S304实现：
步骤S302，在所述判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定所述按键操作为有效按键操作；
在所述确定所述按键操作为有效按键操作之后，移动终端将执行与所述按键触发消息对应的按键操作，即将按键操作指示下发到按键。
步骤S304，在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定所述按键操作为无效按键操作。
在确定所述按键操作为无效按键操作后，移动终端将不会执行任何按键操作，而按键同时也就不会接收到移动终端下发的按键操作指示。
为了增加移动终端的安全性，防止用户信息被他人恶意盗取，本实施例当中还提供了一种基于安全性的按键操作的识别方法。图4是根据本发明实施例的再一种按键操作的识别方法的流程图。如图4所示，在步骤206后，还包括：
步骤S402，获取所述当前用户的眼纹信息；
可选地，在获取所述当前用户的眼纹信息的过程当中，可以通过眼纹采集装置(例如前置摄像头)采集当前用户的眼纹信息。
步骤S404，将所述眼纹信息与所述移动终端中保存的眼纹信息进行匹配；
其中，所述移动终端内存中保存的眼纹信息为眼纹采集装置所采集的合法眼纹信息。其中，该合法眼纹信息是允许访问移动终端并保存在移动终端内部的合法用户的眼纹信息。
步骤S406，依据匹配结果确定所述按键触发消息所对应的按键操作是否为有效按键操作；
可选地，对于步骤S406，可以采取以下的步骤来实现：
在所述匹配结果指示所述眼纹信息与所述移动终端中保存的眼纹信息一致时，确定所述按键操作为有效按键操作；
在所述匹配结果指示所述眼纹信息与所述移动终端中保存的眼纹信息不一致时，确定所述按键操作为无效按键操作。
同时，在本实施例当中还提供了以下的3个应用场景，以便于理解本实施例。
场景一
当使用移动终端的用户在走路的时候，此时用户不小心触碰了移动终端上的某个按键；在这种情况下，移动终端会接收到按键触发的按键触发消息；此时，移动终端将获取当前用户手中的移动终端的状态值；同时，对当前的状态值与预设阈值的大小关系进行判断；容易理解的是，在用户在走路过程当中往往运动状态变化较快，因此，移动终端在运动时的状态值会大于预设阈值；在这种场景下，移动终端就不会去检测当前用户的面部特征，而是判断出当前的按键操作为无效按键操作；因此，按键也就不会接收到移动终端下发的按键操作指示。
场景二
在用户不需要使用移动终端的时候，往往会把移动终端放进衣服的口袋或者携带的背包当中；在这种情况下，移动终端的按键很容易被口袋或者背包内中携带的物品误触发。同时，当前用户改变自身的姿势时，也可能会发生按键被误触发；如果当前用户在走路的时候，那么可以参考场景一，由于状态值大于预设阈值，在没有检测当前用户的面部特征的情况下，判断出当前的按键操作为无效按键操作。而如果当前用户处于静止状态或者很慢的运动状态时，移动终端的状态值会小于预设阈值。然后图像采集装置将会采集当前用户的面部特征；由于移动终端位于口袋或者背包当中，因此，移动终端没有检测到当前用户的面部特征。在这种场景下，移动终端会判断出当前的按键操作为无效按键操作；因此，按键也就不会接收到移动终端下发的按键操作指示。
场景三
在平常用户使用移动终端的时候，往往可能会丢失移动终端或者移动终端在用户不注意的时候被他人所盗用；一般而言，开机，解锁屏这些操作都是通过操作按键来实现的；但是非法用户和合法用户一样也能够在满足移动终端的状态值小于预设阈值且检测到所述面部特征的条件；此时，眼纹采集装置就会采集当前用户的眼纹信息；移动终端根据采集的眼纹信 息与自身内部保存的合法眼纹信息进行匹配。在采集的眼纹信息与移动终端内部保存的合法眼纹信息不一致时，移动终端判断出当前用户是非法用户。在这种场景下，移动终端会判断出当前的按键操作为无效按键操作。按键也就不会接收到移动终端下发的按键操作指示。因此，开机，解锁屏这些通过按键的操作也就不会被触发，从而能够防止非法用户使用移动终端，提高了移动终端的安全性。
需要指出的是，上述场景只是列举，而并非穷举。任何基于上述思路的场景应当落入到本实施例的保护范围之内。
通过上述步骤，解决了相关技术中存在的利用硬件方式解决用户误操作按键问题时所造成的移动终端设计成本高，处理方式不灵活以及用户体验差的问题，能够达到实现方式简单灵活，成本低以及用户体验性好的效果。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行本发明各个实施例所述的方法。
实施例2
在本实施例中还提供了一种按键操作的识别装置，该装置用于实现上述实施例及优选实施方式，已经进行过说明的不再赘述。如以下所使用的，术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现，但是硬件，或者软件和硬件的组合的实现也是可能并被构想的。
图5是根据本发明实施例的一种按键操作的识别装置的结构框图，如图5所示，该装置包括接收模块52、第一获取模块54、判断模块56以及确定模块58：
接收模块52，设置为接收针对移动终端的按键触发消息；
第一获取模块54，连接至接收模块52，设置为获取所述移动终端的状态值，以及检测当前用户的面部特征；其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；
可选地，所述移动终端的状态值可以被看作为是通过利用第一获取模块54内部的重力传感器采集所述移动终端相对于用户运动的加速度值。
可选地，在获取到接收模块成功接收到针对移动终端的按键触发消息，第一获取模块自动检测当前用户的面部特征，不需要用户其他指令触发。
可选地，在检测当前用户的面部特征的过程当中，第一获取模块54还包括：图像采集装置(图中未示出，例如前置摄像头)，设置为采集当前用户的面部特征进行检测。该图像采集装置可以采集当前用户的灰度特征点，光线强度，角度等人脸识别参数；还可以采集当前用户的人脸轮廓；也可以采集五官，颧骨，下巴等多个面部部位以及多个面部部位之间的相对位置关系。
判断模块56，连接至第一获取模块54，设置为判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；
可选地，由于对于一般用户而言，在正常使用移动终端以及操作按键的时候，往往移动终端基本是处于静止状态或者速度很慢的运动状态。因此，该预设阈值可以被看作是当移动终端处于静止状态或以速度较低的运动状态时的状态值。需要指出的是，该预设阈值并不是一个固定的数值，而是可以根据实际情况灵活设定，例如依据用户操作习惯进行调整的数值。
由于对于一般用户而言，在正常使用移动终端以及操作按键的时候，往往用户会正对着屏幕去操作。因此，当检测到的所述面部特征是完整的人脸图像的话，例如采集到人脸识别参数达到识别完整人脸图像的阈值， 或采集到的人脸轮廓完整，或者多个面部部位采集成功并且相对位置关系合理，那么就可以认为，检测到了面部特征。
可选地，判断模块56还包括状态值判断单元与检测单元。其中，状态值判断单元设置为判断所述状态值是否小于预设阈值，而检测单元设置为判断是否检测到所述面部特征。状态值判断单元与检测单元的连接关系可以根据用户的需要进行调整。即可以将状态值先输入到状态值判断单元后再去通过检测单元判断是否检测到面部特征，也可以先通过检测单元判断是否检测到面部特征，再将状态值输入到状态值判断单元，同时还可以同时通过检测单元判断是否检测到面部特征和将状态值先输入到状态值判断单元当然，作为一种比较优选的实施方式，本实施例中采取先判断所述状态值是否小于预设阈值，再去判断是否检测到所述面部特征。这样可以避免在移动终端频繁检测面部特征时，浪费资源的问题。例如，节省移动终端处理器的使用内存；以及减少检测面部特征时电量的消耗。
确定模块58，连接至判断模块56，设置为根据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，如果在判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定模块58会指示所述按键操作为有效按键操作。此时，确定模块58将执行与所述按键触发消息对应的按键操作，即将按键操作指示下发到按键。
可选地，如果在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定模块58会指示所述按键操作为无效按键操作。此时，确定模块58将不会执行任何按键操作，而按键同时也就不会接收到确定模块下发的按键操作指示。
图6是根据本发明实施例的另一种按键操作的识别装置的结构框图，如图6所示，该装置除包括图5所示的所有模块外，还包括第二获取模块62，以及匹配模块64：
第二获取模块62，连接至判断模块56，设置为获取所述当前用户的眼纹信息；
可选地，第二获取模块62还包括眼纹采集装置(例如前置摄像头)，设置为采集当前用户的眼纹信息。
匹配模块64，连接于第二获取模块62与确定模块58，设置为匹配所述眼纹信息与所述移动终端中保存的眼纹信息。
可选地，匹配模块64还包括：存储单元。该存储单元设置为保存合法眼纹信息。其中，该合法眼纹信息是允许访问移动终端的合法用户的眼纹信息。
可选地，匹配模块64将匹配结果发送到确定模块58。依据匹配结果，确定模块58确定所述按键触发消息所对应的按键操作是否为有效按键操作。在匹配结果指示所述眼纹信息与存储单元中保存的眼纹信息一致时，确定模块58确定所述按键操作为有效按键操作；在所述匹配结果指示所述眼纹信息与存储单元中保存的眼纹信息不一致时，确定模块58确定所述按键操作为无效按键操作。
本领域普通技术人员可以理解，图5和图6所示的结构仅为示意，移动终端可以是智能手机(如Android手机、iOS手机等)、平板电脑、掌声电脑以及移动互联网设备(Mobile Internet Devices，MID)、PAD等终端设备。图5和图6其并不对上述电子装置的结构造成限定。例如，移动终端还可包括比图5和图6中所示更多或者更少的组件(如网络接口、显示装置等)，或者具有与图5和图6所示不同的配置。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令终端设备相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质可以包括：闪存盘、只读存储器(Read-Only Memory，ROM)、随机存取器(Random Access Memory，RAM)、磁盘或光盘等。
需要说明的是，上述各个模块是可以通过软件或硬件来实现的，对于 后者，可以通过以下方式实现，但不限于此：上述模块均位于同一处理器中；或者，上述各个模块以任意组合的形式分别位于不同的处理器中。
实施例3
在本实施例中还提供了一种按键操作的移动终端。图7是根据本发明实施例的一种移动终端的结构示意图，如图7所示，移动终端70包括：重力传感器702，图像采集装置704以及处理器706：
重力传感器702，设置为采集所述移动终端的加速度值，并将所述加速度值作为状态值发送给所述处理器处理，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；
图像采集装置704，设置为采集当前用户的面部特征；
可选地，该图像采集装置704可以采集当前用户的灰度特征点，光线强度，角度等人脸识别参数；还可以采集当前用户的人脸轮廓；也可以采集五官，颧骨，下巴等多个面部部位以及多个面部部位之间的相对位置关系。
处理器706，连接至重力传感器702以及图像采集装置704，设置为接收针对所述移动终端的按键触发消息，获取所述重力传感器发送的所述状态值，并且检测所述面部特征；判断所述状态值是否小于预设阈值以及是否检测到所述面部特征；依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，由于对于一般用户而言，在正常使用移动终端以及操作按键的时候，往往移动终端基本是处于静止状态或者速度很慢的运动状态。因此，该预设阈值可以被看作是当移动终端处于静止状态或以速度较低的运动状态时的状态值。需要指出的是，该预设阈值并不是一个固定的数值，而是可以根据实际情况灵活设定，例如依据用户操作习惯进行调整的数值。
由于对于一般用户而言，在正常使用移动终端以及操作按键的时候，往往用户会正对着屏幕去操作。因此，当检测到的所述面部特征是完整的 人脸图像的话，例如采集到人脸识别参数达到识别完整人脸图像的阈值，或采集到的人脸轮廓完整，或者多个面部部位采集成功并且相对位置关系合理，那么就可以认为，检测到了面部特征。
可选地，该处理器706可以先判断所述状态值是否小于预设阈值，再去判断是否检测到所述面部特征；也可以先判断是否检测到所述面部特征，再去判断所述状态值是否小于预设阈值；同时还可以同时进行所述两种判断过程。当然，作为一种比较优选的实施方式，本实施例中的处理器采取先判断所述状态值是否小于预设阈值，再去判断是否检测到所述面部特征的方式。这样可以避免在移动终端频繁检测面部特征时，浪费资源的问题。例如，节省移动终端处理器的使用内存；以及减少检测面部特征时电量的消耗。
可选地，如果在判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，处理器706会指示所述按键操作为有效按键操作。此时，处理器706将执行与所述按键触发消息对应的按键操作，即将按键操作指示下发到按键。
可选地，如果在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，处理器706会指示所述按键操作为无效按键操作。此时，处理器706将不会执行任何按键操作，而按键同时也就不会接收到确定模块下发的按键操作指示。
可选地，处理器706，还设置为存储用于执行以下步骤的程序：用于获取所述当前用户的眼纹信息以及匹配所述眼纹信息与所述移动终端中保存的眼纹信息，并在匹配结果指示所述眼纹信息与存储单元中保存的眼纹信息一致时，确定所述按键操作为有效按键操作；以及在所述匹配结果指示所述眼纹信息与存储单元中保存的眼纹信息不一致时，确定所述按键操作为无效按键操作。
实施例4
本发明的实施例还提供了一种存储介质。可选地，在本实施例中，上述存储介质可以被设置为存储用于执行以下步骤的程序代码：
S11，接收针对移动终端的按键触发消息；
S12，获取所述移动终端的状态值，以及检测当前用户的面部特征，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；
S13，判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；
S14，依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：
S21，获取所述当前用户的眼纹信息；
S22，将所述眼纹信息与所述移动终端中保存的眼纹信息进行匹配；
S23，依据匹配结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
可选地，在本实施例中，上述存储介质可以包括但不限于：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
可选地，在本实施例中，处理器根据存储介质中已存储的程序代码执行判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；在所述判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定所述按键操作为有效按键操作；在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定所述按键操作为无效按键操作。
可选地，在本实施例中，处理器根据存储介质中已存储的程序代码执 行依据匹配结果确定所述按键触发消息所对应的按键操作是否为有效按键操作；在所述匹配结果指示所述眼纹信息与所述移动终端中保存的眼纹信息一致时，确定所述按键操作为有效按键操作；在所述匹配结果指示所述眼纹信息与所述移动终端中保存的眼纹信息不一致时，确定所述按键操作为无效按键操作。
可选地，本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例，本实施例在此不再赘述。
显然，本领域的技术人员应该明白，上述的本发明的各模块或各步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执行的程序代码来实现，从而，可以将它们存储在存储装置中由计算装置来执行，并且在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤，或者将它们分别制作成各个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样，本发明不限制于任何特定的硬件和软件结合。
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。
工业实用性
本发明实施例提供的技术方案，可以应用于按键操作的识别过程中，由于可以通过判断用于指示移动终端相对于所述当前用户的运动状态的状态值是否小于预设阈值以及是否检测到当前用户的面部特征来判断按键操作是否为有效按键，因此，可以通过软件来判断当前按键操作是否有效，从而可以解决相关技术存在的利用硬件方式解决用户误操作按键问题时所造成的移动终端设计成本高，处理方式不灵活以及用户体验差的问题，从而能够达到实现方式简单灵活，成本低以及用户体验性好的效果。

Claims (11)

  1. 一种按键操作的识别方法，包括：
    接收针对移动终端的按键触发消息；
    获取所述移动终端的状态值，以及检测当前用户的面部特征，其中，所述状态值用于指示所述移动终端的相对于所述当前用户的运动状态；
    判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；
    依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
  2. 根据权利要求1所述的方法，其中，所述依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作，包括：
    在所述判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定所述按键操作为有效按键操作；
    在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定所述按键操作为无效按键操作。
  3. 根据权利要求2所述的方法，其中，在所述确定所述按键操作为有效按键操作之后，所述方法还包括：
    执行与所述按键触发消息对应的按键操作。
  4. 根据权利要求1所述的方法，其中，所述判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征，包括：
    在所述状态值小于所述预设阈值时，检测所述当前用户的面部特征。
  5. 根据权利要求1所述的方法，其中，所述获取所述移动终端的状态值，包括：
    获取所述移动终端通过重力传感器采集的加速度值，将所述加速度值作为所述状态值。
  6. 根据权利要求1至5中任一项所述的方法，其中，在所述判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征之后，所述方法还包括：
    获取所述当前用户的眼纹信息；
    将所述眼纹信息与所述移动终端中保存的眼纹信息进行匹配；
    依据匹配结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
  7. 根据权利要求6所述的方法，其中，所述依据匹配结果确定所述按键触发消息所对应的按键操作是否为有效按键操作，包括：
    在所述匹配结果指示所述眼纹信息与所述移动终端中保存的眼纹信息一致时，确定所述按键操作为有效按键操作；
    在所述匹配结果指示所述眼纹信息与所述移动终端中保存的眼纹信息不一致时，确定所述按键操作为无效按键操作。
  8. 一种按键操作的识别装置，包括：
    接收模块，设置为接收针对移动终端的按键触发消息；
    第一获取模块，设置为获取所述移动终端的状态值，以及检测当前用户的面部特征；其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；
    判断模块，设置为判断所述状态值是否小于预设阈值，以及是否检测到所述面部特征；
    确定模块，设置为根据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操作。
  9. 根据权利要求8所述的装置，其中，所述确定模块，还设置为在所述判断结果指示所述状态值小于所述预设阈值，且检测到所述面部特征时，确定所述按键操作为有效按键操作；以及在所述判断结果指示所述状态值大于所述预设阈值和/或未检测到所述面部特征时，确定所述按键操作为无效按键操作。
  10. 根据权利要求8所述的装置，其中，所述装置还包括，
    第二获取模块，设置为获取所述当前用户的眼纹信息；
    匹配模块，设置为匹配所述眼纹信息与所述移动终端中保存的眼纹信息。
  11. 一种移动终端，包括：重力传感器，图像采集装置以及处理器；
    所述重力传感器，设置为采集所述移动终端的加速度值，并将所述加速度值作为状态值发送给所述处理器处理，其中，所述状态值用于指示所述移动终端相对于所述当前用户的运动状态；
    所述图像采集装置，设置为采集当前用户的面部特征；
    所述处理器，设置为接收针对所述移动终端的按键触发消息，获取所述重力传感器发送的所述状态值，并且检测所述面部特征；判断所述状态值是否小于预设阈值以及是否检测到所述面部特征；依据判断结果确定所述按键触发消息所对应的按键操作是否为有效按键操 作。
PCT/CN2016/106970 2016-04-25 2016-11-23 按键操作的识别方法和装置 WO2017185728A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610263797.3 2016-04-25
CN201610263797.3A CN107305434A (zh) 2016-04-25 2016-04-25 按键操作的识别方法和装置

Publications (1)

Publication Number Publication Date
WO2017185728A1 true WO2017185728A1 (zh) 2017-11-02

Family

ID=60151052

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/106970 WO2017185728A1 (zh) 2016-04-25 2016-11-23 按键操作的识别方法和装置

Country Status (2)

Country Link
CN (1) CN107305434A (zh)
WO (1) WO2017185728A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111459265A (zh) * 2020-03-02 2020-07-28 杭州嘉澜创新科技有限公司 一种交互设备及其操作方法、计算机可读存储介质
CN112333318A (zh) * 2020-10-30 2021-02-05 维沃移动通信有限公司 按键功能的响应方法、装置及电子设备
CN112346577A (zh) * 2020-11-09 2021-02-09 杭州拼便宜网络科技有限公司 输入信息纠正方法、系统和相关装置
CN112994678A (zh) * 2021-02-09 2021-06-18 珠海格力电器股份有限公司 一种按键灵敏度控制方法、装置及电器设备

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491151B (zh) * 2018-03-22 2020-06-02 维沃移动通信有限公司 一种移动终端的提示方法及移动终端
CN111198624A (zh) * 2018-11-20 2020-05-26 海能达通信股份有限公司 一种按键数据的处理方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100079508A1 (en) * 2008-09-30 2010-04-01 Andrew Hodge Electronic devices with gaze detection capabilities
CN103186793A (zh) * 2013-03-26 2013-07-03 北京小米科技有限责任公司 一种移动终端屏幕锁定解除方法及装置
CN104036167A (zh) * 2013-03-04 2014-09-10 联想(北京)有限公司 一种信息处理的方法及电子设备
CN104662600A (zh) * 2012-06-25 2015-05-27 亚马逊技术公司 使用注视确定与装置输入
CN105892920A (zh) * 2016-03-31 2016-08-24 努比亚技术有限公司 显示控制方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100079508A1 (en) * 2008-09-30 2010-04-01 Andrew Hodge Electronic devices with gaze detection capabilities
CN104662600A (zh) * 2012-06-25 2015-05-27 亚马逊技术公司 使用注视确定与装置输入
CN104036167A (zh) * 2013-03-04 2014-09-10 联想(北京)有限公司 一种信息处理的方法及电子设备
CN103186793A (zh) * 2013-03-26 2013-07-03 北京小米科技有限责任公司 一种移动终端屏幕锁定解除方法及装置
CN105892920A (zh) * 2016-03-31 2016-08-24 努比亚技术有限公司 显示控制方法和装置

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111459265A (zh) * 2020-03-02 2020-07-28 杭州嘉澜创新科技有限公司 一种交互设备及其操作方法、计算机可读存储介质
CN111459265B (zh) * 2020-03-02 2023-10-13 杭州嘉澜创新科技有限公司 一种交互设备及其操作方法、计算机可读存储介质
CN112333318A (zh) * 2020-10-30 2021-02-05 维沃移动通信有限公司 按键功能的响应方法、装置及电子设备
CN112333318B (zh) * 2020-10-30 2023-04-11 维沃移动通信有限公司 按键功能的响应方法、装置及电子设备
CN112346577A (zh) * 2020-11-09 2021-02-09 杭州拼便宜网络科技有限公司 输入信息纠正方法、系统和相关装置
CN112346577B (zh) * 2020-11-09 2024-05-07 杭州拼便宜网络科技有限公司 输入信息纠正方法、系统和相关装置
CN112994678A (zh) * 2021-02-09 2021-06-18 珠海格力电器股份有限公司 一种按键灵敏度控制方法、装置及电器设备

Also Published As

Publication number Publication date
CN107305434A (zh) 2017-10-31

Similar Documents

Publication Publication Date Title
WO2017185728A1 (zh) 按键操作的识别方法和装置
US10521577B2 (en) Method for unlocking screen of terminal having fingerprint identification sensors and terminal
CN107437009B (zh) 权限控制方法及相关产品
CN107194228B (zh) 解锁控制方法及相关产品
CN110826516B (zh) 光学指纹验证方法及相关产品
WO2017206662A1 (en) Method for updating fingerprint template and terminal device
CN105912915B (zh) 一种指纹解锁方法及终端
CN106127481B (zh) 一种指纹支付方法及终端
CN107292235B (zh) 指纹的采集方法及相关产品
CN105912916B (zh) 一种指纹解锁方法及终端
US11272049B2 (en) Method and device for activating operating system of mobile terminal
CN107516070B (zh) 生物识别方法及相关产品
CN106022058B (zh) 一种指纹解锁方法及终端
TW201732679A (zh) 資訊圖像顯示方法及裝置
CN105825104B (zh) 一种基于指纹识别的业务处理方法及电子设备
CN106055947A (zh) 通过指纹解锁移动终端的方法、装置及移动终端
CN106203034A (zh) 一种指纹解锁方法及终端
CN106570383A (zh) 一种移动终端的解锁方法、装置及移动终端
CN103760978B (zh) 一种信息处理方法与电子设备
CN106485117A (zh) 一种基于人脸识别的智能终端操作控制方法及系统
CN108513664B (zh) 图像处理的方法和设备
CN107609378B (zh) 指纹解锁方法及相关产品
WO2016065746A1 (zh) 唤醒终端设备的方法和装置、存储介质
CN107169472B (zh) 指纹操作方法、移动终端及存储介质
CN107644159B (zh) 人脸识别方法及相关产品

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16900235

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16900235

Country of ref document: EP

Kind code of ref document: A1