CN107526522B

CN107526522B - Black screen gesture recognition method and device, mobile terminal and storage medium

Info

Publication number: CN107526522B
Application number: CN201710699018.9A
Authority: CN
Inventors: 熊星
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2017-08-15
Filing date: 2017-08-15
Publication date: 2021-07-13
Anticipated expiration: 2037-08-15
Also published as: CN107526522A

Abstract

The invention relates to a black screen gesture recognition method which is applied to a mobile terminal with a touch screen. The black screen gesture recognition method comprises the following steps: when the mobile terminal is in a black screen standby state and external force is detected to be pressed on a touch screen of the mobile terminal and continuously slide, judging that the touch screen receives a black screen gesture, and reducing the detection sensitivity of the proximity sensor; obtaining a detection result of the proximity sensor after the detection sensitivity is reduced; and according to the detection result, continuously keeping recognizing the black screen gesture received by the touch screen, or stopping recognizing the black screen gesture received by the touch screen. The invention also provides a system and a device for identifying the black screen gesture for executing the method for identifying the black screen gesture, and a storage medium. According to the mobile terminal and the black screen gesture recognition method and system thereof, when the black screen gesture recognition is carried out, a higher recognition rate is obtained in a more intelligent manner.

Description

Black screen gesture recognition method and device, mobile terminal and storage medium

Technical Field

The invention relates to the field of mobile communication devices, in particular to a mobile terminal and a method and a device for identifying a black screen gesture of the mobile terminal.

Background

With the continuous development of electronic technology, mobile terminals such as smart phones or tablet computers have become electronic devices commonly used by users. Currently, a mobile terminal with a touch screen has a black screen gesture function, where the black screen gesture function is to start gesture recognition on the touch screen when the mobile terminal is in a black screen state (sleep power saving mode), and when a gesture operation performed by a user on the touch screen is detected, for example, a circle or a triangle is scribed on the touch screen with a finger, the mobile terminal is woken up and a corresponding application program is triggered, for example, a camera application is opened or a short message application is opened. Therefore, the black screen gesture function brings convenience to the user.

However, when the black screen gesture function is started for a long time and is in an idle state, the power consumption of the mobile terminal is increased, heating and electric energy loss are caused, and aiming at the defects, the function of automatically locking the black screen gesture is provided for the current mobile terminal. Particularly, when the mobile terminal opens the automatic locking black screen gesture function, judge through proximity sensor whether the screen is sheltered from, if judge when the screen is sheltered from, then think that the user has put into places such as trousers pocket, brief case with mobile terminal, can not operate mobile terminal in the short time again to control black screen gesture function and close, can avoid black screen gesture function to open always like this, thereby save the power consumption and reduce and generate heat. However, such mobile terminals have a low recognition rate, and the black screen gesture input by the user is often difficult to be recognized by the mobile terminal or may be recognized by the mobile terminal incorrectly, so that the application program executed by the mobile terminal is not the application program that the user desires to execute, and an incorrect operation phenomenon occurs. Therefore, the recognition rate of the black screen gesture recognition of the mobile terminal is not ideal, and the user experience is poor.

Disclosure of Invention

An object of the embodiments of the present invention is to provide a mobile terminal capable of effectively recognizing a black screen gesture, a method and an apparatus for recognizing a black screen gesture thereof, and a storage medium, which are used to solve the above technical problems.

The embodiment of the invention provides a black screen gesture recognition method which is applied to a mobile terminal with a touch screen, wherein a proximity sensor is arranged in the mobile terminal. The mobile terminal can support a function of recognizing a black screen gesture input to the touch screen and waking up the black screen gesture of the mobile terminal in a black screen standby state. The black screen gesture recognition method comprises the following steps: when the mobile terminal is in a black screen standby state and external force is detected to be pressed on a touch screen of the mobile terminal and continuously slide, judging that the touch screen receives a black screen gesture, and reducing the detection sensitivity of the proximity sensor; obtaining a detection result of the proximity sensor after the detection sensitivity is reduced; and according to the detection result, continuously keeping recognizing the black screen gesture received by the touch screen, or stopping recognizing the black screen gesture received by the touch screen.

In one embodiment, the acquiring a detection result of the proximity sensor after the detection sensitivity is reduced, and continuing to identify the black screen gesture received by the touch screen or stopping identifying the black screen gesture received by the touch screen according to the detection result includes: acquiring data detected by the proximity sensor after the detection sensitivity is reduced, and comparing the data with a preset proximity event trigger range: if the data fall into a preset proximity event triggering range, the proximity event is considered to have occurred, and the recognition of the black screen gesture received by the touch screen is stopped; and if the data does not fall into a preset proximity event triggering range, determining that the proximity event does not occur, and continuously identifying the black screen gesture received by the touch screen.

In one embodiment, the reducing the detection sensitivity of the proximity sensor includes: reducing the detection sensitivity of the proximity sensor by reducing a proximity distance threshold of the proximity sensor. And acquiring data detected by the proximity sensor after the detection sensitivity is reduced, comparing the data with a preset proximity event trigger range, acquiring the proximity distance detected by the proximity sensor, judging that the proximity distance falls into the preset proximity event trigger range if the proximity distance is smaller than or equal to the reduced proximity distance threshold, and considering that the proximity event occurs.

In one embodiment, the proximity sensor is an infrared proximity sensor, and the reducing the detection sensitivity of the proximity sensor includes: the detection sensitivity of the proximity sensor is reduced by increasing a proximity intensity threshold of the proximity sensor. And acquiring data detected by the proximity sensor after the detection sensitivity is reduced, comparing the data with a preset proximity event trigger range, acquiring the proximity intensity detected by the proximity sensor, judging that the proximity intensity falls into the preset proximity event trigger range if the proximity intensity is greater than or equal to the improved proximity intensity threshold, and considering that the proximity event occurs.

In one embodiment, before a sliding event on a touch screen of the mobile terminal is detected, a state of the mobile terminal is detected, and when the mobile terminal is judged to be in a standby state, the proximity sensor is controlled to be in an on state, and a black screen gesture wake-up function of the mobile terminal is started.

In one embodiment, according to the detection result, if the recognition of the black screen gesture received by the touch screen is stopped, the data detected by the proximity sensor is continuously monitored, and if the proximity event is determined to be cancelled, the recognition of the black screen gesture received by the touch screen is resumed.

In one embodiment, according to the detection result, if the recognition of the black screen gesture received by the touch screen is stopped, the recognition of the black screen gesture received by the touch screen is stopped by turning off a black screen gesture wake-up function of the mobile terminal.

In one embodiment, according to the detection result, if the black screen gesture wake-up function of the mobile terminal is turned off, the data detected by the proximity sensor is continuously monitored, and if the proximity event is determined to be cancelled, the black screen gesture wake-up function of the mobile terminal is recovered.

The embodiment of the invention also provides a black screen gesture recognition device which is operated in a mobile terminal with a touch screen, wherein a proximity sensor is arranged in the mobile terminal, and the mobile terminal can support the function of recognizing the black screen gesture input to the touch screen and awakening the black screen gesture of the mobile terminal in a black screen standby state. The black screen gesture recognition device is used for executing any one of the black screen gesture recognition methods, and comprises: the device comprises a black screen gesture recognition module, a touch screen control module and a control module, wherein the black screen gesture recognition module is used for detecting whether a touch screen of the mobile terminal is pressed by external force and slides continuously when the mobile terminal is in a black screen standby state; the proximity sensor control module is used for reducing the detection sensitivity of the proximity sensor when the black screen gesture recognition module detects that external force is pressed on the touch screen of the mobile terminal and slides continuously; the proximity event judgment module is used for acquiring the detection result of the proximity sensor after the detection sensitivity is reduced; and the black screen gesture recognition module is used for continuously keeping recognizing the black screen gesture received by the touch screen or stopping recognizing the black screen gesture received by the touch screen according to the detection result.

The embodiment of the invention also provides a mobile terminal which comprises a mobile terminal main body and a touch screen arranged on the mobile terminal main body, wherein the mobile terminal can support the functions of identifying the black screen gesture input to the touch screen and awakening the black screen gesture of the mobile terminal in the black screen standby state. The mobile terminal further includes: a proximity sensor disposed on the mobile terminal body; one or more processors; a memory; and the black screen gesture recognition device. The black screen gesture recognition device is stored in the memory and configured to be executed by the one or more processors.

The embodiment of the invention also provides a storage medium, wherein the storage medium is internally stored with a program code, and when the program code runs, the black screen gesture recognition method can be executed.

Compared with the prior art, in the mobile terminal, the black screen gesture recognition device and the method provided by the embodiment of the invention, when the mobile terminal is in a black screen standby state and is pressed on the touch screen of the mobile terminal and continuously slides by detecting that an external force exists, reducing the detection sensitivity of the proximity sensor, when a user inputs a black screen gesture on the sliding screen, even if the proximity sensor is carelessly shielded by the operation gesture, the black screen gesture input is not failed or the passive terminal identification is wrong, therefore, the condition that the user accidentally shields the proximity sensor to cause the awakening termination of the black screen gesture or the recognition error can be avoided, the mobile terminal can successfully recognize the black screen gesture input by the user, therefore, higher recognition rate is obtained in a more intelligent mode, the misoperation rate of the black screen awakening of the mobile terminal is reduced, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of functional modules of a black screen gesture recognition apparatus according to an embodiment of the present invention;

fig. 2 is a schematic diagram of a mobile terminal provided in an embodiment of the present invention;

FIGS. 3 to 7 are schematic diagrams illustrating a black screen gesture operation of the mobile terminal shown in FIG. 2;

FIG. 8 is a flowchart illustrating a method for recognizing a black screen gesture according to an embodiment of the present invention;

fig. 9 is a schematic diagram of a hardware environment of the mobile terminal shown in fig. 2.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1 and fig. 2, an embodiment of the invention provides a black screen gesture recognition apparatus S1, which operates on the mobile terminal 100 shown in fig. 2. The black screen gesture recognition device S1 is configured to, when the mobile terminal 100 is in a black screen standby state and a sliding event of a user on the touch screen 109 of the mobile terminal 100 is detected, reduce the sensitivity of the proximity sensor 114F to avoid that the user accidentally blocks the black screen gesture awakening termination caused by the proximity sensor 114F of the mobile terminal 100, so that the mobile terminal 100 can smoothly recognize the black screen gesture input by the user, and thus the recognition rate of the black screen gesture is improved. In an embodiment of the present invention, the black screen gesture recognition means S1 is stored in a memory of the mobile terminal 100 and is configured to be executed by one or more processors of the mobile terminal 100.

In the present embodiment, the black standby state of the mobile terminal 100 refers to an operation state in which the mobile terminal 100 is in standby and the display panel 111 is turned off, and under this state, the proximity sensor 114F built in the mobile terminal 100 may remain in operation and detect a distance between an object approaching the mobile terminal 100 and the mobile terminal 100 in real time. The proximity sensor 114F is, for example, an infrared proximity sensor, which keeps emitting infrared rays outwards and monitors the intensity of the reflected infrared rays detected by the infrared proximity sensor in real time when the mobile terminal 100 is in a black screen standby state, and takes the intensity of the reflected infrared rays as a proximity intensity indicator, and accordingly determines the distance between the object and the mobile terminal 100.

When a sliding event on the touch screen 109 is detected, the sliding event is understood to be an event triggered by the touch screen 109 being pressed by an external force and the external force continuously sliding on the touch screen 109 for a predetermined time. It is understood that the sliding event does not mean that the external force should continuously press the touch screen 109 until the preset pattern (e.g., Z, O or V) input is completed, but instead, the sliding event may be an initial stage when the external force intends to complete the preset pattern. For example, when the user intends to slide a finger on the touch screen 109 to input a "Z" graphic, the user's finger may be considered to have occurred after beginning to touch the screen and sliding a small distance from left to right.

The mobile terminal 100 supports the black screen gesture wake-up function, which means that when the mobile terminal 100 is in a black screen standby state, the operating system of the mobile terminal 100 is woken up, the display panel 111 of the mobile terminal 100 is lit up, and a service or/and an application corresponding to a particular gesture is activated by recognizing a specific gesture (e.g., drawing Z, O or a V) operation performed by a user on the touch screen 109. It is understood that the black screen gesture may be a gesture set inside the mobile terminal 100 or a gesture customized by a user.

In the research process created by the present invention, the inventor finds that when the mobile terminal 100 performs the black screen gesture wakeup, the black screen gesture wakeup function often fails for a short time, which results in a low recognition rate of the black screen gesture of the mobile terminal 100, or the black screen gesture input by the user is recognized by the mobile terminal incorrectly, which results in an incorrect operation phenomenon because the application program executed by the mobile terminal is not the application program expected to be executed by the user. Therefore, in the present invention, the inventors have intensively studied the reason for the malfunction of the wake-up function of the black screen gesture in the mobile terminal 100 and an improved method.

In the course of the above studies, the inventors' studies included: analyzing the association between different specific black screen gestures and the functional failure, analyzing the association between the same black screen gesture at different operation positions and the functional failure, analyzing the association between the same black screen gesture and the functional failure under different operation habits, analyzing the association between the sensitivities of the proximity sensor 114F and the touch screen 109 and the functional failure, respectively, and the like. After a great deal of research and analysis, the inventor finds that: under different operation habits of the same black screen gesture, the frequency of the failure of the wake-up function of the black screen gesture is higher, and the frequency of the failure of the wake-up function of the black screen gesture under different specific black screen gestures is also higher.

In view of the above situation, please refer to fig. 3 to 7, the inventor finds that, due to inconsistent user operation techniques, in the process of sliding a corresponding graphic (such as Z, O or a graphic like V) on the screen, another finger may be blocked above the proximity sensor 114F (not yet attached to the touch screen 109), or another part of the hand may block the proximity sensor 114F, so that the proximity sensor 114F detects that an object is close to the mobile terminal 100, which causes the mobile terminal 100 to turn off the black screen gesture wake-up function, which causes the black screen gesture wake-up function to be disabled, and the black screen gesture input by the user cannot be recognized by the mobile terminal. In the usage scenarios shown in fig. 3 to 5, when the user uses the mobile terminal 100 in a landscape mode, the index finger slides on the touch screen 109, for example, when drawing a first pen of a "Z" shaped pattern, in the process of sliding the hand of the user from left to right, the proximity sensor 114F is easily shielded by the wrist and the little finger, which results in the failure of the wake-up function of the black screen gesture, and when the user adopts different operation postures, the proximity sensor 114F is shielded by a certain part of the hand, for example, the little finger is tilted (fig. 4) or the five fingers are extended (fig. 5). For another example, particularly in the usage scenarios shown in fig. 6 to 7, when the user uses the mobile terminal 100 while holding the screen across, the index finger slides on the touch screen 109, for example, when drawing the first stroke of the "Z" shaped pattern, the thumb of the user may have an involuntary bending and stretching action, and the thumb may possibly block the proximity sensor 114F, resulting in the wake-up function of the black-screen gesture being disabled.

In view of the above problems, the embodiment of the present invention provides the black screen gesture recognition apparatus S1, so as to improve the phenomenon that the wake-up function of the black screen gesture is temporarily disabled, thereby improving the recognition rate of the black screen gesture. The black screen gesture recognition device S1 is stored in the memory and configured to be executed by the one or more processors.

Referring to fig. 1 again, in the embodiment shown in fig. 1, the black screen gesture recognition apparatus S1 includes: the device comprises a state detection module 201, a proximity sensor control module 203, a proximity event judgment module 205, a black screen gesture control module 207 and a black screen gesture recognition module 209. The state detection module 201 is configured to detect whether the mobile terminal 100 is in a black screen standby state, the proximity sensor control module 203 is configured to control the on/off of the proximity sensor 114F and control the sensitivity of the proximity sensor 114F, the proximity event determination module 205 is configured to acquire data detected by the proximity sensor 114F, the black screen gesture control module 207 is configured to control a black screen gesture wake-up function of the mobile terminal 100, and the black screen gesture recognition module 209 is configured to detect and recognize a black screen gesture input by a user. It is understood that the modules may be program modules running on a computer-readable storage medium, and the purpose and operation of the modules are as follows:

the state detection module 201 is specifically configured to detect a state of the mobile terminal 100, and determine whether the mobile terminal 100 is in a black screen standby state according to working states of various services in the mobile terminal 100.

The proximity sensor control module 203 is specifically configured to control the proximity sensor 114F to be turned on when the state detection module 201 determines that the mobile terminal 100 is in the black screen standby state. Further, the proximity sensor control module 203 is further configured to adjust the detection sensitivity of the proximity sensor 114F, such as to decrease the detection sensitivity of the proximity sensor 114F to a first sensitivity or/and increase the detection sensitivity of the proximity sensor 114F to a second sensitivity.

Specifically, in some embodiments, when the proximity sensor 114F is a distance sensor (e.g., an ultrasonic distance sensor, etc.), the sensitivity of the proximity sensor 114F is characterized by a proximity threshold, and the proximity sensor control module 203 decreases the detection sensitivity of the proximity sensor 114F by decreasing the proximity threshold and increases the detection sensitivity of the proximity sensor 114F by increasing the proximity threshold. When the proximity sensor 114F detects that the proximity distance of the object is equal to or smaller than the reduced proximity distance threshold, it is determined that the data detected by the proximity sensor 114F falls within the preset proximity event trigger range, and the proximity sensor 114F is triggered to report the occurrence of the proximity event to the black screen gesture recognition device S1. At this time, the proximity sensor 114F is easy to set and adjust, and its detection is accurate and concrete. Further, when the proximity sensor 114F detects that the proximity distance of the object is greater than the decreased proximity distance threshold, it is determined that the data detected by the proximity sensor 114F does not fall within the preset proximity event trigger range, and it is determined that the proximity event does not occur, and the proximity sensor 114F does not perform any further action.

It is to be appreciated that in other embodiments, when the proximity sensor 114F is an infrared proximity sensor, the proximity sensor 114F is characterized by a proximity intensity threshold, and the proximity sensor control module 203 decreases the detection sensitivity of the proximity sensor 114F by increasing the proximity intensity threshold and increases the detection sensitivity of the proximity sensor 114F by decreasing the proximity intensity threshold. When the proximity sensor 114F detects that the proximity intensity of the object is greater than or equal to the increased proximity intensity threshold, it is determined that the data detected by the proximity sensor 114F falls within the preset proximity event trigger range, and the proximity sensor 114F is triggered to report the occurrence of the proximity event to the black screen gesture recognition device S1. At this time, the detection of the proximity sensor 114F is fast and accurate. Further, when the proximity sensor 114F detects that the proximity intensity of the object is smaller than the increased proximity intensity threshold, it is determined that the data detected by the proximity sensor 114F does not fall within the preset proximity event trigger range, and it is determined that the proximity event does not occur, and the proximity sensor 114F does not perform any further action.

The proximity event determining module 205 is specifically configured to obtain data detected by the proximity sensor 114F, compare the data with preset data, and determine whether a proximity event occurs according to a comparison result.

Specifically, in some embodiments, when the proximity sensor 114F is characterized by a proximity threshold, the proximity event determining module 205 is configured to obtain a proximity distance detected by the proximity sensor 114F, compare the proximity distance with the reduced proximity threshold, and determine that a proximity event occurs if the proximity distance is less than or equal to the reduced proximity threshold.

It is understood that in other embodiments, when the proximity intensity threshold is used to characterize the sensitivity of the proximity sensor 114F, the proximity event determining module 205 is configured to obtain the proximity intensity detected by the proximity sensor 114F, compare the proximity intensity with the increased proximity intensity threshold, and determine that a proximity event occurs if the proximity intensity is greater than or equal to the increased proximity intensity threshold.

The black screen gesture control module 207 is specifically configured to start the black screen gesture wake-up function of the mobile terminal 100 when the state detection module 201 determines that the mobile terminal 100 is in the black screen standby state. Further, the black screen gesture control module 207 is further configured to turn off the black screen gesture wake-up function of the mobile terminal 100 or stop the black screen gesture wake-up of the mobile terminal 100 when the proximity event determination module 205 determines that the proximity event occurs.

The black screen gesture recognition module 209 is specifically configured to detect whether a sliding event occurs on the touch screen 109 of the mobile terminal 100 when the mobile terminal 100 is in a black screen standby state, and recognize whether the sliding event is a black screen gesture of the mobile terminal 100. The black screen gesture recognition module 209 is further configured to recognize the black screen gesture input by the user, wake up the mobile terminal 100, and start a service or/and an application of the mobile terminal 100 corresponding to the black screen gesture when it is determined that the user inputs the black screen gesture into the mobile terminal 100.

Referring to fig. 8, based on the black screen gesture recognition apparatus S1, an embodiment of the present invention further provides a black screen gesture recognition method. The black screen gesture recognition method is applied to the black screen gesture recognition device S1 and the mobile terminal 100. In the black screen gesture recognition method, when the mobile terminal 100 is in a black screen standby state and a sliding event of a user on a touch screen of the mobile terminal 100 is detected, the sensitivity of the proximity sensor 114F is reduced to avoid the user from accidentally blocking the awakening termination of the black screen gesture caused by the proximity sensor 114F, so that the mobile terminal 100 can smoothly recognize the black screen gesture input by the user, and the recognition rate of the black screen gesture is improved. The black screen gesture recognition method specifically comprises the following steps:

step S101: detects the state of the mobile terminal 100 and controls the proximity sensor 114F to be in an on state when it is judged that the mobile terminal 100 is in the black standby state. Specifically, the state detection module 201 detects the state of the mobile terminal 100, and determines whether the mobile terminal 100 is in the black screen standby state according to the operating state of each service in the mobile terminal 100, and the proximity sensor control module 203 controls the proximity sensor 114F to be turned on when the state detection module 201 determines that the mobile terminal 100 is in the black screen standby state.

It is understood that, in some embodiments, when the mobile terminal 100 to which the black screen gesture recognition method is applied defaults to the on-proximity sensor 114F in the standby state, step S201 may be omitted and step S103 may be directly performed.

Step S103: the black screen gesture wake-up function of the mobile terminal 100 is initiated. Specifically, the black screen gesture control module 207 starts the black screen gesture wake-up function of the mobile terminal 100 when the mobile terminal 100 is in the black screen standby state. The screen wakeup function is to be understood as waking up the mobile terminal operating device S1, lighting up the screen of the mobile terminal 100, and activating the service or/and application corresponding to a specific gesture performed by the user on the touch screen in the black screen state of the mobile phone, and it is understood that the gesture is called a black screen gesture.

It is to be understood that, in some embodiments, when the mobile terminal 100 to which the black screen gesture recognition method is applied starts the black screen gesture wake-up function by default in the standby state, step S103 may be omitted, and step S105 is directly performed.

Step S105: when a sliding event on the touch screen 109 of the mobile terminal 100 is detected, the detection sensitivity of the proximity sensor 114F is lowered. Specifically, the black screen gesture recognition module 209 detects whether a sliding event occurs on the touch screen of the mobile terminal 100, and if the sliding event occurs on the touch screen of the mobile terminal 100, the proximity sensor 114F control module 10 decreases the detection sensitivity of the proximity sensor 114F to the first sensitivity.

Specifically, in some embodiments, where the detection sensitivity of the proximity sensor 114F is characterized by a proximity distance threshold, the proximity sensor control module 203 decreases the detection sensitivity of the proximity sensor 114F by decreasing the proximity distance threshold.

It is to be appreciated that in other embodiments, when the proximity sensor 114F is an infrared proximity sensor 114F, the detection sensitivity of the proximity sensor 114F is characterized by a proximity intensity threshold, and the proximity sensor control module 203 decreases the detection sensitivity of the proximity sensor 114F by increasing the proximity intensity threshold.

Step S107: the detection result of the proximity sensor 114F is acquired. Specifically, the proximity event determination module 205 acquires data detected by the proximity sensor 114F, compares the data with preset data, and determines whether a proximity event occurs according to the comparison result. Further, data detected by the proximity sensor are acquired, the data are compared with a preset proximity event trigger range, and if the data fall into the preset proximity event trigger range, a proximity event is considered to occur; and if the data does not fall into a preset proximity event triggering range, the proximity event is considered not to occur.

Specifically, in some embodiments, when the proximity distance threshold is used to characterize the sensitivity of the proximity sensor 114F, the proximity event determining module 205 is configured to acquire the proximity distance detected by the proximity sensor 114F, compare the proximity distance with the reduced proximity distance threshold, and if the proximity distance is less than or equal to the reduced proximity distance threshold, consider that the data detected by the proximity sensor 114F falls within the preset proximity event trigger range, and determine that a proximity event occurs.

It is understood that in other embodiments, when the proximity intensity threshold is used to characterize the sensitivity of the proximity sensor 114F, the proximity event determining module 205 is configured to obtain the proximity intensity detected by the proximity sensor 114F, compare the proximity intensity with the increased proximity intensity threshold, and if the proximity intensity is greater than or equal to the increased proximity intensity threshold, determine that the data detected by the proximity sensor 114F falls within the preset proximity event trigger range, and determine that a proximity event occurs.

Step S109: the wake-up of the black screen gesture of the mobile terminal 100 is continuously maintained or stopped according to the detection result of the proximity sensor 114F. Specifically, the black screen gesture control module 207 stops the black screen gesture wake-up function of the mobile terminal 100 when the proximity event determination module 205 determines that a proximity event occurs, and otherwise, continues to maintain the black screen gesture wake-up function of the mobile terminal 100. It should be understood that the "stopping the black screen gesture wake-up function of the mobile terminal 100 at this time" means that the mobile terminal 100 stops recognizing the black screen gesture input on the touch screen 109 at this time.

For example, in a low-sensitivity state, when the proximity distance threshold is used to represent the sensitivity of the proximity sensor 114F, when the proximity distance value measured by the proximity sensor 114F is greater than or equal to 5, it is determined that a proximity event does not occur at this time, and it is determined that no object blocks the proximity sensor 114F, so that it is determined that the user normally operates the black screen gesture function; when the proximity distance measured by the proximity sensor 114F is less than 5, it is determined that the proximity sensor 114F is actually covered by an object, and in this low-sensitivity state, it is determined that the occurrence of the proximity event is not an unintentional cover in the process of the user input gesture, and it is determined that the black screen gesture input for the mobile terminal 100 at this time is an erroneous input, and the wake-up of the black screen gesture of the mobile terminal 100 at this time should be stopped.

For another example, in a low-sensitivity state, when the proximity intensity threshold is used to represent the sensitivity of the proximity sensor 114F, when the proximity intensity value measured by the proximity sensor 114F is less than or equal to 500, it is determined that a proximity event does not occur at this time, and it is determined that no object blocks the proximity sensor 114F, so that it is determined that the user normally operates the black screen gesture function; when the proximity intensity measured by the proximity sensor 114F is greater than 500, it is determined that an object blocks the proximity sensor 114F, and in this low-sensitivity state, it is determined that the occurrence of the proximity event is not an unintentional block in the process of the user input gesture, and it is determined that the black screen gesture input for the mobile terminal 100 at this time is an erroneous input, and the black screen gesture wake-up function of the mobile terminal 100 at this time should be stopped.

It is understood that in some embodiments, after the mobile terminal 100 stops recognizing the black screen gesture input on the touch screen 109 at this time, the data detected by the proximity sensor 114F is continuously monitored, and if the proximity event is determined to be cancelled, the recognition of the black screen gesture received by the touch screen 109 is resumed. The above-mentioned "proximity event cancelled" should be understood as: the data detected by the proximity sensor 114F is compared with a preset proximity event trigger range, and if the data does not fall within the preset proximity event trigger range, the proximity event is considered to be cancelled.

It is understood that, in some other embodiments, in step S109, if it is determined that a proximity event occurs, the recognition of the black screen gesture input on the touch screen 109 at this time may be stopped by turning off the black screen gesture wake-up function of the mobile terminal 100. Further, after the black screen gesture wake-up function of the mobile terminal 100 is turned off, the data detected by the proximity sensor 114F is continuously monitored, and if the data detected by the proximity sensor 114F indicates that the proximity event has been cancelled, the black screen gesture wake-up function of the mobile terminal 100 is recovered. The above-mentioned "proximity event cancelled" should be understood as: the data detected by the proximity sensor 114F is compared with a preset proximity event trigger range, and if the data does not fall within the preset proximity event trigger range, the proximity event is considered to be cancelled.

Step S111: a black screen gesture input by the user is recognized and the mobile terminal 100 is woken up. Specifically, when determining that the user inputs the black screen gesture to the mobile terminal 100, the black screen gesture recognition module 209 recognizes the black screen gesture input by the user, wakes up the mobile terminal 100, and starts a service or/and an application corresponding to the black screen gesture of the mobile terminal 100.

In summary, in the device and the method for recognizing a black screen gesture provided by the embodiments of the present invention, when the mobile terminal is in a black screen standby state, and a sliding event of a user on a touch screen of the mobile terminal is detected, the detection sensitivity of the proximity sensor is reduced, and when the user inputs the black screen gesture on the sliding screen, even if the user carelessly shields the proximity sensor by an operation posture, the black screen gesture input is not disabled or the passive terminal recognizes an error, so that a situation that the user unintentionally shields the proximity sensor to cause a termination of the black screen gesture awakening or a recognition error can be avoided, and the mobile terminal can smoothly recognize the black screen gesture input by the user, so as to obtain a higher recognition rate in a more intelligent manner, reduce an erroneous operation rate of the mobile terminal for the black screen awakening, and improve user experience.

Referring to fig. 2 again, based on the black screen gesture recognition device S1 and the black screen gesture recognition method, an embodiment of the present invention further provides a mobile terminal 100, which includes an electronic body 10, where the electronic body 10 includes a housing 12 and a main display 120 disposed on the housing 12. The housing 12 may be made of metal, such as steel or aluminum alloy. In this embodiment, the main display 120 generally includes the display panel 111, and may also include a circuit or the like for responding to a touch operation performed on the display panel 111. The Display panel 111 may be a Liquid Crystal Display (LCD) panel, and in some embodiments, the Display panel 111 is a touch screen 109.

Referring to fig. 9, in an actual application scenario, the mobile terminal 100 may be used as a smart phone terminal, in which case the electronic body 10 generally further includes one or more processors 102 (only one is shown in the figure), a memory 104, an RF (Radio Frequency) module 106, an audio circuit 110, a sensor 114, an input module 118, and a power module 122. It will be understood by those skilled in the art that the structure shown in fig. 9 is merely illustrative and is not intended to limit the structure of the electronic body 10. For example, the electronics body portion 10 may also include more or fewer components than shown in FIG. 9, or have a different configuration than shown in FIG. 9.

Those skilled in the art will appreciate that all other components are peripheral devices with respect to the processor 102, and that the processor 102 is coupled to the peripheral devices via a plurality of peripheral interfaces 124. The peripheral interface 124 may be implemented based on the following criteria: universal Asynchronous Receiver/Transmitter (UART), General Purpose Input/Output (GPIO), Serial Peripheral Interface (SPI), and Inter-Integrated Circuit (I2C), but the present invention is not limited to these standards. In some examples, the peripheral interface 124 may include only a bus; in other examples, the peripheral interface 124 may also include other elements, such as one or more controllers, for example, a display controller for interfacing with the liquid crystal display panel 111 or a memory controller for interfacing with a memory. In addition, the controller may be separate from the peripheral interface 124 and integrated within the processor 102 or a corresponding peripheral.

The memory 104 may be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 104. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the electronic body portion 10 or the primary display 120 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The RF module 106 is used for receiving and transmitting electromagnetic waves, and implementing interconversion between the electromagnetic waves and electrical signals, thereby communicating with a communication network or other devices. The RF module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The RF module 106 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The Wireless network may use various Communication standards, protocols, and technologies, including, but not limited to, Global System for Mobile Communication (GSM), Enhanced Mobile Communication (Enhanced Data GSM Environment, EDGE), wideband Code division multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (WiFi) (e.g., IEEE802.1 a, IEEE802.11 b, IEEE802.1 g, and/or IEEE802.11 n), Voice over internet protocol (VoIP), world wide mail Access (Microwave for Wireless communications, wimax), and any other suitable protocol for instant messaging, and may even include those protocols that have not yet been developed.

The audio circuitry 110, speaker 101, sound jack 103, microphone 105 collectively provide an audio interface between a user and the electronic body portion 10 or main display 120. Specifically, audio circuitry 110 receives sound data from processor 102, converts the sound data to an electrical signal, and transmits the electrical signal to speaker 101. The speaker 101 converts the electric signal into a sound wave that can be heard by the human ear. The audio circuitry 110 also receives electrical signals from the microphone 105, converts the electrical signals to sound data, and transmits the sound data to the processor 102 for further processing. The audio data may be retrieved from the memory 104 or through the RF module 106. In addition, audio data may also be stored in the memory 104 or transmitted through the RF module 106.

The sensors 114 are disposed within the electronic body portion 10 or within the main display 120, examples of sensors 114 include, but are not limited to: light sensors, operational sensors, pressure sensors, gravitational acceleration sensors, and other sensors.

In particular, the light sensor may include an ambient light sensor and a proximity sensor 114F, wherein the ambient light sensor may detect the brightness of the ambient light, and some modules executed by the processor 102 may automatically adjust the output of the display using the output of the ambient light sensor. The proximity sensor 114F may turn off the display output by the processor 102 when an object is near the primary display 120, such as when the electronic body portion 10 is moved to the ear. Specifically, in the present embodiment, the proximity sensor 114F is disposed adjacent to the display panel 111.

Specifically, the proximity sensor 114F may be an infrared proximity sensor, which includes an infrared transmitting tube and an infrared receiving tube, and operates by infrared reflection and infrared reception, and when an object approaches the mobile terminal 100, the intensity of infrared rays reflected by the infrared proximity sensor is large; when the object is far away from the mobile terminal 100, the intensity of the infrared ray reflected back by the infrared proximity sensor after being emitted is small, the infrared proximity sensor obtains a proximity intensity value based on the detected intensity of the reflected infrared ray, and the distance between the mobile terminal 100 and the proximity object can be known through a relation table between the proximity intensity value and a 'proximity intensity value-object distance' prestored in the mobile terminal 100.

As one of the motion sensors, the gravitational acceleration sensor may detect the magnitude of acceleration in various directions (generally three axes), detect the magnitude and direction of gravity when stationary, and be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), and the like, for recognizing the attitude of the mobile terminal 100. In addition, the electronic body 10 may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer and a thermometer, which are not described herein,

in this embodiment, the input unit 118 may include a touch screen 109 disposed on the main display 120, and the touch screen 109 may collect touch operations of the user on or near the touch screen 109 (e.g., operations of the user on or near the touch screen 109 using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. Alternatively, the touch screen 109 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 102, and can receive and execute commands sent by the processor 102. In addition, the touch screen 109 may be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch screen 109, in other modified embodiments, the input unit 118 may include other input devices, such as the keys 107. The keys 107 may include, for example, character keys for inputting characters, and control keys for triggering control functions. Examples of control buttons include a "back to home" button, a power on/off button, and the like.

The main display 120 is used to display information input by the user, information provided to the user, and various graphic user interfaces of the electronic main body section 10, which may be configured by graphics, text, icons, numerals, video, and any combination thereof, and in one example, the touch screen 109 may be provided on the display panel 111 so as to be integrated with the display panel 111.

The power module 122 is used to provide a supply of power to the processor 102 and other components. In particular, the power module 122 may include a power management system, one or more power sources (e.g., batteries or ac power), a charging circuit, a power failure detection circuit, an inverter, a power status indicator light, and any other components associated with the generation, management, and distribution of power within the electronic body portion 10 or the primary display 120.

It should be understood that the mobile terminal 100 described above is not limited to a smartphone terminal, but it should refer to a computer device that can be used in mobility. Specifically, the mobile terminal 100 refers to a mobile computer device equipped with an intelligent operating system, and the mobile terminal 100 includes, but is not limited to, a smart phone, a smart watch, a notebook, a tablet computer, a POS machine, and even a vehicle-mounted computer.

The embodiment of the present invention further provides a storage medium, where the storage medium stores a program code, and when the program code runs, the black screen gesture recognition method is executed, and the specific principle and implementation manner of the black screen gesture recognition method are similar to those described in the foregoing method embodiments, and are not described herein again.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.

More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (mobile terminal) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments. In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions.

Claims

1. A black screen gesture recognition method is applied to a mobile terminal with a touch screen, a proximity sensor is arranged in the mobile terminal, and the method is characterized in that the mobile terminal can support the functions of recognizing a black screen gesture input to the touch screen and awakening the black screen gesture of the mobile terminal in a black screen standby state, and the black screen gesture recognition method comprises the following steps:

detecting the state of the mobile terminal;

when the mobile terminal is in a black screen standby state, controlling a proximity sensor to be in an open state, and starting a black screen gesture recognition function of the mobile terminal;

when the mobile terminal is in a black screen standby state and a sliding event applied by an external force on a touch screen of the mobile terminal is detected, reducing the detection sensitivity of the proximity sensor to a preset sensitivity, wherein the detection sensitivity of the proximity sensor is reduced to the preset sensitivity by reducing a proximity distance threshold of the proximity sensor or/and by improving a proximity strength threshold of the proximity sensor; the sliding event is an initial stage that the external force intends to complete a preset graph, and is not an event that the external force continuously presses the touch screen until the preset graph is completed;

acquiring detection data of the proximity sensor after the detection sensitivity is reduced, and comparing the data with a preset proximity event trigger range;

if the data does not fall into a preset proximity event triggering range, the proximity event is considered not to occur, and a black screen gesture received by the touch screen is kept recognized;

and if the data falls into a preset proximity event triggering range, determining that a proximity event occurs, stopping recognizing the black screen gesture received by the touch screen, and closing the black screen gesture recognition function of the mobile terminal.

2. The black screen gesture recognition method of claim 1, wherein the reducing the detection sensitivity of the proximity sensor to a preset sensitivity comprises: reducing the detection sensitivity of the proximity sensor to a preset sensitivity by reducing a proximity distance threshold of the proximity sensor;

and acquiring data detected by the proximity sensor after the detection sensitivity is reduced, comparing the data with a preset proximity event trigger range, acquiring the proximity distance detected by the proximity sensor, judging that the proximity distance falls into the preset proximity event trigger range if the proximity distance is smaller than or equal to the reduced proximity distance threshold, and considering that the proximity event occurs.

3. The method for recognizing the black screen gesture according to claim 1, wherein the proximity sensor is an infrared proximity sensor, and the reducing the detection sensitivity of the proximity sensor to a preset sensitivity comprises: reducing the detection sensitivity of the proximity sensor to a preset sensitivity by increasing a proximity intensity threshold of the proximity sensor;

and acquiring data detected by the proximity sensor after the detection sensitivity is reduced, comparing the data with a preset proximity event trigger range, acquiring the proximity intensity detected by the proximity sensor, judging that the proximity intensity falls into the preset proximity event trigger range if the proximity intensity is greater than or equal to the improved proximity intensity threshold, and considering that the proximity event occurs.

4. The method for recognizing the black screen gesture according to claim 1, wherein according to the detection result, if the recognition of the black screen gesture received by the touch screen is stopped, the data detected by the proximity sensor is continuously monitored, and if the proximity event is determined to be cancelled, the recognition of the black screen gesture received by the touch screen is resumed.

5. The method for recognizing the black screen gesture according to claim 1, wherein according to the detection result, if the black screen gesture recognition function of the mobile terminal is turned off, the data detected by the proximity sensor is continuously monitored, and if the proximity event is determined to be cancelled, the black screen gesture recognition function of the mobile terminal is restored.

6. A black screen gesture recognition device operates on a mobile terminal with a touch screen, a proximity sensor is arranged in the mobile terminal, the mobile terminal is characterized in that the mobile terminal can support the functions of recognizing black screen gestures input to the touch screen and awakening the black screen gestures of the mobile terminal in a black screen standby state, the black screen gesture recognition device is used for executing the black screen gesture recognition method of any one of claims 1-5, and the black screen gesture recognition device comprises:

the state detection module is used for detecting the state of the mobile terminal;

the proximity sensor control module is used for controlling the proximity sensor to be in an on state when the mobile terminal is in a black screen standby state;

the black screen gesture control module is used for starting a black screen gesture recognition function of the mobile terminal when the mobile terminal is in a black screen standby state;

the mobile terminal comprises a black screen gesture recognition module, a display module and a display module, wherein the black screen gesture recognition module is used for detecting whether a touch screen of the mobile terminal is subjected to a sliding event exerted by an external force when the mobile terminal is in a black screen standby state, the sliding event is an initial stage when the external force intends to finish a preset graph and is not an event after the external force continuously presses the touch screen until the preset graph is finished;

the proximity sensor control module is further configured to reduce the detection sensitivity of the proximity sensor to a preset sensitivity when the black screen gesture recognition module detects that an external force is pressed on the touch screen of the mobile terminal and continuously slides, wherein the detection sensitivity of the proximity sensor is reduced to the preset sensitivity by reducing a proximity distance threshold of the proximity sensor or/and by increasing a proximity strength threshold of the proximity sensor; and

the proximity event judgment module is used for acquiring detection data of the proximity sensor after the detection sensitivity is reduced, comparing the data with a preset proximity event trigger range, and if the data does not fall into the preset proximity event trigger range, determining that a proximity event does not occur; if the data falls into a preset proximity event triggering range, the proximity event is considered to have occurred;

the black screen gesture recognition module is further used for continuously keeping recognizing the black screen gesture received by the touch screen when the proximity event does not occur, or stopping recognizing the black screen gesture received by the touch screen when the proximity event occurs, and the black screen gesture control module is further used for closing the black screen gesture recognition function of the mobile terminal when the proximity event occurs.

7. The utility model provides a mobile terminal, include the mobile terminal main part and set up in touch-sensitive screen in the mobile terminal main part, its characterized in that, mobile terminal can support discernment when black screen standby state to the black screen gesture of touch-sensitive screen input is awaken up mobile terminal's black screen gesture awakening function, mobile terminal still includes:

a proximity sensor disposed on the mobile terminal body;

one or more processors;

a memory; and

the black screen gesture recognition device of claim 6, stored in the memory and configured to be executed by the one or more processors.

8. A storage medium having program code stored therein, wherein the program code when executed performs the method of any one of claims 1 to 5.