WO2019019818A1

WO2019019818A1 - Method and apparatus for accelerating black screen gesture processing, storage medium, and mobile terminal

Info

Publication number: WO2019019818A1
Application number: PCT/CN2018/090506
Authority: WO
Inventors: 韩通; 郭明强; 石仁栋; 张强; 汪昊
Original assignee: Oppo广东移动通信有限公司
Priority date: 2017-07-28
Filing date: 2018-06-08
Publication date: 2019-01-31
Also published as: CN107402713A; CN107402713B

Abstract

Method and apparatus for accelerating black screen gesture processing, a storage medium, and a mobile terminal. The method comprises: acquiring a gesture type corresponding to a black screen gesture when a black screen gesture event is detected; obtaining gesture complexity corresponding to the black screen gesture by means of matching according to the gesture type; determining a data sampling strategy according to the gesture complexity, and acquiring gesture coordinates of the black screen gesture according to the data sampling strategy; and drawing a gesture trajectory corresponding to the black screen gesture by means of at least one drawing thread according to the acquired gesture coordinates, and enabling a touch display screen to display the gesture trajectory according to a set screen refreshing rate.

Description

Method, device, storage medium and mobile terminal for speeding up black screen gesture processing

Technical field

The embodiments of the present application relate to a mobile terminal technology, for example, to a method, an apparatus, a storage medium, and a mobile terminal for speeding up black screen gesture processing.

Background technique

With the development of technology, different types of electronic devices with touch screens are widely used, such as smart phones, tablets or handheld game consoles. The touch technology used in these devices provides a convenient input method and brings great convenience.

The functions developed on the basis of touch screen display are also increasing, and the black screen gesture is one of the representative and technological future. The so-called black screen gesture can be a function of the user to draw some specific patterns on the touch screen display to enable a certain application to be quickly opened without requiring a bright screen. However, the black screen gesture has a large amount of data processing and a slow processing speed, which also improves the power consumption of the system to a certain extent, and has a certain degree of influence on the normal use of the mobile terminal.

The black screen gesture function has the above technical problems, and a corresponding solution is urgently needed.

Summary of the invention

The embodiment of the present invention provides a method, an apparatus, a storage medium, and a mobile terminal for speeding up black screen gesture processing, which can reduce the amount of processed data and improve the processing speed of the black screen gesture.

In a first aspect, an embodiment of the present application provides a method for speeding up black screen gesture processing, where the method includes:

When a black screen gesture event is detected, the gesture type corresponding to the black screen gesture is acquired;

Matching the gesture complexity corresponding to the black screen gesture according to the gesture type;

Determining a data sampling policy according to the gesture complexity, and collecting gesture coordinates of the black screen gesture according to the data sampling policy;

And drawing, by the at least one drawing thread, a gesture track corresponding to the black screen gesture according to the captured gesture coordinates, so that the touch display screen displays the gesture track according to the set screen refresh rate.

In a second aspect, the embodiment of the present application further provides an apparatus for speeding up black screen gesture processing, and the apparatus includes:

The gesture event detection module is configured to acquire a gesture type corresponding to the black screen gesture when the black screen gesture event is detected;

The complexity matching module is configured to match the gesture complexity corresponding to the black screen gesture according to the gesture type;

a sampling policy determining module, configured to determine a data sampling policy according to the gesture complexity, and collect gesture coordinates of the black screen gesture according to the data sampling policy;

The gesture track drawing module is configured to determine, by the at least one drawing thread, the gesture track corresponding to the black screen gesture according to the captured gesture coordinates, so that the touch display screen displays the gesture track according to the set screen refresh rate.

In a third aspect, the embodiment of the present application further provides a computer readable storage medium, where the storage medium stores a computer program, and when the program is executed by the processor, the black screen gesture is implemented as described in any one of the embodiments of the present application. The method of processing.

In a fourth aspect, the embodiment of the present application further provides a mobile terminal, including a touch display screen, a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor executes the computer The method for speeding up the black screen gesture processing as described in any of the embodiments of the present application is implemented in the program.

The method, device, storage medium and mobile terminal for speeding up black screen gesture processing in the embodiments of the present application determine different data sampling strategies according to different gesture types, so as to implement multiple gesture coordinate reading modes and reduce read data of the application layer. The amount and amount of data used in drawing gesture trajectories improves the processing speed of black screen gestures, reduces system response time, and reduces system power consumption.

DRAWINGS

FIG. 1 is a flowchart of a method for speeding up black screen gesture processing according to an embodiment of the present application.

FIG. 2 is a schematic diagram of an Android system framework according to an embodiment of the present application.

FIG. 3 is a schematic diagram of display of a black screen gesture track according to an embodiment of the present application.

FIG. 4 is a flowchart of another method for speeding up black screen gesture processing according to an embodiment of the present disclosure.

FIG. 5 is a flowchart of another method for speeding up black screen gesture processing according to an embodiment of the present disclosure.

FIG. 6 is a structural block diagram of an apparatus for speeding up black screen gesture processing according to an embodiment of the present application.

FIG. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.

Detailed ways

The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting. In addition, it should be noted that, for the convenience of description, only some but not all of the structures related to the present application are shown in the drawings.

Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as a process or method depicted as a flowchart. Although the flowchart depicts multiple steps as a sequential process, many of the steps can be implemented in parallel, concurrently or concurrently. In addition, the order between multiple steps can be rearranged. The process may be terminated when its operation is completed, but may also have additional steps not included in the figures. The processing may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

The black screen gesture function may be that when the mobile terminal (for example, a smart phone) is in a sleep-out state, the touch display screen operates in a low power consumption state to detect a black screen gesture acting on the touch display screen under the screen-off, and according to The black screen gesture wakes up a certain function of the smartphone or turns on a preset function corresponding to the application of the black screen gesture type. In order to facilitate the understanding of the black screen gesture function, the following describes the flow of the application corresponding to the black screen gesture detected by the blank screen gesture to the application layer, and the process includes: storing the gesture data corresponding to the black screen gesture into the driver layer. Within the preset node, wherein the gesture data includes gesture coordinates and gesture type; the drive layer performs black screen gesture data validity determination; if valid, the frame layer performs black screen gesture event dispatch; after the application layer receives the black screen gesture event The application layer reads the gesture coordinates from the preset node in the driver layer, calculates the animation track of the black screen gesture according to the gesture coordinates and the gesture type, and sends the animation track data to the frame buffer (FrameBuffer) to follow the set screen refresh rate. The animation track is refreshed to the touch display screen for display; then, the application layer performs an operation of opening the application corresponding to the black screen gesture.

In the above black screen gesture recognition process, when the user inputs a black screen gesture, the gesture data is read and recognized by the driver layer, and the application layer reads the data and draws the gesture when receiving the black screen gesture event reported by the driver layer. When the trajectory is used, the data is read and the trajectory is drawn according to the unified sampling strategy. However, due to the complexity of the trajectory of different black screen gestures, for simple gestures (such as the gesture trajectory “|”), only a small amount of reading is needed. At the sampling point, the gesture trajectory can be drawn. For more complex gestures (such as gesture track "M"), feature points (such as inflection points) and partial sample points are required to draw the gesture track. The method for speeding up the black screen gesture processing provided by the embodiment of the present invention can determine different data sampling strategies and drawing modes according to the black screen gesture type, which can reduce the data processing amount, reduce the memory occupied by the data, and reduce the system function. Consumption.

FIG. 1 is a flowchart of a method for speeding up a black screen gesture process according to an embodiment of the present disclosure. The method may be applied to a device for speeding up a black screen gesture process, where the method may be performed by a device that speeds up black screen gesture processing, where The device can be implemented in software and/or hardware and can be integrated into a mobile terminal. As shown in Figure 1, the method includes:

Step 110: Acquire a gesture type corresponding to the black screen gesture when the black screen gesture event is detected.

The black screen gesture event may be an event that is pre-negotiated by the driver layer and the application layer for representing a black screen gesture input.

The black screen gesture may be a touch gesture input by the user on the touch display screen of the mobile terminal that is in the off state after the black screen gesture function is turned on. It can be understood that the black screen gesture is not limited to the touch gesture input on the touch display screen, but may also be an operation detected by the sensor of the mobile terminal or the like. For example, shaking the gesture of the smartphone from side to side, gestures from the touch screen of the smartphone, gestures pressing the border of the smartphone, and the like.

2 is a schematic diagram of an Android system framework provided by an embodiment of the present application. The execution flow of the black screen gesture function provided by the embodiment of the present application is described by taking the mobile terminal shown in FIG. 2 as an example of the mobile terminal of the Android system. As shown in FIG. 2, the Android system framework includes a kernel layer 210, a core class library layer 220, a framework layer 230, and an application layer 240 from bottom to top. The kernel layer 210 provides core system services, including security, memory management, process management, network protocol stack, and hardware drivers. The hardware driver in the kernel layer 210 is referred to as a driving layer 211, and the driving layer 211 includes a touch screen display driver, a camera driver, and the like. The core class library layer 220 includes an Android runtime environment (Android Runtime) and a class library (Libraries). Among them, Android Runtime provides most of the functions available in the Java programming language core class library, including the core library (Core Libraries) and the Dalvik virtual machine (Dalvik VM). Each Android application is an instance of the Dalvik virtual machine running in their own process. The class library is used by various components of the Android system, including the following functions: Media Framework, Surface Manager, Relational Database Engine (SQLite), Bitmap and Vector Font Rendering (FreeType), etc. It is exposed to developers through the framework layer 230 of Android. The framework layer 230 provides a series of class libraries needed to develop Android applications, enabling developers to develop applications quickly, to reuse components, and to extend personalization through inheritance. The services provided include component management services. Window management services, system data source components, space frameworks, resource management services, and installation package management services. The application layer 240 includes a plurality of applications that directly interact with the user, or a service program written in the Java language and running in the background, including a desktop application, a contact application, a call application, a camera application, a picture browser, a game, a map, Programs such as web browsers, and other applications developed by developers.

Exemplarily, after the black screen gesture function is turned on, the touch chip generates a wake-up signal when the black screen gesture is detected, and sends the wake-up signal to the kernel layer 210. The wake-up signal triggers the kernel layer 210 to perform a system wake-up operation. After the system wakes up, the kernel layer 210 invokes the driver layer 211 interrupt function to perform an operation of reading the gesture data in the touch chip, and stores the read gesture data in the preset node of the driver layer 211. The touch chip is configured to output a touch sensing control signal to the touch display screen to detect a touch operation, identify a gesture coordinate of a black screen gesture acting on the touch display screen, and store the gesture coordinate as a gesture data in its own register. in. The preset node can be a file node, for example, a virtual file node in the proc-D directory. After the data is read, the driver layer determines the validity of the gesture data. There are many ways to determine the validity, which is not specifically limited in this embodiment. For example, the driver layer 211 determines the gesture type according to the gesture coordinates included in the gesture data, and stores the determined gesture type as gesture data in the preset node. If the gesture type is not a preset black screen gesture, it is determined that the gesture data is invalid. For another example, the driving layer collects the number of the gesture data, determines whether the number satisfies the requirement of drawing a preset black screen gesture, and if the requirement of drawing the preset black screen gesture is not satisfied, determining that the gesture data is invalid. When the data is valid, the driver layer 211 reports a black screen gesture event. The black screen gesture event is transmitted to the framework layer 230 through the core class library layer 220 and distributed through the framework layer 230 to the application layer 240. When the application layer 240 acquires a black screen gesture event, the gesture data is read by the preset node of the driver layer 211. After the gesture data is prepared, the black screen gesture track is calculated according to the gesture coordinates included in the gesture data, and the black screen gesture track is drawn on the touch display screen for display. The application layer 240 then opens an application corresponding to the gesture type based on the type of gesture in the read gesture data. The gesture type may be a gesture for implementing a certain function preset in the mobile terminal, or may be a user-defined gesture. For example, the gesture type can be 0, which means that the camera is turned on. As another example, the gesture type can be V, which means turning on the flashlight and the like.

The execution flow of the black screen gesture function is not limited to the manner enumerated in this embodiment. For example, the black screen gesture event may be reported when the system wakes up, and the kernel layer 210 calls the driver layer 211 interrupt function to perform the operation of reading the gesture data in the touch chip, and stores the gesture data in the preset node of the driver layer 211. When the black screen gesture event is reported, the parallel execution driving layer 211 reads the gesture data, and determines the operation of the gesture type according to the gesture data. For example, the driving layer 211 acquires gesture data in the preset node, and performs curve fitting on the gesture data to obtain a gesture type that is closest to the black screen gesture, and stores the gesture type as gesture data in the preset node. When the application layer 240 receives the black screen gesture event, it is detected whether the gesture data in the preset node is ready to be completed according to the set period. When the preparation is completed, the application layer 240 reads the gesture data from the preset node. When the gesture data is successfully read and valid, the black screen gesture track is calculated according to the gesture coordinates included in the gesture data, and the black screen gesture track is drawn on the touch display screen for display. The application layer 240 then opens an application corresponding to the gesture type based on the type of gesture in the read gesture data.

Step 120: Match the gesture complexity corresponding to the black screen gesture according to the gesture type.

For each gesture type, a gesture complexity can be correspondingly used. The gesture complexity is used to measure the complexity of the black screen gesture track, and belongs to the attribute of the black screen gesture itself, for example, the number of inflection points included in the gesture track, or the included The number of segments and so on. After the application layer 240 obtains the gesture type, the corresponding gesture complexity is matched according to the gesture type.

Step 130: Determine a data sampling policy according to the gesture complexity, and collect gesture coordinates of the black screen gesture according to the data sampling policy.

The complexity of the gesture affects the difficulty level of the gesture trajectory determination and drawing. When the gesture complexity is large, more coordinate points can be collected. When the gesture complexity is small, fewer coordinate points can be collected. For example, a gesture type of "|" can complete the determination and drawing of the gesture track by simply collecting the start point and the end point. Therefore, for different gesture complexity, the sampling reading mode when reading the gesture coordinates is determined, and the data sampling strategy may be to collect a coordinate point as a sampling point every set number of coordinate points, or collect feature points (such as starting point, middle Point or end point, etc. as a sampling point, etc.

Step 140: Draw a gesture track corresponding to the black screen gesture according to the captured gesture coordinates by using at least one drawing thread, so that the touch display screen displays the gesture track according to the set screen refresh rate.

The gesture track corresponding to the black screen gesture may be determined by curve fitting according to the read coordinate points. There are many ways to draw gesture trajectories through at least one drawing thread. For example, in order to more realistically reproduce the black screen gesture input by the user, the drawing thread can acquire the read multiple sampling points, and sequentially connect the plurality of sampling points to obtain the gesture. The gesture track corresponding to the type, and the frame frame including the connection between the sampling point and the sampling point is sent to the frame buffer (FrameBuffer), the gesture track is displayed in an animated manner, and the black screen gesture track is displayed according to the set screen refresh rate. Refresh to the touch display to simulate the drawing process of the black screen gesture. It should be noted that the foregoing process may be separately performed by one drawing thread, or may be separately drawn by at least two drawing threads. After each drawing thread completes the gesture track segment that is responsible for drawing, the completed gesture track segment is spliced into a complete gesture track, thereby effectively improving the drawing efficiency of the gesture track.

The technical solution of the embodiment of the present application is to obtain a gesture type corresponding to the black screen gesture when the black screen gesture event is detected, and to match the gesture complexity corresponding to the black screen gesture according to the gesture type; and determine the data sampling according to the gesture complexity. a strategy, and reading a gesture coordinate according to the data sampling policy; drawing, by the at least one drawing thread, a gesture track corresponding to the black screen gesture according to the read gesture coordinate, and displaying the gesture according to the set screen refresh rate Track. Different data sampling strategies are determined according to different gesture types to implement multiple gesture coordinate reading modes, which reduces the amount of data read by the application layer and the amount of data used when drawing the gesture track, thereby improving the processing speed of the black screen gesture. Reduce system response time and reduce system power consumption.

In an embodiment, the gesture complexity may be the number of inflection points in the standard graphic corresponding to the gesture type;

The standard graphic corresponding to the gesture type is the template track corresponding to the gesture type. For example, if the gesture type is “M”, the gesture complexity may be determined according to the number of inflection points of the standard graphic “M” stored in the mobile terminal, “M. The number of inflection points included in the figure is 3, and it can be determined that the gesture complexity of the gesture type is 3. The gesture complexity corresponding to other gesture types is determined in the same way as this process.

The data sampling strategy may be: writing the time sequence of the preset nodes in the driving layer of the operating system according to the gesture coordinates of the black screen gesture, and reading the gesture coordinates at the starting point, the ending point, and the inflection point as reference points, in any two The gesture coordinates are read between the reference points by a preset number of intervals.

When the user inputs a black screen gesture, the driver layer sequentially reads the black screen gesture data, for example, may read a coordinate point at regular intervals. Therefore, each gesture coordinate is written to the preset nodes in the driver layer in a chronological order. For a type of gesture, the application layer can read data according to different data sampling strategies. Generally speaking, the reading of the starting point, the ending point and the inflection point is necessary. For other coordinate points, the preset can be set according to actual needs. Set the number of intervals to read. For example, if the gesture type is “|” and the number of inflection points is 0, the determination of the gesture track may be completed by only selecting the start point and the end point, or only the start point, the middle point, and the end point may be selected for the determination of the gesture track. For another example, if the gesture type is “M” and the number of inflection points is 3, it can be determined according to the number of inflection points, reading the starting point, the inflection point, and the ending point as feature points, and reading between any two feature points according to the preset interval number. Take the gesture coordinates. For example, it is possible to read 3 points and the like between two feature points. 3 is a schematic diagram of display of a black screen gesture track provided by an embodiment of the present application, in which a start point 301, a first inflection point 302, a second inflection point 303, a third inflection point 304, and an end point 305 of the gesture type “W” are used as feature points. Three gesture coordinates are selected between the two feature points, and the gesture trajectory is drawn by using all the gesture coordinates read. Specifically, the gesture trajectory can be determined by curve fitting. The method of reading data and the way of drawing the gesture track can reduce the amount of data processing, simplify the determination process of the gesture track under the premise of ensuring the accuracy of the gesture track, improve the system processing efficiency, and reduce the system response time. , reducing system power consumption.

FIG. 4 is a flowchart of another method for speeding up black screen gesture processing according to an embodiment of the present disclosure. The present embodiment is applicable to improving a black screen gesture processing speed, and the method may be performed by a device for speeding up black screen gesture processing, where The device can be implemented by software and/or hardware and can generally be integrated in a mobile terminal. As shown in FIG. 4, the method includes:

Step 410: Determine, for the at least one preset gesture type, the number of inflection points of the preset black screen gesture corresponding to each preset gesture type, and determine the gesture complexity corresponding to the gesture type according to the number of the inflection points.

The preset black screen gesture may be a gesture that is provided by the system, or may be a user-defined gesture. The number of inflection points may be determined according to a standard pattern corresponding to the gesture type, or the black screen gesture track may be determined in advance according to the gesture data input by the user history, and the number of inflection points is determined. For example, the number of inflection points corresponding to the gesture track “M” or “W” is three, and the number of inflection points corresponding to the gesture track “V” is one. The corresponding gesture complexity can be determined according to the number of different inflection points. For example, the more the number of inflection points, the larger the value of the gesture complexity.

Step 420: Store each of the preset gesture types in association with a corresponding gesture complexity.

The gesture type is stored in association with the corresponding gesture complexity, so that it can be retrieved at any time during use, and the gesture complexity corresponding to each gesture type is matched according to the stored result.

Step 430: Acquire a gesture type corresponding to the black screen gesture when the black screen gesture event is detected.

Step 440: Match the gesture complexity corresponding to the black screen gesture according to the gesture type.

For example, after the gesture type of the same gesture type as the black screen gesture is found in the stored preset gesture type, the gesture complexity corresponding to the black screen gesture can be obtained according to the gesture type.

Step 450: Determine a data sampling policy according to the gesture complexity, and collect gesture coordinates of the black screen gesture according to the data sampling policy.

Step 460: Draw a gesture track corresponding to the black screen gesture according to the captured gesture coordinates by using at least one drawing thread, so that the touch display screen displays the gesture track according to the set screen refresh rate.

The technical solution of the embodiment of the present application determines the gesture complexity of the gesture type according to the number of inflection points, and stores the gesture type and the gesture complexity in association, so that the gesture complexity can be directly obtained after the gesture type of the black screen gesture is acquired, and then the gesture is based on the gesture. The complexity determines the data sampling strategy, which makes the process of determining the complexity of the gesture more convenient, reduces the data processing capacity of the system, and reduces the power consumption of the system.

In an embodiment, after determining the number of inflection points of the black screen gesture, the method may further include:

The gesture complexity corresponding to the preset gesture type is divided into at least two complexity levels according to the number of inflection points, and each of the complexity levels matches a data sampling strategy for the gesture coordinates.

Among them, since there are some commonalities between gesture trajectories with the same number of inflection points, the same data sampling strategy can be adopted for gesture trajectories with the same number of inflection points. The gesture complexity can be ranked by the number of inflection points. Illustratively, a gesture with a number of inflection points of 3 can be divided into the same complexity level, such as gesture types "M" and "W". The gesture of the number of inflection points is divided into another complexity level, such as gesture types "N" and "Z". The gesture of the number of inflection points is divided into another complexity level, such as gesture types "V" and ">". The gesture of zero inflection point is subdivided into another complexity level, such as gesture types "-" and "|". Then match the data sampling strategy in units of complexity levels.

The above technical solution divides the degree of gesture complexity according to the number of inflection points, and then matches the data sampling strategy according to the complexity level, which simplifies the process of determining the data sampling strategy, reduces the data processing amount of the system, improves the processing speed of the black screen gesture, and reduces the speed. System power consumption.

In an embodiment, after the gesture complexity is divided into at least two complexity levels according to the number of inflection points, the method may further include:

The screen refresh rate when the gesture track is displayed is matched for each of the complexity levels.

The screen refresh rate may be a frame rate of the refresh screen of the touch screen of the mobile terminal. Typically, the touch screen will be refreshed at a 60Hz refresh rate. However, the technical solution of the embodiment of the present application does not display the gesture track at a fixed screen refresh rate. The corresponding screen refresh rate may be set in advance for the target gesture track, and the content to be displayed is refreshed to the touch display screen for display by using the screen refresh rate corresponding to the target gesture track. For example, it can be that the higher the complexity level, the higher the matching screen refresh rate.

In the technical solution of the embodiment of the present application, the screen refresh rate when the gesture track is displayed is set according to different complexity levels, and the power consumption of the touch display screen is reduced and the power consumption of the touch display screen is reduced. The terminal's battery life.

FIG. 5 is a flowchart of another method for speeding up black screen gesture processing according to an embodiment of the present disclosure. This embodiment may be applied to improve a black screen gesture processing speed. The method may be performed by a device that speeds up black screen gesture processing, where The device can be implemented by software and/or hardware and can generally be integrated in a mobile terminal. As shown in FIG. 5, the method includes:

Step 510: Acquire a gesture type corresponding to the black screen gesture when the black screen gesture event is detected.

Step 520: Match the gesture complexity corresponding to the black screen gesture according to the gesture type.

Step 530: Determine a data sampling policy according to the gesture complexity, and collect gesture coordinates of the black screen gesture according to the data sampling policy.

Step 540: Draw a gesture track corresponding to the black screen gesture according to the captured gesture coordinates by using at least one drawing thread, so that the touch display screen displays the gesture track according to the set screen refresh rate.

Step 550: Perform, by using at least one open thread, an operation of an application corresponding to a gesture type in which the black screen gesture is turned on in the background.

The open thread and the drawing thread can be executed in parallel. The open thread can be used to perform an operation of opening an application corresponding to the gesture type in the background. In the Android system, the application is composed of Activity. Therefore, the startup process of the application is actually the startup process of the default Activity in the application, including the call of the Activity class and the instantiation of the object. After the application corresponding to the gesture type is enabled in the background, the corresponding frame of the application interface is cached, and the application interface is not drawn to the touch display.

Pre-establish the relationship between the gesture type and the application or mobile phone function, and store the gesture type and application (such as process number or installation package name) or mobile phone function (such as mobile phone wake-up, conference mode or standard mode) by setting a white list. The relationship of the work mode switching. It can be understood that there are many ways to establish a relationship between a gesture type and an application, which is not limited in the embodiment of the present application. For example, the shortcut function can be set for the setting function or the setting application of the mobile terminal before the mobile terminal leaves the factory, and the setting function can be directly executed in the screen-out state or the setting application can be opened by inputting the setting gesture. Taking the flashlight as an example, the flashlight has a quick start function before the mobile terminal leaves the factory. By inputting the black screen gesture “0”, the flashlight can be turned on in the off state. For another example, the mobile terminal provides a black screen gesture configuration function, and when the user turns on the black screen gesture function, prompts the user to select an application that needs to set a quick start function, and inputs or selects a black screen gesture corresponding to the application, thereby establishing a gesture type and an application. Relationship.

When receiving the black screen gesture event, the application layer queries the preset white list by opening the thread, determines an application corresponding to the gesture type of the black screen gesture, and starts the application in the background.

Step 560: Determine whether the preset display condition is met. If the preset display condition is met, step 570 is performed.

The display condition can be set according to actual needs, which is not specifically limited in the embodiment of the present invention. For example, a display time threshold of a gesture track on the touch display screen can be specified. For another example, it may be specified that the end point of the gesture track drawn on the touch display screen is displayed as a display condition, that is, the end point of the gesture track is drawn.

Step 570: Determine whether the user's input of the abandonment open command for the application is detected. When the user's input of the abandonment open command for the application is detected, step 580 is performed, when the user input is not detected for the application. When the instruction is turned on, step 590 is performed.

In some cases, the user may input an incorrect black screen gesture and find the error in time when the gesture track is displayed. At this time, the user often does not want the application corresponding to the wrong black screen gesture to be turned on and displayed in the touch. Displayed on the screen. The function of closing the application in the background can be added before the terminal corresponding to the touch screen is drawn on the terminal. For example, before the terminal draws the interface corresponding to the application to the touch display screen, it is determined whether the user-input abandonment opening instruction for the application is detected; when the user-entered abandonment opening instruction for the application is detected, then The application is closed in the background, and the mobile terminal is restored to the black screen gesture mode, so that the application corresponding to the wrong black screen gesture can be intercepted in time before the application displaying the black screen gesture is displayed, thereby avoiding wasting the processing resources of the image processor. At the same time, after the application corresponding to the wrong black screen gesture is displayed, the user can close the application again, which can effectively shorten the time of re-entering the black screen gesture mode.

Step 580: Close the application in the background.

Step 590: Draw an interface corresponding to the application to the touch display screen to display the application program interface on the touch display screen.

The process of drawing an interface corresponding to the application to the touch display screen may be: reading data from a preset storage area of a picture frame corresponding to the application interface, and transmitting the data to a frame buffer (FrameBuffer) according to the set. The screen refresh rate refreshes the application interface to the touch display and switches the display directly from the gesture track to the application interface.

The technical solution of the embodiment can effectively improve the response speed of the black screen gesture and shorten the time required for detecting the black screen gesture to open the application corresponding to the black screen gesture.

FIG. 6 is a structural block diagram of an apparatus for speeding up black screen gesture processing according to an embodiment of the present application. The device can be implemented in software and/or hardware and is typically integrated in a mobile terminal. As shown in FIG. 6, the apparatus may include:

The gesture event detection module 610 is configured to acquire a gesture type corresponding to the black screen gesture when the black screen gesture event is detected;

The complexity matching module 620 is configured to match the gesture complexity corresponding to the black screen gesture according to the gesture type;

The sampling policy determining module 630 is configured to determine a data sampling policy according to the gesture complexity, and collect gesture coordinates of the black screen gesture according to the data sampling policy;

The gesture track drawing module 640 is configured to determine, by the at least one drawing thread, the gesture track corresponding to the black screen gesture according to the captured gesture coordinates, so that the touch display screen displays the gesture track according to the set screen refresh rate. .

In an embodiment, the gesture complexity determining module may further be configured to:

Before detecting a black screen gesture event, determining, for at least one preset gesture type, determining a number of inflection points of the preset black screen gesture corresponding to each preset gesture type, and determining, according to the number of inflection points, a gesture corresponding to the gesture type is complex degree;

Each of the preset gesture types is stored in association with a corresponding gesture complexity.

In an embodiment, a complexity grading module may also be included, which is set to:

After determining the number of inflection points of the black screen gesture, the gesture complexity corresponding to the preset gesture type is divided into at least two complexity levels according to the number of inflection points, and each of the complexity levels is matched for the gesture coordinates. Data sampling strategy.

In an embodiment, a refresh rate matching module may also be included, which is set to:

After the gesture complexity corresponding to the preset gesture type is divided into at least two complexity levels according to the number of inflection points, the screen refresh rate when the gesture track is displayed is matched for each of the complexity levels.

In an embodiment, the gesture complexity is the number of inflection points in the standard graphic corresponding to the gesture type;

The data sampling strategy is: writing the time sequence of the preset nodes in the driving layer of the operating system according to the gesture coordinates of the black screen gesture, and reading the gesture coordinates at the starting point, the ending point, and the inflection point as reference points, in any two references. The gesture coordinates are read between the points according to the preset number of intervals.

In an embodiment, the application opening module may also be included, and is set to:

Executing, by the at least one open thread, an operation of an application corresponding to the gesture type of the black screen gesture in the background, wherein the open thread is executed in parallel with the drawing thread;

When the preset display condition is met, the interface corresponding to the application is drawn to the touch display screen to display the application program interface on the touch display screen.

In an embodiment, an application shutdown module may also be included, which is set to:

Before drawing the interface corresponding to the application to the touch display screen, determining whether a user's input abandonment open command for the application is detected;

The application is closed in the background when a user-input abandonment open command for the application is detected.

Storage media - any different type of storage device or storage device. The term "storage medium" is intended to include: a mounting medium such as a CD-ROM, a floppy disk or a tape device; a computer system memory or a random access memory (RAM) such as a dynamic random access memory (dynamic random access memory). DRAM), display data random access memory (DDR RAM), static random access memory (SRAM), extended data output random access memory (EDO RAM) , Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory components, and the like. The storage medium may also include other types of memory or a combination thereof. Additionally, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system, the second computer system being coupled to the first computer system via a network, such as the Internet. The second computer system can provide program instructions to the first computer for execution. The term "storage medium" can include at least two storage mediums that can reside in different locations (eg, in different computer systems connected through a network). The storage medium may store program instructions (eg, implemented as a computer program) executable by the at least one processor.

Certainly, a storage medium containing computer executable instructions provided by the embodiments of the present application, the computer executable instructions are not limited to the operation of speeding up the black screen gesture processing as described above, and may also perform the acceleration provided by any embodiment of the present application. Related operations in the black screen gesture processing method.

The embodiment of the present application provides a mobile terminal, where the device for speeding up black screen gesture processing provided by the embodiment of the present application can be integrated. FIG. 7 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application. As shown in FIG. 7, the mobile terminal may include: a casing (not shown), a memory 701, a central processing unit (CPU) 702 (also referred to as a processor, hereinafter referred to as a CPU), and a circuit board ( Not shown in the drawing), touch display 712 and power supply circuit (not shown). The touch display screen 712 includes a touch chip configured to convert a user operation into an electrical signal input to the processor and display a visual output signal; the circuit board is disposed on the touch display screen 712 and a space enclosed by the casing; the CPU 802 and the memory 701 are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the mobile terminal; the memory 701, It is arranged to store a computer program; the CPU 702 reads and executes a computer program stored in the memory 701. The CPU 702, when executing the computer program, the following steps: when detecting a black screen gesture event, acquiring a gesture type corresponding to the black screen gesture event; and matching the gesture complexity corresponding to the black screen gesture according to the gesture type; The gesture complexity determines a data sampling strategy, and reads gesture coordinates according to the data sampling strategy; and at least one drawing thread, draws a gesture track corresponding to the black screen gesture according to the read gesture coordinates, according to the setting The screen refresh rate shows the gesture track.

The mobile terminal further includes: a peripheral interface 703, a radio frequency (RF) circuit 705, an audio circuit 706, a speaker 711, a power management chip 708, an input/output (I/O) subsystem 709, and other inputs/controls. Device 710 and external port 704, these components communicate via one or more communication buses or signal lines 707.

It should be understood that the illustrated mobile terminal 700 is merely one example of a mobile terminal, and that the mobile terminal 700 may have more or fewer components than those shown in the figures, may combine at least two components, or may have Different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including at least one signal processing and/or application specific integrated circuit.

The mobile terminal integrated with the device for speeding up the black screen gesture processing provided by the embodiment is described in detail below. The mobile terminal takes a mobile phone as an example.

The memory 701 can be accessed by the CPU 702, the peripheral interface 703, etc., and the memory 701 can include a high speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or Other volatile solid-state storage devices.

Peripheral interface 703, which can connect the input and output peripherals of the device to CPU 702 and memory 701.

I/O subsystem 709, which can connect input and output peripherals on the device, such as touch display 712 and other input/control devices 710, to peripheral interface 703. The I/O subsystem 709 can include a display controller 7091 and one or more input controllers 7092 that are configured to control other input/control devices 710. Wherein, one or more input controllers 7092 receive electrical signals from other input/control devices 710 or transmit electrical signals to other input/control devices 710, and other input/control devices 710 may include physical buttons (press buttons, rocker buttons, etc.) ), dial, slide switch, joystick, click wheel. It is worth noting that the input controller 7092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

The touch display screen 712 is an input interface and an output interface between the user terminal and the user, and displays the visual output to the user. The visual output may include graphics, text, icons, videos, and the like.

The display controller 7091 in the I/O subsystem 709 receives an electrical signal from the touch display 712 or transmits an electrical signal to the touch display 712. The touch display 712 detects the contact on the touch display screen, and the display controller 7091 converts the detected contact into an interaction with the user interface object displayed on the touch display screen 712, that is, realizes human-computer interaction, and displays the touch. The user interface objects on the control display 712 can be icons that run the game, icons that are networked to the respective network, and the like. It is worth noting that the device may also include a light mouse, which is a touch sensitive surface that does not display a visual output, or an extension of a touch sensitive surface formed by a touch display.

The RF circuit 705 is configured to establish communication between the mobile phone and the wireless network (ie, the network side) to implement data reception and transmission between the mobile phone and the wireless network. For example, sending and receiving short messages, emails, and the like. Specifically, the RF circuit 705 receives and transmits an RF signal, which is also referred to as an electromagnetic signal, and the RF circuit 705 converts the electrical signal into an electromagnetic signal or converts the electromagnetic signal into an electrical signal, and through the electromagnetic signal and communication network and other devices Communicate. RF circuitry 705 may include known circuitry configured to perform these functions including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec CODER-DECoder (CODEC) chipset, Subscriber Identity Module (SIM), etc.

The audio circuit 706 is arranged to receive audio data from the peripheral interface 703, convert the audio data into an electrical signal, and transmit the electrical signal to the speaker 711.

The speaker 711 is arranged to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 705 to sound and play the sound to the user.

The power management chip 708 is configured to provide power and power management for the hardware connected to the CPU 702, the I/O subsystem, and the peripheral interface.

The mobile terminal provided by the embodiment of the present application determines different data sampling strategies according to different gesture types, so as to implement multiple gesture coordinate reading modes, and reduces the amount of data read by the application layer and the amount of data used when drawing the gesture track. Improves the processing speed of black screen gestures, reduces system response time, and reduces system power consumption.

The device for accelerating the black-screen gesture processing, the storage medium, and the mobile terminal can perform the method for speeding up the black-screen gesture processing provided by all the foregoing embodiments of the present application, and have the corresponding functional modules and beneficial effects of performing the above-described method for speeding up the black-screen gesture processing. For the technical details that are not described in detail in this embodiment, refer to the method for speeding up the black screen gesture processing provided by all the foregoing embodiments of the present application.

Industrial applicability

Claims

A method for accelerating black screen gesture processing, including:

When a black screen gesture event is detected, the gesture type corresponding to the black screen gesture is acquired;

Matching the gesture complexity corresponding to the black screen gesture according to the gesture type;

Determining a data sampling policy according to the gesture complexity, and collecting gesture coordinates of the black screen gesture according to the data sampling policy;

And drawing, by the at least one drawing thread, a gesture track corresponding to the black screen gesture according to the captured gesture coordinates, so that the touch display screen displays the gesture track according to the set screen refresh rate.
The method of claim 1, wherein before detecting the blackout gesture event, the method further comprises:

Determining, by the preset number of gestures, a number of inflection points of the preset black screen gesture corresponding to each preset gesture type, and determining, according to the number of inflection points, a gesture complexity corresponding to each of the preset gesture types;

Each of the preset gesture types is stored in association with a corresponding gesture complexity.
The method of claim 2, after determining the number of inflection points of the black screen gesture corresponding to each preset gesture type, further comprising:

The gesture complexity corresponding to the preset gesture type is divided into at least two complexity levels according to the number of inflection points, and each of the complexity levels matches a data sampling strategy for the gesture coordinates.
The method according to claim 3, further comprising: after dividing the gesture complexity corresponding to the preset gesture type into at least two complexity levels according to the number of inflection points, further comprising:

The screen refresh rate when the gesture track is displayed is matched for each of the complexity levels.
The method according to claim 1, wherein the gesture complexity is a number of inflection points in a standard graphic corresponding to the gesture type;

The data sampling strategy is: writing the time sequence of the preset nodes in the driving layer of the operating system according to the gesture coordinates of the black screen gesture, and reading the gesture coordinates at the starting point, the ending point, and the inflection point as reference points, in any two references. The gesture coordinates are read between the points according to the preset number of intervals.
The method according to any one of claims 1 to 5, further comprising:

Executing, by the at least one open thread, an operation of an application corresponding to the gesture type of the black screen gesture in the background, wherein the open thread is executed in parallel with the drawing thread;

When the preset display condition is met, the interface corresponding to the application is drawn to the touch display screen to display the application program interface on the touch display screen.
The method of claim 6, wherein before the mapping of the interface corresponding to the application to the touch display screen, the method further comprises:

Determining whether a user's input of a discarding open command for the application is detected;

The application is closed in the background when a user-input abandonment open command for the application is detected.
A device for accelerating black screen gesture processing, comprising:

The gesture event detection module is configured to acquire a gesture type corresponding to the black screen gesture when the black screen gesture event is detected;

The complexity matching module is configured to match the gesture complexity corresponding to the black screen gesture according to the gesture type;

a sampling policy determining module, configured to determine a data sampling policy according to the gesture complexity, and collect gesture coordinates of the black screen gesture according to the data sampling policy;

The gesture track drawing module is configured to determine, by the at least one drawing thread, the gesture track corresponding to the black screen gesture according to the captured gesture coordinates, so that the touch display screen displays the gesture track according to the set screen refresh rate.
A computer readable storage medium storing a computer program that, when executed by a processor, implements the method of speeding up black screen gesture processing as claimed in any one of claims 1 to 7.
A mobile terminal comprising a touch display screen, a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the computer program as claimed in any one of claims 1 to 7 A method of speeding up black screen gesture processing as described.