WO2020042807A1

WO2020042807A1 - Target function calling method and apparatus, mobile terminal and storage medium

Info

Publication number: WO2020042807A1
Application number: PCT/CN2019/096454
Authority: WO
Inventors: 黄金龙
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2018-08-31
Filing date: 2019-07-18
Publication date: 2020-03-05
Also published as: TW202011772A; TWI717772B; CN109324737A

Abstract

The embodiments of the present description provide a target function calling method and apparatus, a mobile terminal and a storage medium. Said method comprises: when a detection triggering condition is satisfied, detecting a motion trajectory of a mobile terminal; matching the detected motion trajectory with a target function motion trajectory, the target function motion trajectory being a motion trajectory of the mobile terminal generated by calling a target function; and upon confirmation of the matching, calling the target function of the mobile terminal. The technical solution provided in the present description can automatically identify a user's intention, and then calls a target function, and is fast and easy to implement.

Description

Method, device, mobile terminal and storage medium for calling target function

Technical field

The embodiments of the present specification relate to the field of computer technology, and in particular, to a method, a device, a mobile terminal, and a storage medium for invoking a target function.

Background technique

The current smart mobile terminal is widely used in mobile payment, shooting and other scenarios. In many scenarios, the shooting function or code scanning function of the mobile terminal needs to be called. For example, payment is completed by scanning a two-dimensional code, and information is acquired by scanning a two-dimensional code, and for example, photographing or video recording is performed by calling a shooting function of a mobile terminal.

Calling the above-mentioned functions of the mobile terminal (hereinafter referred to as target functions) often requires the user to find the icon or button corresponding to the target function in the corresponding application program, and implement the call to the target function by clicking or other methods.

In the above scenarios, it is often necessary to quickly call the target function. For example, in order to shorten the transaction waiting time, the code scanning function needs to be called quickly. For example, in order to capture the fleeting beauty or capture other frequently-used moments, the shooting function needs to be called quickly.

Summary of the Invention

The embodiments of the present specification provide a method, a device, a mobile terminal, and a storage medium for invoking a target function, so as to achieve the purpose of quickly invoking the target function.

In a first aspect, an embodiment of the present specification provides a method for invoking a target function, including:

When the detection trigger condition is satisfied, detect the motion trajectory of the mobile terminal; match the detected motion trajectory with the target function motion trajectory, which is the motion trajectory generated by the mobile terminal calling the target function; confirm the match Then, the target function of the mobile terminal is called.

In a second aspect, an embodiment of the present specification provides a device for invoking a target function, including:

A motion trajectory detection module, configured to detect a motion trajectory of a mobile terminal when a detection trigger condition is satisfied;

A motion trajectory matching module, configured to match the detected motion trajectory with a target function motion trajectory, where the target function motion trajectory is a motion trajectory generated by a mobile terminal calling a target function;

The target function calling module is configured to call the target function of the mobile terminal after the matching is confirmed.

In a third aspect, an embodiment of the present specification provides a mobile terminal including: a memory for storing a computer program; and a processor for implementing the steps of the foregoing method embodiment when the computer program is executed.

In a fourth aspect, an embodiment of the present specification provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the foregoing method embodiment are implemented.

The beneficial effects of the embodiments of this specification are as follows:

The inventor discovered through creative labor that the movement trajectory generated by the mobile terminal calling the target function has certain rules. Therefore, when the detection trigger condition is satisfied, the motion trajectory of the mobile terminal is detected, and the detected motion trajectory is matched with the target function motion trajectory. If they match, it means that the user has a need to call the target function, so the mobile is called The target function of the terminal. With the technical solution provided by the embodiment of the present specification, the user does not need to manually trigger the call to the target function, but only needs to make an action using the target function (for example, the action of picking up the mobile terminal to scan the code). The technical solution provided by the embodiment of the present specification The user's intention can be automatically recognized, and then the target function is called, and the implementation method is fast and convenient.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a scenario provided by an embodiment of the present specification;

2 is a schematic diagram of a coordinate direction of a gyroscope according to an embodiment of the present specification;

3 is a schematic diagram of a coordinate direction of an accelerometer in a first posture of a mobile terminal according to an embodiment of the present specification;

4 is a schematic diagram of a coordinate direction of an accelerometer in a second posture of a mobile terminal according to an embodiment of the present specification;

5 is a flowchart of a method provided by an embodiment of the present specification;

FIG. 6 is a schematic diagram of a device provided by an embodiment of the present specification.

detailed description

In order to better understand the above technical solutions, the technical solutions of the embodiments of the present specification will be described in detail through the accompanying drawings and specific embodiments. It should be understood that the embodiments of the present specification and specific features in the embodiments are the technical solutions of the embodiments of the present specification. The detailed description is not a limitation on the technical solutions of the present specification. In the case of no conflict, the embodiments of the present specification and the technical features in the embodiments can be combined with each other.

The embodiments of this specification are widely used in scenes such as code scanning and shooting.

Taking code scanning as an example, as shown in FIG. 1, the posture of the mobile terminal when the user scans or takes pictures with the mobile terminal is different from the posture when the user usually uses the mobile terminal or when the mobile terminal is just taken out. The mobile terminal moves from taking out to moving The terminal aligns with the identification code and starts scanning. In this process, the movement trajectory of the mobile terminal in the space is regularly found. Assuming the identification code is posted on the wall, the user first takes out and lifts the mobile terminal, and then aligns the identification code. In this process, the mobile terminal accelerates in a direction perpendicular to the ground, and the deceleration finally stops (the acceleration result is reflected in the vertical movement Distance), and the mobile terminal will also have rotation (the rotation result is reflected in the included angle with the horizontal line. These data can be obtained and calculated by the mobile terminal's built-in motion sensor. Therefore, the mobile terminal can be obtained during scanning or shooting Motion characteristics (ie, target function motion trajectory), once it is detected that the user's mobile terminal's motion trajectory matches the target function's motion trajectory, then it can be determined that the user wants to open the camera to start scanning or shooting, and directly enter the code scanning page Or take a page, there is no need for the user to click the scan button, thereby reducing the user's operation path and quickly calling the target function.

In the embodiment of the present specification, the motion sensor of the mobile terminal may be a gyroscope, an accelerometer, or the like.

Among them, as shown in FIG. 2, the gyroscope is based on the principle of conservation of angular momentum, and measures the rotation rate along a certain coordinate axis (X axis, Y axis, Z axis). In use, when the rotor of the gyroscope rotates at high speed, it always points to a fixed direction. When the moving direction of the moving object deviates from the predetermined direction, the gyroscope can feel it.

Among them, the accelerometer is a sensor capable of measuring acceleration. As shown in FIG. 3, the reference coordinate system of the accelerometer is established based on the mobile terminal. The planes where the X and Y axes are located are coplanar with the mobile terminal, and the Z axis is always perpendicular to the plane of the mobile terminal. The accelerometer detects the force on three axes, of which gravity cannot be ignored. Take Figure 3 as an example. When the mobile terminal is vertical, the negative direction of the Y axis points to the basic salary. The value obtained by the accelerometer is (0, -1, 0). That is, the mobile terminal receives 0 in the X-axis and Z-axis directions, and receives gravity in the Y-axis direction, and its acceleration is the acceleration of gravity; taking Figure 4 as an example, if the mobile terminal is tilted, the gravity that can be obtained through the accelerometer is on the Y-axis And the Z-axis components, the tilt angle in the X-axis is calculated by geometric principles.

In summary, the rotation angle of the mobile terminal on the X-axis, Y-axis, or Z-axis can be calculated by an accelerometer. The rotation rate of the mobile terminal on the X-axis, Y-axis, or Z-axis can be obtained through a gyroscope. The movement speed and distance of the Y-axis (the vertical direction of the ground) and the Z-axis can be calculated from the data obtained by the gyroscope and accelerometer.

In a first aspect, an embodiment of the present specification provides a method for invoking a target function. Referring to FIG. 5, the method includes:

Step 501: When a detection trigger condition is satisfied, detect a motion trajectory of the mobile terminal.

The detection time of the motion trajectory may be a preset fixed time period or a variable time period.

The motion trajectory is detected by a motion sensor, for example, it can be detected by a gyroscope and an accelerometer, and it can also be detected only by a gyroscope or only an accelerometer.

Step 503: Match the detected motion trajectory with the target function motion trajectory, and the target function motion trajectory is a motion trajectory generated by the mobile terminal calling the target function.

Among them, either all the detected motion trajectories can be matched with the target motion trajectory, or part of the detected motion trajectories can be matched with the target motion trajectory.

Take the fixed detection time as an example, assuming that the target motion trajectory is 2 seconds in length and the detection time is also 2 seconds, then match the detected 2 sec motion trajectory with the target motion trajectory; take the fixed detection time as an example, suppose The time length of the target motion trajectory is 2 seconds, and the mobile terminal motion trajectory of 5 seconds is detected. Then, it is preferable to use the 2 sec motion trajectory to match the target function motion trajectory. There are many ways to intercept motion trajectories, for example, taking the last 2 seconds of motion trajectory, and for example, intercepting the motion trajectory of 2 seconds from the time when the motion data meets the set threshold. The motion data can be the moving distance and movement in a certain direction Speed, acceleration of movement, rotation angle in a certain direction, angular velocity, angular acceleration.

Step 505: After confirming the match, the target function of the mobile terminal is called.

In the method provided in the embodiment of the present specification, the target function of the mobile terminal may include, but is not limited to, a code scanning function or a shooting function.

The method provided in the embodiment of the present specification detects a motion trajectory of a mobile terminal when a detection trigger condition is satisfied, and matches the detected motion trajectory with a target function motion trajectory. If they match, it means that the user needs to call the target function. Therefore, the target function of the mobile terminal is called. By adopting the method provided in the embodiment of the present specification, the user does not need to manually trigger a call to the target function, but only needs to perform an action using the target function (such as picking up a mobile terminal to perform a code scanning action). The method provided in the embodiment of the present specification can be used. Automatically recognize the user's intent, and then call the target function, and its implementation is fast and convenient.

In the embodiment of the present specification, if the target function is a code scanning function, the above detection trigger condition may include, but is not limited to, at least one of the following: a target application of the mobile terminal is called; the motion data of the mobile terminal reaches a set threshold, and the like. If the target function is a shooting function, the above detection trigger condition may include, but is not limited to, at least one of the following: the mobile terminal is woken up; the motion data of the mobile terminal reaches a set threshold.

During the application process, you can set a single trigger condition or multiple trigger conditions.

In the embodiment of the present specification, there are multiple implementation manners of the foregoing step 503. For example, they can be implemented by threshold matching, or by model matching. If it is implemented by model matching, specifically, the detected motion trajectory is input into the target function motion trajectory model. The target function motion trajectory model is obtained by training using the target function motion trajectory sample, and the target function motion trajectory sample is based on the target function motion. The trajectory is processed.

In the embodiments of the present specification, deep learning models such as CNN and RNN (LSTM) may be used, but are not limited thereto. Among them, the model depth can be 4 or 5 layers. Taking CNN as an example, several layers of convolution, several layers of pooling can be used, and tanh or relu is used as the activation function.

In the embodiment of the present specification, a target function motion trajectory model may be trained using target function motion trajectory samples of a historical use target function process of multiple users.

The movement characteristics of the mobile terminal are different for each person during the code scanning process. For example, some people have long arms, so the vertical movement distance is longer. These data can be extracted from the user ’s historical code scanning process data. , Thereby improving the recognition rate. Preferably, the target functional motion trajectory is obtained by training using the historical target functional motion trajectory samples of the mobile terminal. That is, the target function motion trajectory model is trained by using the target function motion trajectory samples obtained by the user's own historical code scanning process, thereby improving the matching accuracy.

The method of acquiring the historical target function motion trajectory sample of the mobile terminal may be, but is not limited to: recording a motion trajectory of the mobile terminal when a recording trigger condition is satisfied; when the confirmation target function is called, according to the recorded motion trajectory Generate historical target function motion trajectory samples.

Taking code scanning as an example, when the target application of the mobile terminal is called, it means that the user may need to call the code scanning function. Therefore, when the target application of the mobile terminal is called, the recording trigger condition is met. However, when the target application is called, it does not mean that the target function must be called. Taking Alipay as an example, the user opens Alipay. Although it means that the user may use its code scanning function, it does not mean that the user must use the code scanning function. When the trigger condition is satisfied, although the motion trajectory of the motion terminal is recorded, it does not mean that the motion trajectory must be the motion trajectory of the target function. The recorded motion trajectory can be generated into the historical target function only after it is determined that the target function is called. Motion trajectory samples.

The recording of the motion trajectory can be real-time, that is, the motion trajectory can be recorded in real time when the trigger condition is dynamically detected; the recording of the motion trajectory can also be non-real-time, for example, by calling the log of the mobile terminal or the log of the target application, According to the information recorded in the log, determine whether the target application is called, the motion trajectory after each call, and whether the call is to call the target function.

It should be noted that the recording trigger condition is not limited to the target application of the mobile terminal being called, but may also be other triggering conditions, for example, the mobile terminal ’s motion data reaches a set threshold to start recording, and is generated after it is determined that the target function is called sample.

Taking shooting as an example, when the mobile terminal is woken up, it means that the user may need to call the shooting function of the camera. Therefore, when the mobile terminal is woken up, the recording trigger condition is satisfied. However, the wake-up of the mobile terminal does not mean that the target function is necessarily called. Therefore, when the trigger condition is met, although the motion track of the motion terminal is recorded, it does not mean that the motion track must be the motion track of the target function. After the target function is called, the recorded motion trajectory can be used to generate historical target function motion trajectory samples.

The recording of the motion track can be real-time, that is, when the trigger condition is dynamically detected, the motion track can be recorded in real time; the recording of the motion track can also be non-real-time, for example, by calling the log of the mobile terminal, according to the information recorded in the log Determine whether the camera is called, the motion trajectory after each call, and whether the call is to call the target function.

It should be noted that the recording trigger condition is not limited to the mobile terminal's mobile terminal being woken up, but also other trigger conditions. For example, the mobile terminal's motion data reaches a set threshold to start recording, and a sample is generated after it is determined that the target function is called. .

The inventor noticed in the process of implementing this application that when using the mobile terminal ’s code scanning function and shooting function, the camera needs to be called, and the shooting trajectories are very similar. Therefore, in the embodiment of this specification, the code scanning function and the shooting function can Using the same motion trajectory model, correspondingly, the historical trajectory scanning motion trajectory sample and the historical shooting function trajectory sample can be used to train a common motion trajectory model. Correspondingly, the recording trigger condition may be at least one of the following conditions: the target application is called, the mobile terminal is woken up, the motion data reaches a set threshold, and so on.

In the embodiment of the present specification, the motion trajectory includes a collection of motion data of the mobile terminal, and the motion data is obtained according to data collected by the motion sensor according to a set sampling frequency.

In the second aspect, based on the same inventive concept, an embodiment of the present specification provides a device for invoking a target function. Please refer to FIG. 6, including:

A motion trajectory detection module 601, configured to detect a motion trajectory of a mobile terminal when a detection trigger condition is satisfied;

A motion trajectory matching module 602, configured to match the detected motion trajectory with a target function motion trajectory, where the target function motion trajectory is a motion trajectory generated by a mobile terminal calling a target function;

The target function calling module 603 is configured to call the target function of the mobile terminal after confirming the matching.

The device provided in the embodiment of the present specification detects a motion trajectory of a mobile terminal when a detection trigger condition is met, and matches the detected motion trajectory with a target function motion trajectory. If they match, it means that the user needs to call the target function. Therefore, the target function of the mobile terminal is called. With the technical solution provided in the embodiment of the present specification, the user does not need to manually trigger the call to the target function, but only needs to make an action using the target function (for example, the action of picking up the mobile terminal to scan the code). The user's intention can be automatically recognized, and then the target function is called, and the implementation method is fast and convenient.

Optionally, the motion trajectory matching module is specifically configured to:

The detected motion trajectory is input into a target function motion trajectory model, and the target function motion trajectory model is obtained by training using target function motion trajectory samples.

Optionally, the target function motion trajectory is obtained by training using historical target function motion trajectory samples of the mobile terminal.

Optionally, it also includes a historical motion trajectory sample acquisition module for:

When the recording trigger condition is satisfied, record the motion trajectory of the mobile terminal; when it is confirmed that the target function is called, generate a historical target function motion trajectory sample according to the recorded motion trajectory.

Optionally, the target function of the mobile terminal includes a code scanning function, and the recording trigger condition includes:

A target application of the mobile terminal is called;

Optionally, the target function of the mobile terminal includes a shooting function, and the recording trigger condition includes: the mobile terminal is woken up.

Optionally, the motion trajectory includes a collection of motion data of the mobile terminal, and the motion data is obtained according to data collected by a motion sensor of the mobile terminal according to a set sampling frequency.

Optionally, the target function of the mobile terminal includes a code scanning function, and the detection trigger condition includes at least one of the following: a target application of the mobile terminal is called; and the motion data of the mobile terminal reaches a set threshold.

Optionally, the target function of the mobile terminal includes a shooting function, and the detection trigger condition includes at least one of the following: the mobile terminal is woken up; the motion data of the mobile terminal reaches a set threshold.

For the implementation manner of the device provided in the embodiments of the present specification, reference may be made to the description of the foregoing method embodiments, and duplicated details are not described repeatedly.

In a third aspect, an embodiment of the present specification provides a mobile terminal including: a memory for storing a computer program; and a processor for implementing the steps of any of the foregoing method embodiments when the computer program is executed.

In a fourth aspect, an embodiment of the present specification provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the foregoing method embodiments are implemented.

This specification is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of this specification. It should be understood that each process and / or block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to produce a machine, so that the instructions generated by the processor of the computer or other programmable data processing device are used to generate instructions A device for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a particular manner such that the instructions stored in the computer-readable memory produce a manufactured article including the instruction device, the instructions The device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing device, so that a series of steps can be performed on the computer or other programmable device to produce a computer-implemented process, which can be executed on the computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

Although the preferred embodiments of the present specification have been described, those skilled in the art can make other changes and modifications to these embodiments once they know the basic inventive concepts. Therefore, the following claims are intended to be construed to include the preferred embodiments and all changes and modifications that fall within the scope of this description.

Obviously, those skilled in the art can make various modifications and variations to this specification without departing from the spirit and scope of this specification. In this way, if these modifications and variations of this specification belong to the scope of the claims of this specification and their equivalent technologies, this specification also intends to include these modifications and variations.

Claims

A method for invoking a target function, comprising:

When the detection trigger condition is satisfied, detecting the motion trajectory of the mobile terminal;

Matching the detected motion trajectory with a target function motion trajectory, where the target function motion trajectory is a motion trajectory generated by a mobile terminal calling a target function;

After confirming the match, the target function of the mobile terminal is called.
The method according to claim 1, wherein the matching the detected motion trajectory with a target functional motion trajectory comprises:

The detected motion trajectory is input into a target function motion trajectory model, and the target function motion trajectory model is obtained by training using target function motion trajectory samples.
The method according to claim 2, wherein the target function motion trajectory is obtained by training using a historical target function motion trajectory sample of the mobile terminal.
The method according to claim 3, wherein the acquiring method of the historical target function motion trajectory sample of the mobile terminal comprises:

When the recording trigger condition is satisfied, recording the motion trajectory of the mobile terminal;

When it is confirmed that the target function is called, a historical target function motion trajectory sample is generated according to the recorded motion trajectory.
The method according to claim 4, wherein the target function of the mobile terminal comprises a code scanning function, and the recording trigger condition comprises: a target application of the mobile terminal is called;

or,

The target function of the mobile terminal includes a shooting function, and the recording trigger condition includes:

The mobile terminal is woken up.
The method according to any one of claims 1 to 5, wherein the motion trajectory includes a set of motion data of the mobile terminal, and the motion data is set according to a motion sensor of the mobile terminal according to a set Obtained from the data collected at the sampling frequency.
The method according to any one of claims 1 to 5, wherein a target function of the mobile terminal includes a code scanning function, and the detection trigger condition includes at least one of the following:

A target application of the mobile terminal is called;

The motion data of the mobile terminal reaches a set threshold;

The target function of the mobile terminal includes a shooting function, and the detection trigger condition includes at least one of the following:

The mobile terminal is woken up;

The motion data of the mobile terminal reaches a set threshold.
A device for invoking a target function, comprising:

A motion trajectory detection module, configured to detect a motion trajectory of a mobile terminal when a detection trigger condition is satisfied;

A motion trajectory matching module, configured to match the detected motion trajectory with a target function motion trajectory, where the target function motion trajectory is a motion trajectory generated by a mobile terminal calling a target function;

The target function calling module is configured to call the target function of the mobile terminal after the matching is confirmed.
The apparatus according to claim 8, wherein the motion trajectory matching module is specifically configured to:

The detected motion trajectory is input into a target function motion trajectory model, and the target function motion trajectory model is obtained by training using target function motion trajectory samples.
The device according to claim 8, wherein the target function motion trajectory is obtained by training using a historical target function motion trajectory sample of the mobile terminal.
The device according to claim 10, further comprising a historical motion trajectory sample acquisition module, configured to:

When the recording trigger condition is satisfied, recording the motion trajectory of the mobile terminal;

When it is confirmed that the target function is called, a historical target function motion trajectory sample is generated according to the recorded motion trajectory.
The device according to claim 11, wherein the target function of the mobile terminal comprises a code scanning function, and the recording trigger condition comprises:

A target application of the mobile terminal is called;

or,

The target function of the mobile terminal includes a shooting function, and the recording trigger condition includes:

The mobile terminal is woken up.
The device according to any one of claims 8 to 12, wherein the motion trajectory includes a set of motion data of the mobile terminal, and the motion data is set according to a motion sensor of the mobile terminal. Obtained from the data collected at the sampling frequency.
The device according to any one of claims 8 to 12, wherein a target function of the mobile terminal includes a code scanning function, and the detection trigger condition includes at least one of the following:

A target application of the mobile terminal is called;

The motion data of the mobile terminal reaches a set threshold;

The target function of the mobile terminal includes a shooting function, and the detection trigger condition includes at least one of the following:

The mobile terminal is woken up;

The motion data of the mobile terminal reaches a set threshold.
A mobile terminal, comprising:

Memory for storing computer programs;

A processor, configured to implement the steps of the method according to any one of claims 1 to 7 when executing the computer program.
A computer-readable storage medium having stored thereon a computer program, characterized in that when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.