WO2020177070A1

WO2020177070A1 - Method for executing instructions based on trajectory, electronic device and computer-readable storage medium

Info

Publication number: WO2020177070A1
Application number: PCT/CN2019/076954
Authority: WO
Inventors: 袁洪烈
Original assignee: 深圳市柔宇科技有限公司
Priority date: 2019-03-05
Filing date: 2019-03-05
Publication date: 2020-09-10
Also published as: CN113260973A

Abstract

A method for executing instructions based on trajectory, which is applied to an electronic device. The method comprises: acquiring an operation trajectory (S101); detecting whether the operation trajectory matches a preset reference trajectory (S103); and, when the operation trajectory matches the reference trajectory, executing a corresponding operation instruction (S105). Further disclosed are an electronic device and a computer-readable storage medium. In the above method for executing instructions based on trajectory, electronic device and computer readable storage medium, the operation trajectory can be directly used to execute a corresponding operation instruction, and the operation is relatively fast.

Description

Method, electronic equipment and computer-readable storage medium for executing instructions based on trajectory

Technical field

The present invention relates to the field of electronic technology, and in particular to a method, electronic equipment and computer-readable storage medium for executing instructions based on trajectories.

Background technique

At present, more and more electronic devices use passwords (such as character passwords, fingerprint passwords, etc.) to execute corresponding instructions to implement some functions, such as launching applications, unlocking screens, and deleting files.

However, character passwords are easy to crack. When the fingerprint password is used in the electronic device, when the corresponding execution needs to be performed, it is generally necessary to confirm whether the fingerprint is used in the touch display screen, and then input the fingerprint to unlock, which is troublesome. Therefore, reducing operation steps and improving user operation efficiency are currently urgently needed.

Summary of the invention

The embodiments of the present application disclose a method, an electronic device, and a computer-readable storage medium for executing instructions based on a trajectory, which can reduce operation steps and improve user operation efficiency.

On the one hand, a method for executing instructions based on trajectories disclosed in an embodiment of the present application is applied to an electronic device, and the method includes:

Obtain the operation track;

Check whether the operation trajectory matches the preset reference trajectory; and

When the operation trajectory matches the preset reference trajectory, the corresponding operation instruction is executed.

On the other hand, an electronic device also disclosed in an embodiment of the present application includes a processor, a memory, and a computer program, wherein the computer program is stored in the memory and is configured to be executed by the processor, and the computer program The above method is implemented when executed by the processor.

On the other hand, an embodiment of the present application also discloses a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor to implement the above method.

The above-mentioned method, electronic equipment, and computer-readable storage medium for executing instructions based on trajectories directly use the operation trajectory to execute corresponding operation instructions, and the operation is relatively fast.

Description of the drawings

FIG. 1 is a schematic flowchart of a method for executing instructions based on trajectories provided by the first implementation of this application.

Fig. 2 is a schematic diagram of a user graphical interface of the first embodiment of the application.

FIG. 3 is a schematic diagram of the preset mapping table relationship table in FIG. 1 of this application.

Fig. 4 is a flowchart of a first embodiment of step S1031 shown in Fig. 1.

FIG. 5 is a partial schematic diagram of a partial sub-process of the second embodiment of step S1031 shown in FIG. 1.

FIG. 6 is a schematic diagram of a partial sub-process of the third embodiment of step S1031 shown in FIG. 1.

FIG. 7 is a schematic flowchart of the first implementation example of step S405 shown in FIG. 4.

FIG. 8 is a schematic diagram of a user graphical interface provided by the second embodiment of this application.

FIG. 9 is a schematic partial flowchart of a method for executing instructions based on trajectories provided by the second embodiment of this application.

FIG. 10 is a schematic diagram of the functional structure of an electronic device provided by the first embodiment of this application.

FIG. 11 is a schematic diagram of a computer-readable storage medium provided by the first embodiment of this application.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in the art without creative work fall within the protection scope of this application.

It should be noted that the terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms of "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and/or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

Please refer to FIG. 1. FIG. 1 is a flowchart of a method for executing instructions based on a trajectory disclosed in an embodiment of the application. The method of executing instructions based on trajectories is applied to electronic devices. In this embodiment, the electronic device is an electronic device with a handwriting drawing function. Wherein, the electronic device includes, but is not limited to, electronic devices with touch display components in mobile phones, tablet computers, smart bracelets, notebook computers, desktop computers, and multimedia players. Operating systems of electronic devices include but are not limited to Andirod operating system, IOS operating system, Symbian operating system, BlackBerry operating system, Windows Phone operating system and so on. The method includes the following steps.

Step S101: Obtain the operation track. In some feasible embodiments, the operation track can be obtained by detecting the touch track of the external object on the touch display component. External objects are but not limited to stylus, fingers, etc. As shown in FIG. 2, when the finger slides in the touch display assembly, the corresponding touch track S can be detected to obtain the operation track TS.

In some other feasible embodiments, the operation trajectory TS may also be obtained by a camera. For example, a camera is provided in an electronic device, and the movement track of an external object (such as a finger, a touch device, a palm, etc.) is acquired through the camera to obtain the operation track TS.

Step S103, detecting whether the operation trajectory TS matches the preset reference trajectory SS. In some feasible embodiments, a preset mapping table relationship table P is stored in the electronic device, wherein the mapping relationship table P includes a reference trajectory set D ₁ and a mapping relationship D _{2 of an} operation instruction set (as shown in FIG. 3) . The preset reference trajectory can be found from the preset mapping table P.

Step S105, when the operation trajectory TS matches the preset reference trajectory SS, a corresponding operation instruction is executed. In some feasible embodiments, the operation instruction may be, but is not limited to, opening an application in the electronic device, unlocking the electronic device, storing, deleting, replaying the track, sending signals and files to other electronic devices At least one item (as shown in Figure 3).

In the above-mentioned embodiment, the operation track can be directly used to execute the corresponding operation instruction, and the operation is relatively quick.

Specifically, in some feasible examples, step S103 includes: step S1031, calculating the similarity between the operation trajectory TS and the preset reference trajectory SS; step S1033, when the similarity reaches the preset threshold, detecting that the operation trajectory TS is The preset reference trajectory SS matches. In this embodiment, it is determined whether the operation trajectory TS matches the preset reference trajectory SS based on the similarity between the operation trajectory TS and the preset reference trajectory SS, which improves the matching efficiency and sensitivity.

In other feasible embodiments, it is also possible to detect whether the operation trajectory TS matches the preset reference trajectory SS. For example, it can be implemented by detecting whether part or all of the track points in the operation track TS and the preset reference track SS are the same.

Referring to FIG. 4, in some feasible embodiments, the preset reference trajectory SS includes a reference coordinate set, and each reference coordinate in the reference coordinate set has a unique serial number. The operation trajectory TS includes a continuous set of first trajectory point coordinates. Among them, step S1031 includes the following steps.

In step S401, a number of track point coordinates are sampled from the first track point coordinate set according to a preset sampling rule to form a sample coordinate set B ₁ to be verified. Among them, it is necessary to verify that the number of sampling coordinates in the sampling coordinate set B ₁ is the same as the number of reference coordinates in the reference coordinate set. The preset sampling rule is to sample according to a preset length, where the preset length is L/(N-1), where L is the total length of the track, and N is the preset number.

Step S403: Assign a unique serial number to the sampling coordinate to be verified in the sampling coordinate set B1 to be verified according to the sequence of the first track point coordinate set, so that the serial number of the sampling coordinate to be verified corresponds to the serial number of the reference coordinate, and the first track point coordinate set The sequence includes the sequence from the start point to the end point of the first track point coordinate set or the sequence from the end point to the start point of the first track point coordinate set.

Step S405: Transform the sample coordinate set B1 to be verified into coordinates in the preset area R to form a first transformed coordinate set (as shown in FIG. 8).

Step S407: Acquire one coordinate in the area enclosed by the first transformed coordinate set as the first center coordinate according to the preset movement rule.

Step S409: Transform the first transformed coordinate set using the first center coordinates as the coordinate origin to form a coordinate set to be verified.

Step S411: Calculate the difference between the coordinate to be verified and the reference coordinate corresponding to the serial number.

In step S413, the similarity is calculated according to the difference value. Specifically, in some embodiments, the difference between the coordinate to be verified and the reference coordinate is: the distance between the coordinate to be verified and the corresponding reference coordinate. The calculation of similarity based on the difference value is specifically:

Among them, s is used to indicate the degree of approximation, W is used to indicate the width of the preset area R; C[k] _{X is} used to indicate the coordinate value of the kth coordinate to be verified on the X axis; the kth coordinate to be verified on the Y axis The coordinate value of C[k]y; T[k] _{X is} used to represent the coordinate value of the k-th reference coordinate on the X axis; T[k] _{y is} used to represent the coordinate value of the k-th reference coordinate on the Y axis; d It is used to represent the average value of the distance between all the coordinates to be verified and the corresponding reference coordinates in the coordinate set to be verified and the reference coordinate value, where N is used to represent the total number of coordinates in the coordinate set to be verified or the reference coordinate set, and k is 1. To N.

In this embodiment, the average difference value is first calculated according to the difference value between the coordinate to be verified and the corresponding reference coordinate, and then the similarity is determined according to the average difference value, and the obtained similarity is more accurate.

Referring to FIG. 5, in some feasible embodiments, before step S411, the method further includes the following steps.

Step S501: Count the number of difference values greater than the preset difference value.

Step S503: It is judged whether the number exceeds a preset number.

Step S505: When the number exceeds the preset number, the operation trajectory TS does not match the preset reference trajectory SS.

Step S507: When the number does not exceed the preset number, the similarity is calculated according to the difference value.

In this embodiment, it is also possible to pre-calculate the number of discrepancy values greater than the preset discrepancy value, and only the number of discrepancy values greater than the preset discrepancy value can be calculated for similarity, which can quickly eliminate incorrect operations or non-compliance. operating.

Referring to FIG. 6, in some feasible embodiments, the preset reference trajectory encloses a closed area. The closed area, for example, the preset trajectory is triangle, circle, ellipse, etc., and the closed area is triangle, circle, ellipse. Before step S411, the method further includes: step S600, detecting whether the operation track encloses a closed area, and executing step S411 when enclosing the closed area. Specifically, detecting whether the operation track encloses a closed area includes:

Step S601, detecting whether the start point coordinates and the end point coordinates of the first track point coordinate set are the same;

Step S603: When the start point coordinates and the end point coordinates of the first track point coordinate set are the same, the operation track encloses a closed area.

In this embodiment, the trajectory enclosed by the closed area is set as the preset reference trajectory, so that by detecting whether the area enclosed by the operation trajectory is a closed area, misoperation or non-compliant operation can be further quickly eliminated.

Please refer to FIG. 7 and FIG. 8. In some feasible embodiments, step S405 specifically includes the following steps.

Step S701: Calculate the width w and height h of the area enclosed by the operation track TS in the X and Y coordinates.

Step S703: Determine the preset area R according to the largest one of the width w and the height h. In this embodiment, the preset area is a square, and the side length of the square is equal to the largest one of the width w and the height h.

Step S705: Scale the sample coordinate set B1 to be verified to the preset area R to form a first transformed coordinate set.

In this embodiment, the operation trajectory can be changed in the preset area, and the position of the operation trajectory is not limited, and the operation is more convenient.

Referring to FIG. 9, in some feasible embodiments, before step S1031, the method further includes a step of forming a reference coordinate set. Wherein, the step of forming the reference coordinate set is basically the same as the step of forming the coordinate set to be verified. Specifically, the method further includes the following steps.

Step S901: Obtain the preset reference trajectory, where the preset reference trajectory includes a continuous set of second trajectory point coordinates.

In step S903, a number of track point coordinates are sampled from the second track point coordinate set according to a preset sampling rule to form the reference sampling coordinate set.

Step S905: Transform the reference sample coordinates in the reference sample coordinate set into coordinates in the preset area R to form a second transformed coordinate.

Step S907: Acquire a coordinate in the area enclosed by the second transformed coordinate set as the second center coordinate according to the movement rule.

Step S909: Transform the second transformed coordinate using the second center coordinate as the coordinate origin to form the reference coordinate set.

Wherein, step S905 specifically includes:

Step S9051: Calculate the width and height of the area enclosed by the preset reference trajectory in X and Y coordinates;

Step S9053: Determine the width of the preset area R according to the largest one of the width and the height;

Step S9055, scaling the reference sampling coordinate set to the preset area R to form the second transformed coordinate set.

The method for forming the reference coordinate set and the step method for forming the coordinate set to be verified in this embodiment can ensure the consistency between the reference coordinate set and the coordinate set to be verified, and further improve the matching accuracy of the operation track.

Please refer to FIG. 10, which is a schematic diagram of the electronic device of the first embodiment. The electronic device 100 includes one or more processors 30, a memory 40, and a bus 50.

The memory 40 includes at least one type of readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 40 may be an internal storage unit of the electronic device 100 in some embodiments, such as a hard disk of the electronic device 100. In other embodiments, the memory 40 may also be an external storage device of the electronic device 100, such as a plug-in hard disk equipped on the terminal 1, a smart media card (SMC), and a secure digital (SD) card. , Flash Card, etc. Further, the memory 40 may also include both an internal storage unit of the electronic device 100 and an external storage device. The memory 40 can be used not only to store application software and various data (for example, the computer program 01) installed in the electronic device 100, but also to temporarily store data that has been output or will be output.

The bus 50 may be a peripheral component interconnection standard (PCI) bus or an extended industry standard architecture (EISA) bus or the like. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only a thick line is used in FIG. 50 to represent, but it does not mean that there is only one bus or one type of bus.

Further, the electronic device 100 further includes a touch display assembly 10. The touch display component 10 may be a touch liquid crystal display panel, an OLED (Organic Light-Emitting Diode, organic light emitting diode), etc. Wherein, the touch display assembly 10 may be appropriately called a touch screen or a touch screen, which is used for displaying information processed in the electronic device 100 and for displaying a visual user interface, and for the user to input instructions by touch operation.

Further, the electronic device 100 further includes a camera 20. The camera 20 is used to collect images.

In some embodiments, the processor 30 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip, and is used to run program codes or processes stored in the memory 40 data. Specifically, the processor 30 executes the computer program 01 to implement the aforementioned method of executing instructions based on trajectories.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part.

Please refer to FIG. 11, which is a schematic diagram of the computer-readable storage medium 300 of the first embodiment. The computer-readable storage medium 300 stores a computer program. The computer program is executed to implement the above-mentioned method of executing instructions based on the trajectory.

The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a dedicated computer, a computer network, or other programmable devices. The computer instruction can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instruction can be transmitted from a website, computer, server, or data center through a cable (Such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a server or data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that this application is not limited by the described sequence of actions, because According to the application, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.

The steps in the method of the embodiment of the present application can be adjusted, merged, and deleted in order according to actual needs.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method in each embodiment of the present application.

Claims

A method for executing instructions based on a trajectory, applied to an electronic device, characterized in that the method includes:

Obtain the operation track;

Detecting whether the operation trajectory matches a preset reference trajectory; and

When the operation trajectory matches the preset reference trajectory, a corresponding operation instruction is executed.
The method according to claim 1, wherein detecting whether the operation trajectory matches the preset reference trajectory specifically comprises:

Calculating the similarity between the operation trajectory and the preset reference trajectory; and

When the similarity reaches a preset threshold, it is detected that the operation trajectory matches the preset reference trajectory.
The method according to claim 2, wherein before calculating the similarity between the operation trajectory and the reference trajectory, the method further comprises:

The preset reference trajectory is searched out from a preset mapping relationship table, where the mapping relationship table includes a mapping relationship between a reference trajectory set and an operation instruction set.
The method according to claim 3, wherein the preset mapping table relationship table is stored in the electronic device.
The method according to claim 1, wherein the preset reference trajectory includes a reference coordinate set, and each reference coordinate in the reference coordinate set has a unique serial number; the operation trajectory includes consecutive first trajectory point coordinates Set, calculating the similarity between the operation trajectory and the preset reference trajectory includes:

According to a preset sampling rule, several trajectory point coordinates are sampled from the first track point coordinate set to form a sampled coordinate set to be verified, wherein the number of sampled coordinates to be verified in the sampled coordinate set to be verified is the same as that of the reference coordinate set. The number of coordinates is the same;

According to the sequence of the first track point coordinate set, a unique serial number is assigned to the sampling coordinate to be verified in the sampling coordinate set to be verified, so that the serial number of the sampling coordinate to be verified corresponds to the serial number of the reference coordinate one-to-one, wherein the first A track point coordinate set sequence includes the sequence of the first track point coordinate set from the start point to the end point or the sequence of the first track point coordinate set from the end point to the start point;

Transforming the sample coordinate set to be verified into coordinates in the preset area R to form a first transformed coordinate set;

Acquiring, according to a preset movement rule, one coordinate in the area enclosed by the first transformed coordinate set as the first center coordinate;

Transforming the first transformed coordinate set using the first center coordinates as the coordinate origin to form a coordinate set to be verified;

Calculate the difference between the coordinate to be verified and the reference coordinate corresponding to the serial number; and

The similarity is calculated according to the difference value.
The method according to claim 5, wherein before calculating the similarity between the operation trajectory and the reference trajectory, the method further comprises:

Acquiring the preset reference trajectory, where the preset reference trajectory includes a continuous set of second trajectory point coordinates;

Sampling a number of track point coordinates from the second track point coordinate set according to a preset sampling rule to form the reference sampling coordinate set;

Transforming the reference sampling coordinates in the reference sampling coordinate set into coordinates in a preset area with a preset size to form a second transformed coordinate;

Acquiring one coordinate in the area enclosed by the second transformed coordinate set as the second center coordinate according to the movement rule; and

Transform the second transformed coordinates using the second center coordinates as the origin of coordinates to form the reference coordinate set.
The method according to claim 5 or 6, wherein the preset sampling rule is to sample according to a preset length, wherein the preset length is L/(N-1), where L is the total length of the track , N is the preset number.
The method according to claim 5, wherein transforming the coordinate set of samples to be verified into the coordinates of a preset area with a preset size specifically comprises:

Calculate the width and height of the area enclosed by the operation track in X and Y coordinates;

Determining the preset area according to the largest one of the width and height; and

The sampling coordinate set to be verified is scaled to the preset area to form the first transformed coordinate set.
The method according to claim 6, wherein transforming the reference sampling coordinates in the reference sampling coordinate set into coordinates in the preset area to form the second transformed coordinates specifically comprises:

Calculating the width and height of the area enclosed by the preset reference track on the X coordinate and the Y coordinate;

Determining the width of the preset area according to the largest one of the width and height;

The reference sampling coordinate set is scaled to the preset area to form the second transformed coordinate set.
The method according to claim 9, wherein the predetermined area is a square, and the side length of the square is equal to the largest one of the width and the height.
The method according to claim 5, wherein the difference value between the coordinate to be verified and the reference coordinate is: the distance between the coordinate to be verified and the corresponding reference coordinate; the calculation of the similarity according to the difference value is specific for:

Among them, s is used to indicate the degree of approximation, W is used to indicate the width of the preset area; the C[k] X is used to indicate the coordinate value of the kth coordinate to be verified on the X axis; the kth coordinate to be verified The coordinate value C[k]y on the Y axis; the T[k] X is used to represent the coordinate value of the k-th reference coordinate on the X axis; the T[k] y is used to represent the k-th reference coordinate in the The coordinate value of the Y axis; d is used to represent the average value of the distance between all the coordinate to be verified and the corresponding reference coordinate in the coordinate set to be verified and the reference coordinate value, where N is used to represent the coordinate set to be verified or the reference The total number of corresponding coordinates in the coordinate set, k is 1 to N.
The method according to claim 5, wherein before calculating the similarity according to the difference value, the method further comprises:

Count the number of difference values greater than the preset difference value;

Determine whether the quantity exceeds a preset quantity;

When the number exceeds the preset number, the operation trajectory does not match the preset reference trajectory; or

When the number does not exceed the preset number, the similarity is calculated according to the difference value.
The method according to claim 5, wherein the preset reference trajectory encloses a closed area, and before calculating the similarity according to the difference value, the method further comprises:

It is detected whether the operation track encloses a closed area.
The method according to claim 13, wherein detecting whether the operation track encloses a closed area is specifically:

Detecting whether the start point coordinates and the end point coordinates of the first track point coordinate set are the same; and

When the start point coordinates and the end point coordinates of the first track point coordinate set are the same, the operation track encloses a closed area.
The method according to claim 1, wherein the operation instruction includes at least one of storing, deleting, replaying the track, and sending a signal and a file to other electronic devices.
The method according to claim 1, wherein the operation track is acquired by a camera, or acquired by detecting a touch track on a touch display component.
An electronic device characterized by comprising: a processor, a memory, and a computer program, wherein the computer program is stored in the memory and is configured to be executed by the processor, and when the computer program is executed by the processor Implement the method according to any one of claims 1-16.
18. The electronic device of claim 17, wherein the electronic device is an electronic device with a handwriting and drawing function.
A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method according to any one of claims 1-16 when the computer program is executed by a processor.