CN113260973A

CN113260973A - Method for executing instructions based on track, electronic equipment and computer-readable storage medium

Info

Publication number: CN113260973A
Application number: CN201980073413.3A
Authority: CN
Inventors: 袁洪烈
Original assignee: Shenzhen Royole Technologies Co Ltd
Current assignee: Shenzhen Royole Technologies Co Ltd
Priority date: 2019-03-05
Filing date: 2019-03-05
Publication date: 2021-08-13
Also published as: WO2020177070A1

Abstract

A method for executing instructions based on tracks is applied to electronic equipment and comprises the following steps: acquiring an operation track (S101); detecting whether the operation track is matched with a preset reference track or not (S103); and when the operation trajectory matches the reference trajectory, executing a corresponding operation instruction (S105). An electronic device and a computer-readable storage medium are also disclosed. According to the method, the electronic device and the computer-readable storage medium for executing the instruction based on the track, the corresponding operation instruction is executed by directly using the operation track, and the operation is relatively quick.

Description

Method for executing instructions based on track, electronic equipment and computer-readable storage medium

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to a method for executing an instruction based on a track, an electronic device, and a computer-readable storage medium.

Background

At present, more and more electronic devices utilize passwords (such as character passwords, fingerprint passwords, etc.) to execute corresponding instructions to implement functions, such as starting applications, unlocking screens, deleting files, etc.

However, the character password is easy to crack. And adopt the fingerprint password among the electronic equipment, need carry out corresponding execution time, generally all need confirm whether to use the fingerprint in the touch-control display screen, then input the fingerprint and unlock, the operation is troublesome. Therefore, it is urgent to reduce the operation steps and improve the operation efficiency of the user.

Disclosure of Invention

The embodiment of the application discloses a method for executing instructions based on a track, electronic equipment and a computer-readable storage medium, which can reduce operation steps and improve user operation efficiency.

On one hand, the method for executing the instruction based on the track disclosed by the embodiment of the application is applied to the electronic equipment, and comprises the following steps:

obtaining an operation track;

detecting whether the operation track is matched with a preset reference track or not; and

and when the operation track is matched with the preset reference track, executing a corresponding operation instruction.

On the other hand, an electronic device further disclosed in an embodiment of the present application includes: a processor, a memory, and a computer program, wherein the computer program is stored in the memory and configured to be executed by the processor, the computer program, when executed by the processor, implementing the method described above.

On the other hand, the embodiments of the present application also disclose a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described above is implemented.

According to the track-based instruction execution method, the electronic device and the computer-readable storage medium, the corresponding operation instruction is executed by directly using the operation track, and the operation is relatively quick.

Drawings

Fig. 1 is a flowchart illustrating a method for executing an instruction based on a track according to a first embodiment of the present disclosure.

Fig. 2 is a schematic diagram of a user graphical interface according to a first embodiment of the present application.

Fig. 3 is a schematic diagram of a relationship table of a preset mapping table in fig. 1 according to the present application.

Fig. 4 is a flowchart of a first exemplary implementation of step S1031 shown in fig. 1.

Fig. 5 is a partial schematic diagram of a partial sub-flow of the second embodiment of step S1031 shown in fig. 1.

Fig. 6 is a schematic diagram of a partial sub-flow of the third embodiment of step S1031 shown in fig. 1.

Fig. 7 is a flowchart illustrating a first exemplary implementation of step S405 shown in fig. 4.

Fig. 8 is a schematic diagram of a graphical user interface provided in the second embodiment of the present application.

Fig. 9 is a partial flowchart of a method for executing an instruction based on a track according to a second embodiment of the present application.

Fig. 10 is a functional structure diagram of an electronic device according to a first embodiment of the present application.

Fig. 11 is a schematic diagram of a computer-readable storage medium according to a first embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It is to be understood that the terminology used in the embodiments of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

Referring to fig. 1, fig. 1 is a flowchart illustrating a method for executing an instruction based on a track according to an embodiment of the present disclosure. The method for executing the instruction based on the track is applied to the electronic equipment. In this embodiment, the electronic device is an electronic device with a function of drawing by handwriting. The electronic device includes, but is not limited to, an electronic device having a touch display component in a mobile phone, a tablet computer, an intelligent bracelet, a notebook computer, a desktop computer, and a multimedia player. Operating systems for electronic devices include, but are not limited to, the Andirod operating system, the IOS operating system, the Symbian operating system, the BlackBerry operating system, the Windows Phone operating system, and the like. The method comprises the following steps.

Step S101, acquiring an operation track. In some possible embodiments, the operation track may be obtained by detecting a touch track of an external object on the touch display device. External objects are, but not limited to, a stylus, a finger, etc. As shown in fig. 2, when the finger slides in the touch display device, the corresponding touch trajectory S can be detected to obtain the operation trajectory TS.

In other possible embodiments, the operation trajectory TS may also be acquired by a camera. For example, a camera is provided in the electronic device, and a motion trajectory of an external object (such as a finger, a touch device, a palm, etc.) is acquired by the camera to obtain the operation trajectory TS.

Step S103, detecting whether the operation trajectory TS matches the preset reference trajectory SS. In some possible embodiments, a preset mapping table P is stored in the electronic device, wherein the mapping table P includes a reference track set D₁And the mapping relation D of the operation instruction set₂(as shown in fig. 3). The predetermined reference trajectory can be found from the predetermined mapping table P.

And step S105, when the operation track TS is matched with the preset reference track SS, executing a corresponding operation instruction. In some possible embodiments, the operation instruction may be, but is not limited to, at least one of starting an application program in the electronic device, unlocking the electronic device, storing, deleting, replaying a track, and sending a signal and a file to other electronic devices (as shown in fig. 3).

In the above embodiment, the corresponding operation instruction can be directly executed by using the operation track, and the operation is relatively quick.

Specifically, in some possible examples, step S103 includes: step S1031, calculating the similarity between the operation track TS and a preset reference track SS; step S1033, when the similarity reaches a preset threshold, detecting that the operation trajectory TS matches the preset reference trajectory SS. In this embodiment, whether the operation trajectory TS is matched with the preset reference trajectory SS is determined according to the similarity between the operation trajectory TS and the preset reference trajectory SS, so that the matching efficiency and sensitivity are improved.

In other possible embodiments, it is also possible to detect whether the operation trajectory TS matches the preset reference trajectory SS. For example, it may be implemented by detecting whether some or all of the track points of the operation track TS and the preset reference track SS are the same.

Referring to fig. 4, in some possible embodiments, the preset reference trajectory SS includes a set of reference coordinates, each reference coordinate in the set of reference coordinates having a unique serial number. The operation trajectory TS comprises a continuous first set of trajectory point coordinates. Wherein step S1031 includes the following steps.

Step S401, sampling a plurality of track point coordinates from a first track point coordinate set according to a preset sampling rule to form a sampling coordinate set B needing to be verified₁. Wherein, the sampling coordinate set B needs to be verified₁The number of the sampling coordinates to be verified is the same as the number of the reference coordinates in the reference coordinate set. The preset sampling rule is to perform sampling according to a preset length, wherein the preset length is L/(N-1), L is the total length of the track, and N is the preset number.

And S403, distributing unique serial numbers to the sampling coordinates to be verified in the sampling coordinate set B1 to be verified according to the sequence of the first track point coordinate set, so that the serial numbers of the sampling coordinates to be verified correspond to the serial numbers of the reference coordinates one by one, wherein the sequence of the first track point coordinate set comprises the sequence of the first track point coordinate set from a starting point to a terminal point or the sequence of the first track point coordinate set from the terminal point to the starting point.

In step S405, the sample coordinate set B1 to be verified is transformed to have coordinates in the preset region R to form a first transformed coordinate set (as shown in fig. 8).

Step S407, acquiring a coordinate in the area surrounded by the first transformation coordinate set according to a preset movement rule as a first center coordinate.

And step S409, transforming the first transformation coordinate set by taking the first center coordinate as a coordinate origin to form a coordinate set to be verified.

Step S411, calculating a difference between the coordinate to be verified and the reference coordinate corresponding to the serial number.

In step S413, similarity is calculated according to the difference value. Specifically, in some embodiments, the difference value between the verification coordinate and the reference coordinate is: the distance between the coordinates and the corresponding reference coordinates needs to be verified. The calculation of the similarity according to the difference values specifically comprises the following steps:

wherein s is used for representing the approximation degree, and W is used for representing the width of the preset region R; c [ k ]] _XThe coordinate value is used for representing the kth coordinate to be verified on the X axis; coordinate value C [ k ] of kth coordinate to be verified on Y axis]y；T[k] _XA coordinate value for indicating the k-th reference coordinate on the X-axis; t [ k ]] _yA coordinate value for indicating the kth reference coordinate on the Y axis; d is used for representing the average value of the distances between all coordinates to be verified and the corresponding reference coordinates in the coordinate set to be verified and the reference coordinate values, wherein N is used for representing the total number of the corresponding coordinates in the coordinate set to be verified or the reference coordinate set, and k is 1 to N.

In this embodiment, first, an average difference value is calculated according to a difference value between a coordinate to be verified and a corresponding reference coordinate, and then, a similarity is determined according to the average difference value, so that the obtained similarity is more accurate.

Referring to fig. 5, in some possible embodiments, the method further includes the following steps before step S411.

In step S501, the number of difference values greater than a preset difference value is counted.

In step S503, it is determined whether the number exceeds a preset number.

In step S505, when the number exceeds the preset number, the operation trajectory TS does not match the preset reference trajectory SS.

And step S507, when the number does not exceed the preset number, calculating the similarity according to the difference value.

In this embodiment, the number of difference counting values larger than the preset difference value may be counted in advance, and the similarity calculation may be performed only for the number of difference counting values larger than the preset difference value, so that the erroneous operation or the non-compliant operation may be quickly eliminated.

Referring to fig. 6, in some possible embodiments, the predetermined reference trajectory encloses a closed area. The closed region is, for example, a triangle, a circle, an ellipse, etc. of the predetermined trajectory, and the closed region is a triangle, a circle, an ellipse, etc. Before step S411, the method further includes: step S600, detecting whether the operation trajectory encloses a closed area, and executing step S411 when enclosing the closed area. Specifically, detecting whether the operation trajectory encloses a closed region includes:

step S601, detecting whether the start point coordinate and the end point coordinate of the first track point coordinate set are the same;

and step S603, when the start point coordinate and the end point coordinate of the first track point coordinate set are the same, the operation track encloses a closed area.

In this embodiment, a track enclosed into a closed area is set as a preset reference track, so that by detecting whether the area enclosed by the operation track is a closed area, misoperation or non-compliant operation is further quickly eliminated.

Referring to fig. 7 and 8, in some possible embodiments, step S405 specifically includes the following steps.

Step S701, calculating a width w and a height h of the region surrounded by the operation trajectory TS on the X coordinate and the Y coordinate.

In step S703, a predetermined region R is determined according to the maximum one of the width w and the height h. In this embodiment, the predetermined area is a square, and the side length of the square is equal to the largest one of the width w and the height h.

In step S705, the sample coordinate set B1 to be verified is scaled to the preset region R to form a first transformed coordinate set.

In this embodiment, the operation trajectory may be transformed in a preset region, and the position of the operation trajectory is not limited, so that the operation is more convenient.

Referring to fig. 9, in some possible embodiments, before step S1031, the method further includes the step of forming a reference coordinate set. The step of forming the reference coordinate set is substantially identical to the step of forming the coordinate set to be verified, and specifically, the method further comprises the following steps.

Step S901, obtaining the preset reference track, where the preset reference track includes a continuous second track point coordinate set.

And step S903, sampling a plurality of track point coordinates from the second track point coordinate set according to a preset sampling rule to form the reference sampling coordinate set.

Step S905 converts the reference sample coordinates in the reference sample coordinate set into coordinates within the preset region R to form second converted coordinates.

Step S907 acquires one coordinate in the area surrounded by the second transformed coordinate set as a second center coordinate according to the movement rule.

In step S909, the second transformed coordinate is transformed to form the reference coordinate set with the second center coordinate as a coordinate origin.

Wherein, step S905 specifically includes:

step S9051, calculating the width and height of an area surrounded by the preset reference track on an X coordinate and a Y coordinate;

step S9053, determining the width of the preset region R according to the maximum width and height;

step S9055, scaling the reference sample coordinate set to a preset region R to form the second transformed coordinate set.

The forming method of the reference coordinate set and the forming step method of the coordinate set to be verified in the embodiment can ensure consistency between the reference coordinate set and the coordinate set to be verified, and further improve matching accuracy of the operation track.

Referring to fig. 10, fig. 10 is a schematic view of an electronic device according to a first embodiment. Electronic device 100 includes one or more processors 30, memory 40, bus 50.

The memory 40 includes at least one type of readable storage medium, which includes flash memory, hard disks, multimedia cards, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disks, optical disks, and the like. The memory 40 may in some embodiments be an internal storage unit of the electronic device 100, such as a hard disk of the electronic device 100. The memory 40 may also be an external storage device of the electronic device 100 in other embodiments, such as a plug-in hard disk provided on the terminal 1, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and so on. Further, the memory 40 may also include both an internal storage unit and an external storage device of the electronic device 100. The memory 40 may be used not only to store application software and various types of data (e.g., the computer program 01) installed in the electronic apparatus 100, but also to temporarily store data that has been output or is to be output.

The bus 50 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 50, but this is not intended to represent only one bus or type of bus.

Further, the electronic device 100 further includes a touch display component 10. The touch display device 10 may be a touch liquid crystal display panel, an Organic Light-Emitting Diode (OLED), or the like. The touch display device 10 may be referred to as a touch screen or a touch screen, and is used for displaying information processed in the electronic device 100 and displaying a visual user interface, and for a user to input instructions through touch operation.

Further, the electronic device 100 further includes a camera 20. The camera 20 is used to capture images.

Processor 30, which in some embodiments may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor or other data Processing chip, executes program code stored in memory 40 or processes data. In particular, the processor 30 executes the computer program 01 to implement the above-described method of executing instructions based on trajectories.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product.

Referring to fig. 11, fig. 11 is a schematic diagram of a computer-readable storage medium 300 of a first embodiment. The computer-readable storage medium 300 stores a computer program. The computer program is executed to implement the above-described method of executing instructions based on a trajectory.

The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the invention are generated in whole or in part when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can store or a data storage device, such as a server, a data center, etc., that is integrated with one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It should be noted that, for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the order of acts described, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the unit is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application.

Claims

A method for executing instructions based on tracks, which is applied to an electronic device, is characterized in that the method comprises the following steps:

obtaining an operation track;

detecting whether the operation track is matched with a preset reference track; and

and when the operation track is matched with the preset reference track, executing a corresponding operation instruction.
The method according to claim 1, wherein detecting whether the operation trajectory matches the preset reference trajectory specifically comprises:

calculating the similarity between the operation track and the preset reference track; and

and when the similarity reaches a preset threshold value, detecting that the operation track is matched with the preset reference track.
The method of claim 2, wherein prior to calculating the similarity of the operation trajectory to a reference trajectory, the method further comprises:

and finding out the preset reference track from a preset mapping relation table, wherein the mapping relation table comprises a mapping relation between a reference track set and an operation instruction set.
The method of claim 3, wherein the predetermined mapping table relation is stored in the electronic device.
The method of claim 1, wherein the preset reference trajectory comprises a set of reference coordinates, each reference coordinate in the set of reference coordinates having a unique serial number; the operation track comprises a continuous first track point coordinate set, and the calculation of the similarity between the operation track and the preset reference track comprises the following steps:

sampling a plurality of trace point coordinates from the first trace point coordinate set according to a preset sampling rule to form a sampling coordinate set to be verified, wherein the number of the sampling coordinates to be verified in the sampling coordinate set to be verified is the same as the number of the reference coordinates in the reference coordinate set;

allocating a unique serial number to the sampling coordinate to be verified in the sampling coordinate set to be verified according to the sequence of the first track point coordinate set, so that the serial number of the sampling coordinate to be verified corresponds to the serial number of the reference coordinate one by one, wherein the sequence of the first track point coordinate set comprises the sequence of the first track point coordinate set from a starting point to an end point or the sequence of the first track point coordinate set from the end point to the starting point;

transforming the sampling coordinate set to be verified into coordinates in a preset region R to form a first transformation coordinate set;

acquiring a coordinate in an area surrounded by the first transformation coordinate set according to a preset movement rule as a first center coordinate;

transforming the first transformation coordinate set by taking the first central coordinate as a coordinate origin to form a coordinate set to be verified;

calculating the difference value between the coordinate to be verified and the reference coordinate corresponding to the serial number; and

and calculating the similarity according to the difference value.
The method of claim 5, wherein calculating the similarity between the operation trajectory and the reference trajectory further comprises:

acquiring the preset reference track, wherein the preset reference track comprises a continuous second track point coordinate set;

sampling a plurality of track point coordinates from the second track point coordinate set according to a preset sampling rule to form a reference sampling coordinate set;

transforming the reference sampling coordinates in the reference sampling coordinate set into coordinates within a preset area having a preset size to form second transformed coordinates;

acquiring a coordinate in an area surrounded by the second transformation coordinate set as a second central coordinate according to the movement rule; and

and transforming the second transformed coordinate by taking the second central coordinate as a coordinate origin to form the reference coordinate set.
The method according to claim 5 or 6, wherein the predetermined sampling rule is sampling according to a predetermined length, wherein the predetermined length is L/(N-1), where L is the total length of the tracks and N is the predetermined number.
The method according to claim 5, wherein transforming the set of sampled coordinates to be verified into coordinates of a preset area having a preset size comprises:

calculating the width and height of the area surrounded by the operation track on an X coordinate and a Y coordinate;

determining the preset area according to the maximum one of the width and the height; and

and scaling the to-be-verified sampling coordinate set to the preset area to form the first transformation coordinate set.
The method of claim 6, wherein transforming the reference sample coordinates in the reference sample coordinate set to coordinates within the preset area to form second transformed coordinates comprises:

calculating the width and height of an area surrounded by the preset reference track on an X coordinate and a Y coordinate;

determining the width of the preset area according to the maximum one of the width and the height;

scaling the reference sample coordinate set to the preset region to form the second transformed coordinate set.
The method of claim 9, wherein the predetermined area is a square having a side length equal to one of the largest width and height.
The method of claim 5, wherein the difference between the coordinates to be verified and the reference coordinates is: the distance between the coordinate to be verified and the corresponding reference coordinate; the calculating the similarity according to the difference value specifically includes:

wherein s is used for representing the approximation degree, and W is used for representing the width of the preset area; c [ k ] is] _XFor indicating the k-th coordinate to be verified atCoordinate values of the X axis; coordinate value C [ k ] of kth coordinate to be verified on Y axis]y; said T [ k ]] _XA coordinate value for indicating the k-th reference coordinate on the X-axis; said T [ k ]] _yA coordinate value for indicating the k-th reference coordinate on the Y-axis; d is used for representing the average value of the distances between all coordinates to be verified and the corresponding reference coordinates in the coordinate set to be verified and the reference coordinate values, wherein N is used for representing the total number of the corresponding coordinates in the coordinate set to be verified or the reference coordinate set, and k is 1 to N.
The method of claim 5, wherein prior to calculating the similarity from the disparity values, the method further comprises:

counting the number of difference values larger than a preset difference value;

judging whether the number exceeds a preset number or not;

when the number exceeds a preset number, the operation track is not matched with the preset reference track; or

And when the number does not exceed the preset number, calculating the similarity according to the difference value.
The method according to claim 5, wherein the preset reference trajectory encloses a closed area, and before calculating the similarity from the difference values, the method further comprises:

and detecting whether the operation track encloses a closed area.
The method according to claim 13, wherein detecting whether the operation trajectory encloses a closed region is specifically:

detecting whether the starting point coordinate and the end point coordinate of the first track point coordinate set are the same; and

and when the coordinates of the starting point and the coordinates of the end point of the first track point coordinate set are the same, the operation track encloses a closed area.
The method of claim 1, wherein the operation instructions include at least one of storing, deleting, track replaying, sending signals and files to other electronic devices.
The method according to claim 1, wherein the operation track is obtained by a camera or by detecting a touch track on a touch display component.
An electronic device, comprising: a processor, a memory, and a computer program, wherein the computer program is stored in the memory and configured to be executed by the processor, the computer program, when executed by the processor, implementing the method of any of claims 1-16.
The electronic device of claim 17, wherein the electronic device is an electronic device with a handwriting drawing function.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-16.