CN111007974A - Touch pen-based interaction method, terminal and readable storage medium - Google Patents

Touch pen-based interaction method, terminal and readable storage medium Download PDF

Info

Publication number
CN111007974A
CN111007974A CN201911289845.6A CN201911289845A CN111007974A CN 111007974 A CN111007974 A CN 111007974A CN 201911289845 A CN201911289845 A CN 201911289845A CN 111007974 A CN111007974 A CN 111007974A
Authority
CN
China
Prior art keywords
target operation
track
operation track
touch pen
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911289845.6A
Other languages
Chinese (zh)
Inventor
夏程杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Chuanying Information Technology Co Ltd
Original Assignee
Shanghai Chuanying Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Chuanying Information Technology Co Ltd filed Critical Shanghai Chuanying Information Technology Co Ltd
Priority to CN201911289845.6A priority Critical patent/CN111007974A/en
Publication of CN111007974A publication Critical patent/CN111007974A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Abstract

The invention discloses an interaction method, a terminal and a readable storage medium based on a touch pen. According to the invention, the matching relation between the user intention and the target operation track is established according to the one-to-one correspondence relation between the target operation track and the response operation of the terminal, so that the terminal can judge the user intention through the target operation track, if the target operation track does not meet the preset trigger condition, the target operation track collected by the display screen is shielded, the interference of the user on the terminal under the wrong operation is reduced, the target operation track which does not meet the preset trigger condition can be eliminated, the target operation track which cannot represent the user intention is eliminated, the recognition rate of the terminal on the target operation track is improved, and the user experience is further improved.

Description

Touch pen-based interaction method, terminal and readable storage medium
Technical Field
The invention relates to the technical field of interactive communication, in particular to an interactive method based on a touch pen, a terminal and a readable storage medium.
Background
With the development of screen hardware technology, people can draw a target operation track corresponding to the gesture on a terminal by using the display screen technology, so that the problem of complicated operation in the past can be solved, and great convenience is brought to users. For example, a corresponding target operation track is drawn on a display screen of the mobile phone, so that the functions of the mobile phone are controlled accordingly.
However, in some terminal products, the identification of the target operation track is not high, and the terminal products are prone to make wrong judgments, so that the terminal products make wrong responses.
Disclosure of Invention
The invention mainly aims to provide an interaction method based on a touch pen, a terminal and a readable storage medium, and aims to solve the technical problem that a machine easily misjudges the operation intention of a user in the process of man-machine interaction so as to make an error response.
In order to achieve the above object, an embodiment of the present invention provides an interaction method based on a touch pen, which is applied to a terminal, and includes: acquiring a target operation track triggered by a touch pen on a display screen; judging whether the target operation track meets a preset trigger condition or not according to the target operation track; and if the target operation track meets a preset trigger condition, performing corresponding response operation according to the target operation track.
Further, establishing communication connection with the searched touch pen; acquiring the identifier of the touch pen and judging whether the identifier of the touch pen exists in a preset authority list or not; if the identifier of the touch pen exists in the preset authority list, displaying an input window of the target operation track on the display screen; the step of acquiring the target operation track triggered by the touch pen on the display screen comprises: and acquiring the target operation track sensed by the input window of the touch pen in the display screen.
Further, the step of acquiring a target operation track triggered by the touch pen on the display screen includes:
if the touch pen is detected to trigger an operation track on the display screen, judging whether the operation track is effective input or not according to the current use scene or state information of the display screen;
and if the operation track is effective input, determining the operation track as the target operation track.
Further, the current usage scenario includes a game scenario, a video scenario, or a driving scenario; or, the state information includes a screen-off state.
Further, a first motion track triggered by a point where the touch pen is in contact with the display screen is obtained, and a second motion track triggered by a preset point located on the touch pen is obtained at the same time; judging whether the first motion track is similar to the second motion track or not according to the first motion track and the second motion track; and if so, taking the first motion track as the target operation track.
Further, if the first motion track and the second motion track are not similar to each other, the second motion track is used as a reference, and the first motion track is corrected, so that the similarity between the corrected first motion track and the corrected second motion track is larger than or equal to a preset value; and taking the corrected first motion track as the target operation track.
Further, if the target operation trajectory meets a preset trigger condition, the specific steps of performing corresponding operations according to the target operation trajectory include:
calculating the similarity between the target operation track and each preset target operation track;
comparing the highest similarity with a preset similarity threshold;
if the highest similarity is larger than or equal to the preset similarity threshold, executing a control instruction corresponding to the highest similarity, and determining the control instruction as the target control instruction matched with the target operation track;
and carrying out corresponding response operation according to the target control instruction.
Further, if the highest similarity is smaller than the preset similarity threshold, outputting a prompt message for prompting the target operation track to be input again; and if the preset time prompt information is retrieved and output within the preset time, shielding the target operation track acquired by the display screen.
The present invention also provides a terminal, including: the interactive program can be executed on the processor, and when being executed by the processor, the interactive program realizes the steps of the interactive method.
The invention also provides a readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the interaction method as described above.
According to the method, the target operation track triggered on the display screen by the touch pen is obtained through the terminal, whether the target operation track meets the preset trigger condition or not is judged according to the target operation track, if the target operation track meets the preset trigger condition, corresponding response operation is carried out according to the target operation track, and if the target operation track does not meet the preset trigger condition, the target operation track collected by the display screen is shielded. Therefore, according to the one-to-one correspondence relationship between the target operation track and the response operation of the terminal, the matching relationship between the user intention and the target operation track is established, so that the terminal can judge the user intention through the target operation track, if the target operation track does not meet the preset trigger condition, the target operation track collected by the display screen is shielded, the interference of the user on the terminal under the wrong operation is reduced, the target operation track which does not meet the preset trigger condition can be eliminated, the target operation track which cannot represent the user intention is eliminated, the recognition rate of the terminal on the target operation track is improved, and the user experience is further improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic structural diagram of a terminal in which hardware according to an embodiment of the present invention operates;
FIG. 2 is a flow chart of an embodiment of a touch pen-based interaction method of the present invention;
FIG. 3 is a scene diagram illustrating a display status of a target operation track on a display screen according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating an embodiment of the touch pen-based interaction method of the present invention before step S10;
FIG. 5 is a schematic diagram of a scenario in which a stylus wirelessly communicates with a display screen according to an embodiment of the present invention;
fig. 6 is a flowchart illustrating an embodiment of an interaction method S30 based on a touch pen according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a terminal in which hardware according to an embodiment of the present invention operates.
The terminal of the embodiment of the invention can be a PC, and can also be a mobile terminal device with a display function, such as a smart phone, a tablet computer, an electronic book reader, an MP3(Moving Picture Experts Group Audio Layer III, dynamic video Experts compress standard Audio Layer 3) player, an MP4(Moving Picture Experts Group Audio Layer IV, dynamic video Experts compress standard Audio Layer 3) player, a portable computer, and the like.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1002, sensors 1003, a user interface 1004, a memory 1005. The user interface 1004 may include a display screen and other input units. The network interface 1002 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001. Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
Wherein the user interface 1004 displays information input by the user or information provided to the user. The touch pen can be used for receiving input numerical or character information and generating signal input with the touch pen. Specifically, the input unit may include a touch panel and other input devices. A touch panel, also called a touch screen, may collect a touch operation of a user on or near the touch panel (for example, an operation of the user on or near the touch panel using any suitable object or accessory such as a finger, a stylus, etc. and drive a corresponding connection device according to a preset program. the touch panel may include two parts of a touch detection device and a touch controller, wherein the touch detection device detects a touch orientation of the user and detects a signal resulting from the touch operation and transmits the signal to the touch controller, and the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, transmits it to the processor, and can receive and execute a command from the processor. Other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.
As shown in fig. 1, a memory 1005, which is a kind of readable storage medium, may include an operating system and an interactive program therein.
In the terminal shown in fig. 1, the network interface 1002 is mainly used for connecting with a touch pen, and can perform wireless communication or wired communication with the touch pen; the user interface 1004 is primarily for interactive communication with a stylus; and the processor 1001 may be configured to call the interactive program stored in the memory 1005 and perform the following operations:
acquiring a target operation track triggered by a touch pen on a display screen;
judging whether the target operation track meets a preset trigger condition or not according to the target operation track;
and if the target operation track meets a preset trigger condition, performing corresponding response operation according to the target operation track.
Further, establishing communication connection with the searched touch pen;
acquiring the identifier of the touch pen and judging whether the identifier of the touch pen exists in a preset authority list or not;
and if the identifier of the touch pen exists in the preset authority list, displaying an input window of the target operation track on the display screen.
Further, the target operation track sensed by the touch pen in the input window of the display screen is obtained.
Further, a first motion track triggered by a point where the touch pen is in contact with the display screen is obtained, and a second motion track triggered by a preset point located on the touch pen is obtained at the same time;
judging whether the first motion track is similar to the second motion track or not according to the first motion track and the second motion track;
and if so, taking the first motion track as the target operation track.
Further, the processor 1001 may call the interactive program stored in the memory 1005, and also perform the following operations:
if not, correcting the first motion track by taking the second motion track as a reference so as to enable the similarity between the corrected first motion track and the second motion track to be larger than or equal to a preset value;
and taking the corrected first motion track as the target operation track.
Further, calculating the similarity between the target operation track and each preset target operation track;
comparing the highest similarity with a preset similarity threshold;
if the highest similarity is larger than or equal to the preset similarity threshold, executing a control instruction corresponding to the highest similarity, and determining the control instruction as the target control instruction matched with the target operation track;
and carrying out corresponding response operation according to the target control instruction.
Further, the processor 1001 may call the interactive program stored in the memory 1005, and also perform the following operations:
if the highest similarity is smaller than the preset similarity threshold, outputting prompt information for prompting the target operation track to be input again;
and if the preset time prompt information is retrieved and output within the preset time, shielding the target operation track acquired by the display screen.
Referring to fig. 2, fig. 2 is a schematic flowchart of an embodiment of an interaction method based on a touch pen according to the present invention, where the interaction method based on the touch pen includes:
and step S10, acquiring a target operation track triggered by the touch pen on the display screen.
The terminal can acquire a target operation track triggered by the touch pen on the display screen in real time or at regular time. For example, the terminal may be a mobile phone, the user may input a corresponding target operation track on a display screen of the mobile phone through a touch pen, and the mobile phone may receive the target operation track input by the user at any position on the display screen. The terminal comprises a display screen, such as a capacitive screen, an electromagnetic screen, a pressure-sensitive resistive display screen, an infrared display screen, a surface acoustic wave display screen and the like, and the display screen is used for enabling a touch pen and other related objects to touch the touch object, recording a target operation track formed by the touched part, and displaying and recording the target operation track. For example, the touch pen may be a capacitive pen, which corresponds to a capacitive screen of the terminal, and when the capacitive screen senses an object with charges, the terminal collects the target operation track.
In some embodiments, the user may set, according to self-habit, an operation of starting a triggering target operation trajectory on an interface of the terminal, for example, the user may be crowded with people due to taking a subway from 7 o 'clock to 8 o' clock, so as to avoid having the terminal in the target operation trajectory that is always detected to be triggered, and the user may not start the operation of triggering the target operation trajectory at 7 o 'clock or 8 o' clock in the morning according to time. Therefore, the trigger target operation track can be started only according to the habit setting of the user, the situation of misoperation of the user can be avoided, and the user experience is further improved.
Optionally, the specific step of obtaining the target operation track triggered by the touch pen on the display screen includes:
and acquiring a target operation track sensed by the touch pen in the input window of the display screen.
And step S20, judging whether the target operation track meets the preset trigger condition according to the target operation track.
And the terminal judges whether the target operation track meets a preset trigger condition or not according to the target operation track. The preset trigger condition may be a preset trigger condition set by an internal program of the terminal or a user according to a requirement of the user, and only a target operation trajectory meeting the preset trigger condition may enter a corresponding application program. In addition, the preset trigger conditions include, but are not limited to, the following cases: any pattern, letter, number, etc. may be used.
In some embodiments, the preset trigger condition may further include that the terminal is associated with other devices, and by inputting a preset arbitrary pattern, letter or number into the terminal, the device associated with the terminal may be triggered to enter a corresponding operation. The device associated with the terminal may be a wireless headset, a watch, a bracelet, and the like. For example, a user sets, according to a requirement of the user, operations that the wireless headset associated with the terminal needs to be powered on and powered off on a setting interface of the terminal in advance, and the headset can be powered on and powered off only when a target operation track input by the user is matched with a preset operation track "L".
And step S30, if the target operation track meets the preset trigger condition, performing corresponding response operation according to the target operation track.
And if the target operation track meets the preset trigger condition, performing corresponding response operation according to the target operation track. And after judging that the target operation track meets the preset trigger condition, the terminal performs corresponding response operation according to the target operation track. For example, if the user adds a corresponding target operation track to the telephone function on the setting interface of the terminal according to the user's own requirements, the target operation track input on the display screen of the terminal by the user using the touch pen is "L", and if the terminal determines that the target operation track meets the preset trigger condition, the terminal enters the corresponding telephone function according to the target operation track.
To assist in understanding the technical solution of this embodiment, referring to fig. 3, on the left side of fig. 3, a target operation trajectory state input by a user on a display screen through a touch pen is displayed, and on the right side of fig. 3, the target operation trajectory corresponds to an operation state display of a corresponding response of a terminal.
For example, a user may set a target operation trajectory in a "weather" function of the mobile phone to satisfy the pattern of the preset trigger condition, if the preset trigger condition is "L", the target operation trajectory input by the user on the display screen of the mobile phone with the touch pen should be "L", and then the target operation trajectory "L" enters a page corresponding to the "weather" function of the mobile phone.
In this embodiment, a target operation track triggered on a display screen by a touch pen is acquired through a terminal, whether the target operation track meets a preset trigger condition or not is judged according to the target operation track, and if the target operation track meets the preset trigger condition, corresponding response operation is performed according to the target operation track. Therefore, functions or application programs on the terminal have a one-to-one correspondence relationship with the target operation tracks, a matching relationship between the user intention and the target operation tracks is established, the terminal can judge the user intention through the target operation tracks, the target operation tracks which do not meet preset triggering conditions can be eliminated, the target operation tracks which cannot represent the user intention can be eliminated, the probability of false triggering can be reduced when the target operation tracks input by the user through the touch pen enter the corresponding application programs, the interference of the user on the terminal under wrong operation is reduced, and the user experience is improved.
Further, as shown in fig. 4, a flowchart of an embodiment of the touch pen-based interaction method before step S10 of the present application is shown, including:
step S11, establishing communication connection with the searched touch pen;
and the terminal establishes communication connection with the searched touch pen. The terminal can send a wireless detection signal through the wireless communication module, search for the touch pen with the unique identifier, and have a one-to-one correspondence with the terminal. The terminal can also be in wired connection with the touch pen and can perform wired communication. The terminal has a radio module that can transmit and receive radio signals of radio signals that can be matched with the radio signals transmitted and received by the stylus pen. The detection signal can detect a radio signal sent by the touch pen, and the terminal wireless communication module determines the identifier of the touch pen according to the detected radio signal. After the terminal wireless communication module establishes communication connection with the touch pen, the terminal wireless communication module can receive information sent by the touch pen, and at the moment, the identifier of the touch pen is obtained.
To assist in understanding the technical solution of the present embodiment, reference may be made to fig. 5, where fig. 5 illustrates a terminal wirelessly communicating with a touch pen.
Step S12, acquiring the identifier of the touch pen and judging whether the identifier of the touch pen exists in a preset authority list;
the terminal acquires the identifier of the touch pen and judges whether the identifier of the touch pen exists in a preset authority list or not. The touch pen has a unique identifier, the terminal can directly add the identifier of the touch pen into a preset authority list, wireless communication connection can be carried out between the terminal and the touch pen with the unique identifier, the terminal allows the touch pen with the unique identifier to enter the preset authority list, and the identifier of the touch pen is stored in the preset authority list.
Specifically, whether the preset authority list has the authority information of the touch pen or not is judged according to the obtained touch pen identifier and by combining the preset authority list stored in the memory, wherein the preset authority list records the identifier information of the touch pen and the like. The terminal can directly judge whether the identifier of the touch pen exists in the preset authority list. And if the identifier of the touch pen does not exist in the preset authority list, which indicates that the touch pen does not obtain the authorized authority of the terminal, no response is given to the target operation track input by the touch pen on the display screen. Meanwhile, a reminding signal is sent to a user on a display screen of the terminal, and the terminal can identify a target operation track input on the display screen by the touch pen only when the terminal needs to obtain an authorization authority. And guiding the user to apply for the operation authority to be obtained according to the flow steps at the terminal and entering a corresponding terminal function interface. If the user of the touch pen is about to enter the operation interface of the terminal for an illegal purpose, or other touch pens are triggered to the terminal carelessly, the user cannot pass the terminal normally when the right is not obtained, and the user cannot be in a preset right list of the terminal. Therefore, the normal use of the terminal and the safety of the user to the terminal are also ensured.
And step 13, if the identifier of the touch pen exists in the preset authority list, displaying an input window of the target operation track on the display screen.
And if the preset authority list has the identifier of the touch pen, displaying an input window of the target operation track on the display screen. And the terminal judges whether the preset authority list has the authority information of the touch pen or not by combining the preset authority list stored in the memory according to the obtained touch pen identifier, wherein the preset authority list records the identifier of the touch pen. If the identifier of the touch pen exists in the preset authority list, which indicates that the touch pen obtains the authorization authority of the terminal, the input window of the target operation track is set to the top, and the user can input the corresponding target operation track on the display screen and enter the corresponding function or application program of the mobile phone.
In this embodiment, a communication connection is established with the searched touch pen, an identifier of the touch pen is obtained, whether the identifier of the touch pen exists in a preset authority list is judged, and if the identifier of the touch pen exists in the preset authority list, an input window of the target operation track is displayed. Therefore, the terminal can make corresponding response through the touch pen with the operation authority, the one-to-one correspondence relationship between the identification of the touch pen and the terminal is established, the target operation track is prevented from being input to the display screen of the terminal by other touch pens of other users, the terminal can judge whether the terminal is operated by the user through the touch pen with the authority, other touch pens without the authority can be eliminated, the safety of the terminal can be improved, the probability of false triggering of the terminal by other touch pens is reduced, and the user experience is further improved.
Further, in step S10 of the above first embodiment, the step of acquiring a target operation track triggered by the touch pen on the display screen includes:
step S101, if the touch pen is detected to trigger an operation track on the display screen, judging whether the operation track is effective input or not according to the current use scene or state information of the display screen;
and step S102, if the operation track is effective input, determining the operation track as a target operation track.
If the terminal detects that the touch pen triggers the operation track on the display screen, whether the operation track is effective input is judged according to the current use scene or state information of the display screen, and if the operation track is effective input, the operation track is determined as a target operation track. The current use scene comprises a game scene, a video scene or a driving scene, and the state information comprises a screen-off state. For example, the terminal detects that the current use scene is a game scene and important WeChat push comes, but the game cannot be pushed out at present, at this time, an operation track corresponding to the entering WeChat can be input on the display screen, and the operation track is determined to be effective input according to the use scene of the current display screen as the game scene.
In addition, if the state information of the current display screen is detected to be in the screen off state and the touch pen is detected to trigger the operation track on the display screen, the operation track is determined to be effective input. For example, in the screen-off state, if a target operation trajectory input by the user on the display screen of the terminal with the touch pen is "L", the operation trajectory is determined to be a valid input.
Further, the step S10 includes:
step A, acquiring a first motion track triggered by a point where a touch pen is in contact with a display screen, and simultaneously acquiring a second motion track triggered by a preset point of the touch pen;
the terminal acquires a first motion track triggered by a point where the touch pen is in contact with the display screen and simultaneously acquires a second motion track triggered by a preset point located on the touch pen. The terminal obtains a starting point of contact between a touch pen and a display screen and records the starting point as a point A, a target operation track triggered by the point A is a first motion track, a preset interval with the preset distance of the point A is obtained at the same time, the vertical preset distance of the point A on the touch pen is a point B, and a motion track formed in the air by the point B is a second motion track. Wherein, the preset interval can be 0.3-2 cm.
B, judging whether the first motion track is similar to the second motion track or not according to the first motion track and the second motion track;
and the terminal judges whether the first motion track is similar to the second motion track or not according to the first motion track and the second motion track. And the terminal judges the first motion track and the second motion track according to the rectangular area of the first motion track covered by the acquired second motion track.
Specifically, two parallel transverse lines and two vertical lines are respectively divided on a display screen at equal intervals, the two transverse lines and the two vertical lines form an operation rectangular area, a user can input a target operation track through a touch pen, the target operation track can be any figure or character, the boundary point of the touch pen passes through the transverse lines and the vertical lines and forms at least one cross point, namely a series of coordinate points in a plane rectangular coordinate system, and the two parallel transverse lines and the two vertical lines pass through the boundary point of the target operation track to form a rectangular area. Namely, the area size of the rectangular region of the two target operation tracks is determined.
Optionally, after the step of determining whether the first motion trajectory is similar to the second motion trajectory according to the first motion trajectory and the second motion trajectory, the method includes:
if not, correcting the first motion track by taking the second motion track as a reference so as to enable the similarity between the corrected first motion track and the second motion track to be larger than or equal to a preset value;
and taking the corrected first motion track as a target operation track.
And if not, correcting the first motion track by taking the second motion track as a reference so as to enable the similarity between the corrected first motion track and the second motion track to be larger than or equal to a preset value. And if the first motion track acquired by the terminal covers the rectangular area of the second motion track and is less than or equal to 80%, judging that the first motion track is not similar to the second motion track.
For example, a user inputs an "L" target operation track on a display screen through a touch pen, and the terminal may only acquire an "I" target operation track, that is, a first motion track, because the pressure of the user on inputting the target operation track using the touch pen is insufficient, but at the same time, the terminal may acquire an entire "L" motion track formed in the air by the touch pen, that is, a second motion track, and correct the first motion track with the second motion track as a reference, so that the similarity between the corrected first motion track and the second motion track is greater than or equal to a preset value of 80%, and the corrected first motion track is used as the target operation track. And judging whether the target operation track meets a preset trigger condition or not according to the target operation track, and if the target operation track meets the preset trigger condition, performing corresponding response operation according to the target operation track.
And C, if the first motion track is similar to the target operation track, taking the first motion track as the target operation track.
And if the first motion track is similar to the second motion track, taking the first motion track as a target operation track. And the terminal judges that the first motion track is similar to the second motion track if the area of the rectangular area of the first motion track covered by the acquired second motion track is more than or equal to 80%. And judging whether the target operation track meets a preset trigger condition or not according to the target operation track, and if the target operation track meets the preset trigger condition, performing corresponding response operation according to the target operation track.
In this embodiment, the terminal obtains a first motion track triggered by a point where the touch pen contacts the display screen, and simultaneously obtains a second motion track triggered by a preset point located on the touch pen, determines whether the first motion track is similar to the second motion track according to the first motion track and the second motion track, and if so, takes the first motion track as a target operation track. Therefore, the first motion track can be corrected through the second motion track, and whether the corrected first motion track meets the preset trigger condition or not is judged, so that the recognition rate of the terminal is improved, and the terminal is prevented from making corresponding response operation.
Further, as shown in fig. 6, which is a flowchart illustrating an embodiment of a touch pen-based interaction method S30 of the present invention, the step S30 includes:
step S31, calculating the similarity between the target operation track and each preset target operation track;
and the terminal respectively calculates the similarity between the target operation track and each preset target operation track. When the user inputs the target operation track, the terminal calculates the similarity between the target operation track input by the user and each preset target operation track, and enters the function of the corresponding terminal. Therefore, different functions of the terminal are set to different preset target operation tracks, and the safety of the terminal can be improved.
In some embodiments, the similarity between the target operation trajectory and each of the two preset target operation trajectories may also be calculated. For example, the user may set a function with a high frequency of use at the terminal and correspond to the first preset target operation trajectory, and the user may set a function with a low frequency of use at the terminal and correspond to the second preset target operation trajectory. And when the target operation track input by the user corresponds to the first preset track, the terminal calls at least one function with high use frequency, and the function is displayed on a page of the terminal for the user to select. Similarly, when the target operation track input by the user corresponds to the second preset track, the terminal calls at least one corresponding function with high frequency of use, and the function is displayed on a page of the terminal for the user to select. The user may add the function to the function with high frequency of use and the function with low frequency of use, or the terminal may detect the function frequently opened by the user and calculate the number of times of opening, and if the number of times of opening is large, the number of times of use is high, and if the number of times of opening is small, the number of times of use is low. Therefore, the calculation amount of the terminal can be reduced, the user does not need to remember the preset target operation track of each function, and the user experience is improved.
Specifically, by dividing a plurality of horizontal lines and vertical lines at equal intervals on a display screen, the plurality of horizontal lines and vertical lines form an operation area, a user can input a target operation track through a touch pen, the target operation track can be any figure or character, the sliding track of the touch pen passes through an intersection formed by the horizontal lines and the vertical lines, namely a series of coordinate points in a rectangular plane coordinate system, adjacent coordinate points are connected by lines, and the target operation track can be obtained, and an area formed by a minimum value X1 and a maximum value X2 of horizontal coordinates, a minimum value Y1 and a maximum value Y2 of vertical coordinates, four coordinate points (X1, Y1), (X2, Y1) (X1, Y2), (X2, Y2) is the area of the target operation track. The preset target operation track is an area formed by the four points and is an area of the target operation track, and the preset target operation track area is stored in a memory. Similarly, when the user inputs a target operation track on the display screen, the terminal records coordinates of each point of the target operation track, and finds out an area formed by four coordinate points in the coordinate points of the target operation track as the area of the target operation track input by the user.
Rotating the target operation track by taking the geometric center of the target operation track area as an original point, recording the coordinate point of the target operation track again after rotating for 1 degree, finding out a rectangular area formed by the coordinate point as a new target operation track area, repeating the steps until the rotation angle reaches 360 degrees, selecting an angle with the length-width ratio closest to the length-width ratio of the preset target operation track area in all target operation track areas corresponding to the selection angles of 1-360 degrees, and at the moment, obtaining the length-width ratio of the target operation track area closest to the length-width ratio of the preset target operation track corresponding to two selection angles.
And according to the length and the width of the preset target operation track area which is actually input, zooming the preset target operation track area corresponding to the two rotated angles along the X direction and the Y direction respectively until the length and the width of the preset target operation track area are consistent. And scaling the element corresponding to the two angles and the target operation track area along the X direction and the Y direction to be consistent with the length and the width of the preset target operation track area respectively by taking the minimum value X1 of the abscissa and the minimum value Y1 of the ordinate as the origin points.
And carrying out scaling comparison according to the actually input target operation track and a preset target operation track. And scaling the length and the width in the target operation track to be consistent with the length and the width of the preset target operation track according to the length and the width of the actually input target operation track.
Step S32, determining the control instruction corresponding to the highest similarity as a target control instruction matched with the target operation track;
and the terminal determines the control instruction corresponding to the highest similarity as a target control instruction matched with the target operation track. And after the terminal calculates the similarity between the target operation track and each preset target operation track, determining the control instruction corresponding to the highest similarity as the target control instruction matched with the target operation track.
And step S33, performing corresponding response operation according to the target control instruction.
And the terminal carries out corresponding response operation according to the target control instruction. For example, after the mobile phone determines that the target control command is matched with the target operation track, the mobile phone enters a corresponding function according to the target control command.
Further, after step S32, the method further includes:
comparing the highest similarity with a preset similarity threshold;
and if the highest similarity is greater than or equal to the preset similarity threshold, executing a control instruction corresponding to the highest similarity, and determining the control instruction as a target control instruction matched with the target operation track.
And the terminal compares the highest similarity with a preset similarity threshold. And if the highest similarity is greater than or equal to the preset similarity threshold, executing a control instruction corresponding to the highest similarity, and determining the control instruction as a control instruction matched with the target operation track. Specifically, if the highest similarity is greater than or equal to the preset similarity threshold, the control instruction corresponding to the highest similarity is determined as the target control instruction matched with the target operation track. And if the similarity between the target operation track input by the user and the preset target operation track reaches more than 80%, determining a target control instruction matched with the target operation track according to the target operation track, and performing corresponding response operation according to the target control instruction.
Optionally, after the step of comparing the highest similarity with a preset similarity threshold, the method further includes:
if the highest similarity is smaller than a preset similarity threshold value, outputting prompt information for prompting the target operation track to be input again;
and if the preset time prompt information is retrieved and output within the preset time, shielding the target operation track acquired by the display screen.
If the highest similarity is smaller than a preset similarity threshold value, prompting a user to re-input a target operation track; and if the preset time prompt information is retrieved and output within the preset time, shielding the target operation track acquired by the display screen. If the similarity between the target operation track input by the user and the preset target operation track is less than 80%, the user can be prompted to input the target operation track again by voice or light flicker, and if the terminal retrieves and outputs the prompt information for 3 times within a period of time, the target operation track collected by the display screen is shielded.
Furthermore, an embodiment of the present invention further provides a readable storage medium (i.e., a computer-readable memory), where an interactive program is stored on the readable storage medium, and when executed by a processor, the interactive program implements the following operations:
acquiring a target operation track triggered by a touch pen on a display screen;
judging whether the target operation track meets a preset trigger condition or not according to the target operation track;
and if the target operation track meets a preset trigger condition, performing corresponding response operation according to the target operation track.
Further, the target operation track sensed by the touch pen in the input window of the display screen is obtained.
Further, when detecting that the touch pen triggers an operation track on the display screen, judging whether the operation track is effective input according to the current use scene or state information of the display screen;
and if the operation track is effective input, determining the operation track as the target operation track.
Further, a first motion track triggered by a point where the touch pen is in contact with the display screen is obtained, and a second motion track triggered by a preset point located on the touch pen is obtained at the same time;
judging whether the first motion track is similar to the second motion track or not according to the first motion track and the second motion track;
and if so, taking the first motion track as the target operation track.
Further, the interactive program when executed by the processor further performs the following operations:
if not, correcting the first motion track by taking the second motion track as a reference so as to enable the similarity between the corrected first motion track and the second motion track to be larger than or equal to a preset value;
and taking the corrected first motion track as the target operation track.
Further, establishing communication connection with the searched touch pen;
acquiring the identifier of the touch pen and judging whether the identifier of the touch pen exists in a preset authority list or not;
and if the identifier of the touch pen exists in the preset authority list, displaying an input window of the target operation track on the display screen.
Further, calculating the similarity between the target operation track and each preset target operation track;
comparing the highest similarity with a preset similarity threshold;
if the highest similarity is larger than or equal to the preset similarity threshold, executing a control instruction corresponding to the highest similarity, and determining the control instruction as the target control instruction matched with the target operation track;
and carrying out corresponding response operation according to the target control instruction.
Further, the interactive program when executed by the processor further performs the following operations:
if the highest similarity is smaller than the preset similarity threshold, outputting prompt information for prompting the target operation track to be input again;
and if the preset time prompt information is retrieved and output within the preset time, shielding the target operation track acquired by the display screen.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are only for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (10)

1. An interaction method based on a touch pen is applied to a terminal and is characterized by comprising the following steps:
acquiring a target operation track triggered by a touch pen on a display screen;
judging whether the target operation track meets a preset trigger condition or not according to the target operation track;
and if the target operation track meets a preset trigger condition, performing corresponding response operation according to the target operation track.
2. The touch-pen based interaction method as claimed in claim 1, wherein the step of obtaining the target operation track triggered by the touch pen on the display screen is preceded by:
establishing communication connection with the searched touch pen;
acquiring the identifier of the touch pen and judging whether the identifier of the touch pen exists in a preset authority list or not;
if the identifier of the touch pen exists in the preset authority list, displaying an input window of the target operation track on the display screen;
the step of acquiring the target operation track triggered by the touch pen on the display screen comprises:
and acquiring the target operation track sensed by the input window of the touch pen in the display screen.
3. The touch pen-based interaction method according to claim 1, wherein the step of acquiring a target operation track triggered by the touch pen on the display screen comprises:
if the touch pen is detected to trigger an operation track on the display screen, judging whether the operation track is effective input or not according to the current use scene or state information of the display screen;
and if the operation track is effective input, determining the operation track as the target operation track.
4. The stylus-based interaction method of claim 3, wherein the current usage scenario comprises a game scenario, a video scenario, or a driving scenario; or, the state information includes a screen-off state.
5. The touch pen-based interaction method according to claim 1, wherein the step of acquiring a target operation track triggered by the touch pen on the display screen comprises:
acquiring a first motion track triggered by a point where the touch pen is in contact with the display screen, and simultaneously acquiring a second motion track triggered by a preset point of the touch pen;
judging whether the first motion track is similar to the second motion track or not according to the first motion track and the second motion track;
and if so, taking the first motion track as the target operation track.
6. The touch-pen based interaction method of claim 5, wherein the step of determining whether the first motion trajectory and the second motion trajectory are similar according to the first motion trajectory and the second motion trajectory comprises:
if not, correcting the first motion track by taking the second motion track as a reference so as to enable the similarity between the corrected first motion track and the second motion track to be larger than or equal to a preset value;
and taking the corrected first motion track as the target operation track.
7. The touch pen-based interaction method according to claim 1, wherein if the target operation trajectory meets a preset trigger condition, the specific steps of performing corresponding operations according to the target operation trajectory include:
calculating the similarity between the target operation track and each preset target operation track;
comparing the highest similarity with a preset similarity threshold;
if the highest similarity is larger than or equal to the preset similarity threshold, executing a control instruction corresponding to the highest similarity, and determining the control instruction as the target control instruction matched with the target operation track;
and carrying out corresponding response operation according to the target control instruction.
8. The stylus-based interaction method of claim 7, wherein the step of comparing the similarity with a preset similarity threshold comprises:
if the highest similarity is smaller than the preset similarity threshold, outputting prompt information for prompting the target operation track to be input again;
and if the preset time prompt information is retrieved and output within the preset time, shielding the target operation track acquired by the display screen.
9. A terminal, characterized in that the terminal comprises: memory, processor and an interactive program stored on the memory and executable on the processor, the interactive program when executed by the processor implementing the steps of the interactive method according to any one of claims 1 to 8.
10. A readable storage medium, characterized in that the readable storage medium has stored thereon an interactive program, which when executed by a processor implements the steps of the interactive method according to any one of claims 1 to 8.
CN201911289845.6A 2019-12-13 2019-12-13 Touch pen-based interaction method, terminal and readable storage medium Pending CN111007974A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911289845.6A CN111007974A (en) 2019-12-13 2019-12-13 Touch pen-based interaction method, terminal and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911289845.6A CN111007974A (en) 2019-12-13 2019-12-13 Touch pen-based interaction method, terminal and readable storage medium

Publications (1)

Publication Number Publication Date
CN111007974A true CN111007974A (en) 2020-04-14

Family

ID=70115301

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911289845.6A Pending CN111007974A (en) 2019-12-13 2019-12-13 Touch pen-based interaction method, terminal and readable storage medium

Country Status (1)

Country Link
CN (1) CN111007974A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111752419A (en) * 2020-07-30 2020-10-09 广州创知科技有限公司 Interaction control method and device for intelligent blackboard, intelligent blackboard and storage medium
CN116048372A (en) * 2023-03-06 2023-05-02 上海合见工业软件集团有限公司 Pen touch command system for EDA software

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101334705A (en) * 2008-08-01 2008-12-31 北京登合科技有限公司 Method for inputting control command by touch induction keyboard and mobile terminal
CN104020958A (en) * 2014-06-20 2014-09-03 深圳市中兴移动通信有限公司 Method and device for quickly viewing information
TW201531920A (en) * 2014-02-11 2015-08-16 Acer Inc Touch control electronic device and calibration method of trajectory
CN104951343A (en) * 2015-06-18 2015-09-30 广东欧珀移动通信有限公司 Starting method and system for application program
CN107678652A (en) * 2017-09-30 2018-02-09 网易(杭州)网络有限公司 To the method for controlling operation thereof and device of target object
CN108055405A (en) * 2017-12-26 2018-05-18 北京传嘉科技有限公司 Wake up the method and terminal of terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101334705A (en) * 2008-08-01 2008-12-31 北京登合科技有限公司 Method for inputting control command by touch induction keyboard and mobile terminal
TW201531920A (en) * 2014-02-11 2015-08-16 Acer Inc Touch control electronic device and calibration method of trajectory
CN104020958A (en) * 2014-06-20 2014-09-03 深圳市中兴移动通信有限公司 Method and device for quickly viewing information
CN104951343A (en) * 2015-06-18 2015-09-30 广东欧珀移动通信有限公司 Starting method and system for application program
CN107678652A (en) * 2017-09-30 2018-02-09 网易(杭州)网络有限公司 To the method for controlling operation thereof and device of target object
CN108055405A (en) * 2017-12-26 2018-05-18 北京传嘉科技有限公司 Wake up the method and terminal of terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111752419A (en) * 2020-07-30 2020-10-09 广州创知科技有限公司 Interaction control method and device for intelligent blackboard, intelligent blackboard and storage medium
CN116048372A (en) * 2023-03-06 2023-05-02 上海合见工业软件集团有限公司 Pen touch command system for EDA software

Similar Documents

Publication Publication Date Title
US9256315B2 (en) Method of identifying palm area for touch panel and method for updating the identified palm area
CN108829327B (en) Writing method and device of interactive intelligent equipment
EP2755112A2 (en) Method and portable terminal for providing a haptic effect
US20130057469A1 (en) Gesture recognition device, method, program, and computer-readable medium upon which program is stored
CN108920066B (en) Touch screen sliding adjustment method and device and touch equipment
US9374547B2 (en) Input apparatus, display apparatus, and control methods thereof
KR101019254B1 (en) apparatus having function of space projection and space touch and the controlling method thereof
CN102902469A (en) Gesture recognition method and touch system
CN106415472A (en) Gesture control method, device, terminal apparatus and storage medium
CN104423697A (en) Display control device, display control method, and program
CN103257811A (en) Picture display system and method based on touch screen
CN108733302B (en) Gesture triggering method
CN104866226A (en) Terminal device and method for controlling same
CN111610904B (en) Icon arrangement method, electronic device and storage medium
CN110730298A (en) Display control method and electronic equipment
CN111007974A (en) Touch pen-based interaction method, terminal and readable storage medium
CN105094396A (en) Element deleting method and apparatus based on touch screen
CN110941469B (en) Application splitting creation method and terminal equipment thereof
KR20140104283A (en) Device and method for managing security in terminal
CN107958239A (en) Fingerprint identification method and device
CN110825306B (en) Braille input method, device, terminal and readable storage medium
JP2013186698A (en) Handwriting management program and recording display device
KR20160054799A (en) Remote controll device and operating method thereof
US20140168106A1 (en) Apparatus and method for processing handwriting input
WO2016197815A2 (en) Method and apparatus for using fingerprint operation, and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination