CN112732154A - Method for extending touch function in remote control and storage medium - Google Patents

Method for extending touch function in remote control and storage medium Download PDF

Info

Publication number
CN112732154A
CN112732154A CN201911036431.2A CN201911036431A CN112732154A CN 112732154 A CN112732154 A CN 112732154A CN 201911036431 A CN201911036431 A CN 201911036431A CN 112732154 A CN112732154 A CN 112732154A
Authority
CN
China
Prior art keywords
control
behavior
touch
controlled end
gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201911036431.2A
Other languages
Chinese (zh)
Inventor
刘德建
黄晨帆
张新洲
杜建强
郭玉湖
陈宏�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujian Tianquan Educational Technology Ltd
Original Assignee
Fujian Tianquan Educational Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujian Tianquan Educational Technology Ltd filed Critical Fujian Tianquan Educational Technology Ltd
Priority to CN201911036431.2A priority Critical patent/CN112732154A/en
Publication of CN112732154A publication Critical patent/CN112732154A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a method and a storage medium for expanding a touch function in remote control, wherein the method comprises the following steps: the control end or the controlled end defines a gesture graph and a corresponding control behavior to a local behavior list; the control end collects touch data; if the control end executes the definition, the control end analyzes the touch data to obtain a corresponding gesture graph, sends a control behavior corresponding to the corresponding gesture graph to the controlled end according to the behavior list, and the controlled end calls a software function corresponding to the control behavior; and if the controlled end executes the definition, the control end sends the acquired touch data to the controlled end, the controlled end analyzes the touch data to acquire a corresponding gesture graph, and a software function of a control behavior corresponding to the corresponding gesture graph is called according to the behavior list. The invention supports the definition to execute the control through various custom gesture graphs, thereby having more flexibility and convenience; more and more random touch experience can be brought to the user, and the user experience is greatly improved.

Description

Method for extending touch function in remote control and storage medium
Technical Field
The invention relates to the field of remote control, in particular to a method and a storage medium for expanding a touch function in remote control.
Background
Some existing operating systems, such as the iOS and Mac systems, have fewer touch screens and touch panels supporting touch in a remote control scene (e.g., single-finger click, single-finger long-press, single-finger hold-and-drag, double-finger click, double-finger zoom, double-finger up-and-down movement, double-finger left-and-right movement, three-finger click, three-finger left-and-right movement, and three-finger up-and-down movement), and when a user wants to expand some other shortcut operations, the expandable space is not large.
Most of the existing remote control systems transmit the touch message of the control end to the controlled end, the controlled end converts the touch message into the touch message of the controlled end system, and the touch message is automatically analyzed and executed by the operating system of the controlled end. However, this method has a disadvantage that it is limited by the operating system function of the controlled end and cannot be flexibly expanded.
Therefore, it is necessary to design a remote control system for a user to expand the touch function, so as to simulate and expand the user-defined touch function in the remote control system.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: a method and a storage medium for flexibly extending a touch function in remote control are provided, and user requirements are met.
In order to solve the technical problems, the invention adopts the technical scheme that:
a method for extending touch control function in remote control comprises the following steps:
the control end or the controlled end defines a gesture graph and a corresponding control behavior to a local behavior list;
the control end collects touch data;
if the control end executes the definition, the control end analyzes the touch data to obtain a corresponding gesture graph, sends a control behavior corresponding to the corresponding gesture graph to the controlled end according to the behavior list, and the controlled end calls a software function corresponding to the control behavior;
and if the controlled end executes the definition, the control end sends the acquired touch data to the controlled end, the controlled end analyzes the touch data to acquire a corresponding gesture graph, and a software function of a control behavior corresponding to the corresponding gesture graph is called according to the behavior list.
The invention provides another technical scheme as follows:
a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, is capable of implementing the steps included in the above-mentioned method for extending a touch function in remote control.
The invention has the beneficial effects that: the touch control method can support different end definition touch behaviors in remote control, and supports definition to execute control through various user-defined gesture graphs, so that the flexibility and convenience are improved; meanwhile, more and more random touch experience can be brought to the user, and the user experience is greatly improved.
Drawings
Fig. 1 is a flowchart illustrating a method for extending a touch function in remote control according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a method for extending a touch function in remote control according to a first embodiment of the present invention;
fig. 3(a) is an image sequence when an eight-way Freeman chain code is used for track identification description in the second embodiment of the present invention;
FIG. 3(b) is a schematic view of the direction corresponding to FIG. 3 (a);
fig. 3(c) is an exemplary diagram and a corresponding example of coding when an eight-way Freeman chain code is used for track identification and description in the second embodiment of the present invention;
fig. 4 is a diagram illustrating an example of encoding a gesture pattern when a differential code algorithm is combined in the track recognition according to the second embodiment of the present invention;
FIG. 5 shows the source code and its difference code corresponding to the gesture pattern of FIG. 4;
FIG. 6 shows the original chain code and the differential code of FIG. 5 after rotation;
FIG. 7 is a diagram illustrating an optimal solution for overcoming the problem of the longest common subsequence in performing algorithm matching in the track recognition process according to the second embodiment;
FIG. 8 is a diagram illustrating an example of 12 possible gestures provided in the second embodiment;
fig. 9 is a schematic diagram of information interaction between the control end and the controlled end in the third embodiment.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
The most key concept of the invention is as follows: in remote control, different end definitions are supported, and the definitions are supported to perform control through various custom gesture graphs.
Referring to fig. 1, the present invention provides a method for extending a touch function in remote control, including:
the control end or the controlled end defines a gesture graph and a corresponding control behavior to a local behavior list;
the control end collects touch data;
if the control end executes the definition, the control end analyzes the touch data to obtain a corresponding gesture graph, sends a control behavior corresponding to the corresponding gesture graph to the controlled end according to the behavior list, and the controlled end calls a software function corresponding to the control behavior;
and if the controlled end executes the definition, the control end sends the acquired touch data to the controlled end, the controlled end analyzes the touch data to acquire a corresponding gesture graph, and a software function of a control behavior corresponding to the corresponding gesture graph is called according to the behavior list.
Further, the touch data comprises the number of touch points, coordinates of each touch point and pressure values of each touch point;
the controlled terminal analyzes the touch data to obtain a corresponding gesture graph, and calls a software function of a control behavior corresponding to the corresponding gesture graph according to a behavior list, wherein the software function specifically comprises the following steps:
the controlled end restores a corresponding behavior track according to the touch data;
the controlled end analyzes the behavior track and identifies a gesture graph corresponding to the behavior track;
the controlled end obtains a control behavior corresponding to the gesture graph according to the behavior list;
and the controlled end calls a software function corresponding to the control behavior.
According to the description, when the controlled end defines the behavior list, the controlled end gradually analyzes and acquires the corresponding gesture graph according to the touch data, so that the controlled end also has the function of self-defining the touch behavior, and further, the user experience is optimized.
Further, the control end or the controlled end analyzes the touch data according to the eight-way Freeman chain code to obtain a corresponding gesture graph;
the method further comprises the following steps:
and the control end or the controlled end encodes the defined gesture graph according to the eight-way Freeman chain code, and stores the encoding result into the software configuration.
According to the description, the encoding and decoding of the gesture graphs are carried out based on the eight-way Freeman chain codes, the definition of various gesture graphs can be supported, direction distinguishing is not needed to be carried out on the corresponding graphs, non-differentiation processing is achieved, compatibility is better, and the probability of accurate identification is higher.
Further, the control end or the controlled end encodes the defined gesture graph according to the eight-way Freeman chain code and the differential analysis algorithm: and
and the control end or the controlled end analyzes the touch data according to the eight-way Freeman chain code and a differential analysis algorithm to obtain a corresponding gesture graph.
According to the description, the graphics are coded and decoded by combining the differential analysis algorithm, the direction of the graphics is limited, the recognized graphics can be greatly expanded, the supported touch function is further expanded, and different requirements of users are met.
Further, the gesture graph comprises a custom graph and Arabic numerals.
According to the description, various graphs such as S-shaped graphs, arc graphs and L-shaped graphs are supported, control is implemented by drawing Arabic numerals, diversified gesture graphs can meet personalized settings of users to the maximum extent, and application experience is improved.
Further, the gesture graph comprises a customized graph with a specific direction and Arabic numerals with a specific direction.
According to the description, the defined gesture graph has directionality corresponding to the encoding and decoding mode combining eight-way Freeman chain codes and a differential analysis algorithm; and additionally, various types of graphic self-definition are supported, and the supported gesture graphics and the corresponding touch function are greatly expanded.
The invention provides another technical scheme as follows:
a computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, being capable of implementing a method of extending touch functionality in remote control, the method comprising the steps of:
the control end or the controlled end defines a gesture graph and a corresponding control behavior to a local behavior list;
the control end collects touch data;
if the control end executes the definition, the control end analyzes the touch data to obtain a corresponding gesture graph, sends a control behavior corresponding to the corresponding gesture graph to the controlled end according to the behavior list, and the controlled end calls a software function corresponding to the control behavior;
and if the controlled end executes the definition, the control end sends the acquired touch data to the controlled end, the controlled end analyzes the touch data to acquire a corresponding gesture graph, and a software function of a control behavior corresponding to the corresponding gesture graph is called according to the behavior list.
Further, the touch data comprises the number of touch points, coordinates of each touch point and pressure values of each touch point;
the controlled terminal analyzes the touch data to obtain a corresponding gesture graph, and calls a software function of a control behavior corresponding to the corresponding gesture graph according to a behavior list, wherein the software function specifically comprises the following steps:
the controlled end restores a corresponding behavior track according to the touch data;
the controlled end analyzes the behavior track and identifies a gesture graph corresponding to the behavior track;
the controlled end obtains a control behavior corresponding to the gesture graph according to the behavior list;
and the controlled end calls a software function corresponding to the control behavior.
Further, the control end or the controlled end analyzes the touch data according to the eight-way Freeman chain code to obtain a corresponding gesture graph;
the method further comprises the following steps:
and the control end or the controlled end encodes the defined gesture graph according to the eight-way Freeman chain code, and stores the encoding result into the software configuration.
Further, the control end or the controlled end encodes the defined gesture graph according to the eight-way Freeman chain code and the differential analysis algorithm: and
and the control end or the controlled end analyzes the touch data according to the eight-way Freeman chain code and a differential analysis algorithm to obtain a corresponding gesture graph.
Further, the gesture graph comprises a custom graph and Arabic numerals.
Further, the gesture graph comprises a customized graph with a specific direction and Arabic numerals with a specific direction.
Referring to fig. 2, a first embodiment of the present invention is:
a method for extending touch control function in remote control comprises the following steps:
s1: defining a gesture graph and a corresponding control behavior thereof to a local behavior list through a control end or a controlled end;
the action list registers each gesture graph and its corresponding control action. For example, a single finger strokes the figure "8" and the corresponding control action is to close the page. The gesture graph can be various customized graphs or Arabic numerals.
In one embodiment, the contents of the behavior list are shown in table 1 below.
Figure 2
Table 1S 2: the control end or the controlled end encodes the defined gesture graph according to the eight-way Freeman chain code, and stores the encoding result into the software configuration;
by adopting the coding mode, the recognition of various graphs is supported, and different directions of the same graph are not distinguished, so that the non-differentiation processing is realized, the drawing error of a user can be better compatible, and the probability of correct recognition is improved.
In another embodiment, the defined gesture pattern is also encoded and decoded by combining a differential analysis algorithm. Through differentiation processing, the image recognition of 8 times of the original fragrance ratio can be expanded, and the requirements of high requirements and specific users are met. Corresponding to the specific example, when defining the gesture graphics, the directions of the respective gesture graphics need to be defined simultaneously, that is, the user-defined graphics in a specific direction or the arabic numerals in a specific direction need to be defined.
S3: the control end collects touch data; the touch data comprises the number of touch points, coordinates of each touch point and pressure values of each touch point;
s4: if a behavior list is defined at the control end (namely the control end executes S1), the control end analyzes the collected touch data to obtain a corresponding gesture graph, then sends a corresponding control behavior to the controlled end according to the behavior list defined by the control end, and the controlled end calls a software function corresponding to the control behavior;
s5: if a behavior list is defined at the controlled end, the control end sends the collected touch data to the controlled end, the controlled end analyzes the touch data to obtain a corresponding gesture graph, and a software function of a control behavior corresponding to the corresponding gesture graph is called according to the behavior list.
The process of analyzing the touch data and calling the corresponding software function by the controlled terminal specifically comprises the following steps:
51. the controlled end restores a corresponding behavior track according to the touch data;
52. the controlled end analyzes the behavior track and identifies a gesture graph corresponding to the behavior track;
specifically, the behavior track is identified according to the eight-way Freeman chain code (when no differentiation processing is available), or the eight-way Freeman chain code and a differential analysis algorithm (when differentiation processing is available), so as to obtain the corresponding gesture graph.
53. The controlled end obtains a control behavior corresponding to the gesture graph according to the behavior list;
54. and the controlled end calls a software function corresponding to the control behavior.
The second embodiment of the invention is as follows:
the present embodiment is further defined on the basis of the first embodiment, and provides a method for extending a touch function in remote control, including:
1. corresponding touch behaviors are defined, for example, a figure of 8 is stroked by a single finger, and the figure can be stored in a software configuration after being coded.
The user can select the behavior defined by the control terminal or the controlled terminal autonomously, and the defined behavior is registered in a behavior list.
2. The control end acquires touch data of the control end through a system API, for example: the number of touch points, the track of each touch point (including the relative operation position of operation within a specified time, the operation distance, the operation angle and the like) and the pressure of each touch point.
3. If the user selects the control end to define the behavior, the control end analyzes the collected data and then stores the corresponding behavior (type) and the data of the touch point in a data structure.
And if the user does not select the control terminal to define the behavior, setting the type of the touch behavior to be 0.
The data structure is as follows:
Touch{
int x; // touch point x coordinate
int y; // touch point y coordinate
int press; // magnitude of touch point pressure
int arc; // angle of touch point
}
Gesture{
List<touch>list_touch;
int type;
}
And the control terminal transmits the touch data Gesture to the controlled terminal program through the network interface, and the controlled terminal program receives the touch data Gesture.
4. If the user selects the behavior defined by the controlled terminal, taking touch point data from the Gesture, analyzing and calculating the data of the touch point, and restoring the running track of the touch point; then analyzing the track, identifying the mode represented by the track, analyzing the mode into a corresponding gesture graph, searching the median value of the behavior represented by the gesture graph in the behavior list, and calling a corresponding software function according to the meaning represented by the behavior.
If the operation is carried out according to the behavior type of the control terminal, the corresponding software function is directly called according to the value of the type.
The track identification method comprises the following steps:
a. pattern recognition using eight-way Freeman chain codes
Referring to FIG. 3(a), a sequence of images is shown; FIG. (b) is a schematic view of the orientation; fig. 3(c) represents an encoding example.
In fig. 3(b), 0 to 7 represent eight directions, representing the directional relationship between any two points. The positional and directional relationship between the central black dot and any other dot can be converted into the directional relationship between the central black dot and 8 gray dots around the central black dot as shown in fig. 3 (a). Thus, any graph can be converted into a series of numbers, for example, as shown in fig. 3(c), P ═ P0, P1, P2, P3, P4, P5, and P6, and the coded number is 107643.
Further, the graph after rotation may be normalized (expanded) by using a differential code method, as follows:
as shown in fig. 4, the original chain code (closed loop curve from S to S in the direction of the arrow): 2120606454, respectively;
the corresponding differential code: 6716626617, respectively;
taking the line S- > S' in FIG. 4 as an example: the direction is 2; and the direction of S' - > S1 is 1; the difference (modulo 8, since eight-chain codes are used) is determined, i.e. (S 'S1-SS') mod 8 equals 7,
the differential code of this pattern can be found as shown in fig. 5. The original chain code and the differential code can be similarly obtained for the rotated pattern, as shown in fig. 6.
In practical applications, the touch trajectory recognition is not standard. In some cases, jitter may occur to generate other data, and at this time, matching needs to be performed through an algorithm.
In this embodiment, the originally configured link code is matched by the longest common subsequence LCS algorithm:
(1) subsequence (b): x is X1X2.. xn, in which several items are deleted arbitrarily, and the remaining sequence is called a subsequence of a; it can also be considered as a sequence obtained by retaining any number of items in the original order from the sequence A.
For example: for sequences 1,3,5,4,2,6,8,7, sequence 3,4,8,7 is a subsequence thereof. For a sequence of length n, it has a total of 2^ n subsequences, and (2^ n-1) non-null subsequences. It should be noted here that the sub-sequence is not a subset, and it is related to the element order of the original sequence.
(2) Common subsequence: if sequence Z is both a subsequence of sequence X and a subsequence of sequence Y, it is referred to as a common subsequence of sequence X and sequence Y. A null sequence is a common subsequence of any two sequences.
(3) Longest common subsequence: the longest common subsequence of X and Y that is longest (contains the most elements) is called X and Y.
Let X1X2 … xm and Y1Y2 … yn be two sequences and Z1Z2 … zk be one longest common subsequence of the two sequences.
If Xm-Yn, Zk-Xm-Yn, and Zk-1 is one of the longest common subsequences of Xm-1, Yn-1;
if Xm ≠ yn, zk ≠ Xm, meaning Z is Xm-1, a longest common subsequence of Y;
if xm ≠ Yn, zk ≠ Yn, meaning Z is a longest common subsequence of X, Yn-1.
As can be seen from the above three cases, the LCS for the two sequences contains LCS for the prefixes of the two sequences. Therefore, the LCS problem has optimal substructure characteristics.
From the optimal substructure, it can be seen that if Xm-Yn, an LCS for Xm-1, Yn-1 should be solved and Xm-Yn is added to the end of the LCS, so that a new LCS is obtained.
If Xm ≠ Yn, two sub-problems need to be solved, one LCS for Xm-1, Y and one LCS for X, Yn-1, respectively. The longer of the two LCS is one LCS for X and Y.
It can be seen that the LCS problem has the property of an overlapping sub-problem. To find an LCS for X and Y, it is necessary to find an LCS for Xm-1, Y and an LCS for X, Yn-1, respectively, and similarly, it is possible to find a sub-problem for an LCS for Xm-1, Yn-1.
From the above analysis, the following formula can be derived:
Figure BDA0002251629700000101
c [ i, j ] represents: the length of the longest common subsequence of (x1, x2.. xi) and (y1, y2... yj).
FIG. 7 is a diagram of an optimal solution to the longest common subsequence problem.
Thus, the original chain code in one direction of one pattern mode can be obtained through the differential code, and the original chain codes in different directions are reversely expanded by taking different directions as starting points according to the differential code of the pattern.
For example, in the pattern of "8", when the direction of the starting point is 1, the original chain code is 10765407654, and the differential code is 1111777777, the inverse calculation can be performed using this differential code, and when the direction is 3, the original chain code is 34567654321.
Similarly, if 12 gesture pattern recognition modes of a1 to a12 are defined as shown in fig. 8, 12 × 8-96 pattern recognition can be extended by means of differential codes. Of course, the user can also do non-differentiation processing on the same graph and different directions without distinguishing.
EXAMPLE III
This embodiment corresponds to the first and second embodiments, and provides a specific application scenario:
referring to fig. 9, in an intelligent classroom with a network environment, a user uses a desktop computer or a notebook computer to connect to the network, and projects the content of the computer to another terminal device with a touch screen of the classroom through software. At this time, by using the method of the first embodiment or the second embodiment, when the user operates the terminal with the touch screen with a finger, the software collects data of the touch point through the API of the operating system, and acquires touch data of the control end, for example: the number of the touch points and the track of each touch point are analyzed into corresponding gesture modes through software, the gesture modes are transmitted to the controlled end, the corresponding gesture modes are converted into corresponding operation behaviors through the control end, for example, a single finger draws 8 to open a folder, and L represents operations of closing a current tab page in a browser.
In summary, the method and the storage medium for extending the touch function in the remote control provided by the present invention support defining touch behaviors at different ends, and support defining to execute control through various custom gesture graphs; furthermore, differentiation recognition is supported, the supported touch function is expanded, and different requirements of users are met; meanwhile, non-differentiation identification can be realized, compatibility is better, and the probability of accurate identification is higher; furthermore, various graphs and numbers are supported, diversified gesture graphs can meet personalized settings of users to the maximum extent, and application experience is improved.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.

Claims (7)

1. A method for extending touch control function in remote control is characterized by comprising the following steps:
the control end or the controlled end defines a gesture graph and a corresponding control behavior to a local behavior list;
the control end collects touch data;
if the control end executes the definition, the control end analyzes the touch data to obtain a corresponding gesture graph, sends a control behavior corresponding to the corresponding gesture graph to the controlled end according to the behavior list, and the controlled end calls a software function corresponding to the control behavior;
and if the controlled end executes the definition, the control end sends the acquired touch data to the controlled end, the controlled end analyzes the touch data to acquire a corresponding gesture graph, and a software function of a control behavior corresponding to the corresponding gesture graph is called according to the behavior list.
2. The method according to claim 1, wherein the touch data includes a number of touch points, coordinates of each touch point, and a pressure value of each touch point;
the controlled terminal analyzes the touch data to obtain a corresponding gesture graph, and calls a software function of a control behavior corresponding to the corresponding gesture graph according to a behavior list, wherein the software function specifically comprises the following steps:
the controlled end restores a corresponding behavior track according to the touch data;
the controlled end analyzes the behavior track and identifies a gesture graph corresponding to the behavior track;
the controlled end obtains a control behavior corresponding to the gesture graph according to the behavior list;
and the controlled end calls a software function corresponding to the control behavior.
3. The method according to claim 1, wherein the control end or the controlled end parses the touch data according to an eight-way Freeman chain code to obtain a corresponding gesture pattern;
the method further comprises the following steps:
and the control end or the controlled end encodes the defined gesture graph according to the eight-way Freeman chain code, and stores the encoding result into the software configuration.
4. The method for extending touch control functions in remote control according to claim 3, wherein the control end or the controlled end encodes the defined gesture pattern according to an eight-way Freeman chain code and a differential parsing algorithm: and
and the control end or the controlled end analyzes the touch data according to the eight-way Freeman chain code and a differential analysis algorithm to obtain a corresponding gesture graph.
5. The method as claimed in claim 1, wherein the gesture graphic includes a custom graphic and an arabic numeral.
6. The method as claimed in claim 1, wherein the gesture pattern includes a custom pattern with a specific direction and an arabic numeral with a specific direction.
7. A computer-readable storage medium, on which a computer program is stored, wherein the program, when executed by a processor, is capable of implementing the steps included in the method for extending touch functionality in remote control according to any one of claims 1 to 6.
CN201911036431.2A 2019-10-29 2019-10-29 Method for extending touch function in remote control and storage medium Withdrawn CN112732154A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911036431.2A CN112732154A (en) 2019-10-29 2019-10-29 Method for extending touch function in remote control and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911036431.2A CN112732154A (en) 2019-10-29 2019-10-29 Method for extending touch function in remote control and storage medium

Publications (1)

Publication Number Publication Date
CN112732154A true CN112732154A (en) 2021-04-30

Family

ID=75589002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911036431.2A Withdrawn CN112732154A (en) 2019-10-29 2019-10-29 Method for extending touch function in remote control and storage medium

Country Status (1)

Country Link
CN (1) CN112732154A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120216154A1 (en) * 2011-02-23 2012-08-23 Google Inc. Touch gestures for remote control operations
CN103076918A (en) * 2012-12-28 2013-05-01 深圳Tcl新技术有限公司 Remote control method and system based on touch terminal
CN104506907A (en) * 2014-11-25 2015-04-08 上海众应信息科技有限公司 A method and a system for interactive operation between a controlling end and multiple remote controlled terminals
CN107066147A (en) * 2017-04-18 2017-08-18 北京北纬天辰科技有限公司 One kind manipulation computer method and system
CN109308159A (en) * 2018-08-22 2019-02-05 深圳绿米联创科技有限公司 Smart machine control method, device, system, electronic equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120216154A1 (en) * 2011-02-23 2012-08-23 Google Inc. Touch gestures for remote control operations
CN103076918A (en) * 2012-12-28 2013-05-01 深圳Tcl新技术有限公司 Remote control method and system based on touch terminal
CN104506907A (en) * 2014-11-25 2015-04-08 上海众应信息科技有限公司 A method and a system for interactive operation between a controlling end and multiple remote controlled terminals
CN107066147A (en) * 2017-04-18 2017-08-18 北京北纬天辰科技有限公司 One kind manipulation computer method and system
CN109308159A (en) * 2018-08-22 2019-02-05 深圳绿米联创科技有限公司 Smart machine control method, device, system, electronic equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
高文 等: "复杂背景中手势的捕获与识别", 《模式识别与人工智能》 *

Similar Documents

Publication Publication Date Title
CN100550036C (en) Chinese character handwritten form recognition system
US20060119588A1 (en) Apparatus and method of processing information input using a touchpad
JP2004213269A (en) Character input device
CN104205047A (en) Apparatus and method for providing for remote user interaction
KR102087807B1 (en) Character inputting method and apparatus
WO2009074047A1 (en) Method, system, device and terminal for correcting touch screen error
CN103078745A (en) Logon authentication code based on picture
KR20100012088A (en) Method, apparatus and computer program product for providing a scrolling mechanism for touch screen devices
JP6030774B2 (en) INPUT METHOD, SYSTEM, PROGRAM, AND RECORDING MEDIUM
EP2780787A1 (en) Display control apparatus, display control method, and program
CN103605491A (en) Method, mobile terminal and system of remote control display device
CN103631556A (en) Method, mobile terminal and system for remote control over display device
CN105824531A (en) Method and device for adjusting numbers
CN103049205A (en) Mobile terminal and control method thereof
CN111427457A (en) Method and device for inputting characters based on virtual keys and electronic equipment
CN110928449A (en) Touch screen point reporting method and device, electronic equipment and storage medium
US10628031B2 (en) Control instruction identification method and apparatus, and storage medium
US20040126017A1 (en) Grammar-determined handwriting recognition
CN111427458B (en) Method and device for virtually inputting characters based on hand actions and electronic equipment
CN112732154A (en) Method for extending touch function in remote control and storage medium
CN105302857A (en) Method and equipment providing contact person information
CN104571847A (en) operation method of electronic device
CN103984427A (en) Multipoint touch method and device
JP5032624B2 (en) Mobile terminal and character string expression changing method in mobile terminal
US9384306B2 (en) Method of searching address book and portable communication device using the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20210430

WW01 Invention patent application withdrawn after publication