CN112306361A - Terminal screen projection method, device and system based on gesture pairing - Google Patents
Terminal screen projection method, device and system based on gesture pairing Download PDFInfo
- Publication number
- CN112306361A CN112306361A CN202011086880.0A CN202011086880A CN112306361A CN 112306361 A CN112306361 A CN 112306361A CN 202011086880 A CN202011086880 A CN 202011086880A CN 112306361 A CN112306361 A CN 112306361A
- Authority
- CN
- China
- Prior art keywords
- screen projection
- data
- coordinate
- gesture track
- gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Abstract
The invention discloses a terminal screen projection method, device and system based on gesture pairing, wherein the method comprises the following steps: starting screen projection pairing software on a screen projection sending end, and establishing network connection with screen projection software running on a screen projection receiving end; acquiring gesture track coordinate point data of a user sliding at a screen projection sending end in sequence based on the screen projection pairing software; the screen projection pairing software packages the acquired gesture track coordinate point data into a data packet and sends the data packet to screen projection software of a screen projection receiving end based on network connection; the screen projection receiving end judges whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not; and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started. In the embodiment of the invention, screen projection pairing is realized through gestures, so that the tedious process of inputting screen projection codes by screen projection pairing and the process of scanning two-dimensional codes are reduced, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of terminal screen projection, in particular to a terminal screen projection method, device and system based on gesture pairing.
Background
At present, when most PC and mobile phone terminals carry out screen projection operation, screen projection code pairing is carried out, or a two-dimensional code mode is generated to carry out scanning connection pairing mode, and screen projection is carried out on large-screen equipment of televisions and conference machines in a pairing mode; inputting screen-projecting codes, wherein screen-projecting numbers need to be checked and input one by one, which is complicated; if the two-dimensional code is scanned, the mobile phone terminal or the tablet terminal is also required to scan the two-dimensional code displayed by the large-screen device, and the operation mode is not convenient enough.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides a terminal screen projection method, device and system based on gesture pairing, which are used for realizing screen projection pairing through gestures, reducing the complicated process of screen projection pairing input screen projection codes and the process of scanning two-dimensional codes and improving user experience.
In order to solve the technical problem, an embodiment of the present invention provides a terminal screen projection method based on gesture pairing, where the method includes:
starting screen projection pairing software on a screen projection sending end, and establishing network connection with screen projection software running on a screen projection receiving end;
acquiring gesture track coordinate point data of a user sliding at a screen projection sending end in sequence based on the screen projection pairing software;
the screen projection pairing software packages the acquired gesture track coordinate point data into a data packet and sends the data packet to screen projection software of a screen projection receiving end based on network connection, wherein the data packet comprises a data packet header and gesture track coordinate point data;
the screen projection receiving end judges whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not;
and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started.
Optionally, before the screen-casting pairing software is started on the screen-casting sending terminal and a network connection is established with the screen-casting software running on the screen-casting receiving terminal, the method further includes:
screen projection software running on the screen projection receiving end randomly generates preset gesture track coordinate data;
and displaying a gesture drawing process in a dynamic drawing mode based on the preset gesture track coordinate data in the screen projection receiving end.
Optionally, a trajectory image formed by the preset gesture trajectory coordinate data is a regular gesture image; the regular gesture image has directionality; and selecting a plurality of preset gesture track coordinate points from the preset gesture track coordinate data as preset key touch point coordinate data.
Optionally, selecting a plurality of preset gesture trajectory coordinate points from the preset gesture trajectory coordinate data as preset key touch point coordinate data includes:
whether the x coordinate and the y coordinate of the previous touch point coordinate and the next touch point coordinate in the preset gesture track coordinate data are increased or decreased along the same direction or not is determined;
if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, all the touch point coordinates in the preset gesture track coordinate data are selected in a traversing manner, and a plurality of preset gesture track coordinate points are selected as preset key touch point coordinate data.
Optionally, the data packet header is arranged at the forefront of the gesture track coordinate point data and is used for identifying the gesture track coordinate point data by screen projection software running on the screen projection receiving end.
Optionally, the screen projection receiving end determines whether the gesture trajectory coordinate point data in the data packet is consistent with the generated preset gesture trajectory coordinate data, including:
the screen projection receiving end judges whether the variation trend of the x coordinate value in the gesture track coordinate data is consistent with the variation trend of the x coordinate value in the preset gesture track coordinate data or not; and a process for the preparation of a coating,
the screen projection receiving end judges whether the variation trend of the y coordinate value in the gesture track coordinate data is consistent with the variation trend of the y coordinate value in the preset gesture track coordinate data or not;
when the variation trend of the x coordinate value and the variation trend of the y coordinate value in the gesture track coordinate data are consistent with the variation trend of the x coordinate value and the variation trend of the y coordinate value in the preset gesture track coordinate data, acquiring key touch point coordinate data in the gesture track coordinate data;
calculating gesture track slope data of a straight line formed by connecting front and rear coordinates in key touch point coordinate data in the gesture track coordinate data;
and performing consistency matching on the gesture track slope data and preset slope data formed by preset key touch point coordinate data.
Optionally, the obtaining of the coordinate data of the key touch point in the gesture trajectory coordinate data includes:
increasing or decreasing the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate along the same direction based on the gesture track coordinate data;
if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, and all the touch point coordinates in the gesture track coordinate data are traversed to obtain the key touch point coordinate data in the gesture track coordinate data.
Optionally, the method further includes:
and when the screen projection receiving end judges that the gesture track coordinate point data in the data packet is inconsistent with the generated preset gesture track coordinate data, prompting a gesture track error to the screen projection sending end, and returning to the screen projection pairing software to sequentially acquire gesture track coordinate point data of a user sliding at the screen projection sending end.
In addition, the embodiment of the invention also provides a terminal screen projection device based on gesture pairing, and the device comprises:
a network connection module: the screen-casting pairing software is used for starting screen-casting pairing software on a screen-casting sending end and establishing network connection with screen-casting software running on a screen-casting receiving end;
an acquisition module: the system comprises a screen projection pairing software, a screen projection sending terminal and a screen projection pairing software, wherein the screen projection pairing software is used for acquiring gesture track coordinate point data of a user sliding at the screen projection sending terminal in sequence;
and (3) packaging a sending module: the screen projection pairing software is used for packaging the acquired gesture track coordinate point data into a data packet and sending the data packet to screen projection software of a screen projection receiving end based on network connection, wherein the data packet comprises a data packet head and gesture track coordinate point data;
a judging module: the screen projection receiving terminal is used for judging whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not;
the data screen projection module: and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started.
In addition, the embodiment of the invention also provides a terminal screen projection system based on gesture pairing, and the system comprises: the system comprises at least one screen throwing sending end provided with screen throwing pairing software and a screen throwing receiving end provided with screen throwing software; the system comprises a screen projection sending end and a screen projection receiving end, wherein the screen projection sending end is provided with screen projection pairing software and the screen projection receiving end is provided with screen projection software, and the system is configured to execute any one of the terminal screen projection methods.
In the embodiment of the invention, the gesture track coordinate point data is collected by the screen projection sending end and is sent to the screen projection receiving end for consistent matching, when the matching is consistent, the screen projection sending end and the screen projection receiving end are successfully matched, data screen projection is started, screen projection matching through gestures is realized, the complicated process of screen projection matching input screen projection codes and the process of scanning two-dimensional codes are reduced, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a terminal screen projection method based on gesture pairing in an embodiment of the present invention;
fig. 2 is a schematic structural composition diagram of a terminal screen projection device based on gesture pairing in the embodiment of the present invention;
fig. 3 is a schematic structural composition diagram of a terminal screen projection system based on gesture pairing in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Examples
Referring to fig. 1, fig. 1 is a schematic flowchart of a terminal screen projection method based on gesture pairing according to an embodiment of the present invention.
As shown in fig. 1, a terminal screen-casting method based on gesture pairing includes:
s11: starting screen projection pairing software on a screen projection sending end, and establishing network connection with screen projection software running on a screen projection receiving end;
in a specific implementation process of the present invention, before the screen-casting pairing software is started on the screen-casting sending terminal and a network connection is established with the screen-casting software running on the screen-casting receiving terminal, the method further includes: screen projection software running on the screen projection receiving end randomly generates preset gesture track coordinate data; and displaying a gesture drawing process in a dynamic drawing mode based on the preset gesture track coordinate data in the screen projection receiving end.
Further, a track image formed by the preset gesture track coordinate data is a regular gesture image; the regular gesture image has directionality; and selecting a plurality of preset gesture track coordinate points from the preset gesture track coordinate data as preset key touch point coordinate data.
Further, selecting a plurality of preset gesture trajectory coordinate points from the preset gesture trajectory coordinate data as preset key touch point coordinate data includes: whether the x coordinate and the y coordinate of the previous touch point coordinate and the next touch point coordinate in the preset gesture track coordinate data are increased or decreased along the same direction or not is determined; if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, all the touch point coordinates in the preset gesture track coordinate data are selected in a traversing manner, and a plurality of preset gesture track coordinate points are selected as preset key touch point coordinate data.
Specifically, screen projection pairing software is started on a screen projection sending terminal, and network connection is established with screen projection software running on a screen projection receiving terminal, wherein the screen projection sending terminal can be an intelligent terminal such as a PC terminal, a smart phone terminal and a tablet terminal, and the screen projection receiving terminal can be a large-screen display device terminal such as an all-in-one machine and a smart television; the network connection can be internet connection or local area network connection, and the specific connection can be wired connection or wireless connection; before network connection is established, screen projection software running on the screen projection receiving end randomly generates preset gesture track coordinate data; and displaying the gesture drawing process in the screen projection receiving end in a dynamic drawing mode according to the preset gesture track coordinate data.
Specifically, a track image formed by the preset gesture track coordinate data is a regular gesture image; and the regular gesture image has directionality; and selecting a plurality of preset gesture track coordinate points from the preset gesture track coordinate data as preset key touch point coordinate data.
The regular gesture graph is a simple regular gesture graph, the direction of the gesture on the regular gesture graph is marked by an arrow on the regular gesture graph, and a user needs to draw the regular gesture graph according to the gesture direction; on the regular gesture graph, solid dots mark preset key touch point coordinate data; the regular gesture graph displays a complete regular gesture graph at a screen projection receiving end, and then displays the drawing process of the regular gesture graph in a dynamic drawing mode so as to prompt a user how to draw a gesture.
Confirming that the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate by judging whether the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate in the preset gesture track coordinate data are increased or decreased along the same direction, traversing and selecting all the touch point coordinates in the preset gesture track coordinate data, and selecting a plurality of preset gesture track coordinate points as preset key touch point coordinate data.
S12: acquiring gesture track coordinate point data of a user sliding at a screen projection sending end in sequence based on the screen projection pairing software;
in the specific implementation process of the invention, the screen-casting sending terminal is a PC terminal, the sliding gesture of the user is received on a touch panel of the PC terminal, and if the screen-casting sending terminal is a tablet or a smart phone terminal, the sliding gesture of the user can be received by using a touch screen; and then acquiring gesture track coordinate point data of the user sliding at the screen projection sending end according to the user gesture sliding sequence through screen projection pairing software.
S13: the screen projection pairing software packages the acquired gesture track coordinate point data into a data packet and sends the data packet to screen projection software of a screen projection receiving end based on network connection, wherein the data packet comprises a data packet header and gesture track coordinate point data;
in a specific implementation process of the invention, the data packet header is arranged at the forefront of the gesture track coordinate point data and is used for identifying the gesture track coordinate point data by screen projection software running on the screen projection receiving end.
Specifically, screen projection pairing software running on a screen projection sending end encapsulates collected gesture track coordinate point data into a data packet, and then sends the data packet to screen projection software of a screen projection receiving end through network connection, wherein the data packet comprises a data packet header and gesture track coordinate point data; the data packet head is arranged at the forefront of the gesture track coordinate point data and is used for identifying the gesture track coordinate point data by screen projection software running on the screen projection receiving end; the data of the packet header can contain multi-bit data information, and the method is mainly used for judging that the data is touch gesture data after the screen projection software receives the specified packet header data when the data is transmitted to the screen projection software of the screen projection receiving end.
S14: the screen projection receiving end judges whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not;
in the specific implementation process of the present invention, the screen projection receiving end determining whether gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data includes: the screen projection receiving end judges whether the variation trend of the x coordinate value in the gesture track coordinate data is consistent with the variation trend of the x coordinate value in the preset gesture track coordinate data or not; the screen projection receiving end judges whether the variation trend of the y coordinate value in the gesture track coordinate data is consistent with the variation trend of the y coordinate value in the preset gesture track coordinate data or not; when the variation trend of the x coordinate value and the variation trend of the y coordinate value in the gesture track coordinate data are consistent with the variation trend of the x coordinate value and the variation trend of the y coordinate value in the preset gesture track coordinate data, acquiring key touch point coordinate data in the gesture track coordinate data; calculating gesture track slope data of a straight line formed by connecting front and rear coordinates in key touch point coordinate data in the gesture track coordinate data; and performing consistency matching on the gesture track slope data and preset slope data formed by preset key touch point coordinate data.
Further, the acquiring key touch point coordinate data in the gesture trajectory coordinate data includes: increasing or decreasing the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate along the same direction based on the gesture track coordinate data; if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, and all the touch point coordinates in the gesture track coordinate data are traversed to obtain the key touch point coordinate data in the gesture track coordinate data.
Specifically, whether the variation trend of the x coordinate value in the gesture track coordinate data is consistent with the variation trend of the x coordinate value in the preset gesture track coordinate data or not is judged on the receiving terminal; judging whether the variation trend of the y coordinate value in the gesture track coordinate data is consistent with the variation trend of the y coordinate value in the preset gesture track coordinate data or not; when the change trend of the x coordinate value and the change trend of the y coordinate value in the gesture track coordinate data are judged to be consistent with the change trend of the x coordinate value and the change trend of the y coordinate value in the preset gesture track coordinate data, key touch point coordinate data in the gesture track coordinate data are obtained; and when the gesture track data are inconsistent, the screen projection sending end prompts that the gesture track is wrong, and returns to collect gesture track coordinate point data sliding on the screen projection sending end of the user according to the screen projection pairing software in sequence.
Then calculating gesture track slope data of a straight line formed by connecting front and rear coordinates in key touch point coordinate data in the gesture track coordinate data; consistency matching is carried out on the gesture track slope data and preset slope data formed by preset key touch point coordinate data, namely the slope errors are considered to be matched within a range of 5 degrees; and when the slopes are matched, the gesture track coordinate point data in the data packet is considered to be consistent with the generated preset gesture track coordinate data, otherwise, the gesture track is not consistent, the screen projection sending end prompts that the gesture track is wrong, and the gesture track coordinate point data of the user sliding at the screen projection sending end is collected according to the screen projection pairing software in sequence.
Increasing or decreasing the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate along the same direction according to the gesture track coordinate data; if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, and all the touch point coordinates in the gesture track coordinate data are traversed to obtain the key touch point coordinate data in the gesture track coordinate data.
S15: and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started.
In the specific implementation process of the invention, the screen projection sending end and the screen projection receiving end are successfully paired, so that data screen projection can be started.
In the embodiment of the invention, the gesture track coordinate point data is collected by the screen projection sending end and is sent to the screen projection receiving end for consistent matching, when the matching is consistent, the screen projection sending end and the screen projection receiving end are successfully matched, data screen projection is started, screen projection matching through gestures is realized, the complicated process of screen projection matching input screen projection codes and the process of scanning two-dimensional codes are reduced, and the user experience is improved.
Examples
Referring to fig. 2, fig. 2 is a schematic structural composition diagram of a terminal screen projection device based on gesture pairing according to an embodiment of the present invention.
As shown in fig. 2, a terminal screen-projection device based on gesture pairing, the device includes:
the network connection module 21: the screen-casting pairing software is used for starting screen-casting pairing software on a screen-casting sending end and establishing network connection with screen-casting software running on a screen-casting receiving end;
in a specific implementation process of the present invention, before the screen-casting pairing software is started on the screen-casting sending terminal and a network connection is established with the screen-casting software running on the screen-casting receiving terminal, the method further includes: screen projection software running on the screen projection receiving end randomly generates preset gesture track coordinate data; and displaying a gesture drawing process in a dynamic drawing mode based on the preset gesture track coordinate data in the screen projection receiving end.
Further, a track image formed by the preset gesture track coordinate data is a regular gesture image; the regular gesture image has directionality; and selecting a plurality of preset gesture track coordinate points from the preset gesture track coordinate data as preset key touch point coordinate data.
Further, selecting a plurality of preset gesture trajectory coordinate points from the preset gesture trajectory coordinate data as preset key touch point coordinate data includes: whether the x coordinate and the y coordinate of the previous touch point coordinate and the next touch point coordinate in the preset gesture track coordinate data are increased or decreased along the same direction or not is determined; if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, all the touch point coordinates in the preset gesture track coordinate data are selected in a traversing manner, and a plurality of preset gesture track coordinate points are selected as preset key touch point coordinate data.
Specifically, screen projection pairing software is started on a screen projection sending terminal, and network connection is established with screen projection software running on a screen projection receiving terminal, wherein the screen projection sending terminal can be an intelligent terminal such as a PC terminal, a smart phone terminal and a tablet terminal, and the screen projection receiving terminal can be a large-screen display device terminal such as an all-in-one machine and a smart television; the network connection can be internet connection or local area network connection, and the specific connection can be wired connection or wireless connection; before network connection is established, screen projection software running on the screen projection receiving end randomly generates preset gesture track coordinate data; and displaying the gesture drawing process in the screen projection receiving end in a dynamic drawing mode according to the preset gesture track coordinate data.
Specifically, a track image formed by the preset gesture track coordinate data is a regular gesture image; and the regular gesture image has directionality; and selecting a plurality of preset gesture track coordinate points from the preset gesture track coordinate data as preset key touch point coordinate data.
The regular gesture graph is a simple regular gesture graph, the direction of the gesture on the regular gesture graph is marked by an arrow on the regular gesture graph, and a user needs to draw the regular gesture graph according to the gesture direction; on the regular gesture graph, solid dots mark preset key touch point coordinate data; the regular gesture graph displays a complete regular gesture graph at a screen projection receiving end, and then displays the drawing process of the regular gesture graph in a dynamic drawing mode so as to prompt a user how to draw a gesture.
Confirming that the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate by judging whether the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate in the preset gesture track coordinate data are increased or decreased along the same direction, traversing and selecting all the touch point coordinates in the preset gesture track coordinate data, and selecting a plurality of preset gesture track coordinate points as preset key touch point coordinate data.
The acquisition module 22: the system comprises a screen projection pairing software, a screen projection sending terminal and a screen projection pairing software, wherein the screen projection pairing software is used for acquiring gesture track coordinate point data of a user sliding at the screen projection sending terminal in sequence;
in the specific implementation process of the invention, the screen-casting sending terminal is a PC terminal, the sliding gesture of the user is received on a touch panel of the PC terminal, and if the screen-casting sending terminal is a tablet or a smart phone terminal, the sliding gesture of the user can be received by using a touch screen; and then acquiring gesture track coordinate point data of the user sliding at the screen projection sending end according to the user gesture sliding sequence through screen projection pairing software.
The encapsulation sending module 23: the screen projection pairing software is used for packaging the acquired gesture track coordinate point data into a data packet and sending the data packet to screen projection software of a screen projection receiving end based on network connection, wherein the data packet comprises a data packet head and gesture track coordinate point data;
in a specific implementation process of the invention, the data packet header is arranged at the forefront of the gesture track coordinate point data and is used for identifying the gesture track coordinate point data by screen projection software running on the screen projection receiving end.
Specifically, screen projection pairing software running on a screen projection sending end encapsulates collected gesture track coordinate point data into a data packet, and then sends the data packet to screen projection software of a screen projection receiving end through network connection, wherein the data packet comprises a data packet header and gesture track coordinate point data; the data packet head is arranged at the forefront of the gesture track coordinate point data and is used for identifying the gesture track coordinate point data by screen projection software running on the screen projection receiving end; the data of the packet header can contain multi-bit data information, and the method is mainly used for judging that the data is touch gesture data after the screen projection software receives the specified packet header data when the data is transmitted to the screen projection software of the screen projection receiving end.
The judging module 24: the screen projection receiving terminal is used for judging whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not;
in the specific implementation process of the present invention, the screen projection receiving end determining whether gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data includes: the screen projection receiving end judges whether the variation trend of the x coordinate value in the gesture track coordinate data is consistent with the variation trend of the x coordinate value in the preset gesture track coordinate data or not; the screen projection receiving end judges whether the variation trend of the y coordinate value in the gesture track coordinate data is consistent with the variation trend of the y coordinate value in the preset gesture track coordinate data or not; when the variation trend of the x coordinate value and the variation trend of the y coordinate value in the gesture track coordinate data are consistent with the variation trend of the x coordinate value and the variation trend of the y coordinate value in the preset gesture track coordinate data, acquiring key touch point coordinate data in the gesture track coordinate data; calculating gesture track slope data of a straight line formed by connecting front and rear coordinates in key touch point coordinate data in the gesture track coordinate data; and performing consistency matching on the gesture track slope data and preset slope data formed by preset key touch point coordinate data.
Further, the acquiring key touch point coordinate data in the gesture trajectory coordinate data includes: increasing or decreasing the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate along the same direction based on the gesture track coordinate data; if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, and all the touch point coordinates in the gesture track coordinate data are traversed to obtain the key touch point coordinate data in the gesture track coordinate data.
Specifically, whether the variation trend of the x coordinate value in the gesture track coordinate data is consistent with the variation trend of the x coordinate value in the preset gesture track coordinate data or not is judged on the receiving terminal; judging whether the variation trend of the y coordinate value in the gesture track coordinate data is consistent with the variation trend of the y coordinate value in the preset gesture track coordinate data or not; when the change trend of the x coordinate value and the change trend of the y coordinate value in the gesture track coordinate data are judged to be consistent with the change trend of the x coordinate value and the change trend of the y coordinate value in the preset gesture track coordinate data, key touch point coordinate data in the gesture track coordinate data are obtained; and when the gesture track data are inconsistent, the screen projection sending end prompts that the gesture track is wrong, and returns to collect gesture track coordinate point data sliding on the screen projection sending end of the user according to the screen projection pairing software in sequence.
Then calculating gesture track slope data of a straight line formed by connecting front and rear coordinates in key touch point coordinate data in the gesture track coordinate data; consistency matching is carried out on the gesture track slope data and preset slope data formed by preset key touch point coordinate data, namely the slope errors are considered to be matched within a range of 5 degrees; and when the slopes are matched, the gesture track coordinate point data in the data packet is considered to be consistent with the generated preset gesture track coordinate data, otherwise, the gesture track is not consistent, the screen projection sending end prompts that the gesture track is wrong, and the gesture track coordinate point data of the user sliding at the screen projection sending end is collected according to the screen projection pairing software in sequence.
Increasing or decreasing the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate along the same direction according to the gesture track coordinate data; if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, and all the touch point coordinates in the gesture track coordinate data are traversed to obtain the key touch point coordinate data in the gesture track coordinate data.
The data screen projection module 25: and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started.
In the specific implementation process of the invention, the screen projection sending end and the screen projection receiving end are successfully paired, so that data screen projection can be started.
In the embodiment of the invention, the gesture track coordinate point data is collected by the screen projection sending end and is sent to the screen projection receiving end for consistent matching, when the matching is consistent, the screen projection sending end and the screen projection receiving end are successfully matched, data screen projection is started, screen projection matching through gestures is realized, the complicated process of screen projection matching input screen projection codes and the process of scanning two-dimensional codes are reduced, and the user experience is improved.
Examples
Referring to fig. 3, fig. 3 is a schematic structural composition diagram of a terminal screen projection system based on gesture pairing according to an embodiment of the present invention.
As shown in fig. 3, a terminal screen projection system based on gesture pairing includes: at least one screen projection sending end 31 provided with screen projection pairing software and a screen projection receiving end 32 provided with screen projection software; the screen projection sending terminal 31 installed with the screen projection pairing software and the screen projection receiving terminal 32 installed with the screen projection software are connected through a network, and the system is configured to execute any one of the terminal screen projection methods.
For a detailed implementation of the system, please refer to the above embodiments, which are not described herein.
In the embodiment of the invention, the gesture track coordinate point data is collected by the screen projection sending end and is sent to the screen projection receiving end for consistent matching, when the matching is consistent, the screen projection sending end and the screen projection receiving end are successfully matched, data screen projection is started, screen projection matching through gestures is realized, the complicated process of screen projection matching input screen projection codes and the process of scanning two-dimensional codes are reduced, and the user experience is improved.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
In addition, the method, the device and the system for screen projection of the terminal based on gesture pairing provided by the embodiment of the invention are described in detail, a specific embodiment is adopted to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A terminal screen projection method based on gesture pairing is characterized by comprising the following steps:
starting screen projection pairing software on a screen projection sending end, and establishing network connection with screen projection software running on a screen projection receiving end;
acquiring gesture track coordinate point data of a user sliding at a screen projection sending end in sequence based on the screen projection pairing software;
the screen projection pairing software packages the acquired gesture track coordinate point data into a data packet and sends the data packet to screen projection software of a screen projection receiving end based on network connection, wherein the data packet comprises a data packet header and gesture track coordinate point data;
the screen projection receiving end judges whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not;
and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started.
2. The terminal screen-casting method according to claim 1, wherein before the screen-casting pairing software is started on the screen-casting sending terminal and a network connection is established with the screen-casting software running on the screen-casting receiving terminal, the method further comprises:
screen projection software running on the screen projection receiving end randomly generates preset gesture track coordinate data;
and displaying a gesture drawing process in a dynamic drawing mode based on the preset gesture track coordinate data in the screen projection receiving end.
3. The terminal screen projection method according to any one of claims 1 or 2, wherein a trajectory image formed by the preset gesture trajectory coordinate data is a regular gesture image; the regular gesture image has directionality; and selecting a plurality of preset gesture track coordinate points from the preset gesture track coordinate data as preset key touch point coordinate data.
4. The terminal screen projection method according to claim 3, wherein the selecting a plurality of preset gesture trajectory coordinate points from the preset gesture trajectory coordinate data as preset key touch point coordinate data comprises:
whether the x coordinate and the y coordinate of the previous touch point coordinate and the next touch point coordinate in the preset gesture track coordinate data are increased or decreased along the same direction or not is determined;
if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, all the touch point coordinates in the preset gesture track coordinate data are selected in a traversing manner, and a plurality of preset gesture track coordinate points are selected as preset key touch point coordinate data.
5. The terminal screen projection method according to claim 1, wherein the data packet header is arranged at the forefront of the gesture track coordinate point data and is used for identifying the gesture track coordinate point data by screen projection software running on the screen projection receiving end.
6. The terminal screen projection method of claim 1, wherein the screen projection receiving end determines whether gesture trajectory coordinate point data in the data packet is consistent with generated preset gesture trajectory coordinate data, and the method comprises the following steps:
the screen projection receiving end judges whether the variation trend of the x coordinate value in the gesture track coordinate data is consistent with the variation trend of the x coordinate value in the preset gesture track coordinate data or not; and a process for the preparation of a coating,
the screen projection receiving end judges whether the variation trend of the y coordinate value in the gesture track coordinate data is consistent with the variation trend of the y coordinate value in the preset gesture track coordinate data or not;
when the variation trend of the x coordinate value and the variation trend of the y coordinate value in the gesture track coordinate data are consistent with the variation trend of the x coordinate value and the variation trend of the y coordinate value in the preset gesture track coordinate data, acquiring key touch point coordinate data in the gesture track coordinate data;
calculating gesture track slope data of a straight line formed by connecting front and rear coordinates in key touch point coordinate data in the gesture track coordinate data;
and performing consistency matching on the gesture track slope data and preset slope data formed by preset key touch point coordinate data.
7. The terminal screen projection method according to claim 6, wherein the acquiring key touch point coordinate data in the gesture trajectory coordinate data comprises:
increasing or decreasing the x coordinate and the y coordinate of the former touch point coordinate and the latter touch point coordinate along the same direction based on the gesture track coordinate data;
if so, the former touch point coordinate is the key touch point coordinate of the latter touch point coordinate, and all the touch point coordinates in the gesture track coordinate data are traversed to obtain the key touch point coordinate data in the gesture track coordinate data.
8. The terminal screen projection method according to claim 1, further comprising:
and when the screen projection receiving end judges that the gesture track coordinate point data in the data packet is inconsistent with the generated preset gesture track coordinate data, prompting a gesture track error to the screen projection sending end, and returning to the screen projection pairing software to sequentially acquire gesture track coordinate point data of a user sliding at the screen projection sending end.
9. A terminal screen projection device based on gesture pairing is characterized in that the device comprises:
a network connection module: the screen-casting pairing software is used for starting screen-casting pairing software on a screen-casting sending end and establishing network connection with screen-casting software running on a screen-casting receiving end;
an acquisition module: the system comprises a screen projection pairing software, a screen projection sending terminal and a screen projection pairing software, wherein the screen projection pairing software is used for acquiring gesture track coordinate point data of a user sliding at the screen projection sending terminal in sequence;
and (3) packaging a sending module: the screen projection pairing software is used for packaging the acquired gesture track coordinate point data into a data packet and sending the data packet to screen projection software of a screen projection receiving end based on network connection, wherein the data packet comprises a data packet head and gesture track coordinate point data;
a judging module: the screen projection receiving terminal is used for judging whether the gesture track coordinate point data in the data packet is consistent with the generated preset gesture track coordinate data or not;
the data screen projection module: and if the data is consistent with the data, the screen projection sending end and the screen projection receiving end are successfully paired, and data screen projection is started.
10. A terminal screen projection system based on gesture pairing is characterized in that the system comprises: the system comprises at least one screen throwing sending end provided with screen throwing pairing software and a screen throwing receiving end provided with screen throwing software; wherein, a screen projection transmitting terminal installed with screen projection pairing software and a screen projection receiving terminal installed with screen projection software are connected through a network, and the system is configured to execute the terminal screen projection method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011086880.0A CN112306361B (en) | 2020-10-12 | 2020-10-12 | Terminal screen projection method, device and system based on gesture pairing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011086880.0A CN112306361B (en) | 2020-10-12 | 2020-10-12 | Terminal screen projection method, device and system based on gesture pairing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112306361A true CN112306361A (en) | 2021-02-02 |
| CN112306361B CN112306361B (en) | 2021-08-31 |
Family
ID=74488415
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011086880.0A Active CN112306361B (en) | 2020-10-12 | 2020-10-12 | Terminal screen projection method, device and system based on gesture pairing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112306361B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102629186A (en) * | 2012-03-09 | 2012-08-08 | 南京商数信息技术有限公司 | Method for establishing terminal matching through touch trajectory |
| CN103455271A (en) * | 2013-01-26 | 2013-12-18 | 曾昭兴 | File transfer method and file transfers system |
| CN103455273A (en) * | 2013-01-26 | 2013-12-18 | 曾昭兴 | Electronic equipment communication method and system |
| CN104023029A (en) * | 2014-06-19 | 2014-09-03 | 百度在线网络技术（北京）有限公司 | Method and device for verifying verification codes |
| US20150177866A1 (en) * | 2013-12-23 | 2015-06-25 | Microsoft Corporation | Multiple Hover Point Gestures |
| CN105955525A (en) * | 2016-04-21 | 2016-09-21 | 青岛海信电器股份有限公司 | Method and device for touch trajectory tracking, and display device |
| CN106371608A (en) * | 2016-09-21 | 2017-02-01 | 努比亚技术有限公司 | Display control method and device for screen projection |
| CN107870722A (en) * | 2017-09-27 | 2018-04-03 | 努比亚技术有限公司 | Document transmission method, mobile terminal and the computer-readable recording medium of terminal room |
| CN108366062A (en) * | 2018-01-24 | 2018-08-03 | 上海哇嗨网络科技有限公司 | Method, client, server and the system of throwing screen connection are established by inviting |
| CN108845747A (en) * | 2018-04-23 | 2018-11-20 | 普联技术有限公司 | A kind of Touch-control error prevention method, apparatus and terminal device |
| CN110582078A (en) * | 2019-08-28 | 2019-12-17 | RealMe重庆移动通信有限公司 | Bluetooth pairing method and device, storage medium and electronic equipment |
-
2020
- 2020-10-12 CN CN202011086880.0A patent/CN112306361B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102629186A (en) * | 2012-03-09 | 2012-08-08 | 南京商数信息技术有限公司 | Method for establishing terminal matching through touch trajectory |
| CN103455271A (en) * | 2013-01-26 | 2013-12-18 | 曾昭兴 | File transfer method and file transfers system |
| CN103455273A (en) * | 2013-01-26 | 2013-12-18 | 曾昭兴 | Electronic equipment communication method and system |
| US20150177866A1 (en) * | 2013-12-23 | 2015-06-25 | Microsoft Corporation | Multiple Hover Point Gestures |
| CN104023029A (en) * | 2014-06-19 | 2014-09-03 | 百度在线网络技术（北京）有限公司 | Method and device for verifying verification codes |
| CN105955525A (en) * | 2016-04-21 | 2016-09-21 | 青岛海信电器股份有限公司 | Method and device for touch trajectory tracking, and display device |
| CN106371608A (en) * | 2016-09-21 | 2017-02-01 | 努比亚技术有限公司 | Display control method and device for screen projection |
| CN107870722A (en) * | 2017-09-27 | 2018-04-03 | 努比亚技术有限公司 | Document transmission method, mobile terminal and the computer-readable recording medium of terminal room |
| CN108366062A (en) * | 2018-01-24 | 2018-08-03 | 上海哇嗨网络科技有限公司 | Method, client, server and the system of throwing screen connection are established by inviting |
| CN108845747A (en) * | 2018-04-23 | 2018-11-20 | 普联技术有限公司 | A kind of Touch-control error prevention method, apparatus and terminal device |
| CN110582078A (en) * | 2019-08-28 | 2019-12-17 | RealMe重庆移动通信有限公司 | Bluetooth pairing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112306361B (en) | 2021-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10810453B2 (en) | Apparatus and method for reproducing handwritten message by using handwriting data | |
| CN111897507B (en) | Screen projection method and device, second terminal and storage medium | |
| CN105306963A (en) | Video processing system, device and method self-adapting to mobile terminal resolution | |
| US10469488B2 (en) | Security verification method, apparatus, and system | |
| CN111782492B (en) | Page first screen loading duration testing method and device, computer equipment and medium | |
| CN112637842B (en) | Screen projection equipment connection method, system, equipment and storage medium | |
| CN106445243B (en) | Touch response device and method of intelligent equipment | |
| CN109085950B (en) | Multi-screen interaction method and device based on electronic whiteboard and electronic whiteboard | |
| US20130297677A1 (en) | Terminal desktop processing system, terminal, server and method | |
| CN113316128B (en) | Screen projection method, receiving terminal equipment and sending terminal equipment | |
| US10192042B2 (en) | User verifying method, terminal device, server and storage medium | |
| EP4191513A1 (en) | Image processing method and apparatus, device and storage medium | |
| CN112135186A (en) | Screen projection method, device, equipment and storage medium based on small program | |
| US20180129846A1 (en) | Two dimension code operating method and terminal | |
| CN112306361B (en) | Terminal screen projection method, device and system based on gesture pairing | |
| EP3007098A1 (en) | Method, device and system for realizing visual identification | |
| US20130014022A1 (en) | Network system, communication method, and communication terminal | |
| CN104102334B (en) | The control method and far-end control system of far end device | |
| CN1925520A (en) | Method for processing instant message in wireless terminal and wireless terminal | |
| CN111859322A (en) | Identity verification method and device and electronic equipment | |
| CN111432271B (en) | Multi-screen interaction method and system | |
| CN110096190B (en) | Method and terminal for displaying two-dimensional code | |
| CN105530528A (en) | Data synchronizing and sharing method and device | |
| CN106993029B (en) | Control the method, apparatus and cleaning equipment of software upgrading | |
| CN114564139A (en) | Touch point position drawing method and device, screen projector and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Room 238, room 406, No.1, Yichuang street, Huangpu District, Guangzhou, Guangdong 510000 Patentee after: Guangzhou langguo Electronic Technology Co.,Ltd. Address before: 510000 unit a and B, zone 02, 4th floor, No. 136, Gaopu Road, high tech Development Zone, Tianhe District, Guangzhou City, Guangdong Province Patentee before: GUANGZHOU LANGO ELECTRONIC SCIENCE & TECHNOLOGY Co.,Ltd. |