CN114466006A - Touch screen information sending and responding method and device - Google Patents
Touch screen information sending and responding method and device Download PDFInfo
- Publication number
- CN114466006A CN114466006A CN202111583377.0A CN202111583377A CN114466006A CN 114466006 A CN114466006 A CN 114466006A CN 202111583377 A CN202111583377 A CN 202111583377A CN 114466006 A CN114466006 A CN 114466006A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- touch
- cloud mobile
- track
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 230000004044 response Effects 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 15
- 230000001788 irregular Effects 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 5
- 238000012545 processing Methods 0.000 description 21
- 238000010586 diagram Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 14
- 230000006870 function Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 238000009499 grossing Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 239000004065 semiconductor Substances 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000003672 processing method Methods 0.000 description 3
- 239000003795 chemical substances by application Substances 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a touch screen information sending and responding method and device, which are used for improving the touch screen responding effect and improving the touch screen responding speed and smoothness. The application provides a touch screen information sending method, which comprises the following steps: acquiring coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of a cloud mobile phone client; determining the type of the touch track according to the coordinate information; and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
Description
Technical Field
The application relates to the technical field of networks, in particular to a method and a device for sending and responding touch screen information.
Background
The following description of background art may include insights, discoveries, understandings or disclosures or associations of at least some examples of embodiments of the application, and disclosures not known to the relevant prior art but provided by the application. Some such contributions of the application may be specifically pointed out below, whereas other such contributions of the application will be apparent from the relevant context.
The cloud mobile phone uses a virtualization technology, hardware resources are virtualized at the cloud end, a user can remotely connect with the virtual cloud mobile phone by locally installing a cloud mobile phone client, and the user can install various APPs and use the APPs in the cloud mobile phone like using a local mobile phone, so that the cloud mobile phone has similar experience with using the local mobile phone. However, the difference is that all touch screen operations of the user are sent to the cloud mobile phone through the network, the APP in the cloud mobile phone reacts to the touch operations, and because the network has a time delay, the reaction of the touch screen operations lags behind the operation of the user, particularly, the network is poor, and the touch screen trajectory is long, as shown in fig. 1.
Disclosure of Invention
The embodiment of the application provides a method and a device for sending and responding touch screen information, which are used for improving the touch screen response effect and improving the touch screen response speed and smoothness.
At a client, a method for sending touch screen information provided by an embodiment of the present application includes:
acquiring coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of a cloud mobile phone client;
determining the type of the touch track according to the coordinate information;
and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
According to the method and the device, coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of a cloud mobile phone client is obtained; determining the type of the touch track according to the coordinate information; the touch track type is reported to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type, the touch screen response effect is improved, the touch screen response speed and smoothness are improved, the touch screen response jam phenomenon is avoided, and the user experience effect is improved.
Optionally, after the touch trajectory type is reported to a cloud mobile phone server corresponding to the cloud mobile phone client, the method further includes:
and reporting the coordinate information to the cloud mobile phone server.
Optionally, while reporting the touch trajectory type to a cloud mobile phone server corresponding to the cloud mobile phone client, the method further includes:
reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of the user for the cloud mobile phone client according to the touch track type and the track related parameters.
Optionally, the touch trajectory type is one of the following types:
click, straight line, reverse broken line, arc line, irregular curve.
Correspondingly, at a server, the touch screen information response method provided by the embodiment of the application comprises the following steps:
the method comprises the steps of obtaining a touch track type reported by a cloud mobile phone client, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of the cloud mobile phone client;
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, while acquiring the touch trajectory type, the method further includes: acquiring track related parameters corresponding to the touch track type;
predicting the touch track of the user for the cloud mobile phone client according to the touch track type, and specifically comprises the following steps:
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and the track related parameters corresponding to the touch track type.
Optionally, when a preset condition is met, predicting a touch track of a user for the cloud mobile phone client according to the touch track type.
Another embodiment of the present application provides a computing device, which includes a memory and a processor, wherein the memory is used for storing program instructions, and the processor is used for calling the program instructions stored in the memory and executing any one of the above methods according to the obtained program.
Furthermore, according to an embodiment, for example, a computer program product for a computer is provided, which comprises software code portions for performing the steps of the method as defined above, when said product is run on a computer. The computer program product may include a computer-readable medium having software code portions stored thereon. Further, the computer program product may be directly loaded into an internal memory of the computer and/or transmitted via a network through at least one of an upload process, a download process, and a push process.
Another embodiment of the present application provides a computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform any one of the methods described above.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of a cloud mobile phone touch scheme in the prior art;
fig. 2 is a schematic view of a cloud mobile phone touch scheme provided in an embodiment of the present application;
fig. 3 is a schematic view of a specific processing flow of sending and responding to touch screen information according to an embodiment of the present application;
fig. 4 is a schematic diagram illustrating a principle of calculating a circle center by using three coordinate points according to an embodiment of the present application;
fig. 5 is a schematic flowchart of a method for sending touch screen information according to an embodiment of the present application;
fig. 6 is a schematic flowchart of a touch screen information response method according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a touch screen information sending apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a touch screen information response apparatus according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a touch screen information sending apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a touch screen information response apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a method and a device for sending and responding touch screen information, which are used for improving the touch screen response effect and improving the touch screen response speed and smoothness.
The method and the device are based on the same application concept, and because the principles of solving the problems of the method and the device are similar, the implementation of the device and the method can be mutually referred, and repeated parts are not repeated.
The terms "first," "second," and the like in the description and in the claims of the embodiments of the application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The following examples and embodiments are to be understood as merely illustrative examples. Although this specification may refer to "an", "one", or "some" example or embodiment(s) in several places, this does not imply that each such reference relates to the same example or embodiment, nor that the feature only applies to a single example or embodiment. Individual features of different embodiments may also be combined to provide other embodiments. Furthermore, terms such as "comprising" and "comprises" should be understood as not limiting the described embodiments to consist of only those features that have been mentioned; such examples and embodiments may also include features, structures, elements, modules, etc. not specifically mentioned.
The technical scheme provided by the embodiment of the application can be applied to various systems, for example, a 5G system or a wired network system.
The client involved in the embodiments of the present application may be, for example, a terminal device, a device providing voice and/or data connectivity to a user, a handheld device having a wireless connection function, or other processing device connected to a wireless modem. In different systems, the names of the terminal devices may be different, for example, in a 5G system, the terminal device may be called a User Equipment (UE). Wireless terminal devices, which may be mobile terminal devices such as mobile telephones (or "cellular" telephones) and computers with mobile terminal devices, e.g., mobile devices that may be portable, pocket, hand-held, computer-included, or vehicle-mounted, communicate with one or more core networks via the RAN. Examples of such devices include Personal Communication Service (PCS) phones, cordless phones, Session Initiation Protocol (SIP) phones, Wireless Local Loop (WLL) stations, and Personal Digital Assistants (PDAs). The wireless terminal device may also be referred to as a system, a subscriber unit (subscriber unit), a subscriber station (subscriber station), a mobile station (mobile), a remote station (remote station), an access point (access point), a remote terminal device (remote terminal), an access terminal device (access terminal), a user terminal device (user terminal), a user agent (user agent), and a user device (user device), which are not limited in this embodiment of the present application.
The server according to the embodiment of the present application may be a network device, for example, a server, and is not limited in the embodiment of the present application.
Various embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that the display sequence of the embodiment of the present application only represents the sequence of the embodiment, and does not represent the merits of the technical solutions provided by the embodiments.
According to the traditional cloud mobile phone touch scheme, a touch track coordinate point sequence collected in a client is completely sent to a server without being processed, and the server draws a track. The original coordinate point data is divided into different IP data packets in the network transmission stage, the arrival time of the data packets can be influenced by network delay, and the time division of the coordinate sequence can be caused. The data is displayed on the server, namely when the track is drawn, data is suddenly unavailable, the operation is blocked, and the user experience is poor.
In order to solve the problem of track drawing delay caused by unstable networks in cloud mobile phone touch data, the method is as smooth as local touch operation. The embodiment of the application provides a cloud mobile phone touch response method based on track identification and prediction, so that the cloud mobile phone touch is smoother and smoother, and the user experience is improved.
In order to overcome the problem that when a cloud mobile phone is in touch operation, gesture track data is transmitted through a delayed network and then arrives at a cloud mobile phone server at an uneven moment, so that a touch track cannot follow the finger speed of a user, an embodiment of the application aims to provide a cloud mobile phone touch smooth operation processing method based on track prediction. In the cloud mobile phone server, if data are lost due to network delay when a track is drawn, the position of the next touch coordinate is predicted and calculated through the existing track identification type and the existing coordinate sequence, and the predicted coordinate is used for responding to user operation more smoothly.
According to the cloud mobile phone touch smooth processing method based on the track recognition and prediction, the cloud mobile phone client can acquire the user touch coordinate sequence before the cloud mobile phone server when the network fluctuation is large. The principle of this scheme is shown in fig. 2. The specific description is as follows:
(1) and the cloud mobile phone client side is provided with a track recognition module, so that the track type of the operation can be calculated in real time according to the touch track of the user.
(2) And the cloud mobile phone client sends the identified track type preferentially, and then sends the data of the track coordinate to the cloud mobile phone server through the network.
(3) And a track smoothing module is installed in the cloud mobile phone server, and when the network delay is large and the subsequent track data is missing, the gesture track is predicted and calculated according to the track type sent by the cloud mobile phone client and the received track coordinate point.
(4) And the cloud mobile phone server draws a user gesture track according to the existing real coordinate data and the prediction data, and responds to the operation corresponding to the track.
The method provided by the embodiment of the application, referring to fig. 3, for example, specifically includes the following steps:
the method comprises the steps that firstly, a track recognition module is installed on a cloud mobile phone client, and the track recognition module calculates the track type according to the touch track coordinate of a user in real time.
For example:
when one touch generates less than 3 coordinate points, the touch operation is regarded as a click operation, and track identification is not performed.
As shown in fig. 4, when only 3 coordinate points are generated, the coordinates of the center of the circle where the three points are located are calculated from the trajectory coordinates (X0, Y0), (X1, Y1), (X2, Y2), and are denoted as (X0, Y0).
When the nth track point is generated, the coordinates of the circle center are calculated by using (x0, y0), (xm, ym) and (Xn, Yn), and are recorded as (Xn-2, Yn-2), wherein m is (n-0)/2 rounded.
For simple calculation, the embodiment of the present application only needs to know the approximate type of the track, and when the value of | X | or | Y | in the coordinates (X, Y) of the circle center is 3 to 4 times (empirical value) larger than the size of the screen of the mobile phone, the track recognition module considers that the track approaches a straight line.
When the values of | X | and | Y | in the coordinates (X, Y) of the circle centers are continuously calculated and basically do not change, the track identification module considers the track to be a circular arc line.
When the numerical value of | X | and | Y | in a circle center coordinate (X, Y) is obtained suddenly in the calculation process and is equal to or smaller than the screen size, namely the circle center is in the screen or near the screen, the track recognition module judges that the track is bent.
When the X, Y sign in the circle center coordinates (X, Y) changes very frequently, the track identification module judges that the track is an irregular curve.
Step two, when the track type is given by a track recognition module of the cloud mobile phone client, the client firstly sets the track type and the attached parameters as high priority and sends the high priority to a cloud mobile phone server, and then sends the coordinate points of the track to the cloud mobile phone server; wherein the incidental parameters, for example: for the arc track type, the coordinates of the circle center are included; for the inflected line type, the inflected point position is included.
Thirdly, the cloud mobile phone server records receiving time according to the type of the track received firstly, and does not perform track prediction when click operation and network conditions are good and coordinate point data can be received continuously;
when the coordinate array is delayed and not arrived in the track drawing in the cloud mobile phone, for example, the coordinate point information which does not receive response after exceeding the preset waiting time, a subsequent smoothing algorithm is determined according to the track type, and track coordinate point calculation is started.
For example, for the straight line type, a primary expression is selected, and the position of the next coordinate point is obtained by combining the network delay time;
selecting a binary primary expression for the arc track type, namely the arc line type, and obtaining the position of the next coordinate point by solving the symmetrical point of the existing coordinate point about the straight line passing through the center of a circle;
for the reverse fold line type, judging directly according to whether the data of the folding point is received or not, when the data of the folding point is not received, obtaining the position of the next coordinate point by adopting a straight line algorithm, and if the data of the folding point is received, taking the existing data as a predicted value;
for more complex curves, a straight line algorithm is used, but only slightly extended by a distance, for example, a preset length.
In fact, among the daily touch screen operations of the user, the most commonly used trajectory types of operations are: clicking, straight lines, reverse broken lines and arc lines, the curve which is changed quickly and is complex is generally few, and the curve basically belongs to random drawing, so that excessive attention is not needed.
And step four, the cloud mobile phone server draws a user operation track according to the predicted data.
Through the prior track type, the predicted data basically accords with the actual data position, the accuracy is high, and therefore the later-reached actual coordinate point data can be discarded without using.
In summary, the embodiment of the application provides a processing method for smooth touch operation of a cloud mobile phone based on trajectory prediction aiming at the fact that a trajectory coordinate sequence is different from original data in time due to network delay. The method comprises the steps that a track identification module is introduced, common track types are identified and then sent to a server side in advance, and accuracy of follow-up track prediction is improved; by introducing the track smoothing module, the problem of gesture operation blockage caused by network delay is reduced; a communication channel between the cloud mobile phone client and the server is utilized, only the gesture type code is added, an additional connecting channel is not needed, and the implementation is simple; the method does not need additional equipment and redundant setting of the user, is transparent to the user and has no perception in the whole process.
The technical solutions provided by the embodiments of the present application are summarized from a single side, respectively.
At a client, referring to fig. 5, a method for sending touch screen information provided in an embodiment of the present application includes:
s101, obtaining coordinate information corresponding to a touch track generated by a user on a touch screen aiming at touch operation of a cloud mobile phone client;
coordinate information corresponding to the touch trajectory, for example: if only three coordinate points are generated in one touch operation, determining the coordinate information of the three coordinate points: (x0, y0), (x1, y1), (x2, y 2).
Alternatively, if one touch operation is less than three coordinate points, the touch trajectory type recognition operation described below is not performed. The subsequent steps are performed only in the case where one touch operation produces three or more coordinate points.
S102, determining the type of the touch track according to the coordinate information;
for example, optionally, the touch trajectory type is one of the following types:
click, straight line, reverse broken line, arc line, irregular curve.
Wherein the irregular curve is the case of the more complex curve described above.
S103, reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
Optionally, after the touch trajectory type is reported to a cloud mobile phone server corresponding to the cloud mobile phone client, the method further includes:
and reporting the coordinate information to the cloud mobile phone server.
That is to say, in the embodiment of the present application, the touch track type of the touch track may be reported to the server, and then the actual coordinate position information of the touch track may be reported to the server.
Of course, the actual coordinate position information of the current touch trajectory may not be reported, and the server may predict the touch trajectory of the current user according to the touch trajectory type of the current touch trajectory and the coordinate position information from the same client acquired (i.e., known) last time.
Optionally, while reporting the touch trajectory type to a cloud mobile phone server corresponding to the cloud mobile phone client, the method further includes:
reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of the user for the cloud mobile phone client according to the touch track type and the track related parameters.
Wherein the trajectory-related parameters, i.e. the incidental parameters mentioned above, are, for example: for the circular arc line type, the circle center coordinate is included; for the inflected line type, the inflected point position is included.
Correspondingly, at the server side, referring to fig. 6, an embodiment of the touch screen information response method includes:
s201, obtaining a touch track type reported by a cloud mobile phone client, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of the cloud mobile phone client;
s202, predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, while acquiring the touch trajectory type, the method further includes: acquiring track related parameters corresponding to the touch track type;
predicting the touch track of the user for the cloud mobile phone client according to the touch track type, and specifically comprises the following steps:
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and the track related parameters corresponding to the touch track type.
Optionally, when a preset condition is met, a touch track of the user for the cloud mobile phone client is predicted according to the touch track type.
Wherein the preset condition is, for example: and if the current network delay meets a preset condition, for example, the delay exceeds a preset value, predicting the touch track of the current user for the cloud mobile phone client according to the type of the current touch track. That is, when the network delay is serious, the touch trajectory needs to be predicted, otherwise, the touch trajectory is drawn directly according to the received coordinate information without prediction.
Optionally, after the touch trajectory is predicted, actual coordinate point data of the same touch trajectory from the same client is received, discarding processing may be selected, or verification may be performed on the predicted touch trajectory according to the received actual coordinate point data of the same touch trajectory, if the deviation exceeds a preset range value, correction processing is performed, and the corrected touch trajectory is responded, otherwise, correction is not required, which indicates that the prediction is accurate, and correction processing is not performed.
The following describes an apparatus or device provided in the embodiments of the present application, where technical features the same as or corresponding to those described in the above methods are explained or illustrated, and are not further described later.
At a client, referring to fig. 7, an apparatus for sending touch screen information provided in an embodiment of the present application includes:
the coordinate acquisition module 11 is used for acquiring coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of the cloud mobile phone client;
a track identification module 12, configured to determine a touch track type according to the coordinate information;
the sending module 13 is configured to report the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
Optionally, after the sending module 13 reports the touch trajectory type to the cloud mobile phone server corresponding to the cloud mobile phone client, the sending module is further configured to:
and reporting the coordinate information to the cloud mobile phone server.
Optionally, the sending module 13 is configured to report the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, and at the same time, further configured to:
reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of the user for the cloud mobile phone client according to the touch track type and the track related parameters.
Optionally, the touch trajectory type is one of the following types:
click, straight line, reverse broken line, arc line, irregular curve.
Correspondingly, at the server side, referring to fig. 8, an embodiment of the touch screen information response apparatus includes:
the receiving module 21 is configured to obtain a touch track type reported by a cloud mobile phone client, where the touch track type is determined according to coordinate information corresponding to a touch track generated by a user on a touch screen for a touch operation of the cloud mobile phone client;
and the track smoothing module 22 is configured to predict a touch track of the user for the cloud mobile phone client according to the touch track type.
Optionally, the receiving module 21, while acquiring the touch track type, is further configured to: acquiring track related parameters corresponding to the touch track type;
predicting the touch track of the user for the cloud mobile phone client according to the touch track type, and specifically comprises the following steps:
the trajectory smoothing module 22 is specifically configured to: and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and the track related parameters corresponding to the touch track type.
Optionally, the trajectory smoothing module 22 is specifically configured to: and when a preset condition is met, predicting a touch track of a user for the cloud mobile phone client according to the touch track type.
It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and another division manner may be available in actual implementation. In addition, functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, which are essential or contributing to the prior art, or all or part of the technical solutions may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The embodiment of the present application provides a computing device, which may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), and the like. The computing device may include a Central Processing Unit (CPU), memory, input/output devices, etc., the input devices may include a keyboard, mouse, touch screen, etc., and the output devices may include a Display device, such as a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT), etc.
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory may be used for storing a program of any one of the methods provided by the embodiments of the present application.
The processor is used for executing any one of the methods provided by the embodiment of the application according to the obtained program instructions by calling the program instructions stored in the memory.
When the computing device is used as a touch screen information sending device of a client, referring to fig. 9, for example, the computing device includes:
the processor 600, which is used to read the program in the memory 620, executes the following processes:
acquiring coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of a cloud mobile phone client;
determining the type of the touch track according to the coordinate information;
reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client through a transceiver 610, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
Optionally, after the processor 600 reports the touch trajectory type to the cloud mobile phone server corresponding to the cloud mobile phone client through the transceiver 610, the processor is further configured to:
and reporting the coordinate information to the cloud mobile phone server through the transceiver 610.
Optionally, the processor 600 reports the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client through the transceiver 610, and is further configured to:
reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server through the transceiver 610, so that the cloud mobile phone server predicts the touch track of the user for the cloud mobile phone client according to the touch track type and the track related parameters.
Optionally, the touch trajectory type is one of the following types:
click, straight line, reverse broken line, arc line, irregular curve.
A transceiver 610 for receiving and transmitting data under the control of the processor 600.
Where in fig. 9, the bus architecture may include any number of interconnected buses and bridges, with various circuits being linked together, particularly one or more processors represented by processor 600 and memory represented by memory 620. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 610 may be a number of elements including a transmitter and a receiver that provide a means for communicating with various other apparatus over a transmission medium. For different user devices, the user interface 630 may also be an interface capable of interfacing with a desired device externally, including but not limited to a keypad, display, speaker, microphone, joystick, etc.
The processor 600 is responsible for managing the bus architecture and general processing, and the memory 620 may store data used by the processor 600 in performing operations.
Alternatively, the processor 600 may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a CPLD (Complex Programmable Logic Device).
When the computing device is used as a touch screen information response device of a server, referring to fig. 10, for example, the computing device includes:
the processor 500, which is used to read the program in the memory 520, executes the following processes:
acquiring a touch track type reported by a cloud mobile phone client through a transceiver 510, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a user on a touch screen aiming at touch operation of the cloud mobile phone client;
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, the processor 500, while acquiring the touch track type through the transceiver 510, is further configured to: acquiring a track related parameter corresponding to the touch track type through a transceiver 510;
the processor 500 predicts the touch trajectory of the user for the cloud mobile phone client according to the touch trajectory type, and specifically includes:
the processor 500 predicts the touch track of the user for the cloud mobile phone client according to the touch track type and the track related parameters corresponding to the touch track type.
Optionally, when a preset condition is met, the processor 500 predicts a touch trajectory of the user for the cloud mobile phone client according to the touch trajectory type.
A transceiver 510 for receiving and transmitting data under the control of the processor 500.
Wherein in fig. 10 the bus architecture may include any number of interconnected buses and bridges, with one or more processors represented by processor 500 and various circuits of memory represented by memory 520 being linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 510 may be a number of elements including a transmitter and a receiver that provide a means for communicating with various other apparatus over a transmission medium. The processor 500 is responsible for managing the bus architecture and general processing, and the memory 520 may store data used by the processor 500 in performing operations.
The processor 500 may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or a Complex Programmable Logic Device (CPLD).
Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method of any of the above embodiments. The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Embodiments of the present application provide a computer-readable storage medium for storing computer program instructions for an apparatus provided in the embodiments of the present application, which includes a program for executing any one of the methods provided in the embodiments of the present application. The computer-readable storage medium may be a non-transitory computer-readable medium.
The computer-readable storage medium can be any available medium or data storage device that can be accessed by a computer, including but not limited to magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CDs, DVDs, BDs, HVDs, etc.), and semiconductor memory (e.g., ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs)), etc.
It should be understood that:
the access technology via which entities in the communication network communicate traffic to and from may be any suitable current or future technology, such as WLAN (wireless local access network), WiMAX (worldwide interoperability for microwave access), LTE-a, 5G, bluetooth, infrared, etc. may be used; in addition, embodiments may also apply wired technologies, e.g. IP based access technologies, such as wired networks or fixed lines.
Embodiments suitable for implementation as software code or as part thereof and for operation using a processor or processing functionality are software code independent and may be specified using any known or future developed programming language, such as a high level programming language, such as objective-C, C, C + +, C #, Java, Python, Javascript, other scripting language, etc., or a low level programming language, such as machine language or assembler.
The implementation of the embodiments is hardware independent and may be implemented using any known or future developed hardware technology or any mixture thereof, such as a microprocessor or CPU (central processing unit), MOS (metal oxide semiconductor), CMOS (complementary MOS), BiMOS (bipolar MOS), BiCMOS (bipolar CMOS), ECL (emitter coupled logic) and/or TTL (transistor-transistor logic).
Embodiments may be implemented as separate devices, apparatus, units, components or functions or in a distributed manner, e.g., one or more processors or processing functions may be used or shared in a process or one or more processing segments or processing portions may be used and shared in a process, where a physical processor or more than one physical processor may be used to implement one or more processing portions dedicated to a particular process as described.
The apparatus may be implemented by a semiconductor chip, a chipset, or a (hardware) module comprising such a chip or chipset.
Embodiments may also be implemented as any combination of hardware and software, such as an ASIC (application specific IC (integrated circuit)) component, FPGA (field programmable gate array) or CPLD (complex programmable logic device) component, or DSP (digital signal processor) component.
Embodiments may also be implemented as a computer program product, comprising a computer usable medium having a computer readable program code embodied therein, the computer readable program code adapted to perform a process as described in the embodiments, wherein the computer usable medium may be a non-transitory medium.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A method for sending information on a touch screen is characterized by comprising the following steps:
acquiring coordinate information corresponding to a touch track generated by a user on a touch screen aiming at the touch operation of a cloud mobile phone client;
determining the type of the touch track according to the coordinate information;
and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
2. The method of claim 1, wherein after the touch trajectory type is reported to a cloud mobile phone server corresponding to the cloud mobile phone client, the method further comprises:
and reporting the coordinate information to the cloud mobile phone server.
3. The method of claim 1, wherein while reporting the touch trajectory type to a cloud mobile phone server corresponding to the cloud mobile phone client, the method further comprises:
reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of the user for the cloud mobile phone client according to the touch track type and the track related parameters.
4. The method of claim 1, wherein the touch trajectory type is one of:
click, straight line, reverse broken line, arc line, irregular curve.
5. A touch screen information response method, comprising:
the method comprises the steps of obtaining a touch track type reported by a cloud mobile phone client, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a user aiming at the touch operation of the cloud mobile phone client on a touch screen;
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
6. The method of claim 5, wherein the touch trajectory type is obtained while the method further comprises: acquiring track related parameters corresponding to the touch track type;
predicting the touch track of the user for the cloud mobile phone client according to the touch track type, and specifically comprises the following steps:
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and the track related parameters corresponding to the touch track type.
7. The method according to claim 5, wherein when a preset condition is met, a touch track of a user for the cloud mobile phone client is predicted according to the touch track type.
8. A computing device, comprising:
a memory for storing program instructions;
a processor for calling program instructions stored in said memory to perform the method of any of claims 1 to 7 in accordance with the obtained program.
9. A computer program product for a computer, characterized in that it comprises software code portions for performing the steps of any one of claims 1 to 7 when said product is run on the computer.
10. A computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111583377.0A CN114466006B (en) | 2021-12-22 | 2021-12-22 | Touch screen information sending and responding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111583377.0A CN114466006B (en) | 2021-12-22 | 2021-12-22 | Touch screen information sending and responding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114466006A true CN114466006A (en) | 2022-05-10 |
| CN114466006B CN114466006B (en) | 2024-01-02 |
Family
ID=81406274
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111583377.0A Active CN114466006B (en) | 2021-12-22 | 2021-12-22 | Touch screen information sending and responding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114466006B (en) |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005322194A (en) * | 2004-05-06 | 2005-11-17 | Shotatsu Kagi Kofun Yugenkoshi | Touch panel type character inputting method and its control module |
| US20120169670A1 (en) * | 2010-12-29 | 2012-07-05 | Lg Electronics Inc. | Mobile terminal and touch recognizing method therein |
| CN202422047U (en) * | 2011-07-22 | 2012-09-05 | 宸鸿科技(厦门)有限公司 | Device for detecting touch track of touch screen |
| US20130181908A1 (en) * | 2012-01-13 | 2013-07-18 | Microsoft Corporation | Predictive compensation for a latency of an input device |
| KR20140103777A (en) * | 2013-02-19 | 2014-08-27 | 엘지전자 주식회사 | Mobile terminal and touch coordinate predicting method thereof |
| US20150153855A1 (en) * | 2013-12-03 | 2015-06-04 | Elwha Llc | Display latency compensation responsive to an indicator of an impending change in a hand-initiated movement |
| CN105975122A (en) * | 2016-04-27 | 2016-09-28 | 集怡嘉数码科技（深圳）有限公司 | Touch track compensation method and apparatus as well as terminal device |
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| US20180188938A1 (en) * | 2016-12-29 | 2018-07-05 | Google Inc. | Multi-Task Machine Learning for Predicted Touch Interpretations |
| CN108306933A (en) * | 2017-12-27 | 2018-07-20 | 杭州华为数字技术有限公司 | A kind of method, apparatus and system that the input based on desktop virtualization redirects |
| CN108919997A (en) * | 2018-06-29 | 2018-11-30 | 中国联合网络通信集团有限公司 | Improve the method and device of capacitive touch screen identification accuracy |
| US20190113999A1 (en) * | 2017-10-17 | 2019-04-18 | STMicroelectronics (Beijing) R&D Co. Ltd | Touch motion tracking and reporting technique for slow touch movements |
| WO2019172829A1 (en) * | 2018-03-08 | 2019-09-12 | Flatfrog Laboratories Ab | Touch apparatus |
| JP2020013423A (en) * | 2018-07-19 | 2020-01-23 | 吉原 歐 | All-in-one GPR card |
| CN111857457A (en) * | 2020-06-22 | 2020-10-30 | 北京百度网讯科技有限公司 | Cloud mobile phone control method and device, electronic equipment and readable storage medium |
| CN113311984A (en) * | 2020-02-27 | 2021-08-27 | 北京小米移动软件有限公司 | Touch screen track data processing method and device, mobile terminal and electronic equipment |
| WO2021190314A1 (en) * | 2020-03-25 | 2021-09-30 | 华为技术有限公司 | Sliding response control method and apparatus of touch screen, and electronic device |
-
2021
- 2021-12-22 CN CN202111583377.0A patent/CN114466006B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005322194A (en) * | 2004-05-06 | 2005-11-17 | Shotatsu Kagi Kofun Yugenkoshi | Touch panel type character inputting method and its control module |
| US20120169670A1 (en) * | 2010-12-29 | 2012-07-05 | Lg Electronics Inc. | Mobile terminal and touch recognizing method therein |
| CN202422047U (en) * | 2011-07-22 | 2012-09-05 | 宸鸿科技(厦门)有限公司 | Device for detecting touch track of touch screen |
| US20130181908A1 (en) * | 2012-01-13 | 2013-07-18 | Microsoft Corporation | Predictive compensation for a latency of an input device |
| KR20140103777A (en) * | 2013-02-19 | 2014-08-27 | 엘지전자 주식회사 | Mobile terminal and touch coordinate predicting method thereof |
| US20150153855A1 (en) * | 2013-12-03 | 2015-06-04 | Elwha Llc | Display latency compensation responsive to an indicator of an impending change in a hand-initiated movement |
| CN105975122A (en) * | 2016-04-27 | 2016-09-28 | 集怡嘉数码科技（深圳）有限公司 | Touch track compensation method and apparatus as well as terminal device |
| US20180188938A1 (en) * | 2016-12-29 | 2018-07-05 | Google Inc. | Multi-Task Machine Learning for Predicted Touch Interpretations |
| US20190113999A1 (en) * | 2017-10-17 | 2019-04-18 | STMicroelectronics (Beijing) R&D Co. Ltd | Touch motion tracking and reporting technique for slow touch movements |
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN108306933A (en) * | 2017-12-27 | 2018-07-20 | 杭州华为数字技术有限公司 | A kind of method, apparatus and system that the input based on desktop virtualization redirects |
| WO2019172829A1 (en) * | 2018-03-08 | 2019-09-12 | Flatfrog Laboratories Ab | Touch apparatus |
| CN108919997A (en) * | 2018-06-29 | 2018-11-30 | 中国联合网络通信集团有限公司 | Improve the method and device of capacitive touch screen identification accuracy |
| JP2020013423A (en) * | 2018-07-19 | 2020-01-23 | 吉原 歐 | All-in-one GPR card |
| CN113311984A (en) * | 2020-02-27 | 2021-08-27 | 北京小米移动软件有限公司 | Touch screen track data processing method and device, mobile terminal and electronic equipment |
| WO2021190314A1 (en) * | 2020-03-25 | 2021-09-30 | 华为技术有限公司 | Sliding response control method and apparatus of touch screen, and electronic device |
| CN111857457A (en) * | 2020-06-22 | 2020-10-30 | 北京百度网讯科技有限公司 | Cloud mobile phone control method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114466006B (en) | 2024-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020038175A1 (en) | Data-stream allocation method for link aggregation and related devices | |
| CN113938456B (en) | Session message overhead processing method and device | |
| US9629170B1 (en) | Rate adaptation in a communication system | |
| AU2017438902B2 (en) | Touch control method and apparatus | |
| US10925038B2 (en) | Method and apparatus for determining time domain resource mapped by reference signal | |
| US10425849B1 (en) | Visualization of personalized quality of experience regarding mobile network | |
| CN105550051A (en) | Asynchronous processing method and device of business request | |
| CN104488291A (en) | Methods and apparatuses for facilitating utilization of cloud services | |
| US20170290054A1 (en) | Information transmission method and apparatus in cell | |
| WO2018171105A1 (en) | Alarm notification method and terminal device | |
| CN105389175A (en) | Application program sharing method and mobile terminal | |
| CN109547335B (en) | Session message processing method and device | |
| CN108345422A (en) | Application control method, apparatus, mobile terminal and computer-readable medium | |
| CN107402777B (en) | Resource updating method and electronic equipment | |
| US9667805B2 (en) | Providing discounted service offerings to customers experiencing reduced service availability | |
| WO2019047708A1 (en) | Resource configuration method and related product | |
| CN106953852B (en) | Registration method and device of broadcast receiver and terminal equipment | |
| US20130290495A1 (en) | Method of setting optimal ping interval and electronic device therefor | |
| CN109287139B (en) | Data transmission method and device | |
| CN112738726A (en) | Positioning method, positioning device, terminal and storage medium | |
| CN114466006B (en) | Touch screen information sending and responding method and device | |
| US10075588B2 (en) | Managing communication events | |
| CN111767074A (en) | Configuration updating method, device, terminal and storage medium | |
| CN107277227B (en) | Mobile terminal communication method, mobile terminal and computer readable storage medium | |
| CN112073308A (en) | Information pushing method, device, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |