CN114466006B - Touch screen information sending and responding method and device - Google Patents
Touch screen information sending and responding method and device Download PDFInfo
- Publication number
- CN114466006B CN114466006B CN202111583377.0A CN202111583377A CN114466006B CN 114466006 B CN114466006 B CN 114466006B CN 202111583377 A CN202111583377 A CN 202111583377A CN 114466006 B CN114466006 B CN 114466006B
- Authority
- CN
- China
- Prior art keywords
- touch
- mobile phone
- cloud mobile
- track
- touch track
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 230000004044 response Effects 0.000 claims abstract description 19
- 238000004590 computer program Methods 0.000 claims description 15
- 230000001788 irregular Effects 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 5
- 238000012545 processing Methods 0.000 description 20
- 238000010586 diagram Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 238000009499 grossing Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000003672 processing method Methods 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 229920001690 polydopamine Polymers 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The application discloses a touch screen information sending and responding method and device, which are used for improving the touch screen response effect, the touch screen response speed and smoothness. The touch screen information sending method provided by the application comprises the following steps: acquiring coordinate information corresponding to a touch track generated by a user aiming at touch operation of a cloud mobile phone client on a touch screen; determining a touch track type according to the coordinate information; and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type.
Description
Technical Field
The present disclosure relates to the field of network technologies, and in particular, to a method and an apparatus for sending and responding touch screen information.
Background
The following description of the background art may include an insight, discovery, understanding, or disclosure, or association, of at least some examples of embodiments of the present application, and disclosures not known to the relevant prior art but provided by the present application. Some such contributions of the application may be specifically pointed out below, while other such contributions of the application will be apparent from the relevant context.
The cloud mobile phone uses a virtualization technology, hardware resources are virtualized at the cloud, a user can remotely connect the virtual cloud mobile phone by locally installing a cloud mobile phone client, and the user can install various APP and use APP in the cloud mobile phone like using the local mobile phone, so that the cloud mobile phone has similar experience with the use of the local mobile phone. But different from that, all touch screen operations of the user are sent to the cloud mobile phone through the network, and APP in the cloud mobile phone reacts to the touch operations, and the reaction of the touch screen operations is delayed from the operation of the user due to the time delay of the network, especially when the network is poor and the touch screen track is long, for example, as shown in fig. 1.
Disclosure of Invention
The embodiment of the application provides a touch screen information sending and responding method and device, which are used for improving the touch screen response effect and improving the touch screen response speed and smoothness.
At a client, a touch screen information sending method provided in an embodiment of the present application includes:
acquiring coordinate information corresponding to a touch track generated by a user aiming at touch operation of a cloud mobile phone client on a touch screen;
determining a touch track type according to the coordinate information;
and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type.
According to the method and the device, coordinate information corresponding to the touch track generated by the touch operation of the user on the touch screen aiming at the cloud mobile phone client is obtained; determining the type of the touch track according to the coordinate information; and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type, thereby improving the touch screen response effect, improving the touch screen response speed and smoothness, avoiding the phenomenon of touch screen response blocking and improving the user experience effect.
Optionally, after the touch track type is reported to the cloud mobile phone server corresponding to the cloud mobile phone client, the method further includes:
and reporting the coordinate information to the cloud mobile phone server.
Optionally, the touch track type is reported to a cloud mobile phone server corresponding to the cloud mobile phone client, and the method further includes:
and reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type and the track related parameters.
Optionally, the touch trajectory type is one of the following types:
click, straight line, reverse fold line, circular arc line, irregular curve.
Correspondingly, at the server, the touch screen information response method provided by the embodiment of the application comprises the following steps:
the method comprises the steps of obtaining a touch track type reported by a cloud mobile phone client, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a touch operation of a user on a touch screen aiming at the cloud mobile phone client;
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, while acquiring the touch track type, the method further includes: acquiring track related parameters corresponding to the touch track types;
according to the touch track type, predicting the touch track of the user aiming at the cloud mobile phone client specifically comprises the following steps:
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and track related parameters corresponding to the touch track type.
Optionally, when a preset condition is met, predicting the touch track of the user for the cloud mobile phone client according to the touch track type.
Another embodiment of the present application provides a computing device including a memory for storing program instructions and a processor for invoking the program instructions stored in the memory to perform any of the methods described above in accordance with the obtained program.
Furthermore, according to an embodiment, for example, a computer program product for a computer is provided, comprising software code portions for performing the steps of the method defined above, when said product is run on a computer. The computer program product may include a computer-readable medium having software code portions stored thereon. Furthermore, the computer program product may be directly loaded into the internal memory of the computer and/or transmitted via the network by at least one of an upload procedure, a download procedure and a push procedure.
Another embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions for causing a computer to perform any of the methods described above.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of a touch scheme of a cloud mobile phone in the prior art;
fig. 2 is a schematic diagram of a touch scheme of a cloud mobile phone according to an embodiment of the present application;
fig. 3 is a schematic diagram of a specific process flow of sending and responding touch screen information provided in an embodiment of the present application;
fig. 4 is a schematic diagram of a principle of circle center calculation of three coordinate points according to an embodiment of the present application;
fig. 5 is a flow chart of a touch screen information sending method provided in the embodiment of the present application;
fig. 6 is a flow chart of a touch screen information response method provided in an embodiment of the present application;
fig. 7 is a schematic structural diagram of a touch screen information sending device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a touch screen information response device according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a touch screen information sending device according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a touch screen information response device according to an embodiment of the present application.
Detailed Description
The following description of the technical solutions in the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
The embodiment of the application provides a touch screen information sending and responding method and device, which are used for improving the touch screen response effect and improving the touch screen response speed and smoothness.
The method and the device are based on the same application, and because the principles of solving the problems by the method and the device are similar, the implementation of the device and the method can be referred to each other, and the repetition is not repeated.
The terms first, second and the like in the description and in the claims of the embodiments and in the above-described figures, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The following examples and embodiments are to be construed as illustrative only. Although the specification may refer to "an", "one", or "some" example or embodiment(s) at several points, this does not mean that each such reference is related to the same example or embodiment, nor that the feature is applicable to only a single example or embodiment. Individual features of different embodiments may also be combined to provide further embodiments. Furthermore, terms such as "comprising" and "including" should be understood not to limit the described embodiments to consist of only those features already mentioned; such examples and embodiments may also include features, structures, units, modules, etc. that are not specifically mentioned.
The technical scheme provided by the embodiment of the application can be suitable for various systems, for example, a 5G system or a wired network system.
The client referred to in the embodiments of the present application may be, for example, a terminal device, a device that provides voice and/or data connectivity to a user, a handheld device with wireless connection functionality, or other processing device connected to a wireless modem. The names of the terminal devices may also be different in different systems, for example in a 5G system, the terminal devices may be referred to as User Equipment (UE). The wireless terminal device may communicate with one or more core networks via the RAN, and may be mobile terminal devices such as mobile phones (or "cellular" phones) and computers with mobile terminal devices, e.g., portable, pocket, hand-held, computer-built-in, or vehicle-mounted mobile devices that exchange voice and/or data with the radio access network. Such as personal communication services (Personal Communication Service, PCS) phones, cordless phones, session initiation protocol (Session Initiated Protocol, SIP) phones, wireless local loop (Wireless Local Loop, WLL) stations, personal digital assistants (Personal Digital Assistant, PDAs), and the like. The wireless terminal device may also be referred to as a system, subscriber unit (subscriber unit), subscriber station (subscriber station), mobile station (mobile), remote station (remote station), access point (access point), remote terminal device (remote terminal), access terminal device (access terminal), user terminal device (user terminal), user agent (user agent), user equipment (user device), and the embodiments of the present application are not limited.
The server referred to in the embodiments of the present application may be a network device, for example, a server, which is not limited in the embodiments of the present application.
Various embodiments of the present application are described in detail below with reference to the drawings attached hereto. It should be noted that, the display sequence of the embodiments of the present application only represents the sequence of the embodiments, and does not represent the advantages or disadvantages of the technical solutions provided by the embodiments.
The traditional cloud mobile phone touch scheme is characterized in that a touch track coordinate point sequence acquired in a client is completely sent to a server without being processed, the server draws tracks, the traditional scheme is ideal in performance under the condition that the network conditions of the client and the server are good, but when the network environment is unstable and the network delay fluctuation is large, the track is obvious in performance. The original coordinate point data is divided into different IP data packets in the network transmission stage, the arrival time of the data packets can be influenced by network delay, and the time splitting of the coordinate sequence can be caused. The method is characterized in that the method is expressed on a server side, namely when a track is drawn, data is suddenly absent, operation is blocked, and user experience is poor.
In order to solve the problem of track drawing delay caused by the fact that cloud mobile phone touch data passes through an unstable network, the cloud mobile phone touch data aims to be as smooth as local touch operation. The embodiment of the application provides a cloud mobile phone touch response method based on track recognition and prediction, so that the cloud mobile phone touch is smoother and smoother, and the user experience is improved.
In order to overcome the defect that when a cloud mobile phone is in touch operation, gesture track data are transmitted through a delayed network, and then the time when the gesture track data reach a cloud mobile phone server is uneven, so that the touch track is not followed by the finger speed of a user, the embodiment of the invention aims to provide a processing method for cloud mobile phone touch smooth operation based on track prediction. In the cloud mobile phone server, if the situation of data loss caused by network delay is encountered when the track is drawn, the next touch coordinate position is predicted and calculated through the existing track identification type and the existing coordinate sequence, and the predicted coordinate is used for responding to the user operation more smoothly and smoothly.
According to the cloud mobile phone touch smooth processing method based on track recognition and prediction, when network fluctuation is large, the cloud mobile phone client can acquire the characteristics of the user touch coordinate sequence before the cloud mobile phone server. The principle of this scheme is shown in fig. 2. The specific description is as follows:
(1) And the cloud mobile phone client is provided with the track recognition module, so that the track type of the operation can be calculated in real time according to the touch track of the user.
(2) And the cloud mobile phone client preferentially transmits the identified track type, and then transmits the track coordinate data to the cloud mobile phone server through a network.
(3) And a track smoothing module is arranged in the cloud mobile phone server, and when the network delay is large and the subsequent track data is missing, the gesture track is predicted and calculated according to the track type sent by the cloud mobile phone client and the received track coordinate points.
(4) And the cloud mobile phone server draws a gesture track of the user according to the existing real coordinate data and the predicted data, and responds to the operation corresponding to the track.
The method provided in the embodiment of the present application, referring to fig. 3, specifically includes the following steps:
step one, a track recognition module is installed at a cloud mobile phone client, and the track recognition module calculates track types in real time according to touch track coordinates of a user.
For example:
when the generation of one touch is smaller than 3 coordinate points, the operation is considered as clicking operation, and track recognition is not performed.
As shown in fig. 4, when only 3 coordinate points are generated, the center coordinates of the circle where the three points are located are calculated from the trajectory coordinates (X0, Y0), (X1, Y1), (X2, Y2), and are denoted as (X0, Y0).
When the nth trace point is generated, the center coordinates are calculated by using (x 0, y 0), (xm, ym), (Xn, yn) and are marked as (Xn-2, yn-2), wherein m is (n-0)/2 rounding.
For simple calculation, the embodiment of the application only needs to know the general type of the track, and when the numerical value of the |X| or the |Y| in the center coordinates (X, Y) is 3-4 times (experience value) greater than the screen size of the mobile phone, the track recognition module considers that the track approaches to a straight line.
When the values of the |X| and the |Y| in the plurality of center coordinates (X, Y) are calculated continuously and basically unchanged, the track recognition module considers the track as an arc line.
When, during the calculation, a center coordinate (X, when the magnitude of the values of |x| and |y| in Y) and the screen size are equal to or smaller than the screen size, i.e. the center of the circle is in or near the screen, the track recognition module determines that the track is bent.
When the sign of X, Y in the center coordinates (X, Y) changes very frequently, the trajectory identification module determines that the trajectory is an irregular curve.
Step two, when the track type is given by the track identification module of the cloud mobile phone client, the client firstly sets the track type and the incidental parameters to be high priority, and sends the track type and the incidental parameters to the cloud mobile phone server, and then sends the coordinate point of the track to the cloud mobile phone server; wherein the incidental parameters, for example: for the arc track type, circle center coordinates are contained; for the reverse fold line type, the reverse fold point position is included.
Thirdly, the cloud mobile phone server records the receiving time according to the type of the track received first, and track prediction is not carried out when the clicking operation and the network condition are good and the coordinate point data can be continuously received;
and when the delay of the coordinate array occurs in the track drawing in the cloud mobile phone, for example, the coordinate point information of the response is not received beyond the preset waiting time, determining a subsequent smoothing algorithm according to the track type, and starting track coordinate point calculation.
For example, for the straight line type, a one-time expression is selected, and the position of the next coordinate point is obtained by combining the network delay time;
for the arc track type, namely the arc line type, selecting a binary one-time expression, and obtaining the position of the next coordinate point by solving the symmetry point of the existing coordinate point about the straight line passing through the circle center;
for the reverse fold line type, judging directly according to whether the data of the folding point is received or not, when the data of the folding point is not received, obtaining the position of the next coordinate point by adopting a linear algorithm, and if the data of the folding point is received, taking the previous data as a predicted value;
for more complex curves, a straight line algorithm is used, but only slightly extended by a distance, e.g. a distance of a predetermined length.
In fact, among the daily touch screen operations, the track types of the most commonly used operations by the user are: click, straight line, reverse fold line and circular arc line, the quick and complex curve is generally few, basically belongs to the mess drawing, and therefore, no excessive attention is required.
And fourthly, the cloud mobile phone server draws a user operation track according to the predicted data.
The prediction data basically accords with the actual data position through the priori track type, and the accuracy is higher, so that the actual coordinate point data which arrives later can be discarded without using.
In summary, according to the embodiment of the application, aiming at the situation that the network delay can cause the track coordinate sequence to be different from the original data in time, the processing method of the cloud mobile phone touch smooth operation based on track prediction is provided, and the track recognition module installed at the cloud mobile phone client and the track smooth module installed at the cloud mobile phone server are utilized, so that the data delay arrival caused by the network delay is reduced, and the problem of unsmooth touch of a user operating the cloud mobile phone is solved. The track recognition module is introduced to recognize common track types and then send the common track types to the server in advance, so that the accuracy of subsequent track prediction is improved; by introducing the track smoothing module, the problem of gesture operation blocking caused by network delay is solved; the communication channels in front of the cloud mobile phone client and the server are utilized, only gesture type codes are added, no additional connection channel is needed, and the implementation is simple; the user is not required to add extra equipment and extra settings, and the device is transparent to the user and has no perception in the whole process.
The technical schemes provided in the embodiments of the present application are summarized and illustrated from a single side.
In a client, referring to fig. 5, a touch screen information sending method provided in an embodiment of the present application includes:
s101, acquiring coordinate information corresponding to a touch track generated by a user aiming at touch operation of a cloud mobile phone client on a touch screen;
coordinate information corresponding to the touch track, for example: if only three coordinate points are generated in one touch operation, determining coordinate information of the three coordinate points: (x 0, y 0), (x 1, y 1), (x 2, y 2).
Alternatively, if one touch operation is less than three coordinate points, the operation of touch trajectory type recognition described below is not performed. The subsequent steps are performed only in the case where one touch operation generates three coordinate points or more.
S102, determining a touch track type according to the coordinate information;
for example, optionally, the touch trajectory type is one of the following types:
click, straight line, reverse fold line, circular arc line, irregular curve.
Wherein the irregular curve is the case of the relatively complex curve described above.
S103, reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user aiming at the cloud mobile phone client according to the touch track type.
Optionally, after the touch track type is reported to the cloud mobile phone server corresponding to the cloud mobile phone client, the method further includes:
and reporting the coordinate information to the cloud mobile phone server.
That is, in the embodiment of the present application, the touch track type of the touch track may be reported to the server first, and then the actual coordinate position information of the touch track may be reported to the server.
Of course, the actual coordinate position information of the current touch track may not be reported, and the server may predict the touch track of the current user according to the type of the touch track of the current touch track and the coordinate position information (i.e. known) from the same client acquired last time.
Optionally, the touch track type is reported to a cloud mobile phone server corresponding to the cloud mobile phone client, and the method further includes:
and reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type and the track related parameters.
Wherein the track-related parameters, i.e. the above-mentioned incidental parameters, are for example: for the type of the arc line, the circle center coordinates are contained; for the reverse fold line type, the reverse fold point position is included.
Accordingly, at the server, referring to fig. 6, a touch screen information response method provided in the embodiment of the present application includes:
s201, acquiring a touch track type reported by a cloud mobile phone client, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a touch operation of a user on a touch screen aiming at the cloud mobile phone client;
s202, predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, while acquiring the touch track type, the method further includes: acquiring track related parameters corresponding to the touch track types;
according to the touch track type, predicting the touch track of the user aiming at the cloud mobile phone client specifically comprises the following steps:
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and track related parameters corresponding to the touch track type.
Optionally, when a preset condition is met, predicting the touch track of the user for the cloud mobile phone client according to the touch track type.
Wherein the preset conditions are as follows: if the current network delay meets a preset condition, for example, if the delay exceeds a preset value, predicting the touch track of the current user aiming at the cloud mobile phone client according to the current touch track type. That is, when the network delay is serious, the touch track needs to be predicted, otherwise, the touch track is directly drawn according to the received coordinate information without prediction.
Optionally, if the touch track is predicted, the actual coordinate point data of the same touch track from the same client is received, discarding processing may be selected, or the predicted touch track may be checked according to the received actual coordinate point data of the same touch track, if the deviation exceeds the preset range value, correction processing is performed, and the corrected touch track is responded, otherwise, correction is not required, which indicates that the prediction is very accurate, and correction processing is not performed.
The following describes a device or apparatus provided in the embodiments of the present application, where explanation or illustration of the same or corresponding technical features as those described in the above method is omitted herein.
At a client, referring to fig. 7, a touch screen information sending device provided in an embodiment of the present application includes:
the coordinate acquisition module 11 is used for acquiring coordinate information corresponding to a touch track generated by a touch operation of a user on the touch screen aiming at the cloud mobile phone client;
a track recognition module 12, configured to determine a touch track type according to the coordinate information;
and the sending module 13 is configured to report the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, so that the cloud mobile phone server predicts a touch track of a user for the cloud mobile phone client according to the touch track type.
Optionally, after reporting the touch track type to the cloud mobile phone server corresponding to the cloud mobile phone client, the sending module 13 is further configured to:
and reporting the coordinate information to the cloud mobile phone server.
Optionally, the sending module 13 is further configured to, while reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client, further:
and reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type and the track related parameters.
Optionally, the touch trajectory type is one of the following types:
click, straight line, reverse fold line, circular arc line, irregular curve.
Accordingly, at the server, referring to fig. 8, a touch screen information response device provided in the embodiment of the present application includes:
the receiving module 21 is configured to obtain a touch track type reported by a cloud mobile phone client, where the touch track type is determined according to coordinate information corresponding to a touch track generated by a touch operation of a user on a touch screen for the cloud mobile phone client;
and the track smoothing module 22 is used for predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, the receiving module 21 is further configured to, while acquiring the touch track type: acquiring track related parameters corresponding to the touch track types;
according to the touch track type, predicting the touch track of the user aiming at the cloud mobile phone client specifically comprises the following steps:
the track smoothing module 22 is specifically configured to: and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and track related parameters corresponding to the touch track type.
Optionally, the track smoothing module 22 is specifically configured to: when the preset condition is met, predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation. In addition, each functional module in each embodiment of the present application may be integrated in one processing unit, or each module may exist alone physically, or two or more modules may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution, in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Embodiments of the present application provide a computing device, which may be specifically a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), and the like. The computing device may include a central processing unit (Center Processing Unit, CPU), memory, input/output devices, etc., the input devices may include a keyboard, mouse, touch screen, etc., and the output devices may include a display device, such as a liquid crystal display (Liquid Crystal Display, LCD), cathode Ray Tube (CRT), etc.
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM) and provides the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory may be used to store a program of any of the methods provided in the embodiments of the present application.
The processor is configured to execute any of the methods provided in the embodiments of the present application according to the obtained program instructions by calling the program instructions stored in the memory.
When the computing device is used as a touch screen information sending device of a client, referring to fig. 9, for example, the computing device includes:
the processor 600, configured to read the program in the memory 620, performs the following procedures:
acquiring coordinate information corresponding to a touch track generated by a user aiming at touch operation of a cloud mobile phone client on a touch screen;
determining a touch track type according to the coordinate information;
and reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client through a transceiver 610, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type.
Optionally, after the processor 600 reports the touch track type to the cloud mobile phone server corresponding to the cloud mobile phone client through the transceiver 610, the processor is further configured to:
and reporting the coordinate information to the cloud mobile phone server through a transceiver 610.
Optionally, the processor 600 is further configured to, while reporting the touch track type to a cloud mobile phone server corresponding to the cloud mobile phone client through the transceiver 610:
and reporting the track related parameters corresponding to the touch track type to the cloud mobile phone server through a transceiver 610, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type and the track related parameters.
Optionally, the touch trajectory type is one of the following types:
click, straight line, reverse fold line, circular arc line, irregular curve.
A transceiver 610 for receiving and transmitting data under the control of the processor 600.
Wherein in fig. 9, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by processor 600 and various circuits of memory represented by memory 620, linked together. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. Transceiver 610 may be a number of elements, including a transmitter and a receiver, providing a means for communicating with various other apparatus over a transmission medium. The user interface 630 may also be an interface capable of interfacing with an inscribed desired device for different user devices, including but not limited to a keypad, display, speaker, microphone, joystick, etc.
The processor 600 is responsible for managing the bus architecture and general processing, and the memory 620 may store data used by the processor 600 in performing operations.
Alternatively, the processor 600 may be a CPU (Central processing Unit), ASIC (Application Specific Integrated Circuit ), FPGA (Field-Programmable Gate Array, field programmable Gate array), or CPLD (Complex Programmable Logic Device ).
When the computing device is used as a touch screen information response device of a server, referring to fig. 10, for example, the computing device includes:
the processor 500, configured to read the program in the memory 520, performs the following procedures:
acquiring a touch track type reported by a cloud mobile phone client through a transceiver 510, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a touch operation of a user on a touch screen aiming at the cloud mobile phone client;
and predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type.
Optionally, the processor 500 is further configured to, while acquiring the touch trajectory type through the transceiver 510: acquiring track related parameters corresponding to the touch track types through a transceiver 510;
the processor 500 predicts the touch track of the user for the cloud mobile phone client according to the touch track type, and specifically includes:
and the processor 500 predicts the touch track of the user aiming at the cloud mobile phone client according to the touch track type and track related parameters corresponding to the touch track type.
Optionally, when a preset condition is met, the processor 500 predicts a touch track of the user for the cloud mobile phone client according to the touch track type.
A transceiver 510 for receiving and transmitting data under the control of the processor 500.
Wherein in fig. 10, a bus architecture may comprise any number of interconnected buses and bridges, and in particular one or more processors represented by processor 500 and various circuits of memory represented by memory 520, linked together. The bus architecture may also link together various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are well known in the art and, therefore, will not be described further herein. The bus interface provides an interface. The transceiver 510 may be a number of elements, i.e., including a transmitter and a receiver, providing a means for communicating with various other apparatus over a transmission medium. The processor 500 is responsible for managing the bus architecture and general processing, and the memory 520 may store data used by the processor 500 in performing operations.
The processor 500 may be a Central Processing Unit (CPU), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a Field programmable gate array (Field-Programmable Gate Array, FPGA), or a complex programmable logic device (Complex Programmable Logic Device, CPLD).
Embodiments of the present application also provide a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the method of any of the above embodiments. The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The present embodiments provide a computer readable storage medium for storing computer program instructions for use with an apparatus provided in the embodiments of the present application described above, which includes a program for executing any one of the methods provided in the embodiments of the present application described above. The computer readable storage medium may be a non-transitory computer readable medium.
The computer-readable storage medium can be any available medium or data storage device that can be accessed by a computer, including, but not limited to, magnetic storage (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical storage (e.g., CD, DVD, BD, HVD, etc.), and semiconductor storage (e.g., ROM, EPROM, EEPROM, nonvolatile storage (NAND FLASH), solid State Disk (SSD)), etc.
It should be understood that:
the access technology via which an entity in the communication network communicates traffic may be any suitable current or future technology, such as WLAN (wireless local access network), wiMAX (worldwide interoperability for microwave access), LTE-a, 5G, bluetooth, infrared, etc. may be used; in addition, embodiments may also apply wired technologies, e.g., IP-based access technologies, such as wired networks or fixed lines.
Embodiments suitable for implementation as software code or portions thereof and for execution using a processor or processing function are software code independent and may be specified using any known or future developed programming language, such as a high-level programming language, such as an objective-C, C, C ++, c#, java, python, javascript, other scripting languages, etc., or a low-level programming language, such as a machine language or assembler.
The implementation of the embodiments is hardware-independent and may be implemented using any known or future developed hardware technology or any hybrid thereof, such as microprocessors or CPUs (central processing units), MOS (metal oxide semiconductors), CMOS (complementary MOS), biMOS (bipolar MOS), biCMOS (bipolar CMOS), ECL (emitter coupled logic), and/or TTL (transistor-transistor logic).
Embodiments may be implemented as a single device, apparatus, unit, component, or function, or in a distributed fashion, e.g., one or more processors or processing functions may be used or shared in a process, or one or more processing segments or portions may be used and shared in a process where one physical processor or more than one physical processor may be used to implement one or more processing portions dedicated to a particular process as described.
The apparatus may be implemented by a semiconductor chip, a chipset, or a (hardware) module comprising such a chip or chipset.
Embodiments may also be implemented as any combination of hardware and software, such as an ASIC (application specific IC (integrated circuit)) component, an FPGA (field programmable gate array) or CPLD (complex programmable logic device) component, or a DSP (digital signal processor) component.
Embodiments may also be implemented as a computer program product comprising a computer usable medium having a computer readable program code embodied therein, the computer readable program code adapted to perform a process as described in the embodiments, wherein the computer usable medium may be a non-transitory medium.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.
Claims (6)
1. A touch screen information transmission method, the method comprising:
acquiring coordinate information corresponding to a touch track generated by a user aiming at touch operation of a cloud mobile phone client on a touch screen;
determining a touch track type according to the coordinate information;
setting the touch track type and track related parameters corresponding to the touch track type to be reported to a cloud mobile phone server corresponding to the cloud mobile phone client in a high priority, and then sending the coordinate information to the cloud mobile phone server, so that the cloud mobile phone server predicts the touch track of a user aiming at the cloud mobile phone client according to the touch track type and the track related parameters when determining that the waiting time waiting for receiving the coordinate information exceeds the preset time.
2. The method of claim 1, wherein the touch trajectory type is one of the following types:
click, straight line, reverse fold line, circular arc line, irregular curve.
3. A touch screen information response method, the method comprising:
acquiring a touch track type reported by a cloud mobile phone client and track related parameters corresponding to the touch track type, wherein the touch track type is determined according to coordinate information corresponding to a touch track generated by a user aiming at touch operation of the cloud mobile phone client on a touch screen;
and when the current network delay meets the preset condition, predicting the touch track of the user aiming at the cloud mobile phone client according to the touch track type and the track related parameters corresponding to the touch track type.
4. A computing device, comprising:
a memory for storing program instructions;
a processor for invoking program instructions stored in said memory and for performing the method according to any of claims 1 to 3 in accordance with the obtained program.
5. A computer program product for a computer, characterized in that it comprises software code portions for performing the steps of any of claims 1 to 3 when the product is run on the computer.
6. A computer-readable storage medium storing computer-executable instructions for causing the computer to perform the method of any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111583377.0A CN114466006B (en) | 2021-12-22 | 2021-12-22 | Touch screen information sending and responding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111583377.0A CN114466006B (en) | 2021-12-22 | 2021-12-22 | Touch screen information sending and responding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114466006A CN114466006A (en) | 2022-05-10 |
| CN114466006B true CN114466006B (en) | 2024-01-02 |
Family
ID=81406274
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111583377.0A Active CN114466006B (en) | 2021-12-22 | 2021-12-22 | Touch screen information sending and responding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114466006B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005322194A (en) * | 2004-05-06 | 2005-11-17 | Shotatsu Kagi Kofun Yugenkoshi | Touch panel type character inputting method and its control module |
| CN202422047U (en) * | 2011-07-22 | 2012-09-05 | 宸鸿科技(厦门)有限公司 | Device for detecting touch track of touch screen |
| KR20140103777A (en) * | 2013-02-19 | 2014-08-27 | 엘지전자 주식회사 | Mobile terminal and touch coordinate predicting method thereof |
| CN105975122A (en) * | 2016-04-27 | 2016-09-28 | 集怡嘉数码科技（深圳）有限公司 | Touch track compensation method and apparatus as well as terminal device |
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN108306933A (en) * | 2017-12-27 | 2018-07-20 | 杭州华为数字技术有限公司 | A kind of method, apparatus and system that the input based on desktop virtualization redirects |
| CN108919997A (en) * | 2018-06-29 | 2018-11-30 | 中国联合网络通信集团有限公司 | Improve the method and device of capacitive touch screen identification accuracy |
| WO2019172829A1 (en) * | 2018-03-08 | 2019-09-12 | Flatfrog Laboratories Ab | Touch apparatus |
| JP2020013423A (en) * | 2018-07-19 | 2020-01-23 | 吉原 歐 | All-in-one GPR card |
| CN111857457A (en) * | 2020-06-22 | 2020-10-30 | 北京百度网讯科技有限公司 | Cloud mobile phone control method and device, electronic equipment and readable storage medium |
| CN113311984A (en) * | 2020-02-27 | 2021-08-27 | 北京小米移动软件有限公司 | Touch screen track data processing method and device, mobile terminal and electronic equipment |
| WO2021190314A1 (en) * | 2020-03-25 | 2021-09-30 | 华为技术有限公司 | Sliding response control method and apparatus of touch screen, and electronic device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101799270B1 (en) * | 2010-12-29 | 2017-11-21 | 엘지전자 주식회사 | Mobile terminal and Method for recognizing touch thereof |
| US10452188B2 (en) * | 2012-01-13 | 2019-10-22 | Microsoft Technology Licensing, Llc | Predictive compensation for a latency of an input device |
| US20150153855A1 (en) * | 2013-12-03 | 2015-06-04 | Elwha Llc | Display latency compensation responsive to an indicator of an impending change in a hand-initiated movement |
| US10261685B2 (en) * | 2016-12-29 | 2019-04-16 | Google Llc | Multi-task machine learning for predicted touch interpretations |
| CN109669565B (en) * | 2017-10-17 | 2021-12-03 | 世意法（北京）半导体研发有限责任公司 | Touch motion tracking and reporting techniques for slow touch movement |
-
2021
- 2021-12-22 CN CN202111583377.0A patent/CN114466006B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005322194A (en) * | 2004-05-06 | 2005-11-17 | Shotatsu Kagi Kofun Yugenkoshi | Touch panel type character inputting method and its control module |
| CN202422047U (en) * | 2011-07-22 | 2012-09-05 | 宸鸿科技(厦门)有限公司 | Device for detecting touch track of touch screen |
| KR20140103777A (en) * | 2013-02-19 | 2014-08-27 | 엘지전자 주식회사 | Mobile terminal and touch coordinate predicting method thereof |
| CN105975122A (en) * | 2016-04-27 | 2016-09-28 | 集怡嘉数码科技（深圳）有限公司 | Touch track compensation method and apparatus as well as terminal device |
| CN107844243A (en) * | 2017-11-09 | 2018-03-27 | 新华三云计算技术有限公司 | Cloud tabletop touch implementation method and device |
| CN108306933A (en) * | 2017-12-27 | 2018-07-20 | 杭州华为数字技术有限公司 | A kind of method, apparatus and system that the input based on desktop virtualization redirects |
| WO2019172829A1 (en) * | 2018-03-08 | 2019-09-12 | Flatfrog Laboratories Ab | Touch apparatus |
| CN108919997A (en) * | 2018-06-29 | 2018-11-30 | 中国联合网络通信集团有限公司 | Improve the method and device of capacitive touch screen identification accuracy |
| JP2020013423A (en) * | 2018-07-19 | 2020-01-23 | 吉原 歐 | All-in-one GPR card |
| CN113311984A (en) * | 2020-02-27 | 2021-08-27 | 北京小米移动软件有限公司 | Touch screen track data processing method and device, mobile terminal and electronic equipment |
| WO2021190314A1 (en) * | 2020-03-25 | 2021-09-30 | 华为技术有限公司 | Sliding response control method and apparatus of touch screen, and electronic device |
| CN111857457A (en) * | 2020-06-22 | 2020-10-30 | 北京百度网讯科技有限公司 | Cloud mobile phone control method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114466006A (en) | 2022-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11166330B2 (en) | Data-stream allocation method for link aggregation and related devices | |
| US11706761B2 (en) | Information transmission method and related product | |
| US10925038B2 (en) | Method and apparatus for determining time domain resource mapped by reference signal | |
| CN108696463B (en) | Downlink control channel detection method, terminal and base station | |
| US11665049B2 (en) | Reference signal indication method, network device and terminal device | |
| EP3637665A1 (en) | Data transmission method, sending device and receiving device | |
| WO2021175146A1 (en) | Frequency compensation method and apparatus, network-side device, terminal, and storage medium | |
| US20170290054A1 (en) | Information transmission method and apparatus in cell | |
| CN109547335B (en) | Session message processing method and device | |
| CN105389175A (en) | Application program sharing method and mobile terminal | |
| CN105100150B (en) | Cloud desktop migration method and device and distributed cloud desktop system | |
| US20230025780A1 (en) | Resource determining method and device | |
| CN107154835B (en) | Data sending method and device | |
| CN106776039A (en) | A kind of data processing method and device | |
| TWI712273B (en) | Method, device and small base station for eliminating adjacent channel interference | |
| US11750697B2 (en) | Message transmission method and related devices | |
| WO2021196880A1 (en) | Harq feedback method, terminal, and base station | |
| CN109287139B (en) | Data transmission method and device | |
| CN114466006B (en) | Touch screen information sending and responding method and device | |
| CN110933758B (en) | Interference coordination method and device, and base station | |
| WO2020048426A1 (en) | Data transmission method and apparatus, and device and storage medium | |
| CN108811162B (en) | System information transmission method, terminal and base station | |
| EP3518513A1 (en) | Streaming data acquisition method, device, and system | |
| CN112073308A (en) | Information pushing method, device, equipment and computer readable storage medium | |
| CN112530435A (en) | Data transmission method, device and system, readable storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |