WO2018161471A1 - 一种跟手性补偿方法、装置及终端设备 - Google Patents

一种跟手性补偿方法、装置及终端设备 Download PDF

Info

Publication number
WO2018161471A1
WO2018161471A1 PCT/CN2017/090358 CN2017090358W WO2018161471A1 WO 2018161471 A1 WO2018161471 A1 WO 2018161471A1 CN 2017090358 W CN2017090358 W CN 2017090358W WO 2018161471 A1 WO2018161471 A1 WO 2018161471A1
Authority
WO
WIPO (PCT)
Prior art keywords
distance
finger
period
image
sampling period
Prior art date
Application number
PCT/CN2017/090358
Other languages
English (en)
French (fr)
Inventor
李付生
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201780022691.7A priority Critical patent/CN108885536B/zh
Publication of WO2018161471A1 publication Critical patent/WO2018161471A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present application relates to the field of touch screens, and in particular, to a chiral compensation method, device, and terminal device.
  • a slide, drag, etc. operation needs to go through the steps of touch screen hardware, system software, graphics processing, display hardware, etc. to finally display to the user's eyes.
  • the duration of this process is affected by various factors such as hardware limitations, so the touch screen device interface graphics
  • the change is always delayed by the change of the finger.
  • the existing technical solution is to shorten the response time of the system as much as possible to improve the hand, such as shortening the time of the touch event, or reducing the time of the interface drawing.
  • hardware processing must take time, so the processing cycle of the entire process is shortened in real time.
  • the movement of the interface is always behind the movement of the finger, or the ideal hand-to-hand experience is not achieved.
  • the embodiment of the present application provides a chirality compensation method, device, and terminal device, which can improve the hand-to-hand experience of the device.
  • a first aspect of the embodiments of the present application provides a chiral compensation method, the method comprising:
  • Determining the optimizable hand distance in the current refresh period Determining the optimizable hand distance in the current refresh period, determining the distance to be moved of the image in the current refresh period according to the distance between the adjustable hand and the distance of the finger movement in the current refresh period, and then performing image processing on the image to be moved distance And display.
  • the embodiment of the present application can predict the optimizable hand distance in the current refresh period, and adjust the image moving distance when the animated image is drawn according to the optimized hand distance. Thereby, the display of the image can be matched with the movement of the finger as much as possible, and the hand-feeling experience of the device is improved.
  • the distance that the finger moves during the processing of the sampled data is taken as an optimizable hand-to-hand distance.
  • the method for determining the optimal hand distance in the current refresh period may be: optimizing the hand distance according to the distance of the finger movement in the first sampling period and the time calculation of the image processing, and the first sampling period is the last in the current refresh period. One sampling period.
  • the process of calculating the optimizable hand distance in the first sampling period according to the distance of the finger movement in the first sampling period and the time of the image processing may be: first obtaining the speed of the previous sampling period of the first sampling period According to the speed of the previous sampling period of the first sampling period, the distance of the finger movement in the first sampling period, and the end speed and acceleration of the first sampling period by using the frequency calculation; and then the speed and acceleration according to the end of the first sampling period And the image processing time is calculated to obtain an optimized hand distance in the first sampling period.
  • the distance to be moved of the image is the sum of the distance between the adjustable hand distance and the finger movement in the current refresh period.
  • the shortening or shortening can optimize the hand distance, and the subsequent frames of the image are optimized.
  • the distance to be moved of the image is the difference between the optimized hand distance and the optimized hand distance in the previous refresh period, plus the finger in the current refresh period. The distance moved.
  • the finger when detecting that the finger stops moving and the finger leaves the touch screen, the finger is removed from the end of the touch screen; when the image display reaches the end point, the distance to be moved by the image is calculated according to the preset acceleration, and the image is processed and displayed.
  • the image can be continuously generated according to the inertia until the speed is reduced to 0, so that the drawing of the animated image can be more closely matched to the real movement of the finger, and the chiral experience can be improved.
  • the acquiring finger stays at the end of the touch screen; in the current period, when the image display reaches the end of the touch screen, the interface refresh is stopped.
  • the interface refresh can be stopped in time, and the image is matched with the finger to improve the chiral experience.
  • the embodiment of the present application further provides a chirality compensation device, which specifically implements the function corresponding to the chirality compensation method provided by the above first aspect.
  • the functions may be implemented by hardware or by executing corresponding software programs through hardware.
  • the hardware and software include one or more unit modules corresponding to the functions described above, which may be software and/or hardware.
  • the chiral compensation device includes:
  • a first determining unit configured to determine an optimizable heel distance within a current refresh period
  • a second determining unit configured to determine a distance to be moved of the image in the current refresh period according to the distance that can be optimized and the distance of the finger movement in the current refresh period;
  • a processing unit configured to perform image processing and display according to the distance to be moved of the image.
  • the chirality compensation device is a terminal device, and the terminal device includes:
  • the memory is used to store program code, and the processor calls the program code in the memory to perform the following operations:
  • Determining the optimal hand distance in the current refresh period determining the distance to be moved of the image in the current refresh period according to the distance between the adjustable hand and the distance of the finger movement in the current refresh period; performing image processing and displaying according to the distance to be moved of the image .
  • Yet another aspect of the present application provides a computer readable storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the method of the first aspect described above.
  • Yet another aspect of the present application provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the first aspect described above.
  • the embodiment of the present application can predict the distance that the finger moves during the image processing process, and uses it as an optimizable hand-to-hand distance.
  • the image correction is performed when the animated image is drawn. .
  • the display of the image can be matched with the movement of the finger as much as possible, and the hand-feeling experience of the device is improved.
  • FIG. 1 is a schematic diagram of a chiral operation scenario in an embodiment of the present application.
  • FIG. 2 is a time-domain diagram of a screen moving with a finger in an embodiment of the present application
  • FIG. 3 is a schematic diagram of response limits of hardware and software of a device in a chiral processing according to an embodiment of the present application
  • FIG. 5 is a schematic diagram of a sampling period and a refresh period in the embodiment of the present application.
  • FIG. 6 is another schematic diagram of a sampling period and a refresh period in the embodiment of the present application.
  • FIG. 7 is a schematic diagram of a position where a finger starts, a final position, and a predicted position to be moved in the embodiment of the present application;
  • FIG. 8 is a time-domain diagram of a screen moving with a finger after the chiral compensation in the embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of functional modules of a chirality compensation device according to an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of hardware of a terminal device in an embodiment of the present application.
  • the method in the embodiment of the present application is applied to various terminal devices having a touch screen, including: a handheld device, an in-vehicle device, a wearable device, a computing device, and various forms of user equipment (User Equipment, UE), such as a mobile phone or a tablet. Computer and other equipment.
  • UE User Equipment
  • the user experience of the touch screen mainly includes the smooth operation of the touch screen.
  • the performance of the image displayed on the screen following the movement of the finger ie, the chirality
  • the time domain map of the image displayed on the screen along with the finger movement may be as shown in FIG. 2.
  • the screen image is always displayed during the entire process from the start of the finger to the end of the finger. The movement of the finger is delayed by 119.44ms. Therefore, the heel experience will directly affect the user's operational fluency.
  • the touch screen controller scans the touch screen with a certain scanning frequency to collect the user's touch position data (which may be touch point coordinates), and then sends the collected touch position data to the application processor of the terminal device.
  • the application processor then performs image processing based on the touch location data and finally displays the image on the screen interface.
  • touch scan sample the user's touch position data, and implement it through software driver.
  • the application responds to the touch screen event, including the sliding speed judgment. It is implemented by the application (application, APP) of the terminal device.
  • LCD liquid crystal display
  • Time period characteristics S1 touch screen wake up and report interrupt T1 Evenly distributed (x0, x1) S2, touch scan T2 Evenly distributed (x2, x3) S3, handling and distribution of touch screen events T3 Fixed cycle S4, application response touch screen event T4 Fixed cycle S5, application interface layout T5 Fixed cycle S6, image rendering T6 Normal distribution (a0, a1) S7, image synthesis T7 Normal distribution (a2, a3) S8, LCD refresh T8 Evenly distributed (x4, x5)
  • the embodiment of the present application calculates the optimizable chiral distance for each LCD refresh according to the eight processing procedures shown in Table 1 and the chiral response limit time corresponding to the eight processing procedures.
  • the sampling frequency of the touch screen is greater than the refresh frequency of the LCD.
  • the sampling frequency of the touch screen may be 120 Hz
  • the frequency of the LCD refresh may be 60 Hz. Therefore, it is possible that the LCD refreshes after a plurality of sampling periods, and the touch screen transmits the touch position data collected in each sampling period to the application processor, and the application processor executes the s3 to s7 shown in FIG. The process processes the image to obtain a composite image corresponding to each sampling period.
  • the LCD refresh is performed, an image synthesized in the most recent sampling period in the refresh period is presented on the screen.
  • the embodiment of the present application predicts the distance that the finger moves during the image processing process of s3 to s7 shown in FIG. 3, and uses it as an optimizable hand distance so that the moving distance of the image can be performed when the LCD is refreshed. Compensation or adjustment to match the display of the image to the movement of the finger as much as possible.
  • the optimizable hand distance within the current refresh period is an optimizable hand distance within a certain sampling period (first sampling period) within the current refresh period.
  • the optimizable follower distance within a certain sampling period in the current refresh period is actually the distance that the finger moves within the time period during which the data within the sampling period is processed (the period from s3 to s7 shown in FIG. 3).
  • a sampling period in the current refresh period may actually refer to the last completed sampling period in the current refresh period, where the completed sampling period refers to the sampling period in which the sampling has ended.
  • every two sampling periods correspond to one refresh period.
  • the first sampling period in a refresh period is the second sampling period in the refresh period.
  • the sampling frequency of the touch screen is 100 Hz (1 ms refresh once) and the LCD refresh frequency is 60 Hz (1.67 ms refresh once)
  • the first refresh period when the finger starts moving that is, 0 ms.
  • the first sampling period in the first refresh period is the sampling period corresponding to 0 ms to 1 ms in the figure.
  • the first sampling period in the refresh period is a sampling period corresponding from 2 ms to 3 ms.
  • the method for determining the optimal hand distance in the current refresh period may be specifically: calculating the optimizable hand distance according to the distance of the finger movement in the first sampling period in the current refresh period and the time of the image processing.
  • the distance that the finger moves in each sampling period can be calculated according to the touch position data (which can be the touch point coordinates) collected by the touch screen.
  • the image processing time refers to the time at which the images are processed by s3 to s7 shown in FIG. 3, that is, the time from t3 to t7.
  • P1 is the finger starting position of the first sampling period
  • P2 is the final position of the finger of the first sampling period. According to the distance between P1 and P2, the synthesis corresponding to the period of P1 to P2 is predicted. When the image is presented on the screen interface, the finger will move to position P3.
  • the specific method for predicting the optimal hand distance in the first sampling period is: obtaining the speed of the last sampling period of the first sampling period ( It may be the end speed or the average speed), according to the speed of the last sampling period of the first sampling period, the distance moved by the finger in the first sampling period, and the end speed and acceleration of the first sampling period by using the frequency, Then, according to the end speed, acceleration and image processing time of the first sampling period, the optimized hand distance in the first sampling period is calculated.
  • the velocity V 0 of the previous sampling period of the first sampling period is first obtained, and then according to the physics formula.
  • the acceleration a of the finger movement during the first sampling period is calculated, wherein S 1 is the distance the finger moves in the first sampling period, and t 1 is the sampling frequency.
  • the method for obtaining the velocity V 0 of the last sampling period of the first sampling period may be: calculating the ending velocity of the last sampling period of the first sampling period according to the distance and the sampling frequency of the first sampling period; or directly according to The distance moved by the finger in the last sampling period of the first sampling period is divided by the sampling frequency to obtain its average speed, and the average speed is directly used as the ending speed of the sampling period.
  • the first sampling period in the embodiment of the present application is the last one in the current refresh period.
  • the completed sampling period but in practical applications, the optimized tracking distance corresponding to each sampling period can be calculated according to the above method.
  • the LCD refresh is performed, only the image synthesized using the most recent sampling period in the refresh period is presented on the screen, and therefore, only the optimized basis distance corresponding to the most recent sampling period in the refresh period is used.
  • the distance that the finger moves in the current refresh period may be the distance that the finger actually moves during the current refresh period, or may be the sum of the distances of the finger movements of the completed sampling period in the current refresh period.
  • the to-be-moved distance of the image is the sum of the optimizable hand distance in the first refresh period and the distance moved by the finger in the refresh period.
  • the distance to be moved of the image corresponding to the cycle is: the difference between the optimal hand-to-hand distance of the refresh cycle and the optimizable hand-over distance in the previous refresh cycle, plus the distance the finger moves during the current refresh cycle.
  • the difference between the optimizable hand distance of the current refresh cycle and the optimizable hand distance in the last refresh cycle is actually adjusted according to the current finger movement speed to optimize the hand distance to optimize the follow-up of the animation. frame. It includes the following two scenarios:
  • the hand distance that needs to be raised during the current refresh is calculated. That is, the optimal hand-to-hand distance in the current refresh cycle is calculated, and the optimum hand-to-hand distance can be optimized in combination with the previous refresh cycle to calculate the actual adjustable hand distance after the speed increase.
  • the difference between the optimizable hand-over distance of the current refresh cycle calculated in this scenario and the optimizable hand-over distance in the previous refresh cycle is a positive number.
  • the hand distance that needs to be reduced at the time of this refresh is calculated. That is, the optimal hand-to-hand distance in the current refresh cycle is calculated, and the optimal hand-to-hand distance can be optimized in combination with the previous refresh cycle to calculate the actually reduced hand-to-hand distance after the current speed reduction.
  • the difference between the optimizable hand-over distance of the current refresh cycle calculated in this scenario and the optimizable hand-over distance in the previous refresh cycle is a negative number.
  • the application processor For each refresh cycle, after obtaining the image to be moved distance in the cycle, the application processor performs image processing and display according to the image to be moved distance in the refresh cycle during the process of processing the image, and finally The composite image is rendered on the screen.
  • the finger when detecting that the finger stops moving, and the finger leaves the touch screen, the finger is taken away from the end of the touch screen, and the coordinate of the finger leaving is the end point.
  • the calculation of the optimized distance is stopped, according to the system native.
  • the animation curve continues to move the interface. That is, according to the preset acceleration deceleration, the distance of the image to be moved for each refresh period is calculated, and then the image is processed and displayed until the speed is reduced to 0, and the refresh interface is stopped.
  • the acquiring finger stays at the end of the touch screen, and in the current period, when the image display reaches the end of the touch screen, the refreshing of the interface is stopped.
  • the time domain map of the image displayed on the screen as the finger moves is as shown in FIG. 8 .
  • the displacement of the finger movement is about 7 mm from the first refresh period (about 117 ms) from the start of the finger movement, and the displacement of the image movement before optimization. It is about 1mm, and the moving displacement of the image lags behind the finger movement by 6mm.
  • the displacement of the image is about 5 mm
  • the displacement of the finger is about 2 mm, which is 6 mm behind the movement of the finger.
  • the chiral experience has greatly improved.
  • the distance that the finger moves during the image processing process can be predicted, and is used as the optimizable hand-to-hand distance.
  • the image correction is performed when the animated image is drawn. Thereby, the display of the image can be matched with the movement of the finger as much as possible, and the hand-feeling experience of the device is improved.
  • the distance between the hand and the hand can be optimized to optimize the subsequent frames of the animation.
  • the distance between the hand and the hand can be optimized, and the subsequent frame of the animation is optimized, so that the hand-tracking optimization of the animated image can be performed according to the sliding speed in real time, and the hand-feeling experience is improved.
  • the refresh of the image can be paused to stop the animation, or the image can be continuously generated according to the inertia until the speed is reduced to zero.
  • the animation image can be drawn more closely to the real movement of the finger, and the chiral experience is improved.
  • a first determining unit 901 configured to determine an optimizable hand distance within a current refresh period
  • a second determining unit 902 configured to determine a distance to be moved of the image in the current refresh period according to the distance that can be optimized and the distance of the finger movement in the current refresh period;
  • the processing unit 903 is configured to perform image processing and display according to the distance to be moved of the image.
  • the first determining unit 901 is specifically configured to optimize the hand distance according to the distance of the finger movement in the first sampling period and the time calculation of the image processing, where the first sampling period is current The last sample period in the refresh cycle.
  • the first determining unit 901 is specifically configured to obtain a speed of a previous sampling period of the first sampling period; and the first sampling according to the speed of the previous sampling period of the first sampling period.
  • the distance moved by the finger during the period, and the end speed and acceleration of the first sampling period are calculated by using the frequency; and the optimal tracking distance in the first sampling period is calculated according to the end speed, acceleration and image processing time of the first sampling period.
  • the second determining unit 902 is configured to: when the current refresh period is the first refresh period, determine that the to-be-moved distance of the image is an optimizable heel distance and a current refresh period. The sum of the distances the fingers move.
  • the second determining unit 902 is specifically configured to: when the current refresh period is not the first refresh period, determine an optimizeable hand distance and an optimizable hand in the last refresh period. The difference between the distances, plus the distance the finger moves during the current refresh cycle, optimizes the distance between the hands.
  • the processing unit 903 is further configured to: when detecting that the finger stops moving, and the finger leaves the touch screen, acquire an end point of the finger leaving the touch screen; when the image display reaches the end point, according to the preset The acceleration calculates the distance the image is to be moved, and performs image processing and display.
  • the processing unit 903 is further configured to: when detecting that the finger stops moving, and the finger stays on the touch screen, acquire the finger to stay at the end of the touch screen; during the current period, when the image display arrives When the end of the touch screen is stopped, the interface refresh is stopped.
  • the chiral compensation device shown in FIG. 9 can be implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD) in practical applications.
  • the PLD may be a complex programmable logic device (CPLD), a Field-Programmable Gate Array (FPGA), a general array logic (GAL), or any combination thereof.
  • CPLD complex programmable logic device
  • FPGA Field-Programmable Gate Array
  • GAL general array logic
  • the service authorization device shown in FIG. 9 may be a terminal device in an actual application.
  • the terminal device may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), an in-vehicle computer, a wearable device, and the like. :
  • FIG. 10 is a block diagram showing a partial structure of a mobile phone related to a terminal device provided by an embodiment of the present application. It will be understood by those skilled in the art that the structure of the handset shown in FIG. 10 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different component arrangements.
  • the input unit 1030 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset.
  • the input unit 1030 may include a touch screen 1031 (or a touch panel) and other input devices 1032.
  • the touch screen 1031 can collect touch operations on or near the user and drive the corresponding connection device according to a preset program.
  • the touch screen 1031 further includes two parts: a touch detection device and a touch screen controller.
  • the touch detecting device is configured to detect a touch orientation of the user, and detect a signal brought by the touch operation, and transmit a signal to the touch controller;
  • the touch screen controller receives the touch information from the touch point detecting device, and converts the touch information into a contact
  • the coordinates are sent to the processor 1080 and can receive commands from the processor 1080 and execute them.
  • the display unit 1040 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone.
  • the display unit 1040 may include a display panel 1041.
  • the display panel 1041 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the touch screen 1031 may cover the display panel 1041, and when the touch screen 1031 detects a touch operation on or near it, transmits to the processor 1080 to determine the type of the touch event, and then the processor 1080 displays the panel according to the type of the touch event. A corresponding visual output is provided on the 1041.
  • touch panel 1031 and the display panel 1041 are used as two independent components to implement the input and input functions of the mobile phone in FIG. 10, in some embodiments, the touch panel 1031 may be integrated with the display panel 1041. Realize the input and output functions of the phone.
  • the memory 1020 can be used to store software programs and modules, and the processor 1080 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 1020.
  • the memory 1020 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.).
  • memory 1020 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the mobile phone may also include at least one type of sensor 1050, such as a light sensor, a motion sensor, and other sensors, which are not described in detail herein.
  • sensor 1050 such as a light sensor, a motion sensor, and other sensors, which are not described in detail herein.
  • the RF circuit 1010 (ie, the transceiver) in the embodiment of the present application can be used for receiving and transmitting signals during the transmission and reception of information or during a call, and in particular, after receiving the downlink information of the base station, the processor 1080 processes; The data for designing the uplink is sent to the base station.
  • Audio circuit 1060 can provide an audio interface between the user and the handset.
  • the mobile phone through the WiFi module 1070 can help users to send and receive e-mail, browse the web and access streaming media, etc. It provides users with wireless broadband Internet access.
  • FIG. 10 shows the WiFi module 1070, it can be understood that it does not belong to the essential configuration of the mobile phone, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 1080 is the control center of the handset, which connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 1020, and invoking data stored in the memory 1020, The phone's various functions and processing data, so that the overall monitoring of the phone. Specifically, the processor 1080 performs all or part of the steps in the foregoing method embodiments (the embodiments shown in FIG. 1 to FIG. 8 ), and details are not described herein.
  • the mobile phone also includes a power source 1090 (such as a battery) that supplies power to various components.
  • a power source 1090 such as a battery
  • the power source can be logically coupled to the processor 1080 through a power management system to manage functions such as charging, discharging, and power management through the power management system.
  • the mobile phone may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transfer to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL), or wireless (eg, infrared, wireless, microwave, etc.).
  • wire eg, coaxial cable, fiber optic, digital subscriber line (DSL), or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer readable storage medium can be any available media that can be stored by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (such as a Solid State Disk (SSD)) or the like.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present application can be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a computer device (which may be a personal computer, a server, Either a network device or the like) performs all or part of the steps of the method described in the various embodiments of the present application.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种跟手性补偿方法、装置及终端设备，能够提升设备的跟手性体验。本申请实施例的方法包括：确定当前刷新周期内的可优化跟手距离，根据可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离，再所述图像的待移动距离进行图像处理和显示。本申请实施例能够预测当前刷新周期内的可优化的跟手距离，根据可优化跟手距离，在动画图像绘制时对图像移动距离进行调整。从而可以使图像的显示尽可能的与手指的移动吻合，提升设备的跟手性体验。

Description

一种跟手性补偿方法、装置及终端设备
本申请要求于2017年3月7日提交中国专利局、申请号为201710132119.8、发明名称为“一种提升跟手体验的方法和设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及触摸屏领域，尤其涉及一种跟手性补偿方法、装置及终端设备。
背景技术
随着触屏设备的普及，滑动、拖动等操作成为人机交互的主要方式。在滑动或拖动的过程中，触屏设备的界面跟随手指的动作变化的跟手性成为影响用户体验的重要指标。
一次滑动、拖动等操作需要经过触屏硬件、系统软件、图形处理、显示硬件等步骤才能最终显示到用户眼前，这个过程的时长受硬件限制等各种因素的影响，所以触屏设备界面图形的变化总是延迟于手指的变化。
现有的技术方案是尽量缩短系统的响应时间来提升跟手性，例如缩短触屏事件传递的时间，或减少界面绘制的时间。但是硬件处理必然是需要时间的，所以即时缩短整个流程的处理周期，界面的移动总是要落后手指的移动，还是达不到理想的跟手性体验。
发明内容
本申请实施例提供了一种跟手性补偿方法、装置及终端设备，能够提升设备的跟手性体验。
本申请实施例第一方面提供了一种跟手性补偿方法，该方法包括：
确定当前刷新周期内的可优化跟手距离，根据可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离，再所述图像的待移动距离进行图像处理和显示。
本申请实施例能够预测当前刷新周期内的可优化的跟手距离，根据可优化跟手距离，在动画图像绘制时对图像移动距离进行调整。从而可以使图像的显示尽可能的与手指的移动吻合，提升设备的跟手性体验。
具体的，本申请实施例中是将对采样的数据进处理过程中手指移动的距离作为可优化的跟手距离。确定当前刷新周期内的可优化跟手距离的方法可以是：根据第一采样周期内手指移动的距离，以及图像处理的时间计算可优化跟手距离，第一采样周期为当前刷新周期内的最后一个采样周期。
可选的，根据第一采样周期内手指移动的距离，以及图像处理的时间计算第一采样周期内的可优化跟手距离的过程可以是：先获得第一采样周期的上一个采样周期的速度；根据第一采样周期的上一个采样周期的速度，第一采样周期内手指移动的距离，以及采用频率计算得到第一采样周期的末速度及加速度；再根据第一采样周期的末速度、加速度以及图像处理时间计算得到第一采样周期内的可优化跟手距离。
进一步，当当前刷新周期为第一次刷新周期时，图像的待移动距离为可优化跟手距离与当前刷新周期内手指移动的距离之和。
进一步，在后续的刷新周期中，当手指的滑动速度变大或变小时，根据最新速度，加大或缩短可优化跟手距离，优化图像的后续帧。具体可以是：当当前刷新周期不是第一次刷新周期时，图像的待移动距离为可优化跟手距离与上一次刷新周期内的可优化跟手距离之差，再加上当前刷新周期内手指移动的距离。
可选的，当检测到手指停止移动，且手指离开触摸屏时，获取手指离开触摸屏的终点；当图像显示到达终点时，根据预设的加速度计算图像待移动的距离，进行图像的处理和显示。如此，能够根据惯性继续生成图像直至速度减为0，从而能够使动画图像的绘制更贴合手指的真实移动，提升跟手性体验。
可选的，当检测到手指停止移动，且手指停留在触摸屏时，获取手指停留在触摸屏的终点；在当前周期内，当图像显示到达触摸屏的终点时，停止界面刷新。如此，当手指停止移动且停留在触摸屏时，能够及时停止界面刷新，保持图像与手指相吻合，提升跟手性体验。
第二方面，本申请实施例还提供一种跟手性补偿装置，具体实现对应于上述第一方面提供的跟手性补偿方法的功能。所述功能可以通过硬件实现，也可以通过硬件执行相应的软件程序实现。硬件和软件包括一个或多个与上述功能相对应的单元模块，所述单元模块可以是软件和/或硬件。
一种可能的设计中，所述跟手性补偿装置包括：
第一确定单元，用于确定当前刷新周期内的可优化跟手距离；
第二确定单元，用于根据可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；
处理单元，用于根据图像的待移动距离进行图像处理和显示。
一种可能的设计中，所述跟手性补偿装置为终端设备，该终端设备包括：
相互连接的收发器、处理器及存储器；
存储器用于存储程序代码，处理器调用存储器中的程序代码，以执行以下操作：
确定当前刷新周期内的可优化跟手距离；根据可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；根据图像的待移动距离进行图像处理和显示。
本申请的又一方面提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机执行上述第一方面所述的方法。
本申请的又一方面提供了一种包含指令的计算机程序产品，当其在计算机上运行时，使得计算机执行上述第一方面所述的方法。
从以上技术方案可以看出，本申请实施例能够预测在图像处理过程中手指移动的距离，将其作为可优化的跟手距离，根据可优化跟手距离，在动画图像绘制时，进行图像修正。从而可以使图像的显示尽可能的与手指的移动吻合，提升设备的跟手性体验。
附图说明
图1为本申请实施例中的跟手性操作场景示意图；
图2为本申请实施例中的屏幕随着手指移动的时域图；
图3为本申请实施例中设备的硬件和软件在跟手性处理中的响应极限示意图；
图4为本申请实施例中的一种跟手性补偿方法的流程图；
图5为本申请实施例中的采样周期与刷新周期的一种示意图；
图6为本申请实施例中的采样周期与刷新周期的另一种示意图；
图7为本申请实施例中手指起始位置、最终位置与预测的将移动到的位置示意图；
图8为本申请实施例中的跟手性补偿后屏幕随着手指移动的时域图；
图9为本申请实施例中的跟手性补偿装置的功能模块结构示意图；
图10为本申请实施例中的终端设备的硬件结构示意图。
具体实施方式
以下结合附图对本申请实施例进行进一步详细说明。
本申请实施例中的方法应用于各种具有触摸屏的终端设备，包括：手持设备、车载设备、可穿戴设备、计算设备以及各种形式的用户设备(User Equipment，UE)，例如：手机、平板电脑等设备。
触摸屏的用户体验主要包括触摸屏的操作流畅性。在用户在触摸屏上进行滑动或拖动操作的过程中，屏幕上显示的图像跟随手指的动作变化的性能(即跟手性)是用户操作流畅性的一种体现。如图1所示，在滑动或拖动过程中，会出现图像滞后于手指的滑动的情况。在此种情况下，屏幕上显示的图像随着手指移动的时域图可以是如图2所示，由图可知，从手指开始移动直到手指结束的整个过程中，屏幕图像的显示总是比手指的移动滞后119.44ms。因此，跟手性体验会直接影响用户的操作流畅性。
触摸屏在工作时，触摸屏控制器会以一定的扫描频率对触摸屏进行扫描，以采集用户的触摸位置数据(可以是触摸点坐标)，再将采集的触摸位置数据发送至终端设备的应用处理器，应用处理器再根据触摸位置数据进行图像处理，并最终将图像显示在屏幕界面上。
如图3所示，从触摸屏采集触摸位置数据到将图像显示在屏幕界面上，需要经过以下几个处理过程：
s1、触屏唤醒和上报中断，通过触摸屏硬件实现。
s2、触控扫描：对用户的触摸位置数据进行采样，通过软件驱动实现。
s3、触屏事件的处理和分发，即触控行为判断。通过终端设备的操作系统实现。
s4、应用响应触屏事件，包括滑动速度判断。通过终端设备的应用程序(application，APP)实现。
s5、应用界面布局，通过终端设备的应用程序实现。
s6、界面渲染，通过显示系统软件实现。
s7、界面合成，通过显示系统软件实现。
s8、液晶显示屏(liquid crystal display，LCD)刷新，以使得显示屏呈现图像，通过LCD 硬件实现。
在以上8个处理过程中，各过程对应的跟手性响应极限时间分别为：t1、t2、t3、t4、t5、t6、t7、t8，各个时间段的特性如表1所示：
表1
处理过程 时间段 时间段的特性
s1、触屏唤醒和上报中断 t1 均匀分布(x0,x1)
s2、触控扫描 t2 均匀分布(x2,x3)
s3、触屏事件的处理和分发 t3 固定周期
s4、应用响应触屏事件 t4 固定周期
s5、应用界面布局 t5 固定周期
s6、图像渲染 t6 正态分布(a0,a1)
s7、图像合成 t7 正态分布(a2,a3)
s8、LCD刷新 t8 均匀分布(x4,x5)
本申请实施例根据表1所示的8个处理过程，以及这8个处理过程对应的跟手性响应极限时间，计算每一次LCD刷新时的可优化跟手性距离。
一般的，触摸屏的采样频率大于LCD刷新的频率，例如：触摸屏的采样频率可以为120Hz，LCD刷新的频率可以为60Hz。因此，有可能是多个采样周期后，LCD才刷新一次，触摸屏在将每个采样周期采集的触摸位置数据发送给应用处理器后，应用处理器都会执行图3中所示的s3至s7的过程对图像进行处理，以得到每个采样周期对应的合成图像。在进行LCD刷新时，是将该刷新周期内最近一个采样周期合成的图像呈现在屏幕上。
对于每个采样周期，当前采样周期内采集到的仅是图3中所示的s1至s2的时间内手指移动的触摸位置数据，在对该采样周期内的触摸位置数据进行图3中所示的s3至s7的处理时，手指仍然在移动。因此，若在LCD刷新时呈现该采样周期对应的合成图像时，呈现的合成图像已经滞后于手指实际所在的位置。
本申请实施例是预测在图3中所示的s3至s7的图像处理过程中手指移动的距离，将其作为可优化的跟手距离，以使得在LCD刷新时，能对图像的移动距离进行补偿或调整，使图像的显示能够尽可能的与手指的移动吻合。
下面结合图4对本申请实施例中的跟手性补偿方法进行介绍。
401、确定当前刷新周期内的可优化跟手距离；
因为在进行LCD刷新时，是将该刷新周期内最近一个采样周期合成的图像呈现在屏幕上。因此，当前刷新周期内的可优化跟手距离是当前刷新周期内的某一个采样周期(第一采样周期)内的可优化跟手距离。
当前刷新周期内某一个采样周期内的可优化跟手距离实际是：在处理该采样周期内的数据的时间段内(图3所示的s3至s7的时间段)手指移动的距离。
当前刷新周期内的某一个采样周期实际可以是指当前刷新周期内的最后一个已完成的采样周期，此处的已完成的采样周期是指采样已经结束的采样周期。
例如：如图5所示，当触摸屏的采样频率为120Hz，LCD刷新的频率为60Hz时，刚 好每两个采样周期对应一个刷新周期，此时，某刷新周期中的第一采样周期为该刷新周期中的第二个采样周期。
又例如：如图6所示，当触摸屏的采样频率为100Hz(1ms刷新一次)，LCD刷新的频率为60Hz(1.67ms刷新一次)时，在手指开始移动的第1个刷新周期内，即0ms至1.67ms内，只有一个已经完成的采样周期和一个正在采样的采样周期，则在第1个刷新周期内的第一采样周期为图中的0ms至1ms对应的采样周期。在第2个刷新周期内，即1.67ms至3.34ms内，有两个已完成的采样周期，分别是从1ms至2ms对应的采样周期和从2ms至3ms对应的采样周期，则在第2个刷新周期内的第一采样周期为从2ms至3ms对应的采样周期。
确定当前刷新周期内的可优化跟手距离的方法具体可以是：根据当前刷新周期内的第一采样周期内手指移动的距离，以及图像处理的时间计算所述可优化跟手距离。其中，每一个采样周期内手指移动的距离可以根据触摸屏采集到的触摸位置数据(可以是触摸点坐标)计算得到。图像处理时间是指图3中所示的s3至s7对图像进行处理的时间，也即t3至t7的时间。
如图7所示，P1时刻为第一采样周期的手指起始位置，P2时刻为第一采样周期的手指最终位置，根据P1至P2之间的距离，预测在将P1至P2周期对应的合成图像呈现在屏幕界面时，手指将移动到的位置P3。
可选的，根据第一采样周期内手指移动的距离，以及图像处理的时间预测第一采样周期内的可优化跟手距离的具体方法为：获得第一采样周期的上一个采样周期的速度(可以是末速度，也可以是平均速度)，根据第一采样周期的上一个采样周期的速度，第一采样周期内手指移动的距离，以及采用频率计算出第一采样周期的末速度及加速度，再根据第一采样周期的末速度、加速度以及图像处理时间计算得到第一采样周期内的可优化跟手距离。
可以是先获取第一采样周期的上一个采样周期的速度V0，再根据物理学公式
Figure PCTCN2017090358-appb-000001
计算第一采样周期内手指移动的加速度a，其中，S1是第一采样周期内手指移动的距离，t1是采样频率。获取第一采样周期的上一个采样周期的速度V0的方法具体可以是：根据前几个采样周期的距离和采样频率计算出第一采样周期的上一个采样周期的末速度；也可以直接根据第一采样周期的上一个采样周期中手指移动的距离除以采样频率得到其平均速度，直接将平均速度作为该采样周期的末速度。
在得到第一采样周期内手指移动的加速度后，再根据第一采样周期的上一个采样周期的速度，第一采样周期内手指移动的加速度、以及采样频率计算第一采样周期的末速度；再根据物理学公式
Figure PCTCN2017090358-appb-000002
计算所述第一采样周期内的可优化跟手距离，其中，Vt是第一采样周期的末速度、a是第一采样周期的加速度，t2是图像处理时间，即图3中所示t3至t7的时间。
可选的，也可以直接根据物理学公式s＝Vt计算第一采样周期内手指移动的平均速度，将其平均速度再乘以图像处理时间计算得到第一采样周期内的可优化跟手距离。
需要说明的是，本申请实施例中的第一采样周期虽然是当前刷新周期内的最后一个已 完成的采样周期，但是实际应用中，可以按照上述方法计算每一个采样周期对应的可优化跟手距离。在进行LCD刷新时，仅使用该刷新周期内最近一个采样周期合成的图像呈现在屏幕上，因此，也仅使用该刷新周期内最近一个采样周期对应的可优化根据距离。
402、根据可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；
其中，当前刷新周期内手指移动的距离可以是指当前刷新周期内手指实际移动的距离，也可以是指当前刷新周期内已完成的采样周期的手指移动的距离之和。
当当前刷新周期为从手指开始移动后的第一次刷新周期时，图像的待移动距离为第一次刷新周期内的可优化跟手距离与该刷新周期内手指移动的距离之和。
当当前刷新周期不是手指开始移动后的第一次刷新周期时，针对后续的每个刷新周期，则只需要在上一个刷新周期的基础上对图像进行补偿或调整，因此，后续的每一个刷新周期对应的图像的待移动距离则是：该刷新周期的可优化跟手距离与上一次刷新周期内的可优化跟手距离之差，再加上当前刷新周期内手指移动的距离。
其中的，计算当前刷新周期的可优化跟手距离与上一次刷新周期内的可优化跟手距离之差，实际是根据当前手指移动的速度来调整可优化的跟手距离，来优化动画的后续帧。包括以下两种场景：
如果识别出当前刷新周期内，手指的滑动速度有提升时，则计算出本次刷新时需要提升的跟手距离。即计算出本次刷新周期内的可优化跟手距离，并结合上一刷新周期的可优化跟手距离，计算出本次速度提升后的实际可提升的跟手距离。此种场景下计算出的当前刷新周期的可优化跟手距离与上一次刷新周期内的可优化跟手距离之差为正数。
如果识别出当前刷新周期内，手指的滑动速度降低时，则计算出本次刷新时需要减少的跟手距离。即计算出本次刷新周期内的可优化跟手距离，并结合上一刷新周期的可优化跟手距离，计算出本次速度降低后的实际可减少的跟手距离。此种场景下计算出的当前刷新周期的可优化跟手距离与上一次刷新周期内的可优化跟手距离之差为负数。
403、根据图像的待移动距离进行图像处理和显示。
对于每一个刷新周期来说，在获得了该周期内的图像待移动距离后，应用处理器在对图像进行处理的过程中，根据该刷新周期内的图像待移动距离进行图像处理和显示，最终将合成的图像呈现在屏幕上。
进一步，可选的，当检测到手指停止移动，且手指离开触摸屏时，获取手指离开触摸屏的终点，以手指离开的坐标为终点，当图像显示到达终点时，停止优化距离的计算，按照系统原生的动画曲线继续移动界面。即：根据预设的加速度减速，计算每个刷新周期的图像待移动的距离，再进行图像的处理和显示，直到速度减为0时，停止刷新界面。
可选的，当检测到手指停止移动，且手指继续停留在触摸屏时，获取手指停留在触摸屏的终点，在当前周期内，当图像显示到达触摸屏的终点时，停止刷新界面。
通过本申请实施例中的跟手性补偿方法对动画图像的绘制进行调整后，屏幕上显示的图像随着手指移动的时域图如图8所示。由图8可知，从手指开始移动的第一个刷新周期(大概是117ms的位置)，手指移动的位移大概是7mm，如果是优化前，图像移动的位移 大概是1mm，图像的移动位移滞后于手指移动6mm。通过本申请实施例中的跟手性补偿方法对图像的绘制进行调整后，图像的移动位移大概是5mm，滞后于手指移动位移大概2mm，相比优化前滞后于手指移动位移6mm来说，跟手性体验有很大提升。
本申请实施例中，能够预测在图像处理过程中手指移动的距离，将其作为可优化的跟手距离，根据可优化跟手距离，在动画图像绘制时，进行图像修正。从而可以使图像的显示尽可能的与手指的移动吻合，提升设备的跟手性体验。
进一步，当手指的滑动速度变大时，根据最新速度，加大可优化跟手距离，优化动画的后续帧。当手指的滑动速度降低时，根据最新速度，缩短可优化跟手距离，优化动画的后续帧，从而能够实时地根据滑动速度进行动画图像的跟手性优化，提升跟手性体验。
进一步，当滑动停止时，能够暂停图像的刷新以停止动画，或根据惯性继续生成图像直至速度减为0。从而能够使动画图像的绘制更贴合手指的真实移动，提升跟手性体验。
以上是对本申请实施例中的方法实施例的介绍，下面从功能模块角度对本申请实施例中的跟手性补偿装置进行介绍。
结合图9，本申请实施例中的跟手性补偿装置以下几个功能模块：
第一确定单元901，用于确定当前刷新周期内的可优化跟手距离；
第二确定单元902，用于根据可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；
处理单元903，用于根据图像的待移动距离进行图像处理和显示。
可选的，在一些具体的实施方式中，第一确定单元901，具体用于根据第一采样周期内手指移动的距离，以及图像处理的时间计算可优化跟手距离，第一采样周期为当前刷新周期内的最后一个采样周期。
可选的，在一些具体的实施例中，第一确定单元901，具体用于获得第一采样周期的上一个采样周期的速度；根据第一采样周期的上一个采样周期的速度，第一采样周期内手指移动的距离，以及采用频率计算得到第一采样周期的末速度及加速度；再根据第一采样周期的末速度、加速度以及图像处理时间计算得到第一采样周期内的可优化跟手距离。
可选的，在一些具体的实施例中，第二确定单元902，具体用于当当前刷新周期为第一次刷新周期时，确定图像的待移动距离为可优化跟手距离与当前刷新周期内手指移动的距离之和。
可选的，在一些具体的实施例中，第二确定单元902，具体用于当当前刷新周期不是第一次刷新周期时，确定可优化跟手距离与上一次刷新周期内的可优化跟手距离之差，再加上当前刷新周期内手指移动的距离为可优化跟手距离。
可选的，在一些具体的实施例中，处理单元903，还用于当检测到手指停止移动，且手指离开触摸屏时，获取手指离开触摸屏的终点；当图像显示到达终点时，根据预设的加速度计算图像待移动的距离，进行图像的处理和显示。
可选的，在一些具体的实施例中，处理单元903，还用于当检测到手指停止移动，且手指停留在触摸屏时，获取手指停留在触摸屏的终点；在当前周期内，当图像显示到达触摸屏的终点时，停止界面刷新。
以上跟手性补偿装置中的各单元之间的信息交互可以参阅上述方法实施例(图1至图8所示的实施例)，本申请不做赘述。
图9所示的跟手性补偿装置在实际应用中，可以通过专用集成电路(application-specific integrated circuit，ASIC)实现，或可编程逻辑器件(programmable logic device，PLD)实现。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device，CPLD)，现场可编程门阵列(Field－Programmable Gate Array，FPGA)，通用阵列逻辑(generic array logic,GAL)或其任意组合。
图9所示的业务授权装置在实际应用中，可以是终端设备。该终端设备可以为包括手机、平板电脑、PDA(Personal Digital Assistant，个人数字助理)、POS(Point of Sales，销售终端)、车载电脑、可穿戴设备等任意终端设备，下面以手机为例进行说明：
图10示出的是与本申请实施例提供的终端设备相关的手机的部分结构的框图。本领域技术人员可以理解，图10中示出的手机结构并不构成对手机的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图10对手机的各个构成部件进行具体的介绍：
输入单元1030可用于接收输入的数字或字符信息，以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地，输入单元1030可包括触摸屏1031(或触摸面板)和其他输入设备1032。
触摸屏1031可收集用户在其上或附近的触摸操作，并根据预先设定的程式驱动相应的连接装置。可选的，触摸屏1031还包括触摸检测装置和触摸屏控制器两个部分。其中，触摸检测装置用于检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸屏控制器从触摸点检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器1080，并能接收处理器1080发来的命令并加以执行。
显示单元1040可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元1040可包括显示面板1041，可选的，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板1041。进一步的，触摸屏1031可覆盖显示面板1041，当触摸屏1031检测到在其上或附近的触摸操作后，传送给处理器1080以确定触摸事件的类型，随后处理器1080根据触摸事件的类型在显示面板1041上提供相应的视觉输出。虽然在图10中，触控面板1031与显示面板1041是作为两个独立的部件来实现手机的输入和输入功能，但是在某些实施例中，可以将触控面板1031与显示面板1041集成而实现手机的输入和输出功能。
存储器1020可用于存储软件程序以及模块，处理器1080通过运行存储在存储器1020的软件程序以及模块，从而执行手机的各种功能应用以及数据处理。存储器1020可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器1020可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
手机还可包括至少一种传感器1050，比如光传感器、运动传感器以及其他传感器，在此不做具体赘述。
另外，本申请实施例中的RF电路1010(即收发器)可用于收发信息或通话过程中，信号的接收和发送，特别地，将基站的下行信息接收后，给处理器1080处理；另外，将设计上行的数据发送给基站。音频电路1060可提供用户与手机之间的音频接口。手机通过WiFi模块1070可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图10示出了WiFi模块1070，但是可以理解的是，其并不属于手机的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器1080是手机的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器1020内的软件程序和/或模块，以及调用存储在存储器1020内的数据，执行手机的各种功能和处理数据，从而对手机进行整体监控。具体的，处理器1080执行上述方法实施例(图1至图8所示的实施例)中的全部或部分步骤，此处不做赘述。
手机还包括给各个部件供电的电源1090(比如电池)，优选的，电源可以通过电源管理系统与处理器1080逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
尽管未示出，手机还可以包括摄像头、蓝牙模块等，在此不再赘述。
需要说明的是，在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。
所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存储的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘(Solid State Disk，SSD))等。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”“第四”等(如果存在)是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请实施例的限制。

Claims (15)

  1. 一种跟手性补偿方法，其特征在于，包括：
    确定当前刷新周期内的可优化跟手距离；
    根据所述可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；
    根据所述图像的待移动距离进行图像处理和显示。
  2. 根据权利要求1所述的方法，其特征在于，所述确定当前刷新周期内的可优化跟手距离包括：
    根据第一采样周期内手指移动的距离，以及图像处理的时间计算所述可优化跟手距离，所述第一采样周期为当前刷新周期内的最后一个采样周期。
  3. 根据权利要求2所述的方法，其特征在于，所述根据第一采样周期内手指移动的距离，以及图像处理的时间计算所述第一采样周期内的可优化跟手距离包括：
    获得所述第一采样周期的上一个采样周期的速度；
    根据所述第一采样周期的上一个采样周期的速度，第一采样周期内手指移动的距离，以及采用频率计算得到所述第一采样周期的末速度及加速度；
    根据所述第一采样周期的末速度、所述加速度以及所述图像处理时间计算得到所述第一采样周期内的可优化跟手距离。
  4. 根据权利要求2或3所述的方法，其特征在于，所述根据所述可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像待移动的距离包括：
    当当前刷新周期为第一次刷新周期时，所述图像的待移动距离为所述可优化跟手距离与所述当前刷新周期内手指移动的距离之和。
  5. 根据权利要求2或3所述的方法，其特征在于，所述根据所述可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离包括：
    当当前刷新周期不是第一次刷新周期时，所述图像的待移动距离为所述可优化跟手距离与上一次刷新周期内的可优化跟手距离之差，再加上当前刷新周期内手指移动的距离。
  6. 根据权利要求1至5中任一项所述的方法，其特征在于，所述方法还包括：
    当检测到手指停止移动，且手指离开触摸屏时，获取手指离开触摸屏的终点；
    当图像显示到达所述终点时，根据预设的加速度计算图像待移动的距离，进行图像的处理和显示。
  7. 根据权利要求1至5中任一项所述的方法，其特征在于，所述方法还包括：
    当检测到手指停止移动，且手指停留在触摸屏时，获取手指停留在触摸屏的终点；
    在当前周期内，当图像显示到达所述触摸屏的终点时，停止界面刷新。
  8. 一种跟手性补偿装置，其特征在于，包括：
    第一确定单元，用于确定当前刷新周期内的可优化跟手距离；
    第二确定单元，用于根据所述可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；
    处理单元，用于根据所述图像的待移动距离进行图像处理和显示。
  9. 根据权利要求8所述的装置，其特征在于，
    所述第一确定单元，具体用于根据第一采样周期内手指移动的距离，以及图像处理的时间计算所述可优化跟手距离，所述第一采样周期为当前刷新周期内的最后一个采样周期。
  10. 根据权利要求9所述的装置，其特征在于，
    所述第一确定单元，具体用于获得所述第一采样周期的上一个采样周期的速度；根据所述第一采样周期的上一个采样周期的速度，第一采样周期内手指移动的距离，以及采用频率计算得到所述第一采样周期的末速度及加速度；再根据所述第一采样周期的末速度、所述加速度以及所述图像处理时间计算得到所述第一采样周期内的可优化跟手距离。
  11. 根据权利要求9或10所述的装置，其特征在于，
    所述第二确定单元，具体用于当当前刷新周期为第一次刷新周期时，确定所述图像的待移动距离为所述可优化跟手距离与所述当前刷新周期内手指移动的距离之和。
  12. 根据权利要求9或10所述的装置，其特征在于，
    所述第二确定单元，具体用于当当前刷新周期不是第一次刷新周期时，确定所述可优化跟手距离与上一次刷新周期内的可优化跟手距离之差，再加上当前刷新周期内手指移动的距离为所述可优化跟手距离。
  13. 根据权利要求8至12中任一项所述的装置，其特征在于，
    所述处理单元，还用于当检测到手指停止移动，且手指离开触摸屏时，获取手指离开触摸屏的终点；当图像显示到达所述终点时，根据预设的加速度计算图像待移动的距离，进行图像的处理和显示。
  14. 根据权利要求8至12中任一项所述的装置，其特征在于，
    所述处理单元，还用于当检测到手指停止移动，且手指停留在触摸屏时，获取手指停留在触摸屏的终点；在当前周期内，当图像显示到达所述触摸屏的终点时，停止界面刷新。
  15. 一种终端设备，其特征在于，所述终端设备包括：
    相互连接的收发器、处理器及存储器；
    所述存储器用于存储程序代码，所述处理器调用所述存储器中的所述程序代码，以执行以下操作：
    确定当前刷新周期内的可优化跟手距离；根据所述可优化跟手距离以及当前刷新周期内手指移动的距离，确定当前刷新周期内图像的待移动距离；根据所述图像的待移动距离进行图像处理和显示。
PCT/CN2017/090358 2017-03-07 2017-06-27 一种跟手性补偿方法、装置及终端设备 WO2018161471A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201780022691.7A CN108885536B (zh) 2017-03-07 2017-06-27 一种跟手性补偿方法、装置及终端设备

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710132119.8 2017-03-07
CN201710132119 2017-03-07

Publications (1)

Publication Number Publication Date
WO2018161471A1 true WO2018161471A1 (zh) 2018-09-13

Family

ID=63447355

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/090358 WO2018161471A1 (zh) 2017-03-07 2017-06-27 一种跟手性补偿方法、装置及终端设备

Country Status (2)

Country Link
CN (1) CN108885536B (zh)
WO (1) WO2018161471A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112506413A (zh) * 2020-12-16 2021-03-16 Oppo广东移动通信有限公司 触控点预测方法、装置、终端设备及计算机可读存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110162215A (zh) * 2019-05-10 2019-08-23 Oppo广东移动通信有限公司 控制方法、控制装置、电子设备和计算机可读存储介质
CN110286982B (zh) * 2019-06-26 2024-01-12 努比亚技术有限公司 一种跟手动画的显示方法、终端及存储介质
CN112612372A (zh) * 2020-12-22 2021-04-06 努比亚技术有限公司 一种触控事件调控方法、设备及计算机可读存储介质
CN115328345A (zh) * 2022-04-19 2022-11-11 天津先楫半导体科技有限公司 一种显示控件的刷新方法、系统、设备及介质
CN115657863B (zh) * 2022-12-29 2023-04-07 北京东舟技术股份有限公司 一种触屏设备的非侵入式跟手性检测方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751195A (zh) * 2009-12-30 2010-06-23 中兴通讯股份有限公司 一种电阻式触摸屏上的移动事件控制方法及装置
CN101937311A (zh) * 2010-09-09 2011-01-05 宇龙计算机通信科技(深圳)有限公司 一种移动终端及图标控制方法
CN102298502A (zh) * 2011-09-26 2011-12-28 鸿富锦精密工业（深圳）有限公司 触摸型电子装置及其图标换页的方法
CN103530052A (zh) * 2013-09-27 2014-01-22 华为技术有限公司 一种界面内容的显示方法和用户设备
CN103995615A (zh) * 2014-05-20 2014-08-20 胡世曦 一种触摸板拼接方法
CN105260123A (zh) * 2015-11-02 2016-01-20 厦门飞信网络科技有限公司 一种移动终端和触摸屏的显示方法
US20160328109A1 (en) * 2013-01-18 2016-11-10 Panasonic Intellectual Property Corporation Of America Scrolling apparatus, scrolling method, and computer-readable medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2466566B (en) * 2008-12-22 2010-12-22 N trig ltd Digitizer, stylus and method of synchronization therewith
CN102096530B (zh) * 2011-01-28 2013-09-18 广东威创视讯科技股份有限公司 一种多点触摸轨迹跟踪方法
US20160148521A1 (en) * 2011-04-11 2016-05-26 Ali Mohammad Bujsaim Sensitivity adjustment for talking book
CN102789335B (zh) * 2012-07-11 2015-07-08 广东威创视讯科技股份有限公司 一种触摸书写轨迹的处理方法
CN102929433A (zh) * 2012-11-06 2013-02-13 山东大学 一种通过触点预测降低嵌入式设备上拖拽延迟的方法
US9870083B2 (en) * 2014-06-12 2018-01-16 Microsoft Technology Licensing, Llc Multi-device multi-user sensor correlation for pen and computing device interaction
CN110286982B (zh) * 2019-06-26 2024-01-12 努比亚技术有限公司 一种跟手动画的显示方法、终端及存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751195A (zh) * 2009-12-30 2010-06-23 中兴通讯股份有限公司 一种电阻式触摸屏上的移动事件控制方法及装置
CN101937311A (zh) * 2010-09-09 2011-01-05 宇龙计算机通信科技(深圳)有限公司 一种移动终端及图标控制方法
CN102298502A (zh) * 2011-09-26 2011-12-28 鸿富锦精密工业（深圳）有限公司 触摸型电子装置及其图标换页的方法
US20160328109A1 (en) * 2013-01-18 2016-11-10 Panasonic Intellectual Property Corporation Of America Scrolling apparatus, scrolling method, and computer-readable medium
CN103530052A (zh) * 2013-09-27 2014-01-22 华为技术有限公司 一种界面内容的显示方法和用户设备
CN103995615A (zh) * 2014-05-20 2014-08-20 胡世曦 一种触摸板拼接方法
CN105260123A (zh) * 2015-11-02 2016-01-20 厦门飞信网络科技有限公司 一种移动终端和触摸屏的显示方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112506413A (zh) * 2020-12-16 2021-03-16 Oppo广东移动通信有限公司 触控点预测方法、装置、终端设备及计算机可读存储介质
CN112506413B (zh) * 2020-12-16 2022-06-07 Oppo广东移动通信有限公司 触控点预测方法、装置、终端设备及计算机可读存储介质

Also Published As

Publication number Publication date
CN108885536A (zh) 2018-11-23
CN108885536B (zh) 2021-05-18

Similar Documents

Publication Publication Date Title
WO2018161471A1 (zh) 一种跟手性补偿方法、装置及终端设备
EP3805982B1 (en) Gesture recognition method, apparatus and device
US20170109756A1 (en) User Unsubscription Prediction Method and Apparatus
CN109804339B (zh) 识别操作的方法、装置及移动终端
CN106445340B (zh) 一种双屏终端显示立体图像的方法和装置
CN108984066B (zh) 一种应用程序图标显示方法及移动终端
CN106406530B (zh) 一种屏幕显示方法及其移动终端
CN108196775B (zh) 截图控制方法、柔性屏终端以及计算机可读存储介质
WO2016206491A1 (zh) 目标对象运动轨迹确定方法、装置以及存储介质
CN103677564B (zh) 滑动操作响应方法、装置及终端设备
CN110874128B (zh) 可视化数据处理方法和电子设备
TW201512865A (zh) 一種網頁數據搜索方法、裝置和系統
CN110147742B (zh) 一种关键点定位方法、装置及终端
US8711110B2 (en) Touchscreen with Z-velocity enhancement
WO2015003618A1 (en) Method and apparatus for webpage browsing
CN105930077A (zh) 屏幕显示对象的尺寸调整方法及装置
CN110083742B (zh) 一种视频查询方法和装置
US11513671B2 (en) Split-screen display method for terminal and apparatus
CN105095259B (zh) 瀑布流对象显示方法及装置
CN111596836A (zh) 一种分屏显示方法及电子设备
CN108628534B (zh) 一种字符展示方法及移动终端
CN105513098B (zh) 一种图像处理的方法和装置
CN106796912B (zh) 用于设置块的电子装置和方法
CN110225106B (zh) 一种数据传输方法、装置及存储介质
CN105630315A (zh) 调节数量的方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899246

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17899246

Country of ref document: EP

Kind code of ref document: A1