WO2023001011A1

WO2023001011A1 - Cursor interaction method, electronic device, and medium thereof

Info

Publication number: WO2023001011A1
Application number: PCT/CN2022/104934
Authority: WO
Inventors: 范振华; 曹原
Original assignee: 华为技术有限公司
Priority date: 2021-07-20
Filing date: 2022-07-11
Publication date: 2023-01-26
Also published as: CN115639929A

Abstract

The present application relates to the technical field of electronics, and in particular to a cursor interaction method, an electronic device, and a medium thereof. In the cursor interaction method of the present application, an electronic device determines, according to pixel attributes of each application program icon in a user interface (UI) of the electronic device, physical attributes of each icon, for example, mass, magnetic force, and other physical attributes of the icon, and determines physical attributes such as mass and magnetic force of a cursor and a friction coefficient between the cursor and the interface according to the size, color, and shape of the cursor; and therefore, the electronic device can generate and display different animation interaction effects in an interaction process of the cursor and different icons according to the physical attributes of the cursor and the different icons, such that the animation interaction effects in human-computer interaction better conforms to a physical rule, a human-computer interaction process is more appealing, and the human-computer interaction experience of a user is further improved.

Description

Cursor interaction method, electronic device and medium thereof

This application claims the priority of the Chinese patent application with the application number 202110823307.1 and the application name "cursor interaction method, electronic equipment and its medium" submitted to the China Patent Office on July 20, 2021, the entire contents of which are incorporated herein by reference Applying.

technical field

The present application belongs to the field of electronic technology, and in particular relates to a cursor interaction method, an electronic device and a medium thereof.

Background technique

At present, many electronic devices support human-computer interaction, and users can achieve their own goals through the human-computer interaction methods provided by electronic devices. For example, the user can select an icon of a certain application program displayed on the touch screen by moving a finger on the touch screen of the tablet computer to open the application program. During this process, in order to allow the user to perceive the process of selecting an application, a cursor is generally displayed on the touch screen of the tablet computer, which will be synchronized with the movement of the user's finger, so that the user can perceive the selected application through the movement of the cursor. The process of an application.

Contents of the invention

In order to bring more diverse and more interesting human-computer interaction experiences to users, an embodiment of the present application provides a cursor interaction method. In the cursor interaction method of the embodiment of the present application, the electronic device determines the physical properties of each icon, such as the quality, magnetic force, and friction of the icon, according to the pixel attributes of each application program icon in its user interface (UI). At the same time, according to the size, color and shape of the cursor, determine the physical properties of the cursor, such as mass, magnetism, friction, etc., so that when the cursor is close to an icon, the cursor can be accelerated due to the magnetic force between the cursor and the icon ( Attracted by the icon) to approach the icon, and according to the size of the magnetic force between the cursor and each icon, the icon or cursor will have different deformations. In this way, the animation interaction effect in human-computer interaction is more in line with physical laws, thereby improving the user's human-computer interaction experience.

The technical solution of the present application is introduced below.

In the first aspect, the embodiment of the present application provides a cursor interaction method, which can be applied to electronic devices, and the method includes: determining a target icon interacting with the cursor; displaying the physical properties of the cursor and the physical properties of the target icon Animation interaction effect, wherein the physical properties are based on the image information of the cursor and the image information of the target icon, which is beneficial to the preset physical rules and simulates the physical properties of objects in the physical world, and the animation interaction effect shows that the cursor and the target icon are in the The physical phenomena produced by following the corresponding physical laws during the interaction process.

It can be understood that before displaying the animation interaction effect between the cursor and the icon, the electronic device must first determine which icon the cursor interacts with, and then display the animation interaction effect between the cursor and the icon (ie, the target icon). Moreover, in this application, the animation interaction effect between the cursor and the icon is generated by the electronic device based on the physical properties of the cursor and the icon, so each animation interaction effect must be related to the physical properties of the cursor and the physical properties of an icon. There is a one-to-one mapping relationship between physical attributes. For example, if the physical attribute of the cursor is the physical attribute under the system theme of the bright color theme, the physical attribute of the icon is the physical attribute of the WeChat icon, and the cursor under the system theme is the bright color theme. The animation interaction effect displayed when the WeChat icon interacts is related to the physical properties of the cursor under the bright color theme and the physical properties of the WeChat icon. Among them, the physical property refers to the image information of the electronic device based on the icon and the cursor, such as the pixel value of the image corresponding to the icon or the cursor, simulating the physical property of the object in the physical world, such as the mass, magnetism, and friction coefficient of the object in the physical world etc., using the preset physical rules to set the physical attributes for the cursor and icons in the electronic device, the purpose is reflected in two aspects: on the one hand, it is to make the cursor more consistent with the real world in the physical world during the interaction with the icon. In the scene of object interaction, correspondingly, the animation interaction effect between the cursor and the icon is a manifestation of the physical phenomenon produced by the cursor and the icon following the corresponding physical laws during the interaction process; on the other hand, it is to make each Icons can have unique physical properties based on their own image information, so that the cursor can produce different animation interaction effects when interacting with different icons. In the process of interacting with it, the magnetic attraction force of the icon is also large, so that the deformation of the cursor when it is close to the icon is also large, and the quality of the icon with lighter color is small, the magnetic force is also small, and the cursor is in the process of interacting with it. The magnetic attraction force of the icon is also small, so that the amount of deformation that occurs when the cursor approaches the icon is also small.

Based on this, in some embodiments of the present application, the electronic device first determines the target icon that interacts with the cursor, and then determines the physical properties of the cursor and the physical properties of the target icon according to the physical properties of the target icon and the physical properties of the cursor. The animation interaction effect related to the property, and display the animation interaction effect during the interaction process between the cursor and the target icon. In this way, not only the interaction process between the cursor and the icon in the electronic device is more in line with the interaction process of the real object in the physical world, but also different animation interaction effects are provided for the interaction between icons with different physical properties and the cursor, and the cursor is improved. The variety of animation effects in the process of interacting with icons improves the user's interactive experience.

With reference to the first aspect, in a possible implementation of the first aspect, the method for determining the target icon for interaction with the cursor includes: setting a hot zone including the icon, and the distance between each boundary of the hot zone and the center of the icon If the distance is greater than the preset distance, when the cursor enters the hot zone, it is determined that the icon in the hot zone is the target icon.

In some embodiments, when the electronic device determines a target icon for interaction with the cursor, it may determine whether the cursor is going to approach the icon according to the distance between the cursor and the icon. Specifically, the electronic device can set a hot zone for the icon, wherein the distance between each boundary of the hot zone and the center of the icon is greater than a preset distance, and when the cursor enters the hot zone, it considers that the cursor is approaching the icon and takes the icon as the target icon . Among them, the preset distance can be dynamically adjusted by the electronic device according to the number of existing icons in the interface of the electronic device. There may be overlapping, which is not conducive to judging the target icon that interacts with the cursor, so the preset distance can be set smaller at this time, such as 5 pixels, or the preset distance is not set, that is, the edge of the icon image corresponding to the icon is the hot zone At this time, as long as the cursor contacts the edge of the icon image corresponding to the icon, the icon is determined to be the target icon; when the number of icons in the electronic device interface is small, the preset distance can be set larger, such as 10 pixels, so that Better divide the hot zone boundary between icons, and then better judge the target icon that interacts with the cursor. It should be understood that the present application does not limit the manner of how to determine the target icon for interaction with the cursor.

With reference to the first aspect and the foregoing possible implementation manners, in another possible implementation manner of the first aspect, the physical properties include mass, magnetic force, and a friction coefficient of an interface where the cursor and the icon are located.

In combination with the first aspect and the foregoing possible implementation manners, in another possible implementation manner of the first aspect, during the interaction process between the cursor and the target icon, the electronic device displays one or more of the following animation interaction effects:

When the cursor is close to the target icon, the cursor accelerates to approach the target icon under the magnetic attraction of the target icon; when the cursor leaves the target icon, the cursor decelerates and moves away from the target icon under the magnetic attraction of the target icon; when the cursor approaches or When the cursor is separated from the target icon, the cursor is deformed under the magnetic attraction of the target icon; when the cursor is close to or separated from the target icon, the target icon is deformed under the magnetic attraction of the cursor; In this case, the target icon tilts toward the direction of the cursor.

It can be understood that the above embodiment is an animation interaction effect generated during the interaction between the cursor and a certain icon (target icon) in the electronic device, that is, during the interaction between the cursor and a target icon, the cursor can simultaneously accelerate or decelerate, Animation effects such as deformation of the cursor or icon, tilting of the icon, etc. It should be noted that, in order to facilitate the explanation of the animation interaction effect of the interaction between the cursor and the icon in this application, the following will take the interaction between the cursor and an icon as an example for illustration. It can be understood that in some embodiments, the cursor can be Interaction with multiple icons, for example, the cursor enters the hot zone of multiple icons at the same time, in this case, the electronic device can display the animation interaction effect of the cursor interacting with multiple icons at the same time, it should also be understood that the cursor is affected by the The effect of the force is the resultant force of the magnetic attraction of multiple icons acting on the cursor at the same time, and the frictional resistance between the cursor and the interface.

In combination with the first aspect and the above-mentioned possible implementation manners, in another possible implementation manner of the first aspect, during the interaction process between the cursor and the target icon, friction that hinders the movement of the cursor occurs between the interface where the cursor and the target icon are located Resistance, and the electronic device displays one or more of the following animation interaction effects: when the cursor is close to the target icon, the cursor accelerates towards the target icon under the action of the magnetic force of the target icon, the cursor and frictional resistance; when the cursor leaves the target icon In the case of , the cursor decelerates away from the target icon under the action of the magnetic force of the target icon, the cursor and frictional resistance.

It can be understood that the cursor will inevitably move during the interaction process between the cursor and the target icon. In order to make the interaction process between the cursor and the target icon more similar to the interaction process of objects in the physical world, the electronic device can set the cursor and icon for the cursor. The friction coefficient between the interface, so that when the cursor interacts with the icon, the cursor is also affected by the friction resistance between it and the interface.

Similarly, if the cursor also has magnetic force at this time, the magnetic force of the cursor will also attract the icon within a certain range, and the icon will also move relative to it. Gradually approaching the boundary of the hot zone, it is not difficult to understand that the electronic device can also set the friction coefficient between it and the interface for the icon, so that the icon is also affected by the friction resistance between it and the interface when it is close to the boundary of the hot zone. Among them, whether it is the friction coefficient between the cursor and the interface or the friction coefficient between the icon and the interface, it is related to the blurring degree of the interface, the blurring degree of the icon, and the blurring degree of the cursor. The greater the coefficient of friction with the icon, the greater the blur of the icon, the greater the coefficient of friction between the icon and the interface, the greater the blur of the cursor, the greater the coefficient of friction between the cursor and the interface. Wherein, the blurring degree of the interface is related to the system setting of the electronic device, for example, if the system setting of the electronic device is "frosted", the blurring degree of the interface is relatively high.

With reference to the first aspect and the above possible implementation manners, in another possible implementation manner of the first aspect, the image information of the icon includes the pixel value of the icon image corresponding to the icon; and the method further includes: according to the pixel value of the icon image The pixel value of the background color of the interface determines the quality of the icon, and the quality of the icon is positively correlated with the difference between the pixel value of the icon image and the pixel value of the background color of the interface.

In some embodiments, the electronic device can set the simulated quality for the icon according to the pixel value of the icon image of the icon object, and the pixel value of the icon image is related to the pixel value of the background color of the interface where the icon is located, and the pixel value of the icon image is related to The greater the difference in pixel values of the background color, the greater the quality of the icon. Wherein, the manner in which the electronic device specifically sets the quality for the icon will be described in detail in the specific embodiments below, and will not be repeated here.

With reference to the first aspect and the foregoing possible implementation manners, in another possible implementation manner of the first aspect, the magnetic force of the icon is positively correlated with the mass of the icon.

In some embodiments, the mass of the icon is positively correlated with the magnetic force of the icon, that is, the greater the mass of the icon, the greater the magnetic force of the icon. Wherein, the manner in which the electronic device specifically sets the magnetic force for the icon will be described in detail in the specific embodiments below, and will not be repeated here.

In combination with the first aspect and the above possible implementations, in another possible implementation of the first aspect, the frictional resistance between the cursor and the interface where the icon is located and the quality of the cursor and the friction coefficient between the cursor and the interface where the icon is located Correlation, the friction coefficient between the cursor and the interface is negatively correlated with the pixel value of the interface, and the friction coefficient between the cursor and the interface is a constant greater than 1.

In some embodiments, the friction resistance experienced by the cursor and the icon during the interaction process is related to the friction coefficient between the cursor and the interface, and the friction coefficient between the cursor and the interface is negatively related to the pixel value of the interface, that is, the electronic device The larger the pixel value of the interface, the smaller the friction coefficient between the cursor and the interface. For example, the pixel value of the electronic device interface is OXFFFFFF, and the electronic device interface is white. At this time, the friction coefficient between the cursor and the interface is the smallest. When the electronic device The pixel value of the interface is OXOOOOOO, and the interface of the electronic device is black. At this time, the friction coefficient between the cursor and the interface is the largest. Wherein, the manner in which the electronic device specifically sets the friction coefficient between the cursor and the interface will be described in detail in the specific embodiments below, and will not be repeated here.

It should be understood that the above interface where the icon is located and the interface where the cursor is located both refer to the interface being displayed on the electronic device.

With reference to the first aspect and the foregoing possible implementation manners, in another possible implementation manner of the first aspect, the physical law includes at least one of a friction formula, an acceleration formula, and an elastic force formula.

With reference to the first aspect and the above possible implementation manners, in another possible implementation manner of the first aspect, the icons include the icons of the application programs installed on the desktop of the electronic device and the icons on the application program interface during the running of the application programs. icon. It should be understood that since the cursor interaction method of the present application is a physical attribute set by the electronic device for the icon based on the image information of the icon, the physical attribute has nothing to do with whether the icon is installed on the electronic device, and whether the icon is located on the desktop of the electronic device or otherwise. The interface has nothing to do with it. Therefore, the icons in the above embodiments and possible implementations include not only the icons of the application programs installed on the desktop of the electronic device, but also the icons displayed on the application program interface during the running of these application programs. icon.

In the second aspect, the embodiment of the present application also provides an electronic device, the electronic device includes a memory, which stores computer program instructions; a processor, and the processor and the memory are coupled, and when the computer program instructions stored in the memory are executed by the processor, the The electronic device performs the following operations: determine a target icon interacting with the cursor; display animation interaction effects related to the physical properties of the cursor and the physical properties of the target image, wherein the physical properties are based on the image information of the cursor and the image information of the target image, It is beneficial to the preset physical rules, which are obtained by simulating the physical properties of objects in the physical world, and the animation interaction effect shows the physical phenomena produced by the cursor and the target image following the corresponding physical laws during the interaction process.

With reference to the second aspect, in a possible implementation manner of the second aspect, determining the target icon for interaction with the cursor includes: setting a hot zone including the icon, and the distance between each boundary of the hot zone and the center of the icon is greater than a predetermined distance. Set the distance; when the cursor enters the hot zone, determine the icon in the hot zone as the target icon.

With reference to the second aspect and the foregoing possible implementation manners, in another possible implementation manner of the second aspect, the physical properties include mass, magnetic force, and a friction coefficient of an interface where the cursor and the icon are located.

With reference to the second aspect and the above possible implementation manners, in another possible implementation manner of the second aspect, during the interaction process between the cursor and the target icon, the electronic device displays one or more of the following animation interaction effects: When the cursor is close to the target icon, under the magnetic attraction of the target icon, the cursor accelerates to approach the target icon; when the cursor leaves the target icon, the cursor decelerates away from the target icon under the magnetic attraction of the target icon; when the cursor approaches or leaves the target In the case of an icon, the cursor is deformed under the magnetic attraction of the target icon; when the cursor is close to or away from the target icon, the target icon is deformed under the magnetic attraction of the cursor; when the cursor is in contact with the target icon , the target icon tilts in the direction of the cursor.

In combination with the second aspect and the above-mentioned possible implementation manners, in another possible implementation manner of the second aspect, during the interaction process between the cursor and the target icon, friction that hinders the movement of the cursor occurs between the interface where the cursor and the target icon are located Resistance, and the electronic device displays one or more of the following animation interaction effects including: when the cursor is close to the target icon, the cursor accelerates towards the target icon under the action of the magnetic force of the target icon, the cursor and frictional resistance; In the case of an icon, the cursor decelerates away from the target icon under the action of the magnetic force of the target icon, the cursor and frictional resistance.

With reference to the second aspect and the above possible implementation manners, in another possible implementation manner of the second aspect, the image information of the icon includes the pixel value of the icon image corresponding to the icon, and the method further includes: according to the pixel value of the icon image The pixel value of the background color of the interface determines the quality of the icon, and the quality of the icon is positively correlated with the difference between the pixel value of the icon image and the pixel value of the background color of the interface.

With reference to the second aspect and the foregoing possible implementation manners, in another possible implementation manner of the second aspect, the magnetic force of the icon is positively correlated with the mass of the icon.

In combination with the second aspect and the above possible implementations, in another possible implementation of the second aspect, the frictional resistance between the cursor and the interface where the icon is located and the quality of the cursor and the friction coefficient between the cursor and the interface where the icon is located Correlation, the friction coefficient between the cursor and the interface is negatively correlated with the pixel value of the interface, and the friction coefficient between the cursor and the interface is a constant greater than 1.

With reference to the second aspect and the foregoing possible implementation manners, in another possible implementation manner of the second aspect, the physical law includes at least one of a friction formula, an acceleration formula, and an elastic force formula.

With reference to the second aspect and the above possible implementation manners, in another possible implementation manner of the second aspect, the icons include the icons of the application programs installed on the desktop of the electronic device and the icons on the application program interface during the running of the application programs. icon.

In the third aspect, the embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and it is characterized in that, when the computer program is executed by a processor, any possible solution in the above-mentioned first aspect can be realized. The cursor interaction method in the implementation.

In a fourth aspect, an embodiment of the present application provides a computer program product that, when the computer program product is run on an electronic device, causes the electronic device to execute the cursor interaction method in any possible implementation manner of the first aspect above.

It can be understood that, for the beneficial effects of the above-mentioned second aspect to the fourth aspect, reference can be made to the relevant description in the above-mentioned first aspect, and details are not repeated here.

Description of drawings

Fig. 1 is a diagram of an application scenario of cursor interaction provided by some embodiments;

Fig. 2 is an animation interaction effect diagram of an example of cursor-icon interaction provided by some embodiments;

Fig. 3 is another animation interaction effect diagram of the interaction between the cursor and the icon provided by some embodiments;

Fig. 4 is a schematic flowchart of an example of generating an interactive animation effect between a cursor and an icon provided by some embodiments;

Fig. 5 is an animation interaction effect diagram of an example of cursor-icon interaction provided by some embodiments;

Fig. 6 is an animation interaction effect diagram of an example of cursor-icon interaction provided by some embodiments;

Fig. 7 is an animation interaction effect diagram of an example of cursor-icon interaction provided by some embodiments;

Fig. 8 is a schematic diagram of a physical principle of interaction between a cursor and an icon provided by some embodiments;

Fig. 9 is a schematic diagram of a physical principle of interaction between a cursor and an icon provided by some embodiments;

Fig. 10 is a schematic diagram of a physical principle of interaction between a cursor and an icon provided by some embodiments;

Fig. 11 is a schematic diagram of a physical principle of interaction between a cursor and an icon provided by some embodiments;

Fig. 12 is an animation interaction effect diagram of an example of cursor-icon interaction provided by some embodiments;

Fig. 13 is a schematic flowchart of a method for determining a target icon approached by a cursor provided by some embodiments;

Fig. 14 is a schematic diagram of an example of determining the target icon approached by the cursor provided by some embodiments;

Fig. 15A is the display and control gain curve of the Windows touch screen;

Fig. 15B is a Mac touch screen display and control gain curve;

Fig. 16A is an example of display control gain curve diagram provided by some embodiments;

Fig. 16B is a schematic diagram of the relationship between the moving speed of the cursor and the actual input speed of the user provided by some embodiments;

Fig. 17 is a schematic diagram of the relationship between the moving distance of the cursor and the speed of the cursor provided by some embodiments;

Fig. 18A is a schematic diagram of an example of the relationship between cursor moving distance and cursor speed provided by some embodiments;

Fig. 18B is a schematic diagram of an example of the relationship between cursor moving distance and cursor speed provided by some embodiments;

Fig. 19A is a schematic diagram of a cursor movement process without Kalman filter processing provided by some embodiments;

Fig. 19B is a schematic diagram of a cursor movement process processed by Kalman filtering provided by some embodiments;

Fig. 20 is a schematic diagram of the hardware structure of a tablet computer provided by some embodiments;

Fig. 21 is a schematic diagram of a software structure of a tablet computer provided by some embodiments.

detailed description

Various aspects of the illustrative embodiments are described below using terms commonly employed by those skilled in the art.

It can be understood that the illustrative embodiments of the present application include, but are not limited to, interactive methods, electronic devices, storage media, and the like.

In order to improve the user's experience in human-computer interaction, the electronic device will set some animation interaction effects for the human-computer interaction process, so that when the user moves the cursor close to or away from a certain application icon, the cursor will move closer to or away from a certain application icon. The application icon is deformed to indicate to the user that the application icon has been selected or is about to be disengaged.

For example, in some embodiments of the present application, when the electronic device is developing the system, it will pre-set the animation interaction effect between the cursor and the icon of the application program on the system desktop, and apply the animation interaction effect on the system desktop application icons, but the preset animation interaction effects have the following defects: First, the preset animation interaction effects are limited in type, because the preset animation interaction effects do not take into account the characteristics of each application icon, such as each The pixel value of the application icon, which causes the preset animation interaction effect to be essentially the same, that is, the animation interaction effect generated when the cursor interacts with any application icon is similar; secondly, the preset animation interaction effect It is limited in number. It is understandable that electronic devices cannot predict how many applications will be installed on electronic devices during system development, and electronic devices cannot provide different animation interaction effects for each application; finally, electronic devices The animation interaction effect set is generally aimed at the application icon installed on the desktop of the electronic device. For the icon in the application program interface generated when an application is running, for example, the icon on the interface after a certain program is opened, it does not There is also an animation interaction effect for the cursor to interact with the icon.

Specifically, as shown in FIG. 1 , on the desktop shown in FIG. 1 , the user can move the cursor 101 to the icon of the target application program and open the application program. When the user moves the cursor 101 to select the weather application 102, the following animation interaction effect will be produced between the cursor 101 and the icon of the weather application 102 (hereinafter referred to as the weather icon 102):

That is, when the user moves the cursor 101 close to the icon, when the cursor 101 touches the icon, the size of the cursor 101 will change to prompt the user to contact the icon at this time; when the user moves the cursor 101 away from the icon, the size of the cursor 101 will also change. Change, to prompt the user to leave the icon at this time; and after the user moves the cursor 101 and releases it, the time-consuming time for the cursor 101 to approach and select the icon is the same as the time-consuming time for the cursor 101 to leave the icon.

Specifically as shown in Figure 2, the animation interaction effect between the cursor 101 and the weather icon 102 can be divided into: the cursor 101 approaches the weather icon 102 stage, the cursor 101 selects the weather icon 102 stage, and the cursor 101 breaks away from the weather icon 102 stage, wherein, from The time taken from the cursor 101 approaching the weather icon 102 to the cursor 101 selecting the weather icon 102 is t1, the time from the cursor 101 selecting the weather icon 102 to the cursor 101 leaving the weather icon 102 is t2, and t1 is equal to t2. It should be understood that the time during which the user stays the cursor 101 on the icon is not counted here.

As shown in Figure 2A, the cursor 101 is close to the weather icon 102, and contacts with the hot area P ₁ edge of the weather icon 102, at this moment, the weather icon 102 will be close to the cursor 101; when the cursor 101 contacts the weather icon 102, the cursor 101 The deformation as shown in Figure 2B takes place to remind the user that the weather icon 102 has been touched at this moment; afterward, as shown in Figure 2C, the layer where the cursor 101 is located is hidden behind the layer where the weather icon 102 is located, and the weather icon 102 appears Transform (increase in volume) to prompt the user that the weather icon 102 has been selected at this time. In this way, an animation interaction effect in which the user moves the cursor 101 to select the weather icon 102 is realized, and this process takes time t1. Wherein, the hot zone _P1 refers to the zone where the electronic device considers that the cursor 101 has selected the weather icon 102 when the cursor 101 touches the zone.

When the user moves the cursor 101 away from the weather icon 102 , the animation interaction effect between the cursor 101 and the weather icon 102 is the same as when the user moves the cursor 101 close to the weather icon 102 , but the process is reversed. Specifically, as shown in FIG. 2D, the cursor 101 gradually departs from the weather icon 102; and when the cursor 101 moves to the edge _of the hot zone P1, as shown in FIG. 2E, the weather icon 102 returns to the initial size as shown in FIG. 2A, Cursor 101 then completely disengages from weather icon 102 . In this way, the animation interaction effect of the user moving the cursor 101 away from the weather icon 102 is realized, and this process takes time t2, and t1 is equal to t2.

As mentioned above, the animation interaction effect between the cursor 101 and the weather icon 102 is preset by the electronic device for each application icon on the system desktop, that is, for other applications on the desktop of the electronic device, such as

Do it now 105, IG (instagram) icon 106, setting 107 or short message 108 etc., the interactive animation of cursor 101 and aforementioned icon and the interactive animation of cursor 101 and weather icon 102 are consistent; The device is pre-set for the application icon on the system desktop, so it cannot be applied to the icon in the application interface after the user opens an application, for example, when the user uses the DingTalk application 104, the cursor 101 on the desktop The above-mentioned animation interaction effect can be generated when approaching or away from the DingTalk icon 104, but after the DingTalk application 104 is opened, since the electronic device cannot predict the icon type on the DingTalk application 104 interface, the user moves the cursor 101 to approach or When moving away from the icon on the DingTalk application 104 interface, there will no longer be an animation interaction effect.

In order to solve the above problems, improve the above-mentioned animation interaction effect between the cursor 101 and the icon, and further enhance the user experience, when the electronic device sets the animation interaction effect between the cursor 101 and the icon, it will display the physical phenomenon of the real world on the man-machine In the interactive interface display, the way of human-computer interaction is more in line with the way of interaction in the real world. For example, in the physical world, when a magnetic object A is brought close to another magnetic object B, the object B will have a magnetic attraction to the object A, so that the object A accelerates to approach the object B under the magnetic force of the object B; when When object A moves away from object B, object A decelerates under the action of object B's magnetic force. This physical phenomenon is manifested in the animation interaction effect set by the electronic device: when the user moves the cursor 101 close to the target icon, the cursor 101 accelerates to approach the target icon under the magnetic force of the target icon; when the user moves the cursor 101 away from the target icon, the cursor 101 101 will slow down under the magnetic force of the target icon.

Specifically, in some embodiments of the present application, after the system is successfully installed on the electronic device, the electronic device determines each application icon corresponding to the physical world based on the characteristics of each application program icon in the electronic device, for example, the color of each application program icon. Based on the physical properties of the application icons such as quality and magnetism, different animation interaction effects for the icons of different application programs installed in the system to interact with the cursor 101 are set based on the physical properties of each application program icon. Since the electronic device sets the animation interaction effect for the cursor 101 and the icon based on the characteristics of each icon, so, for different application program icons, if the corresponding physical attributes of each application program icon are different, then each application program icon and the cursor 101 The animation interaction effect is also different, and it can be understood that the animation interaction effect set based on the characteristics of the application icon has nothing to do with when the electronic device installs the application and whether the icon is generated by an application during operation, so , the animation interaction effect can also be applied to the icon on the application program interface of a certain application when it is running.

Specifically, for example, in the scenario shown in FIG. 1 , the electronic device may set different animation interaction effects simulating physical phenomena in the real world when the user moves the cursor 101 close to or away from the weather icon 102 . For example, the animation interaction effect of the interaction between the cursor 101 and the weather icon 102 is as follows: when the cursor 101 is close to an icon with magnetic force, under the action of the magnetic force of the icon, the cursor 101 will accelerate to approach the icon; when the cursor 101 leaves the icon with magnetic force At this time, under the action of the magnetic force of the icon, the cursor 101 will be resisted and decelerate, which causes the time consumption of the cursor 101 to approach the icon to be different from that of leaving the icon. When the icon is displayed, it will be deformed under the action of the icon's magnetic force.

Specifically, as shown in FIG. 3A, the cursor 101 approaches the weather icon 102 and contacts the edge of the hot area P1 _of the weather icon 102. At this time, the magnetic force between the cursor 101 and the weather icon 102 will make the cursor 101 Accelerate and approach the weather icon 102, on the one hand, as shown in Figure 3B, it will drive the weather icon 102 to move towards the direction where the cursor 101 is located; when the cursor 101 contacts the weather icon 102, the cursor 101 will also deform as shown in Figure 3B , so as to remind the user that the cursor 101 has touched the weather icon 102 at this time; then, as shown in FIG. Continue to approach the edge of the hot zone P ₁ under the action of inertia; finally, as shown in FIG. 3D , the weather icon 102 returns to the center of the hot zone P ₁ . In this way, an animation interaction effect in which the user moves the cursor 101 to select the weather icon 102 is realized, and this process takes time t3.

When the user moves the cursor 101 away from the weather icon 102 , the animation interaction effect between the cursor 101 and the weather icon 102 is the same as when the user moves the cursor 101 close to the weather icon 102 , but the process is reversed. Specifically, as shown in FIG. 3E, the weather icon 102 gradually approaches the edge _of the hot zone P1 under the magnetic attraction of the cursor 101, and the cursor 101 gradually breaks away from the weather icon 102; and when the cursor 101 appears again, as shown in FIG. 3F, The weather icon 102 returns to the initial size shown in Figure 3A; finally as shown in Figure 3G, the cursor 101 breaks away from the weather icon 102, and returns to the initial size of Figure 3A, and the weather icon 102 also resets to as shown in Figure 3A The location _of the hot zone P1 center. In this way, the animation interaction effect of the user moving the cursor 101 away from the weather icon 102 is realized, and this process takes time t4. It can be understood that under the magnetic force of the weather icon 102, the cursor 101 accelerates to approach the weather icon 102 and decelerates away from the weather icon 102, so t3 is smaller than t4.

Comparing the animation interaction effects in the above different embodiments, it can be seen that the electronic device sets different animation interaction effects for the cursor 101 and each application program icon based on the physical properties of the application program icons, which is more in line with the rules of object interaction in the real world, and can better provide Users bring a good interactive experience.

In order to understand more clearly the implementation details of the different animation interaction effects set for the cursor 101 and the application icon based on the physical properties of the application icon on the electronic device, the following will introduce in detail with reference to FIGS. 4-12 .

It should be noted that the animation interaction effect displayed when the cursor 101 approaches or departs from a certain application program icon is used as an example for illustration, and the animation interaction effect between the cursor 101 and the application program icon described below is provided by the electronic device. It is generated when the cursor 101 interacts with a certain application program icon for the first time. It can be understood that in practical applications, the cursor 101 will interact with the application program icon many times. Therefore, in order to save power consumption of the electronic device, the electronic device can The animation interaction effect between the set cursor 101 and the icon is stored in the memory of the electronic device, and during the subsequent interaction process between the cursor 101 and the icon, the electronic device can directly obtain the set cursor 101 from the memory The animation interaction effect of interacting with the icon and displaying it.

It should be understood that the electronic devices in the above embodiments may be various electronic devices that have the function of displaying desktop icons and supporting cursor interaction, for example, electronic devices include but are not limited to laptop computers, desktop computers, tablet computers, mobile phones, server , wearable devices, head-mounted displays, mobile email devices, portable game consoles, portable music players, reader devices, or other electronic devices capable of accessing the Internet. In order to facilitate understanding of the cursor interaction solution of the present application, the electronic device 100 is a tablet computer 100 as an example for description below.

Specifically, FIG. 4 is a schematic flowchart of an example of an electronic device generating an animation interaction effect between a cursor and an icon provided by some embodiments. As shown in FIG. 4, method 400 includes:

In step 402, the image information of the icon image corresponding to the icon is obtained, and the physical attributes of the icon are set according to preset physical rules.

It can be understood that in the embodiment of the present application, the rules for calculating the physical attributes of icons can be preset, and then use the preset physical rules to target image information such as the pattern, color, and coordinates of each pixel in the icon image corresponding to the icon. , set the physical properties corresponding to the icon. Specifically, for example, the physical properties of an icon may include the quality, magnetism, etc. of the icon. For some icons whose background color is darker and whose pattern is more metallic, the physical properties of the icon may be set to be similar to those of metal, that is, Set larger quality and magnetic force; and for icons with cartoonish patterns, you can set their physical properties to be close to elastic balls, that is, set smaller quality and magnetic force.

For example, in some embodiments, the tablet computer 100 acquires the pixel value of the icon image corresponding to the icon, and determines the quality of the icon according to the pixel value of the icon image and the pixel value of the background color of the UI interface. Specifically, the icon quality can be calculated by the following formula (1).

Wherein, a is the current pixel value of the icon image corresponding to the icon, b is the pixel value of the background color of the UI interface, and X is the quality of the unit pixel of the icon image, that is, the quality of each pixel in the icon image. It can be understood that if the background color of the UI interface is a bright color theme, then b=OXFFFFFF (indicating white), and if the background color of the UI interface is a dark color theme, then b=OXOOOOOO (indicating black). It can be understood that the pixel value can also be represented by other systems, such as binary system and decimal system, which are not limited in this application.

In some embodiments, the current pixel value of the icon image can be the average value of all the pixel values of the icon image. Taking the WeChat icon 103 as an example, the overall color of the WeChat icon 103 is green, so it can be considered that the current pixel value of the WeChat icon 103 is The average value of the overall color, i.e. Ocean Green=OX2E8B57, at this time, the unit pixel quality of the icon image of the WeChat icon 103 calculated according to the formula (1) is

It can be seen that the mass of the icon pixel unit of the WeChat icon 103 calculated by the tablet computer 100 using the formula (1) is relatively large, and other physical properties of the icon are not used in subsequent calculations based on the icon quality. Therefore, in some embodiments, the tablet computer 100 also needs to use a normalization formula to normalize the unit pixel quality of the icon image obtained by using the formula (1), so as to reduce the order of magnitude of the icon pixel unit quality, which is convenient for subsequent Icon calculations for other physical properties.

Optionally, the above normalization formula (2) can be the following formula:

X ^t = (X-μ)/(MaxValue-MinValue) (2)

Among them, X ^t is the unit mass of the normalized icon pixel, μ is the preset normalized intermediate value, MaxValue is the largest pixel value in the unit pixel in the icon image, and MinValue is the smallest in the unit pixel in the icon image Pixel values.

After the tablet computer 100 uses the formula (2) to normalize the result calculated according to the formula (1), the unit mass of the icon pixel whose order of magnitude is reduced can be obtained.

Afterwards, the tablet computer 100 uses the summation formula (3) to calculate the sum of the masses of all unit pixels in the icon image to obtain the mass M ₁ of the icon (unit: kilogram (kg)). Among them, formula (3) can be expressed as:

Wherein, M ₁ represents the quality of the icon, n represents the number of pixels of the icon image, and x represents the quality of a unit pixel in the icon image.

After obtaining the mass M1 _of the icon, the tablet computer 100 will calculate the magnetic force of the icon according to the mass of the icon. In some embodiments, the tablet computer 100 can set the quality of the icon to be proportional to the magnetic force of the icon. For example, the magnetic force of the icon can be 20 times the mass of the icon. For an icon whose mass is M ₁ (kg), the magnetic force of the icon is 20M ₁ (unit: cattle (N)). It should be understood that the present application does not limit the proportional relationship between the mass of the icon and the magnetic force of the icon. In some embodiments, the magnetic force of the icon may be n times the mass of the icon, and n is a constant greater than 0. For example, n may be 2, 3,, 3.5, ..., 10, 11, ..., 21, 22 etc.

It can be understood that the calculation methods of the above physical attributes are only exemplary, and in other embodiments of the present application, other methods may also be used to set the physical attributes for the icon, which is not limited here.

Step 404 , setting physical attributes for the cursor 101 .

It can be understood that, in the embodiment of the present application, the tablet computer 100 also needs to set physical properties for the cursor 101 to simulate the real world, and the tablet computer 100 can set different physical properties for the cursor 101 according to different desktop themes. Wherein, the physical properties of the cursor 101 include the mass, magnetism and the like of the cursor 101 .

In some embodiments, the quality of the cursor 101 can be preset by the developer according to the system characteristics of the tablet computer 100 . For example, the mass of the cursor 101 can be set according to the system version or system theme. Suppose the system theme is night mode. Since the system theme color is dark, the mass of the cursor 101 can be set to a larger value, such as 0.1 kg. Assuming the system theme In the daytime mode, since the theme color of the system is a bright color system, the mass of the cursor 101 can be set to a small value, such as 0.01 kg.

Then, the tablet computer 100 calculates the magnetic force of the cursor 101 according to the mass of the cursor 101 . In some embodiments, the quality of the cursor 101 is directly proportional to the magnetic force of the cursor 101. For example, the magnetic force of the cursor 101 can be 20 times the mass of the cursor 101. Assuming that the mass of the cursor 101 is M ₂ (kg), the magnetic force of the cursor 101 is 20M ₂ (N). It should be understood that the present application also does not limit the proportional relationship between the mass of the cursor 101 and the magnetic force of the cursor 101 .

Then, the tablet computer 100 calculates the coefficient of friction between the cursor 101 and the UI interface according to the quality of the cursor 101 , so as to subsequently calculate the frictional resistance f1 between the cursor 101 and the UI interface. In some embodiments, the tablet computer 100 can calculate the coefficient of friction G between the cursor 101 and the UI interface through the following formula (4):

G＝1+(OXFFFFFF-background color pixel value)*Friction conversion coefficient (4)

Among them, the friction conversion coefficient can be set in advance by the research and development personnel, and the purpose is to adjust the order of magnitude of the friction coefficient to a lower order of magnitude. For example, assuming that the friction coefficient is 10n, the function of the friction conversion factor is to adjust the n in the friction coefficient 10n to a lower order of magnitude, for example, n is a small value such as 0.1, 1, 2, 3, etc., and OXFFFFFF is the white pixel value. Hexadecimal representation of the result.

According to the above formula (4), when the background color of the UI interface is darker, the pixel value of the UI interface background color is smaller, and the friction coefficient of the UI interface background is larger; when the background color of the UI interface is lighter, the pixel value of the UI interface background color is smaller. The larger the value, the smaller the friction coefficient of the UI interface background. For example, assuming that the background color of the UI interface is black, the hexadecimal representation result of the pixel value of the UI interface background color is OXOOOOOO, and when the background color of the UI interface is white, the hexadecimal representation result of the pixel value of the UI interface background color is OXFFFFFF , it can be seen that the friction coefficient of the black UI interface background calculated by formula (4) is larger than that of the white UI interface background and the cursor 101 .

It should be understood that, in some embodiments, the friction coefficient G is also positively correlated with the UI interface background ambiguity, that is, the greater the UI interface background ambiguity, the greater the friction coefficient G, and the smaller the UI interface background ambiguity, the greater the friction coefficient G. Also smaller. For example, the user can set the UI interface to the "frosted" mode through the system settings of the tablet computer 100. Assuming that the background color pixel values of the UI interface are the same, then when the UI interface is in the "frosted" mode, the friction coefficient of the UI interface G is larger than the friction coefficient G when the UI interface is in normal mode.

Step 406, according to the physical property of the cursor 101 and the physical property of the icon, an animation interaction effect when the cursor 101 interacts with the icon is generated.

It can be understood that in the embodiment of the present application, the tablet computer 100 can set different animation interaction effects for the cursor 101 and icons with different physical attributes according to physical laws. For example, if the quality of the icon is relatively large and the magnetic force is relatively strong, then when the cursor 101 approaches or leaves the icon, the magnetic attraction received will be stronger, and the cursor 101 will approach the icon faster or leave the icon more slowly; The quality of 101 under the system theme is bright color is greater than that under the system theme of dark color, then the cursor 101 touches the icon under the bright color theme, and the tilt of the icon will be smaller than that of the cursor 101 under the dark theme. resulting inclination.

Specifically, after obtaining the quality and magnetic force of the cursor 101 through the above-mentioned

steps

402 and 404, as well as the friction coefficient with the UI interface and the quality and magnetic force of the icon, when the user moves the cursor 101 to approach or leave the icon, the tablet computer 100 will Between 101 and the icon, animation interaction effects as shown in Figure 2 above and Figure 5 to Figure 11 below are set.

For example, under the magnetic force of the icon, the cursor 101 accelerates towards the icon or decelerates away from the icon (refer to FIG. 3); Deformation (see FIG. 6 ) that conforms to physical laws occurs to remind the user that the icon has been selected by the cursor 101 or that the cursor 101 is approaching or moving away from the icon, and it can be understood that when the cursor 101 or the icon is subject to a greater magnetic force, the greater the amount of deformation. or when the user moves the cursor 101 to select an icon, the icon is “pressed” by the cursor 101 to produce a 3D tilt effect as shown in FIG. 7 . Wherein, the animation interaction effect of the interaction between the cursor 101 and the icon will be described in detail below, and will not be repeated here.

Corresponding to the specific implementation method of cursor interaction described above, the animation interaction effect of cursor interaction realized according to the cursor interaction method of the present application will be introduced below with reference to FIGS. 5 to 12 . Specifically, the animation interaction effect between the above-mentioned cursor 101 and each icon provided by the embodiment of the present application will be introduced in detail below from the perspectives of the time taken for the cursor 101 to approach or move away from the icon, and the resulting deformation.

(1) The time spent when the cursor 101 approaches or moves away from the icon will vary according to the physical properties of the icon.

First of all, it can be understood that in the real physical world, when a magnetic object T1 is close to a magnetic object T2 that is not completely fixed, under the action of the magnetic force of the object T2, there will be a gap between the object T1 and the object T2. trend towards each other. For example, as shown in FIG. 8A , the range of the magnetic field formed by the magnet is P ₂ , and the user presses the coin at a distance L ₁ from the magnet. When the user moves the coin up to enter the magnetic field range P ₂ of the magnet, and the distance from the magnet is L ₂ , as shown in Figure 8B, although the coin is already within the magnetic force range of the magnet, the magnet is still not in contact with the magnet due to the long distance. The coin makes contact; the user continues to move the coin upwards, as shown in Figure 8C, when the user moves the coin to a distance _of L3 from the magnet, the coin makes contact with the magnet at this time, and as shown in Figure 8D, since the coin is pressed by the user Can't get close to the magnet, so the magnet is close to the coin under the action of the coin's magnetic force. Moreover, under the action of the magnetic force of the object T2, the object T1 will have acceleration, so that the object T1 can accelerate to approach the object T2. If the plane where the object T2 and the object T1 are located is not a smooth plane at this time, then the object T1 is still affected by frictional resistance in the process of approaching the object T2. At this time, the acceleration of the object T1 is determined by the magnetic force of the object T2 received by the object T1 and the frictional resistance between the object T1 and the plane are jointly determined.

Based on the above physical phenomena, taking the cursor 101 as the object T1, the icon as the object T2, and the cursor 101 approaching the icon as an example, the process of calculating the acceleration of the cursor 101 relative to the icon is as follows:

1) First, calculate the friction resistance f1 experienced by the cursor 101 according to the background friction coefficient between the cursor 101 and the UI interface.

In some embodiments, the tablet computer 100 calculates the coefficient of friction G between the cursor 101 and the background of the UI interface by using the above formula (4). For the convenience of explanation, take the background color as bright color as an example below, then the cursor 101 and the UI background friction coefficient G=1+(OXFFFFFF-OXFFFFFF)*friction force conversion coefficient=1 as an example, calculate the friction between the cursor 101 and the UI interface background Friction resistance f1.

After calculating the friction coefficient G between the cursor 101 and the UI background, the frictional resistance f1 experienced by the cursor 101 can be calculated according to formula (5):

f1=cursor quality*g*the friction coefficient between the cursor and the UI interface background (5)

Wherein, g is the gravitational acceleration, generally 10m/s ² .

2) Next, use the formula (6) to calculate the total force F of the cursor 101 according to the magnetic force F1 of the icon received by the cursor 101 and the frictional resistance f1 of the cursor 101:

F＝F1+f (6)

3) Calculate the acceleration a ₁ of the cursor 101 according to Newton's law F=M ₂ a ₁ , and the cursor 101 will approach the icon with the acceleration a ₁ .

Through the above method, when the user moves the cursor 101 to the magnetic force range _of the icon, the cursor 101 will accelerate towards the icon with acceleration a1, and it can be understood that when the cursor 101 leaves the icon and continues to move, the cursor 101 will be subjected to the magnetic force of the icon 1. The frictional resistance between the cursor 101 and the interface makes the cursor 101 decelerate and stop. For example, as shown in FIG. 9 , when the user moves the cursor 101 into the magnetic field range of the icon, under the action of the icon magnetic force F1 and frictional resistance f, the cursor 101 will have an acceleration a ₁ in the same direction as the cursor 101 moves, and the acceleration a ₁ The cursor 101 can be accelerated to approach the icon, and when the user moves the cursor 101 away from the icon, under the action of the icon magnetic force F1 and frictional resistance f, the cursor 101 will also have a certain acceleration that is opposite to the direction of the cursor 101, so that the cursor 101 The speed away from the icon gradually decreases and eventually stops.

Moreover, in order to make the interaction between the cursor 101 and the icon more consistent with the laws of the physical world, in some embodiments, the electronic device can set the icon to be not completely fixed, that is, the icon can approach the cursor 101 under the action of the cursor 101 , and, when the cursor 101 leaves the icon or selects the icon, the icon returns to its original position. That is, the electronic device sets one end of the icon to be fixedly connected to a virtual spring, such as shown in FIG. The effect produces animation interaction effects such as rebound and jump, and finally returns to the original position under the action of the virtual spring force. Wherein, the elastic force of the spring follows Hooke's law, and it should be understood that this application does not limit the animation interaction effect between the icon and the spring based on the elastic force of the spring.

Through the above method, the animation interaction effect shown in FIG. 3 above is realized between the cursor 101 and the icon.

(2) When the cursor 101 approaches or moves away from the icon, the cursor 101 will deform according to the physical properties of the icon.

As mentioned above, since each icon has magnetic force, there will be an attractive force between the cursor 101 and each icon, so that when the cursor 101 approaches or moves away from the icon, it will be deformed by the magnetic force of the icon. Specifically, as shown in Figure 5A, the cursor 101 is at the edge of the hot zone _P3 of the WeChat icon 103 at this time; and when the user continues to move the cursor 101 close to the WeChat icon 103, as shown in Figure 5C, the layer where the cursor 101 is located is hidden in the lower layer of the layer where the WeChat icon 103 is located, and the volume of the WeChat icon 103 will become larger. From Figure 5B to Figure 5C, the cursor 101 will be "sucked" into the WeChat icon 103 by the WeChat icon 103 visually, and the WeChat icon 103 will be "sucked" into the cursor 101, so the volume of the WeChat icon 103 will be reduced. increase.

Similarly, when the user moves the cursor 101 away from the WeChat icon 103, as shown in Figure 5D, since the cursor 101 is "adsorbed" on the WeChat icon 103, the WeChat icon 103 will follow the cursor 101 and approach the edge of the hot zone _P3 ; then the user Continue to move the cursor 101 away from the WeChat icon 103, the cursor 101 is gradually detached from the WeChat icon 103 under the gravitational force of the WeChat icon 103, and at the same time the deformation as shown in Figure 5E occurs, and because the cursor 101 is detached from the WeChat icon 103 , the "volume" of the WeChat icon 103 will also return to the initial size shown in Figure 5A; until the cursor 101 is completely separated from the WeChat icon 103, as shown in Figure 5F, the cursor 101 will also return to the initial shape shown in Figure 5A.

The above-mentioned embodiments have introduced the process that the cursor 101 deforms due to the gravitational force of the icon when the cursor 101 approaches or leaves the icon. 101 deformed under the gravitational force.

Specifically, as shown in FIG. 6A , the cursor 101 is at the edge of the hot zone P ₄ of the DingTalk icon 104 at this time; The deformation as shown in Figure 6B will occur; and when the user moves the cursor 101 and continues to approach the DingTalk icon 104, the layer where the cursor 101 is located is hidden under the layer where the DingTalk icon 104 is located, and the visual effect at this time is The cursor 101 is integrated with the DingTalk icon 104, and the DingTalk icon 104 is deformed as shown in Figure 6C. It can be seen that the "volume" of the DingTalk icon 104 in Figure 6C is larger than that of the DingTalk icon 104 in Figure 6A "volume".

When the user moves the cursor 101 away from the DingTalk icon 104, the _DingTalk icon 104 will follow the cursor 101 and move to the edge of the hot zone P4 as shown in FIG. Detach, and under the gravitational force of the cursor 101, the DingTalk icon 104 will deform as shown in Figure 6E; then when the cursor 101 is completely detached from the DingTalk icon 104, as shown in Figure 6F, the DingTalk icon 104 will recover to the initial shape as shown in Figure 6A.

It can be understood that, in some other embodiments, when the user moves the cursor 101 within the hot zone P4 of the _DingTalk icon 104, as shown in FIGS. The deformation as shown in FIGS. 6G-6I will occur due to being "attracted" by the cursor 101 . Among them, in FIG. 6G , the center position of the cursor 101 is consistent with the center position of the DingTalk icon 104, so the visual effect is that the edges of the DingTalk icon 104 gather toward the center; when the user moves the cursor toward the diagonally upward direction d 101 to the position shown in FIG. 6I , the nail icon 104 will deform as shown in FIG. 6H , until the cursor 101 moves to the position shown in FIG. 6I , and the nail icon 104 returns to the deformation shown in FIG. 6G . And it can also be understood that when the user moves the cursor 101 in the hot zone P4 of the _DingTalk icon 104, the animation interaction effects shown in FIGS.

(3) When the cursor 101 selects an icon or is about to unselect the icon, a corresponding 3D (dimension) effect occurs on the icon.

Since the interaction method of the present application defines physical attributes for both the cursor 101 and the icon, the cursor 101 and the icon have attributes similar to objects in the real physical world. However, in the real physical world, when an X object is used to press an Y object, the Y object generally deforms or tilts toward the pressing direction. For example, as shown in Figure 11A, when an X object is used to press a Y object, the surface of the Y object A concave area is formed as shown in FIG. 11B , or the Y object is tilted toward the pressing direction, so in some embodiments, the icon can also have a 3D tilting effect as shown in FIG. 7 due to being selected by the cursor 101 .

Specifically, as shown in FIG. 7A , the cursor 101 is now at the edge of the hot zone _P5 of the do-now icon 105. For the "tilt" effect shown in Figure 7B, when the user continues to move the cursor 101 until the layer where the cursor 101 is located is hidden under the layer where the icon 105 is located, the icon 105 will be deformed as shown in Figure 7C, that is, the icon icon The "volume" of the 105 will increase.

Similarly, when the user moves the cursor 101 away from the do-now icon 105, since the cursor 101 covers the do-now icon 105 again, the do-now icon 105 will have a "tilt" effect as shown in Figure 7D until the cursor 101 is completely separated The do-now icon 105, the do-now icon 105 returns to the initial shape as shown in FIG. 7A.

(4) When the cursor 101 selects an icon or is about to unselect an icon, the cursor 101 produces a light effect, which further affects the icon to produce a light effect.

In some embodiments, in order to remind the user that an icon has been selected, when the user moves the cursor 101 to touch the icon, a corresponding light effect may occur on the icon to remind the user that the icon has been selected. Specifically, as shown in FIG. 12A, the cursor 101 is at the edge of the hot zone _P6 of the _Instagram icon 106 (hereinafter referred to as "IG icon"). When the user continues to move the cursor 101 and contacts the IG icon 106, the cursor 101 will Generate a light effect to prompt the user to select the IG icon 106, and the light effect of the cursor 101 will be reflected through the IG icon 106, providing the user with a visual effect as shown in Figure 12B; when the user continues to move the cursor 101, in order to The user shows the movement track of the cursor 101, the cursor 101 will continue to emit light and move under the IG icon 106 (as shown in Figure 12C to Figure 12D), the visual effect at this time is that the user can observe the movement of the cursor 101 through the IG icon 106 track, so that the user can determine the position of the cursor 101 and perform subsequent operations, for example, the user moves the cursor 101 to the hot zone P ₆ .

When the user moves the cursor 101 away from the _IG icon 106, it will bring the user a visual effect as shown in FIG. , as shown in FIG. 12F , the light effect of the cursor 101 will disappear and return to the size shown in FIG. 12A .

The above is the animation interaction effect generated when the user uses the cursor 101 to approach or leave the icon provided by the cursor interaction method of the present application. Through the above-mentioned interactive animation interaction effect between the cursor 101 and the icon, the human-computer interaction mode of the user through the cursor 101 and the icon is closer to the user's interaction mode in the physical world, and the user's human-computer interaction experience is improved.

Moreover, it can be understood that in the cursor interaction method of the present application, since the image information of each icon is different, the physical attributes of each icon determined based on the image information are also different, and the magnetic attraction force generated between the cursor 101 and each icon is also different. are not the same, so when the user moves the cursor 101 close to or away from different application program icons in the interface shown in FIG. Therefore, compared with the single animation interaction effect preset by the electronic device mentioned above, the cursor interaction method of the present application can provide users with a better human-computer interaction experience.

It should be noted that in practical applications, when the user moves the cursor 101 close to or away from a certain icon, the tablet computer 100 needs to determine the target icon that the user moves the cursor 101 close to, and then determine the animation associated with the cursor 101 and the target icon. interaction effect, and display the animation interaction effect during the interaction process between the cursor 101 and the target icon. Specifically, the method for the tablet computer 100 to determine the target icon approached by the cursor 101 and display the corresponding animation interaction effect according to the cursor 101 and the target icon is shown in FIG. 13 , the method 1300 includes:

Step 1302, acquiring the distance between the cursor 101 and the icon.

It can be understood that the tablet computer 100 needs to determine whether the cursor 101 is going to approach the icon according to the distance between the cursor 101 and the icon.

In some embodiments, the tablet computer 100 can obtain the distance between the cursor 101 and the center of the icon as a sign for judging whether the cursor 101 is close to the icon, or can obtain the distance between the cursor 101 and the boundary of the hot zone where the icon is located as a sign for whether the cursor 101 is close to the icon . For example, as shown in FIG. 14A , the tablet computer 100 can determine whether the cursor 101 is close to the cursor 101 according to whether the distance L _X1X3 between the center point Px3 of the cursor 101 and the center point Px1 of the WeChat icon 103 is greater than or equal to a preset value.

The cursor 101 may also determine the target icon approached by the cursor 101 according to the distance between the center point Px3 of the cursor 101 and the edge of the hot zone of the icon. Specifically, as shown in FIG. 14B , the tablet computer 100 can determine whether the cursor 101 is close to the cursor 101 according to whether the distance Lx1 between the center point Px3 of the cursor 101 and the hot zone _P3 of the WeChat icon 103 is greater than or equal to a preset value.

Step 1304, according to the distance between the cursor 101 and the icon, determine whether the icon is a target icon.

It can be understood that the tablet computer 100 will determine whether the icon is a target icon approached by the cursor 101 according to the distance between the cursor 101 and an icon. Specifically, in some embodiments, the tablet computer 100 judges whether the distance between the cursor 101 and the icon is greater than or equal to a preset value, and if the distance between the cursor 101 and the icon is greater than or equal to the preset value, determines whether the icon is the target icon approached by the cursor 101 . For example, take the distance L _X1X3 between the center point Px3 of the cursor 101 and the center point Px1 of the WeChat icon 103 shown in FIG. If the distance _LX1X3 between the points Px1 is greater than or equal to a preset value (for example, 5 pixels), then the WeChat icon 103 is determined as the target icon. For another example, take the distance between the center point Px3 of the cursor 101 shown in FIG. If the edge distance Lx1 is greater than a preset value (for example, 5 pixels), then the WeChat icon 103 is determined as the target icon.

Step 1306, acquire the animation interaction effect related to the physical properties of the cursor 101 and the target icon, and display the animation interaction effect.

It can be understood that after the tablet computer 100 determines the target icon, it will obtain the animation interaction effect related to the physical properties of the cursor 101 and the target icon from the animation interaction effect between the cursor 101 and the icon generated according to the above method 400, and display the animation interaction effect on the cursor 101 During the interaction with the target icon, the animation interaction effect is displayed. Specifically, in some embodiments, the manner in which the tablet computer 100 obtains the animation interaction effect related to the cursor 101 and the icon may be:

After the tablet computer 100 generates the animation interaction effect between the cursor 101 and an icon for the first time, associate the animation interaction effect with the physical properties of the cursor 101 and the physical properties of the icon, and associate the animation interaction effect with the cursor 101 The association between the physical attributes and the physical attributes of the icon, as well as the animation interaction effect are stored in the memory of the tablet computer 100, so that when the tablet computer 100 obtains the animation interaction effect of the interaction between the cursor 101 and an icon, The animation interaction effect may be determined and displayed according to the association relationship between the animation interaction effect and the physical properties of the cursor 101 and the physical properties of the icon.

Optionally, the above association relationship may be the number corresponding to the physical property of the cursor 101, the number corresponding to the physical property of the icon, and the number of the animation interaction effect, wherein the number of the physical property of the cursor 101 may correspond to the system theme of the tablet computer 100 , for example, assuming that the physical property number of the cursor 101 is 001, it indicates the physical property of the cursor 101 under the bright color theme; the physical property number of the icon can correspond to the coordinates of the center point of the icon, for example, the coordinates of the center point of the WeChat icon 103 are (100, 140) Then the physical attribute number of the icon is 100-140; the numbering of the animation interaction effect can correspond to the order in which the tablet computer 100 generates the animation interaction effect. The serial number is 000013, so the animation interaction effect between the cursor 101 and the WeChat icon 103, and the relationship between the physical properties of the cursor 101 and the WeChat icon 103 is: 001-100-140-000013. When the tablet computer 100 determines that the target icon approached by the cursor 101 is the WeChat icon 103, it only needs to follow the physical attribute numbers 100-140 of the WeChat icon 103 and the physical attribute number 001 of the cursor 101 to determine the cursor 101 and the WeChat icon from the memory. The animation interaction effect between the icons 103 is 001-100-140-000013.

It can be understood that, in some embodiments, the user may pass through multiple icons when moving the cursor 101, so that the distance between the cursor 101 and the multiple icons is greater than or equal to a preset value. At this time, the tablet computer 100 will determine that the multiple icons are all targets icon, and then simultaneously display animation interaction effects between multiple icons and the cursor 101 . For example, as shown in Figure 14C, the distance K _X1X3 between the center point Px3 of the cursor 101 and the center point Px1 of the Wechat icon 103 and the distance _LX1X2 between the center point Px2 of the icon 105 to be done soon are all greater than the preset value (for example, 5 pixels), so when the cursor 101 is located at the position shown in FIG.

It should be understood that the purpose of this application is to introduce the implementation process of the animation interaction effect of the cursor 101 interacting with the icon, and there is no limitation on how the electronic device determines the target icon approached by the cursor 101 .

In addition, it can be seen from the above that in the process of realizing the interactive animation between the cursor 101 and the icon, the user needs to operate the cursor 101 to approach or move away from the icon, and when the user operates the cursor 101 to approach the icon, since the cursor 101 is on the tablet computer 100 The speed of moving on the touch screen is not the same as the speed at which the user actually moves the cursor 101. For example, the user slides his finger on the interface shown in FIG. 15 pixels/8 milliseconds, but on the interface shown in Figure 1, the moving speed of the cursor 101 may be 30 pixels/8 milliseconds, and for example, the user sometimes stops moving the cursor 101, but the cursor 101 will continue to move toward In this case, the user cannot predict the final position of the cursor 101 according to the actual speed of moving the cursor 101, so that in the above situation, the user may touch an icon by mistake when moving the cursor 101, for example, in In the interface shown in FIG. 1 , when the user quickly slides the cursor 101 to get close to the weather icon 102, since the speed at which the cursor 101 moves on the interface may be greater than the actual speed at which the user moves the cursor 101, the cursor 101 may cross the weather icon 102 at this time. , and stay on the short message icon 108 at last.

Therefore, in order for the tablet computer 100 to dynamically adjust the moving speed of the cursor 101 on the tablet computer 100 according to the speed at which the user moves the cursor 101 , the user can control the final stop position of the cursor 101 to avoid the above situation. For example, when the user needs to approach a certain icon, the cursor 101 can move faster to help the user approach the target icon, and when the user is about to approach a certain icon, the cursor 101 can move slowly to help the user accurately select the target icon. In some embodiments, the tablet computer 100 can dynamically adjust the moving speed of the cursor 101 by setting the display control gain. That is, when the user needs to move the cursor 101 close to an icon that is far away, the tablet computer 100 can select a larger display control gain, so that the actual speed at which the user moves the cursor 101 can be converted into a larger movement of the cursor 101 Speed, so that the cursor 101 can approach the icon faster; when the user needs to move the cursor 101 to select an icon, the tablet computer 100 can select a smaller display control gain, so that the actual speed of the user moving the cursor 101 is the same as that of the cursor 101. The moving speed on the tablet computer 101 can be approached as soon as possible, so that the user can predict the moving speed of the cursor 101 on the tablet computer 100 according to the actual speed of the moving cursor 101 , and then realize precise control of the position of the cursor 101 .

Wherein, the control display gain (Control Display Gain) represents the ratio of the speed at which the cursor 101 moves on the touch screen (display screen) of the tablet computer 100 to the speed at which the user moves the cursor 101 on the display screen, i.e. CD Gain=(cursor movement speed)/ (The speed at which the finger moves the cursor), where the speed at which the finger moves the cursor 101 represents the speed at which the user moves the cursor 101 in the physical world, and the speed at which the cursor 101 moves represents the speed at which the cursor 101 moves on the touch screen in response to the user's operation.

In order to better understand the meaning of the display control gain, the following briefly introduces the above-mentioned effects achieved by the tablet computer 100 based on different operating systems in some embodiments.

Specifically, FIG. 15A is a display and control gain curve of a Windows touch screen. The display and control gains of a Windows touch screen can be divided into "fast", "medium", and "slow" grades, corresponding to the curves s1, s2, and s3 shown in FIG. 15A. It can be seen from FIG. 15A that when the gain level of the display control is "fast", the cursor 101 will only have a speed when the user's moving speed of the cursor 101 is greater than 5 pixels per millisecond, and the speed increases with the user's actual moving speed of the cursor 101 increase; and when the display control gain grade is "medium", the speed of the user moving the cursor 101 is less than 5 pixels every 8 milliseconds, the cursor 101 will have a speed; when the display control gain grade is "low", the user moves the cursor 101 As long as the speed is greater than 0 pixels every 8 milliseconds, the cursor 101 will have a speed, indicating that when the level of the display and control gain is low, the touch screen of the tablet computer 100 can detect the speed of the user moving the cursor 101 with high accuracy, that is, when the level of the display and control gain is low When it is low, the user only needs to move the cursor 101 slightly, but when the gain level of display control is high, the accuracy of the touch screen of the tablet computer 100 to detect the speed of the cursor 101 moved by the user is low, that is, the user needs to move the cursor rapidly 101, the cursor 101 can be manipulated to move.

Therefore, based on the display control gain curve shown in FIG. 15A , when the tablet computer 100 dynamically adjusts the display control gain according to the speed at which the user moves the cursor 101 to adjust the moving speed of the cursor 101 on the touch screen, the speed at which the user moves the cursor 101 has a certain effect. Only when the speed at which the user moves the cursor 101 exceeds 5 pixels per millisecond, the tablet computer 100 will adjust the display control gain level of the touch screen to "fast", so that the speed at which the cursor 101 moves on the touch screen will also change accordingly. fast, and when the speed of the user moving the cursor 101 is less than 5 pixels per millisecond, the tablet computer 100 will not adjust the display control gain level to "fast". Moreover, the display control gains shown in FIG. 15A are all less than 1, that is, the speed at which the cursor 101 moves on the touch screen will not be greater than the speed at which the user actually moves the cursor 101 . It can be understood that when the user moves the cursor 101 close to the icon, he of course hopes that the cursor 101 can approach the icon as quickly as possible, and based on the display control gain curve shown in FIG. The speed of actually moving the cursor 101 can only be increased at the same time, and even so, the speed of the cursor 101 moving on the touch screen will not exceed the speed at which the user actually moves the cursor 101, which obviously does not meet the user's expectations.

Similarly, Figure 15B shows the display control gain curve of the Mac touch screen. The display control gain of the Mac touch screen can also be divided into "fast", "medium" and "slow" grades, corresponding to the curve s4, curve s5 and curve s6 shown in Figure 15B respectively , the difference from the display control gain curve of the Windows touch screen is that the detection accuracy of the Mac touch screen is higher than that of the Windows touch screen. It can be seen from FIG. 15B that no matter the display control gain level of the Mac touch screen is "fast", "medium" or "slow", as long as the user actually moves the cursor 101 at a speed greater than 0, the cursor 101 will have a speed on the touch screen.

For example, when the user actually moves the cursor 101 at a speed of 5 pixels per 8 milliseconds, and when the display control gain level of the Mac touch screen is "fast", the speed of the cursor 101 is: 5×0.1=0.5 pixels per 8 milliseconds; When the control gain level is "medium", the speed of the cursor 101 is: 5×0.15=0.75 pixels per 8 milliseconds; when the Mac touch screen display control gain level is "slow", the speed of the cursor 101 is: 5×1=5 pixels Every 8 milliseconds, which is close to the actual input speed of the user.

However, in the same scene, when the Windows touch screen display control gain grade is "fast", the speed of the cursor 101 is 5*0=0 pixels per 8 milliseconds, that is, the Windows touch screen cannot detect the user's movement of the cursor 101; When the display control gain level of the Windows touch screen is "medium", the speed of the cursor 101 is: 5×0.1=0.5 pixels per 8 milliseconds; when the display control gain level of the Windows touch screen is "slow", the speed of the cursor 101 is infinitely close to 0 , that is, at this time, the Windows touch screen cannot detect the speed at which the user moves the cursor 101 .

Moreover, it can be seen from FIG. 15B that when the speed at which the user moves the cursor 101 changes, unlike the Windows touch screen that detects the speed at which the user moves the cursor 101 by switching levels and adjusts the speed at which the cursor 101 moves, the Mac touch screen operates at the same Adjust the moving speed of the cursor 101 under the control gain level. For example, when the speed at which the user moves the cursor 101 changes from 20 pixels per 8 milliseconds to 5 pixels per 8 milliseconds, the display control gain level of the Windows touch screen must be converted from "fast" to "medium" to detect the speed at which the user moves the cursor 101 , and adjust the moving speed of the cursor 101 from 20×0.5=10 pixels every 8 milliseconds to 5×0.1=0.5 pixels every 8 milliseconds, and the Mac touch screen only needs to set the cursor 101 under the “fast” level of the display control gain The speed is adjusted from 20×0.3=6 pixels per 8 milliseconds to 5×0.1=0.5 pixels per 8 milliseconds. It can be seen that the response speed of the Mac touch screen to adjust the display and control gain level is also faster than that of the Windows touch screen to adjust the display and control gain level. quick.

However, similar to FIG. 15A , the display and control gains that can be adjusted by the Mac touch screen are all less than or equal to 1, that is, for the Mac touch screen, the speed at which the cursor 101 moves on the Mac touch screen will not exceed the actual speed at which the user moves the cursor 101 . Understandably, similar to the Windows touch screen in FIG. 15A, this also does not meet user expectations.

In order to solve the above problems, in some embodiments, the present application will combine the friction resistance and the magnetic attraction force of the icon during the movement of the cursor 101 calculated in the above method 400 to design the tablet computer 100 as shown in Figure 16 below. Display and control gain curve, wherein, FIG. 16A is the display and control gain curve of the touch screen of the tablet computer 100, and FIG. 16B is corresponding to different display and control gain levels in FIG. speed) curves.

Specifically, FIG. 16A is the display and control gain curve of the touch screen of the tablet computer 100. It can be seen from FIG. 16 that the detection accuracy of the touch screen of the tablet computer 100 is relatively high. An operation by the user to move the cursor 101 such that the cursor 101 has a speed as shown in FIG. 16B can be detected.

Moreover, it can be seen from FIG. 16A and FIG. 16B that when the display and control gain grade of the touch screen of the tablet computer 100 is "slow", the display and control gain is a fixed value of 0.25, that is, the moving speed of the cursor 101 is always equal to the actual moving speed of the cursor 101 by the user. In this case, the user can predict the position where the cursor 101 will be moved by the speed at which the cursor 101 is moved, so that the user can manipulate the cursor 101 more accurately, especially when the user moves the cursor 101 When selecting certain icons or function options. For example, on the interface shown in Figure 1, when the user moves the cursor 101 to select between the weather icon 102 and the short message icon 108, the user can control the cursor 101 more precisely to select between the weather icon 102 and the short message icon 108. to make a choice between clicks without accidental clicks.

Furthermore, since the detection accuracy of the touch screen of the tablet computer 100 is relatively high, when the user moves the cursor 101 from fast to slow, it can be seen from FIG. The speed at which the cursor 101 moves. For example, if the speed at which the user moves the cursor 101 changes from 120 pixels per 8 milliseconds to 0 pixels per 8 milliseconds, the tablet computer 100 can change the moving speed of the cursor 101 from 375 pixels per millisecond to "fast". Adjusted to 0 pixels per millisecond, the tablet computer 100 can also adjust the moving speed of the cursor 101 from 180 pixels per millisecond to 0 pixels per millisecond when the display control gain level is "medium", and the tablet computer 100 can also adjust the speed of the cursor 101 to 0 pixels per millisecond. When the gain control level is set to "slow", the moving speed of the cursor 101 is adjusted from 30 pixels per millisecond to 0 pixels per millisecond.

Moreover, it can be seen from FIG. 16A that the display control gain of the touch screen of the tablet computer 100 may be greater than 1, that is, the speed at which the cursor 101 moves on the touch screen of the tablet computer 100 may be greater than the speed at which the user actually moves the cursor 101 . Specifically, it can be seen from FIG. 16B that when the user actually moves the cursor 101 at the same speed, the higher the display control gain level, the faster the cursor 101 moves. For example, suppose the user moves the cursor 101 at a speed of 120 pixels per 8 milliseconds, under the "fast" level of display control gain, the moving speed of the cursor 101 is 357 pixels per 8 milliseconds, under the "medium" level of display control gain, the moving speed of the cursor 101 is 180 pixels per 8 milliseconds. Under the level display control gain, the moving speed of the cursor 101 is 30 pixels every 8 milliseconds.

Therefore, the tablet computer 100 can dynamically adjust the display control gain level of the touch screen of the tablet computer 100 according to the speed at which the user actually moves the cursor 101 , so that the user can control the cursor 101 more precisely. For example, in some embodiments, when the cursor 101 is far away from the target position, the user will move the cursor 101 faster so that it can approach the target position as soon as possible. is "fast", so that when the user moves the cursor 101 at the same speed, the cursor 101 can have a faster speed to get closer to the target position; when the cursor 101 is closer to the target position, the user moves the cursor 101 The speed will be slowed down so that the cursor 101 can be controlled to accurately reach the target position. At this time, the tablet computer 100 can adjust the display control gain level of the touch screen to "slow", so that the user can control the cursor 101 more precisely.

It should be understood that the above-mentioned tablet computer 100 touch screen display and control gain levels "fast", "medium", "slow" and the numbers of corresponding curves a, b, c are only exemplary. In other embodiments, the tablet computer 100 There can be more display and control gain grades on the touch screen, and correspondingly, more display and control gain curves. Moreover, it is also exemplary that the grades of the above-mentioned display control gains are expressed as "fast", "medium" and "slow". In other embodiments, the grades of display control gain can also be expressed as numbers, letters, etc., for example, "fast The display control gain level of the "grade is expressed as "5", the display control gain level of the "medium" level is expressed as "0", the display control gain level of the "slow" level is expressed as "-5" and so on. There is no limit to the number and representation of the gain levels displayed and controlled on the touch screen of the computer 100 .

Further, since the initial speed of the cursor 101 depends on the speed when the user moves the cursor 101 and releases the cursor 101, if the speed when the user releases the cursor 101 is different, the cursor 101 is affected by the same frictional resistance f1, and the final staying position will be different. Not the same. Specifically, a schematic diagram of the relationship between the speed of the cursor 101 and the distance moved by the cursor 101 is shown in FIG. After being released at the maximum speed, the final moving distance of the cursor 101 will be different due to the difference in its maximum speed. For example, when the user releases the cursor 101, the speed of the cursor 101 reaches the maximum value. Curves (a), (b) The maximum speed of the cursor 101 corresponding to (c) is va, vb, vc respectively, and the moving distance of the cursor 101 is Sa, Sb, Sc. As can be seen from FIG. 17, vc is greater than va than vb, and Sc is greater than Sa than Sb.

Specifically, as shown in FIG. 18A, suppose the user moves the cursor 101 from position X1 to position X2, and releases the cursor 101 at position X2. At this time, the speed of the cursor 101 is v2. Under the action of frictional resistance f1, the cursor 101 finally The staying position is X3; as shown in Figure 18B, suppose the user still moves the cursor 101 from the position X1 to the position X2 to release, but at this time the speed of the cursor 101 at the position X2 is v3 (greater than v2), then the cursor 101 at this time Under the same frictional resistance f1, 101 will eventually stay at position X3', and the distance between position X3' and position X2 is greater than the distance between position X3 and position X2.

In addition, when the user moves the cursor 101, because the hardware sampling rate of the tablet computer 100 is insufficient, or the sampling accuracy is insufficient, the reporting position of the cursor 101 is discontinuous. As shown in FIG. 19A, when the user moves the cursor 101, the tablet computer The distance intervals of the cursor 101 displayed on the display screen 100 are h1, h2, and h3 respectively, and it can be seen from the figure that h1, h2, and h3 are not equal. In order to improve the accuracy of reporting the position of the cursor 101, when the user moves the cursor 101, the distance of the cursor 101 on the display screen of the tablet computer 100 can be as shown in FIG. In some embodiments, Kalman filtering (Kalman filtering) operation may be performed on the position of the cursor 101 to make the position of the cursor 101 more precise, so that the reported position displayed on the tablet computer 100 is more accurate.

Specifically, at first set up a linear stochastic differential equation (Linear Stochastic Dufference equation) (seven) and tablet computer 100 input and output system measurement values (eight):

X _k ＝AX _k-1 +BU _k +W _k (7)

Z _k ＝HX _k +V _k (eight)

Wherein, X _k is the system state of the tablet computer 100 at time k, U _k is the user’s control amount of the cursor 101 at time k, A and B are input and output system parameters of the tablet computer 100 of the tablet computer 100, and Z _k is time k The measured value of the moving speed of the cursor 101, H is the parameter of the tablet computer 100 input and output system, W _k represents the noise in the moving process of the cursor 101, V _k represents the noise of the measurement process, the covariance of W _k is Q, and the V _k is Covariance is R

Assuming that the current state is K, the process of predicting the current state K according to the last state of the input-output system of the tablet computer 100 is as follows (nine):

X( _K|K-1 )＝AX _(K-1|K-1) +BU _k (nine)

Among them, X _(K|K-1) is the result predicted by the previous state, X _(K-1|K-1) is the optimal result of the previous state, U _k is the user's control amount in the current state, If there is no user's control quantity at present, U _k is 0. It should be understood that the user's control amount refers to the user's control amount such as the strength and duration of moving the cursor 101 .

At the same time, update the covariance P _(K|K-1 ) of X _(K|K -1) = AP _(K-1|K-1) A′+Q(ten), where P _{(K-1|K -1)} is the covariance corresponding to X _{(K−1|K−1)} , A′ represents the transpose matrix of A, and Q is the covariance of the input and output measurement process of the tablet computer 100 .

Afterwards, use formula (7) to formula (10) to get the prediction result of the current state, and then collect the current measurement value, and combine the prediction result and measurement value, use the formula (11) to get the maximum value of the current state (K) Optimize estimates X(K K).

X _(K|K) ＝X _(K|K-1) +Kg _k (Z _k -HX _(K|K-1) ) (eleven)

Wherein, Kg _k is Kalman Gain=P _(K|K-1) H'/(HX _(K|K-1) H'+R) (12).

Moreover, in order to make the Kalman filter continue to move until the input and output measurement process of the tablet computer 100 ends, it is necessary to use the formula (13) to update the covariance of X _(K|K) in the current state K.

P _(K|K) ＝(I-Kg(K)HP _(K|K-1) (thirteen)

Among them, I is a matrix whose values are all 1.

In this way, when the system enters the K+1 state, P _(K|K) is P _{(K-1|k-1) in formula (10)} .

Then utilize above-mentioned formula (seven) to formula (thirteen), calculate the cursor 101 in the current state according to the distance that the user controls cursor 101 to move on the tablet computer 100 and the distance (measured value) that the tablet computer 100 gathers to move the cursor 101 The optimal estimated value of the movement, so as to improve the accuracy of the position of the cursor 101, and then achieve the effect of continuous reporting of the cursor 101 as shown in FIG. 19B.

Fig. 20 shows a schematic structural diagram of an example of a tablet computer 100 provided by some embodiments.

The tablet computer 100 may include a processor 110, a screen 111, an internal memory 120, an interface module 130, a power module 140, a wireless communication module 150, a mobile communication module 160, an audio module 170, a camera 180, and a touch sensor 190.

It can be understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the tablet computer 100 . In some other embodiments of the present application, the tablet computer 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

A memory may also be provided in the processor 110 for storing instructions and data. In the embodiment of the present application, the processor 110 may execute a method for displaying an interface of an application.

The screen 111 is used to display images, videos and the like. In the embodiment of the present application, the tablet computer 100 can dynamically adjust the positions of the display elements in the display interface of the application according to the size of the display area of the display interface of the application on the screen 111 .

The internal memory 120 may be used to store computer-executable program code, which includes instructions. The internal memory 120 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data (such as audio data, phone book, etc.) created during the use of the tablet computer 100 . In the embodiment of the present application, the display style parameters of the application, the layout rules of the display elements in the display interface of the application, and the display style models of the display elements may be stored in the internal memory 120 . The layout rules here are used to configure the default display interface of the application.

The interface module 130 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the tablet computer 100. The external memory card communicates with the processor 110 through the interface module 130 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The power module 140 receives the input of the battery, and provides power for the processor 110, the internal memory 120, the display screen 111 and so on.

The wireless communication module 150 can provide applications on the tablet computer 100 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), Bluetooth (blue tooth, BT), global navigation, etc. Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.

The mobile communication module 160 can provide wireless communication solutions including 2G/3G/4G/5G applied on the tablet computer 100 .

The tablet computer 100 realizes the display function through the GPU, the display screen 111 , and the application processor.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .

The tablet computer 100 can realize the shooting function through the camera 180 and the application processor.

The touch sensor 190 is also called "touch device". The touch sensor 190 may be disposed on the screen 111, and the touch sensor 190 and the screen 111 constitute a touch screen, also called “touch screen”. In the embodiment of the present application, the touch sensor 190 is used to identify the user operation performed by the user on the screen 111 of the tablet computer 100 and obtain physical data of the user operation, for example, the physical data includes the force and direction of the user operation, etc. .

FIG. 21 is a block diagram of the software structure of the tablet computer 100 according to the embodiment of the present invention.

As shown in Figure 21, the tablet computer 100 can be divided into application program layer, application program framework layer, Android runtime (Android runtime) and system library, and kernel layer.

Wherein, the application program layer may include a series of application program packages.

As shown in FIG. 21, the application package may include application programs such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message. In the embodiment of the present application, the application program package may include a gallery application and the like.

Application framework layers can include view systems, gesture recognition systems, and more.

In the embodiment of the present application, the gesture recognition system is used to recognize the user's operation performed on the gallery application on the screen of the tablet computer 100 .

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build the display interface of the application. The display interface may be composed of one or more display elements, where the display elements refer to the elements in the display interface of the application on the screen of the electronic device. For example, display elements may include buttons, text, pictures, pop-up windows, menus, title bars, lists, or search boxes. The display interface of the application may include at least one display element. In the embodiment of the present application, the view system can be used to implement the layout scheme of the display interface of the application of the present application. For example, when the application starts, the view system can be based on the display area of the display interface of the application on the screen of the tablet computer 100 size, dynamically adjust the position of the display elements in the display interface; at the same time, the view system can also configure the display style model for the application's display interface, and when the application starts, the view system uses the application's display style parameters to calculate through the display style model The display effect of the display elements in the display interface.

Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

A system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

The embodiment of the present application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and operable on the at least one processor, and the processor executes The computer program implements the steps in any of the above method embodiments.

The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in each of the foregoing method embodiments can be realized.

An embodiment of the present application provides a computer program product. When the computer program product is run on a mobile terminal, the mobile terminal can implement the steps in the foregoing method embodiments when executed.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments in the present application can be completed by instructing related hardware through computer programs, and the computer programs can be stored in computer-readable storage media. When executed by the processor, the steps in the above-mentioned various method embodiments can be realized. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying computer program codes to a photographing device/terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (random access memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media. Such as U disk, mobile hard disk, magnetic disk or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunication signals under legislation and patent practice.

In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases, and for parts that are not detailed or recorded in a certain embodiment, refer to the relevant descriptions of other embodiments.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

In the embodiments provided in this application, it should be understood that the disclosed device/network device and method may be implemented in other ways. For example, the device/network device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units Or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In the above description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and/or components, but does not exclude one or more other Presence or addition of features, wholes, steps, operations, elements, components and/or collections thereof.

It should also be understood that the term "and/or" used in the description of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

As used in this specification and the appended claims, the term "if" may be construed depending on the context as "when" or "once" or "in response to determining" or "in response to detecting" . Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be construed, depending on the context, to mean "once determined" or "in response to the determination" or "once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.

In addition, in the description of the specification and appended claims of the present application, the terms "first", "second", "third" and so on are only used to distinguish descriptions, and should not be understood as indicating or implying relative importance.

Reference to "one embodiment" or "some embodiments" or the like in the specification of the present application means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically stated otherwise. The terms "including", "comprising", "having" and variations thereof mean "including but not limited to", unless specifically stated otherwise.

The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still implement the foregoing embodiments Modifications to the technical solutions described in the examples, or equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application, and should be included in the Within the protection scope of this application.

Claims

A cursor interaction method applied to electronic equipment, characterized in that the method includes:

determining a target icon for interaction with the cursor;

Displaying animation interaction effects related to the physical properties of the cursor and the physical properties of the target icon, wherein the physical properties are based on the image information of the cursor and the image information of the target icon, which is beneficial to preset physical properties The rules are obtained by simulating the physical properties of objects in the physical world, and the animation interaction effect shows the physical phenomenon produced by the cursor and the target icon following the corresponding physical laws during the interaction process.
The method according to claim 1, wherein the determining the target icon interacting with the cursor comprises:

setting a hot zone including an icon, the distance between each boundary of the hot zone and the center of the icon is greater than a preset distance;

When the cursor enters the hot zone, it is determined that the icon in the hot zone is the target icon.
The method according to claim 1 or 2, wherein the physical properties include mass, magnetic force, and a coefficient of friction between the cursor and the interface where the icon is located.
The method according to any one of claims 1 to 3, wherein, during the interaction process between the cursor and the target icon, the electronic device displays one or more of the following animation interaction effects:

When the cursor is close to the target icon, the cursor is accelerated to approach the target icon under the magnetic attraction of the target icon;

When the cursor leaves the target icon, the cursor decelerates away from the target icon under the magnetic attraction of the target icon;

When the cursor approaches or departs from the target icon, the cursor is deformed under the magnetic attraction of the target icon;

When the cursor approaches or departs from the target icon, the target icon is deformed under the magnetic attraction of the cursor;

When the cursor comes into contact with the target icon, the target icon tilts toward the direction where the cursor is located.
The method according to any one of claims 1 to 3, wherein during the interaction process between the cursor and the target icon, an obstacle between the cursor and the interface where the target icon is located Frictional resistance of cursor movement, and the electronic device displays one or more of the following animation interaction effects:

When the cursor is close to the target icon, the cursor is accelerated to approach the target icon under the action of the magnetic force of the target icon, the cursor and the frictional resistance;

When the cursor is separated from the target icon, the cursor decelerates away from the target icon under the action of the magnetic force of the target icon, the cursor and the frictional resistance.
The method according to any one of claims 3 to 5, wherein the image information of the icon includes pixel values of an icon image corresponding to the icon; and

The method also includes:

The quality of the icon is determined according to the pixel value of the icon image and the pixel value of the background color of the interface, and the difference between the quality of the icon and the pixel value of the icon image and the pixel value of the background color of the interface is determined. The difference between is positively correlated.
The method according to any one of claims 3 to 5, characterized in that the magnetic force of the icon is positively correlated with the mass of the icon.
The method according to any one of claims 3 to 5, wherein the frictional resistance between the cursor and the interface where the icon is located and the mass of the cursor and the distance between the cursor and the interface where the icon is located The friction coefficient between the cursor and the interface is negatively correlated with the pixel value of the interface, and the friction coefficient between the cursor and the interface is a constant greater than 1.
The method according to any one of claims 1 to 8, wherein the physical law includes at least one of a friction formula, an acceleration formula, and an elastic force formula.
The method according to any one of claims 1 to 9, wherein the icons include icons of application programs installed on the desktop of the electronic device, and during the running of the application programs, the application program interface on the icon.
An electronic device, characterized in that it comprises:

a memory storing computer program instructions;

A processor, the processor and the memory are coupled, and when the computer program instructions stored in the memory are executed by the processor, the electronic device is made to perform the following operations:

determining a target icon for interaction with the cursor;

Displaying animation interaction effects related to the physical properties of the cursor and the physical properties of the target icon, wherein the physical properties are based on the image information of the cursor and the image information of the target icon, which is beneficial to preset physical properties The rules are obtained by simulating the physical properties of objects in the physical world, and the animation interaction effect shows the physical phenomenon produced by the cursor and the target icon following the corresponding physical laws during the interaction process.
The electronic device according to claim 11, wherein the determining the target icon interacting with the cursor comprises:

setting a hot zone including an icon, the distance between each boundary of the hot zone and the center of the icon is greater than a preset distance;

When the cursor enters the hot zone, it is determined that the icon in the hot zone is the target icon.
The electronic device according to claim 11 or 12, wherein the physical properties include mass, magnetic force, and a coefficient of friction between the cursor and the interface where the icon is located.
The electronic device according to any one of claims 11 to 13, wherein, during the interaction process between the cursor and the target icon, the electronic device displays one or more of the following animation interaction effects:

When the cursor is close to the target icon, the cursor is accelerated to approach the target icon under the magnetic attraction of the target icon;

When the cursor leaves the target icon, the cursor decelerates away from the target icon under the magnetic attraction of the target icon;

When the cursor approaches or departs from the target icon, the cursor is deformed under the magnetic attraction of the target icon;

When the cursor approaches or departs from the target icon, the target icon is deformed under the magnetic attraction of the cursor;

When the cursor comes into contact with the target icon, the target icon tilts toward the direction where the cursor is located.
The electronic device according to any one of claims 11 to 13, wherein during the interaction process between the cursor and the target icon, an obstacle occurs between the cursor and the interface where the target icon is located. frictional resistance of the cursor movement, and the electronic device displays one or more of the following animation interaction effects:

When the cursor is close to the target icon, the cursor is accelerated to approach the target icon under the action of the magnetic force of the target icon, the cursor and the frictional resistance;

When the cursor is separated from the target icon, the cursor decelerates away from the target icon under the action of the magnetic force of the target icon, the cursor and the frictional resistance.
The electronic device according to any one of claims 13 to 15, wherein the image information of the icon includes the pixel value of the icon image corresponding to the icon, and the method further includes: according to the image information of the icon image The pixel value and the pixel value of the background color of the interface determine the quality of the icon, and the quality of the icon is positively correlated with the difference between the pixel value of the icon image and the pixel value of the background color of the interface .
The electronic device according to any one of claims 13 to 15, wherein the magnetic force of the icon is positively correlated with the mass of the icon.
The electronic device according to any one of claims 13 to 15, wherein the frictional resistance between the cursor and the interface where the icon is located and the quality of the cursor and the interface where the cursor and the icon are located The coefficient of friction between the cursor and the interface is negatively correlated with the pixel value of the interface, and the coefficient of friction between the cursor and the interface is a constant greater than 1.
The electronic device according to any one of claims 11 to 18, wherein the physical law includes at least one of a friction formula, an acceleration formula, and an elastic force formula.
The electronic device according to any one of claims 11 to 19, wherein the icon includes an icon of an application program installed on the desktop of the electronic device, and during the running of the application program, the application program Icons on the interface.
A computer-readable medium, characterized in that instructions are stored on the computer-readable medium, and when the instructions are executed on the electronic device, the electronic device executes the cursor interaction method according to any one of claims 1 to 10.