CN116185263A

CN116185263A - Screen interaction method, interaction device, electronic device and readable storage medium

Info

Publication number: CN116185263A
Application number: CN202111422014.9A
Authority: CN
Inventors: 李德旺
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-11-26
Filing date: 2021-11-26
Publication date: 2023-05-30

Abstract

The application discloses a screen interaction method, interaction equipment, electronic equipment and readable storage medium, wherein the method comprises the following steps: detecting a sliding operation on the screen; dynamically setting a damping coefficient based on the sliding operation; based on the damping coefficient, the change speed of the display element corresponding to the sliding operation is set. In this way, the present application can set the changing speed of the corresponding display element by dynamically setting the damping coefficient in response to the sliding operation of the user.

Description

Screen interaction method, interaction device, electronic device and readable storage medium

Technical Field

The present disclosure relates to the field of touch technologies, and in particular, to a method for screen interaction, an interaction device, an electronic device, and a readable storage medium.

Background

Generally, with the promotion of various demands of people for product equipment, users often want to keep the touch timeliness of the product equipment and the touch rationality of the product equipment when the product equipment is used for touch.

Generally, in terms of touch technology, in order to use convenience of a product device, a touch screen is often disposed on the product device, and a user may interact with an application program or a display element of the product device such as a mobile terminal by using a sliding operation manner on the touch screen.

Currently, in the process of interaction between a user and a touch screen, the sliding of a picture appears very hard.

Disclosure of Invention

An embodiment of the present application provides a method for screen interaction, where the method includes: detecting a sliding operation on the screen; dynamically setting a damping coefficient based on the sliding operation; based on the damping coefficient, the change speed of the display element corresponding to the sliding operation is set.

A second aspect of an embodiment of the present application provides an interaction device, including: a detection module for detecting a sliding operation on a screen; a selection module for dynamically selecting a damping coefficient based on a sliding operation; and the control module is used for controlling the change speed of the display element corresponding to the sliding operation based on the damping coefficient.

A third aspect of the embodiments of the present application provides an electronic device, including: a processor and a memory, in which a computer program is stored, the processor being adapted to execute the computer program to implement the method according to the first aspect.

A fourth aspect of the embodiments of the present application provides a computer readable storage medium storing a computer program which, when executed by a processor, is capable of implementing the method of the first aspect of the embodiments of the present application.

The beneficial effects of this application are: the method can respond to the sliding operation on the screen, dynamically select the change of the damping attribute by dynamically setting the damping coefficient, and control the damping size in real time according to the sliding operation behavior, thereby setting the change speed of the corresponding display element, controlling the soft feeling in the process of interactive animation with the screen and avoiding the animation to be hard.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of an embodiment of a method of screen interaction of the present application;

FIG. 2 is a schematic diagram of a screen illustrating an embodiment of step S12 in FIG. 1 of the present application;

FIG. 3 is a schematic view of a screen sliding in a short direction of the present application;

FIG. 4 is a schematic diagram of damping variation of an embodiment of FIG. 3 of the present application;

FIG. 5 is a schematic flow chart of damping arrangement according to different sliding directions in FIG. 2 of the present application;

FIG. 6 is a flowchart illustrating an embodiment of determining a sliding direction of a touch point in FIG. 2;

FIG. 7 is a schematic view of a screen of the present application with transparency change in response to a sliding operation;

FIG. 8 is a block diagram of an interactive device according to an embodiment of the present application;

FIG. 9 is a schematic diagram of an electronic device according to an embodiment of the disclosure;

FIG. 10 is a schematic diagram of a computer-readable storage medium provided herein;

fig. 11 is a schematic block diagram of a hardware architecture of the terminal of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It is also to be understood that the terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.

As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".

In order to explain the technical solution of the present application, the present application provides a method for screen interaction, please refer to fig. 1, fig. 1 is a schematic diagram of an overall system framework of the anonymous communication method of the present application, and the method specifically includes the following steps:

s11: detecting a sliding operation on the screen;

generally, in order to facilitate interaction with an electronic device, a screen for man-machine interaction may be provided on the electronic device, and by detecting a touch track of a user on the screen, a touch operation of the user on the electronic device may be implemented.

The touch operation at least comprises one of touch clicking, sliding operation and pressing a certain preset position of the screen for a long time. Timely instruction control of man-machine interaction can be realized through clicking, for example, communication is realized by using electronic equipment; the movement of the picture on the screen is realized through sliding operation; triggering voice instructions and the like by pressing a preset position of a screen for a long time.

Specifically, since the display screen is provided with the display element, and movement of the display element can be in response to the sliding operation, the movement of the display element is subject to a damping coefficient of the display screen, where the damping coefficient is similar to that of the display screen, the larger the damping coefficient is, the more difficult the display element is to be moved, and the smaller the damping coefficient is, the more easy the display element is to be moved.

S12: dynamically setting a damping coefficient based on the sliding operation;

in general, a user performs a sliding operation on a display screen, and the user generally contacts the display screen with a finger, generates pressure between the finger and the display screen when the user contacts the display screen, and has a pressing time, and controls the sliding operation on the display screen by the pressing time and the pressure.

The sliding operation may be linear sliding or non-linear sliding, and is not limited herein. Based on the sliding operation, the damping coefficient may be dynamically set so that the change speed of the display element is dynamically changed.

Specifically, for example, in the case of a list of application messages, in a list scroll scenario, when a finger touches an application message (such as an application list of a mini-game, a camera, information, music, or the like), the sliding of the application message changes as the finger sliding changes.

S13: based on the damping coefficient, the change speed of the display element corresponding to the sliding operation is set.

In the process of sliding operation of a user, the damping coefficient is fixed often because the sliding operation is too fast, the sliding time can reach 100ms, especially the sliding time is even shorter in the sliding process of a multitasking card, the shortest human brain reaction time is 200ms, and the sliding speed easily exceeds the human brain reaction speed at the same distance, so that the picture is lost.

In order to improve the soft feel of the picture brought by the display element of the display screen, the change speed of the display element corresponding to the sliding operation can be set based on the damping coefficient. For example, when the sliding process is hard or fast, the damping coefficient is dynamically set, and the changing speed of the display element corresponding to the sliding operation is closely related to the damping coefficient, specifically, the positive correlation or the inverse correlation can be performed, so as to control the changing speed of the display element.

Specifically, the object motion track of the application message comprises a plurality of intervals for adjusting damping coefficients, wherein the larger the interval between two adjacent intervals is, the faster the speed is represented, and the smaller the interval is, the smaller the speed is represented; during stopping, the speed is dynamically influenced by the damping, and the speed is gradually stopped after being fast.

Therefore, the method and the device can respond to the sliding operation of the user, dynamically select the change of the damping attribute by dynamically setting the damping coefficient, and control the damping size in real time according to the sliding operation, thereby setting the change speed of the corresponding display element, controlling the soft feeling in the process of interactive animation with the screen, and avoiding the animation to be hard.

Referring to fig. 2, fig. 2 is a schematic screen diagram of an embodiment of step S12 in fig. 1 of the present application, specifically including:

in order to dynamically change the damping value and achieve the effect of controlling the animation speed, the damping coefficient can be set according to the position of the touch point corresponding to the sliding operation on the screen or the position of the display element on the screen.

Further, the closer the position of the touch point or the position of the display element is to the edge of the screen, the larger or smaller the damping coefficient is set. For example, the damping of the middle area of the screen may be set small and the damping of the surrounding area large. Specifically, as shown in fig. 2, a mobile terminal is used herein, which may specifically be a mobile phone, where the mobile phone may be provided with a full screen 20, and different positions may be divided on the full screen 20.

For example, the area surrounded by the broken line in fig. 2 is denoted as a central area 21, the central area 21 has a display element 22 thereon, and the periphery between the central area 21 and the full screen 20 is a peripheral area. It is assumed that the display element is disposed in the center area 21 at this time. Wherein the distance between the bottom edge of the central area 21 and the short side of the full screen 20 may be one third or 30% of the long side of the full screen 20, wherein the damping coefficient at the edge may be 0.7f, and the damping coefficient at the bottom edge of the central area 21 is 0.94f, wherein f is a floating parameter, which is a constant, typically an empirical value.

Wherein the damping coefficient is dynamically set based on the sliding operation, comprising: and setting a damping coefficient according to the initial speed or touch time of the sliding operation. Further, the shorter the initial speed or the touch time is, the larger the damping coefficient is set smaller or larger.

Through long-term observation experience, the damping coefficient is generally related to the initial speed, contact time, and sliding direction of the sliding operation, and is strongly related to one of the three variables of the initial speed, contact time, and sliding direction in different sliding situations. In general, there are two ways to set the damping coefficient, one is to set the damping coefficient according to the initial speed of the sliding operation, and the other is to set the damping coefficient according to the touch time.

Specifically, if the damping coefficient is set according to the initial speed of the sliding operation, the relationship between the initial speed and the damping coefficient can be seen in table 1:

TABLE 1 correspondence table of initial velocity and damping coefficient

As can be seen from the table, different sliding intervals are set according to the initial speed of the sliding operation, different damping magnitudes are set in different intervals, when the initial speed is less than or equal to 4000, the sliding is determined to be slow, and the damping coefficient range is correspondingly set to be 4-5; when the initial speed is larger than 4000 and smaller than 10000, the sliding is determined to be middle-speed sliding, and the damping coefficient range is correspondingly set to be 2-4; when the initial speed is larger than 18000, the sliding is determined to be high-speed sliding, and the corresponding damping coefficient range is set to be 1-2.

Wherein the type of sliding operation in the user's daily activities is also continuous fast sliding, as in table 1, the starting condition of the trigger may be 5 continuous sliding, each acceleration multiplying the current speed by 1.5, wherein each sliding interval is 500ms; the triggered termination condition may be that the acceleration is no longer 10 times after the acceleration or that the acceleration is no longer after the speed has reached the maximum speed; and continuous sliding below a certain speed, although within the interval, does not trigger. The specific numbers are used herein as one specific embodiment, and other numbers are also possible in other embodiments, and are not limited herein.

In addition, if the damping coefficient is set according to the touch time, the relationship between the touch time and the damping coefficient is specifically shown in fig. 3 and 4, fig. 3 is a schematic view of a screen sliding in a short side direction of the present application, and fig. 4 is a schematic view of damping variation in an embodiment of fig. 3 of the present application.

As shown in fig. 3, a plurality of region positions, such as a first region position 23 and a second region position 24, may be provided on the full screen 20, wherein a plurality of display elements, such as display element 1, display element 2, display element 3, display element 4 …, etc., provided in fig. 3, may be provided on the first region position 23. Since the contact time of the sliding operation with the screen is short in this sliding situation, it is usually within 1 second.

As shown in fig. 4, f=0.8 in the curve f1, f=1 in the curve f2, f=1.5 in the curve f3, the abscissa is the contact time t, and the ordinate is the damping coefficient y, wherein the correspondence between the contact time t and the damping coefficient y can be functionally constructed by using a deceleration interpolator (floating coefficient), so as to obtain the following formula (1):

y＝1-(1-t)∧(2f) (1)

the XML attribute is an android factor, the acceleration parameter f is a constant, and different curves are obtained by setting different f constants. As can be seen from this, the longer the contact time t is, the larger the damping coefficient y is at the constant f; when the contact time t is constant, the larger f is, the larger the damping coefficient y is.

Wherein the damping coefficient is dynamically set based on the sliding operation, comprising:

and selecting a setting mode of the damping coefficient according to the sliding direction of the touch point of the sliding operation.

In the above description, the sliding operation may be linear sliding or nonlinear sliding, and the sliding direction corresponding to the touch point of the sliding operation determines the changing direction of the display element, when the hand touches the display element, the larger the initial acceleration is, the changing speed of the display element changes accordingly, and when the hand leaves the screen of the display screen, the changing speed of the display element is slower along with the sliding direction of the touch point.

Further, according to the sliding direction of the touch point of the sliding operation, the setting mode of the damping coefficient is selected, referring to fig. 5, fig. 5 is a schematic flow chart of setting damping according to different sliding directions in fig. 2 of the present application, specifically including the following steps:

s21: judging whether the touch point slides along the long side direction of the screen or slides along the short side direction of the screen;

in particular, for a mobile phone, when the user uses the mobile phone, the display screen of the mobile phone is generally faced, and the sliding operation of the finger can be divided into sliding in the long side direction and sliding in the short side direction, which is generally related to the size ratio of the mobile phone.

Whether the touch point slides along the long side direction or the short side direction of the screen is judged by the sliding direction of the touch point depends on not only the size proportion of the mobile phone but also the willingness degree of the user, and only the size of the mobile phone is taken as an example.

Since the full screen 20 of the mobile phone generally has long sides and short sides, the sliding distance is affected to the extent of the sliding distance, if the speed is constant, the shorter the contact time for the sliding operation is, so that the damping coefficient is dynamically set in the short side direction to be more relevant to the contact time; if the distance is fixed, the time variable of contact is looser, and the initial speed is more strongly related.

S22: if the sliding operation is performed along the long side direction, the initial speed of the sliding operation is selected to set a damping coefficient;

specifically, the dynamic setting may be performed with reference to the relationship between the initial speed and the damping coefficient in table 1, which is not described herein.

S23: if the sliding is performed along the short side direction, the touch time of the sliding operation is selected to set the damping coefficient.

Specifically, the dynamic setting may be performed with reference to the relationship between the contact time and the damping coefficient in fig. 4, which is not described herein.

Referring to fig. 6, fig. 6 is a flow chart of an embodiment of determining a sliding direction of a touch point in fig. 2 of the present application, specifically including the following steps:

s31: after the touch point moves a preset distance, respectively projecting a connecting line between a starting point and an ending point of the touch point in a long-side direction and a short-side direction to obtain a long-side component projected in the long-side direction and a short-side component projected in the short-side direction;

the long-side direction sliding, i.e., up-down sliding or longitudinal sliding, the short-side direction sliding, i.e., left-right sliding or lateral sliding, can be determined based on a comparison between the short-side direction displacement x and the long-side direction displacement y, thereby determining whether it is the long-side direction sliding or the short-side direction sliding, wherein the displacement can be expressed in units of pixels.

S32: judging whether the long-side component is larger than the short-side component;

if x > y is indicated, step S33 is performed, namely, sliding of the touch point in the long side direction, namely, transverse sliding or left-right sliding is determined; if not, indicating x < y, the process proceeds to step S34, i.e., determining that the touch point slides in the short side direction, i.e., slides longitudinally or slides up and down.

Further, if the short-side component is greater than or equal to the preset number of pixels, and the starting point of the sliding operation is located in the long sidebar, the outgoing sidebar is called out, and the application enters a multi-task global list scrolling scene, wherein the preset number of pixels can be 10-30 pixels, and specifically can be 20 pixels.

Since the short-side sliding is more suitable for the conventional one-hand side holding of the user, a hidden side rail is provided, such as a first area position 23 or a second area position 24 shown in fig. 3, and the side rail is area-limited, when the short-side component x > = the preset number of pixels and the starting point of the sliding operation is located in the long side rail, the outgoing side rail can be divided into a following-hand outgoing and a quick outgoing, wherein the quick outgoing exceeds the final position, and the quick outgoing is from the receiving callback, and the quick outgoing is performed with a speed-reducing rebound movement from the outgoing position to the final position according to a special preset function; the hand-following exhalation is any position that can be between the maximum out position and the starting position of the screen edge, the final position being the position where the sidebar exhales eventually rest.

Still further, the display element may be a graphical control that is capable of moving following the sliding operation and/or moving by itself after the sliding operation is completed; the step of setting the change speed of the display element corresponding to the sliding operation based on the damping coefficient includes: and setting the moving speed of the graphic control based on the damping coefficient.

Further, the display element is a translucent cover layer capable of performing a transparency change in response to a sliding operation; referring to fig. 7, fig. 7 is a schematic view of a screen for transparency change in response to a sliding operation.

The step of setting the change speed of the display element corresponding to the sliding operation based on the damping coefficient includes: the speed of change of the transparency of the translucent cover is set based on the damping coefficient.

Specifically, as shown in fig. 7, for example, in an album scene, the picture 25 is displayed on the full screen 20, when the enlarged picture 25 is viewed in full screen, the black semitransparent mask effect of the background can control the transparency change time thereof through damping, so that when the picture 25 is retracted by sliding down a gesture, the situation that the picture 25 is slowed down by a damping coefficient, the screen is blackened or the screen is hard and abrupt due to too fast action is relieved, so that the soft sense of the animation speed is realized, and the display efficiency is improved.

Therefore, the dynamic change is added to the damping attribute, the damping size is controlled in real time according to the user behavior, so that soft feeling in the interactive animation process is controlled, animation hardness is avoided, meanwhile, the damping is reduced in a rolling scene, and the efficiency of sliding of the user is improved.

Therefore, in the future development direction, different qualities can be set for windows and UI elements with different sizes of the system, based on the different qualities, the influence of the quality can be considered when dynamic damping is added, so that the change of the dynamic damping is set more normalized, a complete mechanical UI system is built in the system, and the consistent and standard dynamic feedback can be ensured to be provided for users.

In addition, referring to fig. 8, fig. 8 is a block diagram of an interactive device provided in the present application, where the interactive device 60 includes: a detection module 61, a selection module 62 and a setting module 63.

A detection module 61 for detecting a sliding operation on the screen;

a selection module 62 for dynamically selecting a damping coefficient based on a sliding operation;

a setting module 63 for setting a change speed of the display element corresponding to the sliding operation based on the damping coefficient.

Therefore, the present application can respond to the sliding operation of the user, dynamically set the damping coefficient through the selection module 62 to dynamically select the damping attribute change, and control the damping size according to the user behavior in real time, so as to set the change speed of the corresponding display element, and control the soft feeling in the process of interaction animation with the screen through the setting module 63, so as to avoid animation harshness.

In addition, referring to fig. 9, fig. 9 is a schematic structural diagram of a terminal according to an embodiment of the present application, where the electronic device 70 includes: a processor 71 and a memory 72, the memory 72 having stored therein a computer program 721, the processor 71 being adapted to execute the computer program 721 to implement the method as described above.

In addition, referring to fig. 10, fig. 10 is a schematic structural diagram of a computer readable storage medium, where the computer readable storage medium 80 stores a computer program 81, and the computer program 81 can be executed by a processor to implement a method as described above.

Referring to fig. 11, fig. 11 is a schematic block diagram of a hardware architecture of a terminal of the present application, where the electronic device 900 may be a smart tv, an industrial computer, a tablet computer, a mobile phone, a notebook computer, and the like, and this embodiment illustrates the mobile phone as an example. The structure of the terminal 900 may include a Radio Frequency (RF) circuit 910, a memory 920, an input unit 930, a display unit 940, a sensor 950, audio circuits 960, wiFi (wireless fidelity) module 970, a processor 980, a power source 990, and the like. Wherein the RF circuit 910, the memory 920, the input unit 930, the display unit 940, the sensor 950, the audio circuit 960, and the WiFi module 970 are respectively connected to the processor 980; the power supply 990 is used to provide power to the entire electronic device 900.

Specifically, RF circuitry 910 is used to send and receive signals; memory 920 is used to store data instruction information; the input unit 930 is used for inputting information, and may specifically include a touch panel 931 and other input devices 932 such as operation keys; the display unit 940 may include a display panel, etc.; the sensor 950 includes an infrared sensor, a laser sensor, etc., for detecting a user proximity signal, a distance signal, etc.; a speaker 961 and a microphone 962 are coupled to the processor 980 by an audio circuit 960 for receiving and transmitting audio signals; the WiFi module 970 is configured to receive and transmit WiFi signals, and the processor 980 is configured to process data information of the mobile phone.

The foregoing description is only a partial embodiment of the present application, and is not intended to limit the scope of the present application, and all equivalent devices or equivalent process transformations made by using the descriptions and the drawings of the present application, or direct or indirect application to other related technical fields, are included in the patent protection scope of the present application.

Claims

1. A method of screen interaction, the method comprising:

detecting a sliding operation on the screen;

dynamically setting a damping coefficient based on the sliding operation;

and setting the change speed of the display element corresponding to the sliding operation based on the damping coefficient.

2. The method of claim 1, wherein the step of determining the position of the substrate comprises,

the dynamically setting a damping coefficient based on the sliding operation includes:

and setting the damping coefficient according to the position of the touch point corresponding to the sliding operation on the screen or the position of the display element on the screen.

3. The method of claim 2, wherein the damping coefficient is set to be larger or smaller as the position of the touch point or the position of the display element is closer to the edge of the screen.

4. The method of claim 1, wherein the step of determining the position of the substrate comprises,

and setting the damping coefficient according to the initial speed or touch time of the sliding operation.

5. The method of claim 4, wherein the shorter the initial speed or the touch time is, the larger the damping coefficient is set smaller or larger.

6. The method of claim 1, wherein the step of determining the position of the substrate comprises,

judging whether the touch point slides along the long side direction of the screen or slides along the short side direction of the screen;

if sliding along the long side direction, selecting the initial speed of the sliding operation to set the damping coefficient;

and if the sliding operation is performed along the short side direction, selecting the touch time of the sliding operation to set the damping coefficient.

7. The method of claim 6, wherein the step of providing the first layer comprises,

the judging whether the touch point slides along the long side direction of the screen or slides along the short side direction of the screen includes:

after the touch point moves a preset distance, respectively projecting a connecting line between a starting point and a terminating point of the touch point in the long-side direction and the short-side direction to obtain a long-side component projected in the long-side direction and a short-side component projected in the short-side direction;

judging whether the long-side component is larger than the short-side component;

if yes, determining that the touch point slides in the long-side direction;

if not, the touch point is determined to slide in the short side direction.

8. The method of claim 7, wherein the short side component is greater than or equal to a preset number of pixels and the starting point of the sliding operation is at a long side bar, the side bar is expired.

9. The method according to claim 1, wherein the display element is a graphical control that is movable following the sliding operation and/or is self-moving after the sliding operation is ended;

the step of setting the change speed of the display element corresponding to the sliding operation based on the damping coefficient includes:

and setting the moving speed of the graphic control based on the damping coefficient.

10. The method of claim 1, wherein the display element is a translucent cover capable of transparency change in response to the sliding operation;

and setting the change speed of the transparency of the semitransparent cover layer based on the damping coefficient.

11. An interactive device, characterized in that,

a detection module for detecting a sliding operation on a screen;

a selection module for dynamically selecting a damping coefficient based on the sliding operation;

and the setting module is used for setting the change speed of the display element corresponding to the sliding operation based on the damping coefficient.

12. An electronic device, comprising: a processor and a memory, the memory having stored therein a computer program for executing the computer program to implement the method of any of claims 1-10.

13. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method according to any of claims 1-10.