CN108351717B

CN108351717B - Method, device and terminal for selecting interface elements

Info

Publication number: CN108351717B
Application number: CN201680059609.3A
Authority: CN
Inventors: 余亮
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2016-04-27
Filing date: 2016-04-27
Publication date: 2020-07-07
Anticipated expiration: 2036-04-27
Also published as: WO2017185264A1; CN108351717A

Abstract

A method, a device and a terminal for selecting interface elements are provided, which are used for obtaining the pressing operation input by a user on a terminal display interface; acquiring the position of a pressing point of the pressing operation according to the pressing operation, and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point; determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector; determining the staying position of the interface element according to the position of the pressing point; controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same moment; and receiving off-screen operation triggered by a user at a staying position where the target interface element to be selected stays, operating the target interface element, and selecting the interface element under the condition that the user cannot touch a display position of the interface element.

Description

Method, device and terminal for selecting interface elements

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a terminal for selecting an interface element.

Background

With the development of communication technology, users have higher and higher requirements for functions that can be realized by terminals.

When a user uses a terminal, the user often needs to select interface elements displayed on a terminal interface first and then can perform operations of corresponding functions. Interface elements generally refer to any element on a terminal display interface that is responsive to user manipulation and identified in a user-recognizable appearance, including, but not limited to, application icons and run controls, such as desktop icon buttons, list items of a list, thumbnails of an album preview (as clicking on a thumbnail opens an artwork), and so forth. At present, if a user wants to select an interface element displayed on a display interface of a terminal, the user usually performs operations such as clicking on the display position of the interface element to select the interface element, and if the user cannot touch the display position of the interface element, the user cannot select the interface element to be selected.

Disclosure of Invention

The embodiment of the invention provides a method, a device and a terminal for selecting interface elements, which are used for realizing the selection of the interface elements under the condition that a user cannot touch the display position of the interface elements.

According to the first aspect, a user inputs a pressing operation on a terminal display interface, the terminal obtains the pressing operation input by the user on the terminal display interface, the interface elements in the vertical vector action range on the terminal display interface are controlled to move towards the pressing point according to the pressing operation, when a target interface element to be selected moves to a position which can be touched by the user, the user triggers off-screen operation to realize selection of the target interface element, the terminal executes a corresponding function selected by the interface element, and the interface element is selected under the condition that the user cannot touch the display position of the interface element.

In one possible design, a terminal obtains a position of a pressing point of the pressing operation according to the pressing operation, and a vertical vector which is formed by the pressing operation and is perpendicular to a terminal display interface at the pressing point, and determines an action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector, wherein the action range is used for determining an interface element moving towards the direction of the pressing point. And the terminal determines the staying position of the interface element according to the position of the pressing point, controls the interface element positioned in the action range to move to the staying position of the interface element, and controls the staying position to stay at most one interface element at the same moment. And the terminal receives off-screen operation triggered by a user at a staying position where the target interface element to be selected stays, and operates the target interface element.

Determining the stop position of the interface element according to the position of the pressing point, wherein the step of determining the stop position of the interface element comprises the following steps: and determining the position of the pressing point as the stop position of the interface element. Or determining a stopping area at a position where the distance from the position where the pressing point is located is less than or equal to a set threshold value position as the stopping position of the interface element. The number of the interface elements in the action range is at least two, and the number of the stay areas is at least two.

Determining an action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector, wherein the action range comprises:

determining a radius according to the size of the vertical vector; determining a circular range according to the radius by taking the position of the pressing point as a circle center; and determining the determined circular range as an action range of the pressing operation on the terminal display interface.

Wherein the controlling the movement of the interface element located in the action range to the stop position of the interface element comprises:

controlling the interface element to execute the following steps in the process of moving to the stop position of the interface element until the interface element moves to the stop position: acquiring the position coordinates of the interface element at the previous moment and the position coordinates of the interface element at the current moment; redrawing the drawing of the interface element at the position coordinate at the current moment, and canceling the drawing of the interface element at the position coordinate at the previous moment.

Wherein the number of interface elements located within the action range is at least two; the controlling the interface element located in the action range to move to the stop position of the interface element comprises the following steps:

determining an initial movement velocity of each of the at least two interface elements; determining a distance between each interface element of the at least two interface elements and a dwell position of the interface element; determining the time for each interface element to reach the staying position of the interface element according to the distance between each interface element and the staying position of the interface element and the initial movement speed of each interface element; adjusting the movement speed of the interface elements with the same arrival time to ensure that the time for each interface element to arrive at the staying position of the interface element is different; taking the adjusted movement speed as the movement speed of the interface element with the adjusted movement speed, and taking the initial movement speed as the movement speed of the interface element without the adjusted movement speed; and controlling each interface element in the at least two interface elements to move to the stop position of the interface element at the movement speed corresponding to the interface element.

In the embodiment of the invention, the position of the motion interface element in the action range after motion is obtained; under the condition that the position of the moving interface element after moving is coincident with the stopping position, judging whether the interface element is stopped at the stopping position; if the interface element is stopped at the stopping position, replacing the stopped interface element with the motion interface element; if the interface elements which are stopped do not exist at the stopping position, stopping the motion interface elements at the stopping position, and controlling the stopping position to stop at most one interface element at the same time so as to avoid ambiguity when the user selects the interface elements.

In another possible embodiment, after the moved interface element is used to replace the stopped interface element, the replaced interface element that has stopped at the stop position is no longer placed in the range of action, so as to avoid the interface element moving again toward the pressing point.

In another possible design, an exit area may be set, where the exit area is an area where the user triggers the off-screen operation without selecting an interface element, and when the interface element moves to the stop position and obtains the off-screen operation triggered by the user in the exit area, the interface element at the stop position is not operated, so as to avoid that the user selects the interface element that does not need to be selected when the user triggers the off-screen operation.

In the method, a terminal detects a pressing operation input by a user on a terminal display interface, and controls an interface element to move towards a position where a pressing point of the pressing operation is located, wherein the position of the interface element on the terminal display interface is different from the position where the pressing point is located, and when a target interface element to be selected moves to a preset stop position and an off-screen operation triggered by the user at the stop position is detected, the target interface element is operated, so that the interface element is selected near the pressing point, and the operation of the user is facilitated.

The preset stopping position comprises the position of the pressing point; or the preset stop position comprises a stop area at a position where the distance from the position where the pressing point is located is smaller than or equal to a set threshold value. In the case where the number of the interface elements is at least two, the number of the stay areas is at least two.

In one possible design, the movement speed and the movement direction of the interface element are determined, and the movement direction is a radial direction from the position of the interface element to the preset stop position. And controlling the interface element to move towards the position of the pressing point of the pressing operation along the ray direction from the position of the interface element to the preset stop position at the movement speed corresponding to the interface element.

In another possible design, the interface elements include a first interface element and a second interface element. The time for the first interface element to reach the preset stop position is first time; the time for the second interface element to reach the preset stop position is a second time; the first time is different from the second time.

In yet another possible design, at most one interface element is stopped at the preset stop position at the same time.

And the position of the interface element on the terminal display interface is positioned in a circular range which takes the position of the pressing point as the center of a circle on the terminal display interface.

In another possible design, when the interface element moves to the preset stop position and the user is detected to trigger the off-screen operation in the exit area, the interface element at the preset stop position is not operated; the exit area is an area where the user triggers the screen-off operation without selecting an interface element, so that the screen-off operation can be triggered, but the interface element is not selected, so that the user is prevented from selecting the interface element which is not required to be selected when the screen-off operation is triggered.

In a third aspect, an apparatus for selecting an interface element is provided, where the apparatus for selecting an interface element has a function of implementing the method for selecting an interface element according to the first aspect. The functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above-described functions. For example, the device for selecting an interface element includes an obtaining unit and a processing unit, where the obtaining unit is configured to obtain a pressing operation input by a user on a terminal display interface, and receive an off-screen operation triggered by the user at a stop position where an object interface element to be selected stops. The processing unit is used for acquiring the position of a pressing point of the pressing operation and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point according to the pressing operation acquired by the acquiring unit; determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector; determining the staying position of the interface element according to the position of the pressing point; controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same moment; and when the obtaining unit receives an off-screen operation triggered by a user at a stop position where the target interface element to be selected stays, operating the target interface element.

In a fourth aspect, an apparatus for selecting an interface element is provided, where the apparatus for selecting an interface element has a function of implementing the method for selecting an interface element according to the second aspect. The functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above-described functions. For example, the device for selecting the interface element comprises a detection unit and a control unit, wherein the detection unit is used for detecting a pressing operation input by a user on a terminal display interface and detecting an off-screen operation triggered by the user at a stop position to which the interface element to be selected moves. The control unit is used for controlling an interface element to move towards the position where a pressing point of the pressing operation detected by the input unit is located, wherein the position of the interface element on a terminal display interface is different from the position where the pressing point is located; and running the target interface element under the condition that the target interface element to be selected moves to a preset stop position and the input unit detects that the user triggers off-screen operation at the stop position.

In a fifth aspect, a terminal is provided, where the terminal has a function of implementing the method for selecting an interface element according to the first aspect. The functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above-described functions. For example, the terminal comprises an input device, an output device, a processor, a memory and a bus, wherein the input device, the output device and the memory are all connected with the processor through the bus, and the memory is used for storing program codes executed by the processor. The input device is used for acquiring the pressing operation input by the user on the terminal display interface and receiving the off-screen operation triggered by the user at the stop position where the object interface element to be selected stays.

The output device is used for outputting the interface element. The processor is used for calling a program stored in the memory and obtaining the pressing operation according to the input equipment; acquiring the position of a pressing point of the pressing operation and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point; determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector; determining the staying position of the interface element according to the position of the pressing point; controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same moment; and when the input equipment receives an off-screen operation triggered by a user at a stop position where the target interface element to be selected stays, operating the target interface element.

In a sixth aspect, a terminal is provided, where the terminal has a function of implementing the method for selecting an interface element according to the second aspect. The functions can be realized by hardware, and the functions can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above-described functions. For example, the terminal comprises an input device, an output device, a processor, a memory and a bus, wherein the input device, the output device and the memory are all connected with the processor through the bus, and the memory is used for storing program codes executed by the processor. The input device is used for detecting the pressing operation input by the user on the terminal display interface and detecting the off-screen operation triggered by the user at the stop position to which the interface element of the object to be selected moves. The output device is used for outputting the interface element. The processor is used for controlling an interface element to move towards a position where a pressing point of the pressing operation detected by the input device is located, wherein the position of the interface element on a terminal display interface is different from the position where the pressing point is located; and running the target interface element under the condition that the target interface element to be selected moves to a preset stop position and the input equipment detects that the user triggers off-screen operation at the stop position.

Drawings

Fig. 1 is a flowchart illustrating an implementation of a method for selecting an interface element according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of vertical vector determination provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating the determination of a circle radius when the coverage area is a circular area according to an embodiment of the present invention;

FIG. 4 is a first schematic diagram illustrating a motion process of two interface elements when the resting position is a pressing point according to an embodiment of the present invention;

FIG. 5 is a second schematic view of the movement process of two interface elements when the resting position is a pressing point according to the embodiment of the present invention;

FIG. 6 is a third schematic view illustrating a movement process of two interface elements when the resting position is a pressing point according to the embodiment of the present invention;

FIG. 7 is a first schematic diagram illustrating a motion process of four interface elements when the resting position is a pressing point according to an embodiment of the present invention;

FIG. 8 is a second schematic view of a movement process of four interface elements when the resting position is a pressing point according to an embodiment of the present invention;

FIG. 9 is a third schematic view of a movement process of four interface elements when the resting position is a pressing point according to the embodiment of the present invention;

FIG. 10 is a first schematic diagram illustrating a movement process of an interface element when a staying position is a predetermined area according to an embodiment of the present invention;

FIG. 11 is a second schematic diagram illustrating a movement process of an interface element when the staying position is a predetermined area according to an embodiment of the present invention;

FIG. 12 is a third schematic diagram illustrating a movement process of an interface element when the staying position is a predetermined area according to an embodiment of the present invention;

FIG. 13 is a fourth schematic diagram illustrating a movement process of an interface element when the staying position is a predetermined area according to an embodiment of the present invention;

FIG. 14 is a timing diagram illustrating an implementation of movement of an interface element by a terminal during a duration of a pressing operation according to an embodiment of the present invention;

FIG. 15 is a timing diagram illustrating a control sequence after a terminal receives a user-triggered off-screen operation according to an embodiment of the present invention;

FIG. 16 is a schematic structural diagram of an apparatus for selecting interface elements according to an embodiment of the present invention;

FIG. 17 is a schematic structural diagram of another apparatus for selecting interface elements according to an embodiment of the present invention;

fig. 18 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention.

The method, the device and the terminal for selecting the interface element provided by the embodiment of the invention can be applied to a scene that a user needs to select the interface element but cannot touch the display position of the interface element, for example, the user needs to select the interface element on the display interface of the terminal with a touch screen by fingers, but holds the terminal and other objects (such as holding a wallet and the terminal with one hand or holding the object with the hand of the terminal with the other hand), or has an excessively large screen and is difficult to touch a target interface element to be selected, or any other situation that the target interface element on the display interface of the terminal is out of the finger touch range.

In the embodiment of the invention, a user inputs a pressing operation on a terminal display interface, a vertical vector vertical to the terminal display interface is formed at a pressing point, the terminal controls an interface element in the action range of the vertical vector on the terminal display interface to move towards the pressing point according to the vertical vector, when a target interface element to be selected moves to a position which can be touched by the user, the user triggers off-screen operation, so that the selection of the target interface element is realized, and the terminal executes the corresponding function of the selected interface element.

Fig. 1 is a flowchart illustrating an implementation of a method for selecting an interface element according to an embodiment of the present invention, where an execution subject of the method illustrated in fig. 1 is a Terminal (Terminal). It should be understood that the Terminal according to the embodiments of the present invention may also be referred to as a Mobile Terminal (Mobile Terminal), a Mobile Station (MS), a User Equipment (UE), and the like, and the Terminal may communicate with one or more than one core networks through a Radio Access Network (RAN), for example, the Terminal may be a Mobile phone (or referred to as a cellular phone), a computer with a Mobile Terminal, and the like, and for example, the Terminal may also be a portable, pocket, hand-held, computer-embedded, or vehicle-mounted Mobile device, and they exchange voice and/or data with the RAN.

As shown in fig. 1, a method for selecting an interface element provided in an embodiment of the present invention includes:

s101: and detecting and acquiring the pressing operation input by the user on the terminal display interface.

In the embodiment of the invention, the position of the pressing operation input by the user on the terminal display interface is not limited, but in order to avoid triggering the terminal to execute other unnecessary response programs, the position of the input pressing operation is generally selected to be the position without the defined response action on the terminal display interface.

S102: and acquiring the position of a pressing point of the pressing operation according to the pressing operation, and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point.

After the user inputs the pressing operation in the embodiment of the present invention, an input device (e.g., a touch screen) of the terminal may detect and acquire a position of a pressing point where the user inputs the pressing operation, so as to obtain coordinates (X0, Y0) of the pressing point.

Similarly, the input device of the terminal may acquire a vertical vector perpendicular to the terminal display interface formed at the pressing point by the pressing operation input by the user.

In the embodiment of the present invention, the vector is a vector in a three-dimensional space, and is used to describe a geometric object whose direction is perpendicular to a plane where a terminal screen is located and which has a size, for example, a touch screen with a Force touch function can obtain a pressure which acts perpendicularly on the plane of the screen, where the pressure is a three-dimensional vector, which is perpendicular to the surface of the screen and has a size degree, for example, as shown in fig. 2, a vector y perpendicular to the screen is a pressure of a pressing operation under the Force touch condition.

It should be noted that, the implementation of the present invention includes, but is not limited to, using the pressure of the force touch as the vector perpendicular to the terminal display interface formed by the pressing operation, and any touch screen factor that can be or is understood as the vector perpendicular to the terminal display interface of the pressing operation belongs to the protection scope of the embodiment of the present invention.

S103: and determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector.

In the embodiment of the invention, the action range is used for determining the interface element moving towards the direction of the pressing point.

In the embodiment of the present invention, the action range of the pressing operation on the terminal display interface is determined according to the position of the pressing point and the size of the vertical vector, and the following manner may be adopted:

and determining a radius r according to the size of the vertical vector, wherein the r satisfies r ═ y |/tan a, wherein y is the vertical vector, | y | is the value of the vertical vector, and a is a preset angle. For example, as shown in fig. 3, the horizontal line represents the screen surface, and the range of action of the pressing point is set to be centered on the pressing point and limited to a circular range in the current interface. The preset angle value a is set, the radius r of the action range is determined by the value | y | of a and the vertical vector y, and then r is | y |/tan a. And determining a circular range by taking the position of the pressing point as a circle center and the radius as r. And determining the determined circular range as an action range of the pressing operation on the terminal display interface.

The range of action in the embodiments of the present invention may have different shapes, and the embodiments of the present invention are not limited thereto, and may be, for example, a circle as described above or a rectangle. For example, if the coordinates of the pressed point are known to be (X0, Y0), the rectangular region between X0+ L, X0-L, Y0+ M, Y0-M can be determined as the coverage.

S104: and determining the stop position of the interface element according to the position of the pressing point.

In the embodiment of the invention, the terminal can control the interface element to move towards the position of the pressing point of the pressing operation, so that a user can touch the interface element conveniently.

The stopping position of the interface element after movement can be set in the embodiment of the invention, and the principle of setting the stopping position is that the stopping position is set at a position which is convenient for a user to touch. In the embodiment of the present invention, the position of the pressing point may be determined as the staying position of the interface element. The staying area with the distance between the staying area and the position where the pressing point is located being smaller than or equal to the set threshold value position can also be determined as the staying position of the interface element. The number of the stay areas can be more than one, especially when the number of the interface elements is multiple, a plurality of stay areas can be arranged, each stay area can be independent of each other, each stay area stays on one interface element, and of course, each stay area can also be connected into a whole stay area so as to stay and accommodate a plurality of elements in one stay area. In the embodiment of the present invention, the staying area may have a set shape on the terminal display interface, and the shape is not limited.

S105: and controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same time.

In the embodiment of the invention, the terminal can determine each interface element (Xi, Yi) positioned in the action range of the pressing point by traversing the coordinates of all the interface elements on the current terminal display interface.

Generally, the number of interface elements in the scope of action may be one or more (at least two). In the embodiment of the invention, the movement speed of each interface element positioned in the action range can be determined, the movement direction of each interface element positioned in the action range is determined, the movement direction is the ray direction from the position of the interface element to the stop position of the interface element, each interface element in the action range is controlled to move to the stop position of the interface element along the ray direction from the position of the interface element to the stop position of the interface element at the movement speed corresponding to the interface element.

It should be noted that, in the embodiment of the present invention, the terminal controls the interface element to move to the stop position of the interface element, that is, an effect of the interface element moving to the position where the pressing point of the pressing operation is located is achieved.

In the embodiment of the present invention, the movement locus of the interface element moving to the stopping position is not limited, and the embodiment of the present invention is described by taking a straight line from the position of the interface element to the stopping position of the interface element as an example, and any other movement locus is within the scope of the present invention.

In the embodiment of the invention, the interface elements are stopped at most at the stopping position at the same moment so as to avoid ambiguity when the user selects the interface elements.

S106: and receiving off-screen operation input by a user at a stop position where the target interface element to be selected stays, and realizing selection of the target interface element.

In the embodiment of the invention, when the target interface element to be selected moves to the preset stop position, or the distance between the target interface element and the stop position is less than or equal to the set threshold, the user can trigger off-screen operation at the stop position where the target interface element stops, so that the target interface element is selected, and the terminal runs the target interface element. For example, if the stopping position is the position of the pressing point, the user can directly release the finger pressing the touch screen when the target interface element moves to the position of the pressing point, so as to realize the selection of the target interface element. If the stopping position is a stopping area near the pressing point, when the target interface element moves to the stopping area, the user presses the terminal interface to release the hand and moves the finger to the stopping area where the target element stops, and then releases the finger, so that the target interface element is selected.

According to the embodiment of the invention, the interface element is controlled to move towards the position of the pressing point of the pressing operation input by the user, and the off-screen operation is triggered when the interface element moves to the position near the pressing point, so that the interface element is selected, the method for selecting the interface element near the pressing point is realized, and the operation of the user is facilitated.

The following description of the embodiments of the present invention focuses on the steps S105 and S106 in the above embodiments in combination with practical applications.

In the embodiment of the present invention, each interface element located in the range of action according to the vertical vector on the current terminal display interface may be assigned a moving speed of centripetal motion toward the stopping position, and the moving speed may be determined according to the magnitude of the vertical variable, for example, the moving speed of the interface element may be determined by using a formula Vi | Ki, where y is the vertical vector, | y | is the value of the vertical vector, Ki is a normal number, and Vi is the moving speed of the ith interface element.

It should be noted that, in the embodiment of the present invention, the movement speed of the interface element is set to be a uniform movement and directly proportional to the vertical vector, but not limited to this, for example, the movement speed may be changed into various accelerated movements, and the interface element may be given a priority weight, and different movement speeds may be set according to different priorities.

Optionally, in order to ensure that at most one interface element moves to the stop position at the same time, in the embodiment of the present invention, a movement speed determined according to the above formula may be used as an initial movement speed, then a distance Li between each interface element in the action range and the stop position of the interface element is determined, where the distance Li may be determined by a stop position coordinate acquired by the terminal and a coordinate of the interface element, and then a time Ti for each interface element to reach the stop position of the interface element is determined according to the distance Li between each interface element and the stop position of the interface element and the initial movement speed Vi of each interface element, where Ti is Li/Vi. Determining the time for each interface element to reach the dwell position, so as to determine whether an interface element with the same time for reaching the dwell position exists, and if so, adjusting the movement speed of the interface element with the same time for reaching, so that the time for each interface element to reach the dwell position of the interface element is different, that is, assuming that the interface element includes a first interface element and a second interface element, where the time for the first interface element to reach the preset dwell position is a first time, and the time for the second interface element to reach the preset dwell position is a second time, the first time is different from the second time.

In the embodiment of the invention, the movement speed of the interface element with the same arrival time can be adjusted in the following way:

assuming that k interface elements are expected to reach the dwell position in equal time, the k interface elements may be numbered, for example, if the k interface elements are numbered 1, 2, 3.., k, then T1T 2T 3T, and in order to avoid that the interface elements reach the dwell position at the same time, the terminal may randomly sort the k interface elements, and a specific sorting rule according to an embodiment of the present invention is not limited. First, the terminal determines a speed reduction amplitude unit u, for example, u is 1/k. And then according to a random sorting result, adjusting the motion speed of the k interface element after sorting to Vi '═ Vi (1-u × k), wherein Vi' is the adjusted motion speed, Vi is the initial motion speed of the i interface element, u is the preset motion speed reduction amplitude, and k is the number of the interface elements with the same arrival time. If the interface element has the same expected arrival time with other interface elements after the adjustment speed is found, the interface elements are adjusted in speed in the mode of the previous step until the expected arrival time of each interface element to the pressing point is different.

It should be noted that, the embodiment of the present invention is not limited to the movement speed adjustment scheme for avoiding multiple interface elements from reaching the stop position at the same time, and includes, but is not limited to, the scheme described above.

In the embodiment of the invention, the adjusted movement speed is taken as the movement speed of the interface element with the adjusted movement speed, and the initial movement speed is taken as the movement speed of the interface element without the adjusted movement speed.

After the movement speed and the movement direction of each interface element within the action range are determined, the terminal can control each interface element within the action range to move to the stopping position according to the movement speed and the movement direction corresponding to each interface element, and display the movement speed and the movement direction on the terminal display interface. In the embodiment of the present invention, during the movement of the interface element located in the action range to the staying position of the interface element, the position coordinate displayed on the terminal display interface of each interface element satisfies the formula:

(Xi，Yi)＝(Xi_t-1，Yi_t-1)+Tunit*(Vix_t-1，Viy_t-1)；

wherein, (Xi, Yi) is the position coordinate displayed on the terminal display interface by the ith interface element at the time t, (Xi, Yi)_t-1，Yi_t-1) Is as followsThe position coordinates of i interface elements displayed on the terminal display interface at the moment t-1, Tunit is the time difference between adjacent moments, Vix_t-1As the velocity component of the i-th interface element in the x-axis direction, Viy_t-1The speed component of the ith interface element in the y-axis direction is defined, and the x-axis and the y-axis are the x-axis and the y-axis of a horizontal coordinate system established on a plane where the terminal display interface is located by taking the original display position coordinate of the ith interface element on the terminal display interface as an origin.

Preferably, in the embodiment of the present invention, the coordinates of each interface element are determined at each new time in the above manner, and the moving speed of the interface elements is adjusted, so as to prevent new conflicts between the interface elements at adjacent times (and the stop position is reached at the same time), and also prevent the stop position from being changed due to the change of the pressed point.

In particular, if the size of the vertical variable formed by the pressing operation detected by the system at a certain time becomes smaller, so that the interface elements which are in the pressing point action range at the previous time are no longer in the pressing point action range at the current time, in the embodiment of the present invention, during the existence period of the pressing operation, the interface elements which are in the pressing point action range at the previous time and are no longer in the pressing point action range at the current time are kept at the current position. Of course, the embodiments of the present invention include, but are not limited to, the above processing manners.

In the embodiment of the invention, in order to control the interface element staying at the staying position at most at the same moment, the interface element staying at the staying position is controlled in addition to the adjustment of the movement speed of the interface element according to the above manner.

In the embodiment of the present invention, each interface element given the motion reaches the stop position in sequence due to different distances and speeds from the stop position, so that a later-arriving interface element replaces an earlier-arriving interface element at the stop position, and at most one interface element is only at each moment at the stop position, and the specific implementation process is as follows: acquiring the position of the moving interface element in the action range after the movement; under the condition that the position of the moving interface element after moving is coincident with the stopping position, judging whether the interface element is stopped at the stopping position; if the interface element is stopped at the stopping position, replacing the stopped interface element with the motion interface element; and if the interface element which is stopped does not exist at the stopping position, stopping the interface element at the stopping position.

Optionally, after replacing the stopped interface element with the moving interface element, the replaced interface element that has stopped at the stopping position may not be placed within the action range, so as to prevent the stopped interface element from moving to the stopping position again.

In the embodiment of the invention, when the non-target interface element reaches the stop position, the user can press the original position to replace the non-target interface element by the subsequent interface element; when the target interface element reaches the stopping position, the user can release the pressing action (namely, the off-screen operation is triggered) at the stopping position to realize the selection of the target interface element, and when the terminal receives the off-screen operation, the response effect of the selected function of the interface element is executed.

In the embodiment of the invention, different stopping modes can be provided for a plurality of stopping areas arranged at the positions of the pressing points or the positions of the pressing points according to the stopping positions.

Fig. 4 to 6 are schematic diagrams illustrating the movement process of two interface elements when the stop position is a pressing point.

In fig. 4, the finger of the user inputs a pressing operation on the terminal display interface, and it is represented that the radius of the acting range of the pressing point is determined by the pressing point as the center of the circle and the vertical vector of the pressing point, so as to form the acting range of the pressing point, and the interface element 1 and the interface element 2 in the acting range are given uniform linear motions at speeds V1 and V2 toward the pressing point, respectively. The interface element 3 is not in the range of action of the pressing point and therefore does not move. In fig. 5, interface element 2 reaches the pressing point first and stays at the pressing point, and interface element 1 moves toward the pressing point. In fig. 6, when the interface element 1 reaches the pressed point, the interface element 2 that has been at the pressed point is replaced and disappears.

Fig. 7 to 9 are schematic diagrams illustrating the movement process of four interface elements when the stop position is a pressing point.

In fig. 7, the user's finger inputs a pressing operation on the terminal display interface to form a rectangular action range with a pressing point as a center and a set length and width, and the interface element 1, the interface element 2, the interface element 4, and the interface element 5 within the range are given uniform linear motions toward the pressing point at respective corresponding speeds. The interface element 3 is not in the range of action of the pressing point and therefore does not move. In fig. 8, the interface element 4 reaches the pressing point first and stays at the pressing point, and the rest interface elements in the action range continue to move to the position of the pressing point. When the interface element 5 reaches the pressed point in fig. 9, the interface element 4 which is originally at the pressed point is replaced and disappears, and the

interface elements

1 and 2 continue to move.

In the embodiment of the invention, if the target interface element moves to the position of the pressing point or the distance from the position of the pressing point is less than the set value, the user can directly release the finger to realize the selection of the target interface element.

In the embodiment of the invention, a limited number of non-overlapping stopping areas can be preset around the position of the pressing point, the stopping areas are used as the stopping positions of the interface elements, the stopping areas are numbered in a determined order, when the coordinate center of the interface element is less than a set threshold value from the coordinate center of the stopping area, the interface element is considered to have arrived at the stopping area, and the arrived interface element is placed into the idle stopping area with the smallest number; if no parking area is free, the new arriving interface element replaces the interface element that parked in the least numbered parking area.

Fig. 10 to 13 are schematic diagrams illustrating the movement process of the interface element when the stop position is a stop region preset near the pressing point.

In fig. 10, two stay areas, i.e., a stay area 1 and a stay area 2, are provided near the pressing point, and the interface element 1 moves toward the stay areas. In fig. 11, after the interface element reaches the dwell region, it dwells in a less numbered idle dwell region, such as dwell region 1 in fig. 11. In FIG. 12, the dwell regions have all the interface elements dwelled, i.e., dwell region 1 dwelled on interface element 1, dwell region 2 dwelled on interface element 2, while still other interface elements (interface element 3, interface element 4, and interface element 5) move toward the dwell region. In fig. 13, interface element 3 and interface element 4 reach the dwell region, and interface element 5 continues to move, so interface element 3 stays in dwell region 1 and replaces interface element 1, and interface element 4 stays in dwell region 2 and replaces interface element 2.

In the embodiment of the invention, if the target interface element moves to the stay area, the user can press the terminal display interface and move the pressing point in a short distance, move the pressing point to the stay area where the target element stays, and then release the finger to realize the selection of the target interface element.

In the embodiment of the invention, the limited non-overlapping staying areas are preset around the position of the pressing point, so that a plurality of interface elements stay near the pressing point at the same time, the interface elements staying in the staying areas are not blocked by fingers on the pressing point, and a user can clearly identify the interface elements staying in the staying areas.

It should be noted that, no matter where the position of the pressing point is used as the staying position, or where the staying area is used as the staying position, if the pressing point is not released (off-screen operation is triggered) at the staying position of any interface element, no interface element is selected in the pressing process.

Optionally, after the target interface element is selected, all interface elements which move centripetally to the stopping position can be respectively returned to the original position. If any interface element is not selected, all the moved interface elements are respectively returned to the original position.

Optionally, in the embodiment of the present invention, an exit area may be set on the terminal display interface according to an actual application scenario, where the exit area is an area where a user triggers an off-screen operation without selecting an interface element, so as to avoid that the user selects the interface element that is not required to be selected when triggering the off-screen operation.

For example, when a list item is selected, each list item is an interface element, so that the bottommost or topmost list item of a screen is pressed, a pressing point is formed on the list item, the list item within the action range of the pressing point moves towards the direction of the pressing point and sequentially passes through the pressing point, namely only one list item always exists at the pressing point, in order to avoid that a user selects an interface element which does not need to be selected when the user triggers the screen-off operation, an exit area can be arranged near the pressing point, the pressing point moves to the exit area to trigger the screen-off operation, and the terminal executes a function that the interface element is not selected when receiving the screen-off operation condition triggered by the user in the exit area, so that the screen-off operation can be triggered, but no selected list item is selected.

The following will describe an internal implementation process of selecting interface elements related to the implementation of the above embodiment by a terminal.

Fig. 14 is a timing chart illustrating an implementation of movement of an interface element by a terminal during a duration of a pressing operation according to an embodiment of the present invention, where the terminal according to an embodiment of the present invention includes an input device (e.g., a touch screen), a processor, and an output device (e.g., a screen), and as shown in fig. 4, the terminal includes:

s201: and the processor of the terminal acquires the coordinates of each interface element on the display interface of the terminal.

S202: and the processor of the terminal acquires the coordinates of the pressing point of the pressing operation input by the user through the input device at the current moment and the vector vertical to the display interface of the terminal.

In the embodiment of the invention, the pressing point is allowed to move in the process of one-time pressing, so that the allowance is different from the allowance at the last moment, and therefore, a processor of the terminal in the embodiment of the invention needs to acquire the coordinates of the pressing point and a vector vertical to a display interface of the terminal in real time.

It should be noted that, in the embodiment of the present invention, the visible appearance of the pressed point may be drawn on the terminal display interface, or may not be drawn.

S203: and calculating the action range of the pressing point according to the vector of the pressing point perpendicular to the terminal display interface at the current moment, and controlling the interface element in the action range to move to the stop position.

S204: and judging whether the coordinate of the interface element at the time t is the same as the coordinate at the time t-1, if not, indicating that the interface element moves relative to the previous time, so that the interface element is redrawn at the coordinate of the time t and output through an output device of the terminal, and the redrawn interface element is displayed on a display interface of the terminal, wherein the redrawn interface element comprises the steps of canceling the element drawing at the previous position and drawing the element drawing at the current position, and the moving process of the interface element to the stop position is realized.

In the embodiment of the present invention, an implementation manner of eliminating element drawing at an original position of an interface element in a moving process of the interface element is not limited, for example, a representation (for example, a virtual image of the interface element) may be created for the interface element within a range of an action of a pressing point, so that only one of the interface element or the representation thereof moves toward the pressing point, and the other one remains in place to prompt a user.

S205: judging whether a moving interface element with the same coordinate at the time t and the same coordinate at the staying position exists in the interface elements, if the moving interface element exists and the coordinate at the previous time of the moving interface element is not equal to the coordinate at the staying position, indicating that the moving interface element moves to the staying position at the current time, continuously judging whether the staying position has the staying interface element, if the staying position has the staying interface element, canceling the drawing of the staying interface element, drawing the drawing of the moving interface element at the staying position, and realizing the process of replacing the interface element which arrives at the staying position first by the interface element which arrives at the staying position later.

In the embodiment of the invention, for each element which reaches the pressing point and is replaced, the coordinate is temporarily set to be a null value, which indicates that the element does not appear on the interface during the existence of the pressing action.

S206: and calculating and setting the coordinates of the t +1 moment for each interface element in the action range, taking the coordinates of each interface element at the t +1 moment as the coordinates of the interface element acquired in the step S201, and executing the steps in a circulating manner until a processor of the terminal receives an off-screen operation triggered by a user through input equipment.

The coordinates of each interface element at the time t +1 are calculated according to the coordinates of the interface element at the time t, as represented by (Xi t +1, Yi t +1) ═ Xit, Yi t) + Tunit (Vixt, Viyt). Wherein, (Xi t +1, Yit +1) is a position coordinate of the ith interface element displayed on the terminal display interface at the time t +1, (Xit, Yi t) is a position coordinate of the ith interface element displayed on the terminal display interface at the time t, Tunit is a time difference between adjacent times, Vixt is a velocity component of the ith interface element in the x-axis direction at the time t, and Viyt is a velocity component of the ith interface element in the y-axis direction at the time t.

It should be noted that in the embodiment of the present invention, the movement speed of the interface element at the stop position is approximately 0, and the coordinate at the time t +1 is maintained as the same as the time t.

The result of the foregoing calculation is set as the next-time coordinate of the element for use in looping back to the first step.

Fig. 15 is a control timing diagram after the terminal receives a user-triggered off-screen operation.

S301: the user triggers the off-screen operation through the input device of the terminal, and the input device sends off-screen operation information to the processor.

S302: and the processor of the terminal acquires the position coordinate where the pressed point is located at the previous moment, namely the last coordinate before the pressed point leaves the screen.

S303: and comparing the coordinates of all the interface elements at the current moment with the coordinates of the positions of the pressing points acquired in the step S102.

S304: if the current coordinate of the interface element is found to be equal to the coordinate of the pressing point in the S102, executing the preset operation when the element is selected; if there is no interface element whose current coordinates are equal to the coordinates of the pressed point in the second step, no operation in which any interface element is selected is performed.

S305: if a bounding element is selected in S304, a display effect of the corresponding action for which the element is selected is output to an output device.

S306: and if the terminal display interface is not switched, controlling all interface elements to return to the original positions.

In the embodiment of the present invention, there are two possibilities that the terminal display interface is not switched, and one possibility is that the interface remains the terminal display interface before the interface element is selected after the interface element is selected and the corresponding action effect corresponding to the selected interface element is executed in S304. Another possibility is that no interface element is selected in S304, and therefore the terminal display interface before the interface element selection is performed is maintained.

In the embodiment of the invention, by the interface element selection method in the embodiment, an effect similar to that of a simulated gravity is realized by controlling the interface element to move to the stop position, wherein the gravity point is the position of the stop position, and when the interface element moves to the vicinity of the stop position, off-screen operation is triggered to realize the selection of the interface element, so that the method for selecting the interface element in the vicinity of the pressing point is realized, and the operation of a user is facilitated.

The method can be applied to scenes that the fingers of the user cannot reach the target interface element, for example, the user holds the mobile device with things in the hand or the mobile device is a large screen, and the like, and the interface element can move towards the fingers of the user (namely, the position forming the attraction point) by simulating the attraction effect, so that the embarrassment that the target is not close to touch is avoided, the user experience is improved, and certain operation interest can be brought.

Based on the method for selecting an interface element provided in the foregoing embodiment, an embodiment of the present invention further provides an apparatus 100 for selecting an interface element, fig. 16 is a schematic structural diagram of the apparatus 100 for selecting an interface element provided in the embodiment of the present invention, and as shown in fig. 16, the apparatus 100 for selecting an interface element includes an obtaining unit 101 and a processing unit 102.

The obtaining unit 101 is configured to obtain a pressing operation input by a user on a terminal display interface, and receive an off-screen operation triggered by the user at a stop position where an interface element of an object to be selected stays.

The processing unit 102 is configured to obtain, according to the pressing operation obtained by the obtaining unit 101, a position of a pressing point of the pressing operation, and a vertical vector formed by the pressing operation at the pressing point and perpendicular to a terminal display interface. And determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector. And determining the stop position of the interface element according to the position of the pressing point. And controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same time. When the obtaining unit 101 receives an off-screen operation triggered by a user at a stop position where a target interface element to be selected stays, the target interface element is operated.

And the action range is used for determining the interface element moving towards the direction of the pressing point.

Optionally, the processing unit 102 specifically determines the stop position of the interface element according to the position of the pressing point in the following manner:

and determining the position of the pressing point as the stop position of the interface element. Or determining a stopping area at a position where the distance from the position where the pressing point is located is less than or equal to a set threshold value position as the stopping position of the interface element.

Optionally, in the case that the number of the interface elements in the action range is at least two, the processing unit 102 determines that the dwell area is at least two.

Optionally, the processing unit 102 specifically determines an action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector in the following manner:

and determining the radius according to the size of the vertical vector. And determining a circular range according to the radius by taking the position of the pressing point as a circle center. And determining the determined circular range as an action range of the pressing operation on the terminal display interface.

Optionally, the processing unit 102 specifically controls the interface element located in the action range to move to the stop position of the interface element by using the following method:

controlling the interface element in the action range to execute the following steps in the process of moving to the stop position of the interface element until the interface element moves to the stop position:

and acquiring the position coordinates of the interface element in the action range at the previous moment and the position coordinates of the interface element in the current moment. Redrawing the drawing of the interface element at the position coordinate at the current moment, and canceling the drawing of the interface element at the position coordinate at the previous moment.

Optionally, the number of interface elements in the action range is at least two. The processing unit 102, specifically, controlling the interface element located in the action range to move to the stop position of the interface element by using the following method, includes:

an initial movement velocity of each of the at least two interface elements is determined. Determining a distance between each interface element of the at least two interface elements and a dwell position of the interface element. And determining the time for each interface element to reach the stopping position of the interface element according to the distance between each interface element and the stopping position of the interface element and the initial movement speed of each interface element. And adjusting the movement speed of the interface elements with the same arrival time to ensure that the time for each interface element to reach the staying position of the interface element is different. And taking the adjusted movement speed as the movement speed of the interface element with the adjusted movement speed, and taking the initial movement speed as the movement speed of the interface element without the adjusted movement speed. And controlling each interface element in the at least two interface elements to move to the stop position of the interface element at the movement speed corresponding to the interface element.

Optionally, the processing unit 102 specifically controls the stopping position to stop at most one interface element at the same time in the following manner, including:

and acquiring the position of the moving interface element in the action range after the movement. And under the condition that the position of the moving interface element after the movement is coincident with the stopping position, judging whether the interface element is stopped at the stopping position. And if the interface element is stopped at the stopping position, replacing the stopped interface element with the motion interface element. And if the interface element which is stopped does not exist at the stopping position, stopping the motion interface element at the stopping position.

Optionally, the processing unit 102 is further configured to: after replacing the stopped interface element by the motion interface element, the replaced interface element which is stopped at the stopping position is not placed in the action range.

Optionally, the obtaining unit 101 is further configured to obtain an off-screen operation triggered by the user in the exit area.

The processing unit 102 is further configured to: when the interface element moves to the stop position and the acquiring unit 101 acquires the off-screen operation triggered by the exit area by the user, the interface element at the stop position is not operated. The exit area is an area for triggering off-screen operation by a user under the condition that the user does not need to select an interface element.

The device 100 for selecting an interface element provided in the embodiment of the present invention has all functions in the interface element selection process related in the foregoing method embodiment, and specific implementation processes thereof can refer to the description related to the foregoing embodiment and the accompanying drawings, and are not described herein again.

Based on the method for selecting an interface element provided in the foregoing embodiment, an apparatus 200 for selecting an interface element is provided in the embodiment of the present invention, fig. 17 is a schematic structural diagram of the apparatus 200 for selecting an interface element provided in the embodiment of the present invention, and as shown in fig. 17, the apparatus 200 for selecting an interface element provided in the embodiment of the present invention includes a detection unit 201 and a control unit 202.

The detecting unit 201 is configured to detect a pressing operation input by a user on a terminal display interface, and detect an off-screen operation triggered by the user at a stop position to which an interface element of an object to be selected moves.

A control unit 202, configured to control an interface element to move towards a position where a pressing point of the pressing operation detected by the detection unit 201 is located, where a position of the interface element on the terminal display interface is different from the position where the pressing point is located. When the target interface element to be selected moves to a preset stop position and the detection unit 201 detects that the user triggers off-screen operation at the stop position, the target interface element is operated.

Optionally, the preset stop position includes a position where the pressing point is located. Or the preset stop position comprises a stop area at a position where the distance from the position where the pressing point is located is smaller than or equal to a set threshold value.

Optionally, the number of the interface elements is at least two, and the number of the stay areas is at least two.

Optionally, the control unit 202 specifically controls the interface element to move towards the position of the pressing point of the pressing operation in the following manner:

determining at least one interface element moving towards a position where a pressing point of the pressing operation is located. Determining a speed of movement of the at least one interface element. And determining the movement direction of the at least one interface element, wherein the movement direction is the ray direction from the position of the interface element to the preset stopping position. And controlling each interface element to move towards the position of the pressing point of the pressing operation along the ray direction from the position of the interface element to the preset stop position at the movement speed corresponding to the interface element.

Optionally, the interface element includes a first interface element and a second interface element. And the time for the first interface element to reach the preset stop position is the first time. And the time for the second interface element to reach the preset stop position is a second time. The first time is different from the second time.

Optionally, at most one interface element is stopped at the preset stopping position at the same time.

Optionally, the position of the interface element on the terminal display interface is located within a circular range on the terminal display interface with the position of the pressing point as a circle center.

Optionally, the detecting unit 201 is further configured to acquire an off-screen operation triggered by the user in the exit area.

The control unit 202 is further configured to: when the interface element moves to the preset stop position and the detection unit 201 detects that the user triggers the off-screen operation in the exit area, the interface element at the preset stop position is not operated. The exit area is an area for triggering off-screen operation by a user under the condition that the user does not need to select an interface element.

The device 200 for selecting an interface element provided in the embodiment of the present invention has all functions in the interface element selection process related to the foregoing method embodiment, and the specific implementation process thereof can refer to the description related to the foregoing embodiment and the drawings, and is not described herein again.

Based on the method for selecting an interface element provided in the foregoing embodiment, an embodiment of the present invention further provides a terminal 300, and fig. 18 is a schematic structural diagram of the terminal 300 provided in the embodiment of the present invention. As shown in fig. 18, the terminal 300 according to the embodiment of the present invention includes an input device 301, an output device 302, a processor 303, a memory 304, and a bus 305, where the input device 301, the output device 302, and the memory 304 are all connected to the processor 303 through the bus 305.

The input device 301 may be a touch screen.

The output device 302 may be a screen of a terminal.

The processor 303 may be a general purpose Central Processing Unit (CPU), microprocessor, Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to control the execution of programs in accordance with the teachings of the present invention. The memory or memories included in the computer system may be a read-only memory (ROM) or other type of static storage device that may store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that may store information and instructions, or a disk storage device. These memories are connected to the processor via a bus.

The memory 304, such as RAM, holds an operating system and programs that implement aspects of the present invention. The operating system is a program for controlling the operation of other programs and managing system resources.

The bus 305, which may include a path, carries information between the various components of the computer.

In one possible design, the memory 304 is used for storing program codes executed by the processor 303.

The input device 301 is configured to obtain a pressing operation input by a user on a terminal display interface, and receive an off-screen operation triggered by the user at a stop position where an interface element of an object to be selected stays.

The output device 302 is configured to output the interface element.

The processor 303 is configured to call a program stored in the memory 304, and perform the pressing operation acquired by the input device 301. And acquiring the position of a pressing point of the pressing operation and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point. And determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector. And determining the stop position of the interface element according to the position of the pressing point. And controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same time. When the input device 301 receives an off-screen operation triggered by a user at a stop position where a target interface element to be selected stays, the target interface element is operated.

Optionally, the processor 303 determines the stop position of the interface element according to the position of the pressing point by specifically adopting the following method:

Wherein the number of interface elements in the action range is at least two. The processor 303 determines that the dwell area is at least two.

The processor 303 specifically determines an action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector in the following manner:

The processor 303, during controlling the interface element in the action range to move to the stop position of the interface element, executes the following steps until the interface element moves to the stop position: and acquiring the position coordinates of the interface element in the action range at the previous moment and the position coordinates of the interface element in the current moment. And redrawing the drawing of the interface element at the position coordinate at the current moment, and canceling the drawing of the interface element at the position coordinate at the previous moment so as to control the interface element positioned in the action range to move to the stop position of the interface element.

Wherein the number of interface elements in the action range is at least two.

The processor 303 specifically controls the interface element located in the action range to move to the stop position of the interface element in the following manner, including: an initial movement velocity of each of the at least two interface elements is determined. Determining a distance between each interface element of the at least two interface elements and a dwell position of the interface element. And determining the time for each interface element to reach the stopping position of the interface element according to the distance between each interface element and the stopping position of the interface element and the initial movement speed of each interface element. And adjusting the movement speed of the interface elements with the same arrival time to ensure that the time for each interface element to reach the staying position of the interface element is different. And taking the adjusted movement speed as the movement speed of the interface element with the adjusted movement speed, and taking the initial movement speed as the movement speed of the interface element without the adjusted movement speed. And controlling each interface element in the at least two interface elements to move to the stop position of the interface element at the movement speed corresponding to the interface element.

The processor 303 specifically controls the stopping position to stop at most one interface element at the same time in the following manner, including: and acquiring the position of the moving interface element in the action range after the movement. And under the condition that the position of the moving interface element after the movement is coincident with the stopping position, judging whether the interface element is stopped at the stopping position. And if the interface element is stopped at the stopping position, replacing the stopped interface element with the motion interface element. And if the interface element which is stopped does not exist at the stopping position, stopping the motion interface element at the stopping position.

Optionally, the processor 303 is further configured to: after replacing the stopped interface element by the motion interface element, the replaced interface element which is stopped at the stopping position is not placed in the action range.

Optionally, the input device 301 is further configured to obtain an off-screen operation triggered by the user in the exit area.

The processor 303 is further configured to: when the interface element moves to the stop position and the input device 301 acquires an off-screen operation triggered by the user in the exit area, the interface element at the stop position is not operated. The exit area is an area for triggering off-screen operation by a user under the condition that the user does not need to select an interface element.

In another possible design, the memory 304 is used for storing program codes executed by the processor 303.

The input device 301 is configured to detect a pressing operation input by a user on a terminal display interface, and detect an off-screen operation triggered by the user at a stop position to which an interface element of an object to be selected moves.

The output device 302 is configured to output the interface element.

The processor 303 is configured to control an interface element to move towards a position where a pressing point of the pressing operation detected by the input device 301 is located, where a position of the interface element on the terminal display interface is different from the position where the pressing point is located. And when the target interface element to be selected moves to a preset stop position and the input device 301 detects that the user triggers off-screen operation at the stop position, operating the target interface element.

Wherein, the preset stop position comprises the position of the pressing point. Or the preset stop position comprises a stop area at a position where the distance from the position where the pressing point is located is smaller than or equal to a set threshold value.

Wherein the number of the interface elements is at least two, and the number of the stay areas is at least two.

The processor 303 specifically controls the interface element to move towards the position of the pressing point of the pressing operation in the following manner:

Wherein the interface element comprises a first interface element and a second interface element. The time for the first interface element to reach the preset stop position is the first time. And the time for the second interface element to reach the preset stop position is a second time. The first time is different from the second time.

And stopping at most one interface element at the preset stopping position at the same moment.

Optionally, the input device 301 is further configured to acquire an off-screen operation triggered by the user in the exit area.

The processor 303 is further configured to not run the interface element at the preset stop position when the interface element moves to the preset stop position and the input device 301 detects that the user triggers the off-screen operation in the exit area. The exit area is an area for triggering off-screen operation by a user under the condition that the user does not need to select an interface element.

The device 300 for selecting an interface element according to the embodiment of the present invention has all functions in the interface element selection process related to the above method embodiment, and the specific implementation process may refer to the description related to the above embodiment and the drawings, which are not described herein again.

It will be understood by those skilled in the art that all or part of the steps in the method for implementing the above embodiments may be implemented by a program, and the program may be stored in a computer-readable storage medium, where the storage medium is a non-transitory medium, such as a random access memory, a read only memory, a flash memory, a hard disk, a solid state disk, a magnetic tape (magnetic tape), a floppy disk (floppy disk), an optical disk (optical disk), and any combination thereof.

The present invention has been described with reference to flowchart illustrations and block diagrams, respectively, of methods and apparatus according to embodiments of the invention. It will be understood that each flow and block of the flow diagrams and block diagrams, and combinations of flows and blocks in the flow diagrams and block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and block diagram block or blocks.

The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method of selecting an interface element, comprising:

acquiring a pressing operation input by a user on a terminal display interface;

acquiring the position of a pressing point of the pressing operation according to the pressing operation, and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point;

determining an action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector, wherein the action range is used for determining an interface element moving towards the direction of the pressing point;

determining the staying position of the interface element according to the position of the pressing point;

controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same moment;

and receiving off-screen operation triggered by a user at a staying position where the target interface element to be selected stays, and operating the target interface element.

2. The method of claim 1, wherein determining the dwell position of the interface element based on the location of the pressed point comprises:

determining the position of the pressing point as the staying position of the interface element; or

And determining a stopping area at a position where the distance from the position where the pressing point is located is less than or equal to a set threshold value position as a stopping position of the interface element.

3. The method of claim 2, wherein the number of interface elements in the functional range is at least two;

the number of dwell areas is at least two.

4. The method of claim 1, wherein determining the scope of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector comprises:

determining a radius according to the size of the vertical vector;

determining a circular range according to the radius by taking the position of the pressing point as a circle center;

and determining the determined circular range as an action range of the pressing operation on the terminal display interface.

5. The method of any one of claims 1 to 4, wherein said controlling movement of an interface element within said reach to a dwell position of said interface element comprises:

controlling the interface element to execute the following steps in the process of moving to the stop position of the interface element until the interface element moves to the stop position:

acquiring the position coordinates of the interface element at the previous moment and the position coordinates of the interface element at the current moment;

redrawing the drawing of the interface element at the position coordinate at the current moment, and canceling the drawing of the interface element at the position coordinate at the previous moment.

6. The method according to any one of claims 1 to 4, wherein the number of interface elements located within the action range is at least two;

the controlling the interface element located in the action range to move to the stop position of the interface element comprises the following steps:

determining an initial movement velocity of each of the at least two interface elements;

determining a distance between each interface element of the at least two interface elements and a dwell position of the interface element;

determining the time for each interface element to reach the staying position of the interface element according to the distance between each interface element and the staying position of the interface element and the initial movement speed of each interface element;

adjusting the movement speed of the interface elements with the same arrival time to ensure that the time for each interface element to arrive at the staying position of the interface element is different;

taking the adjusted movement speed as the movement speed of the interface element with the adjusted movement speed, and taking the initial movement speed as the movement speed of the interface element without the adjusted movement speed;

and controlling each interface element in the at least two interface elements to move to the stop position of the interface element at the movement speed corresponding to the interface element.

7. The method of any one of claims 1 to 4, wherein said controlling the dwell at the dwell location at the same time of up to one interface element comprises:

acquiring the position of the moving interface element in the action range after the movement;

under the condition that the position of the moving interface element after moving is coincident with the stopping position, judging whether the interface element is stopped at the stopping position;

if the interface element is stopped at the stopping position, replacing the stopped interface element with the motion interface element;

and if the interface element which is stopped does not exist at the stopping position, stopping the motion interface element at the stopping position.

8. The method of claim 7, wherein after replacing the stopped interface element with the moving interface element, the method further comprises:

the interface element which has been replaced and has already stopped at the stop position is no longer placed within the range of action.

9. The method of any of claims 1 to 4, further comprising:

when the interface element moves to the stop position and the off-screen operation triggered by the user in the exit area is acquired, the interface element at the stop position is not operated;

the exit area is an area for triggering off-screen operation by a user under the condition that the user does not need to select an interface element.

10. A method of selecting an interface element, comprising:

detecting a pressing operation input by a user on a terminal display interface;

controlling an interface element to move towards the position of a pressing point of the pressing operation, wherein the position of the interface element on a terminal display interface is different from the position of the pressing point;

and running the target interface element under the condition that the target interface element to be selected moves to a preset stop position and the condition that the user triggers off-screen operation at the stop position is detected.

11. The method of claim 10, wherein the predetermined rest position comprises a position at which the pressing point is located; or

The preset stop position comprises a stop area at a position where the distance between the preset stop position and the position where the pressing point is located is smaller than or equal to a set threshold value.

12. The method of claim 11, wherein the number of interface elements is at least two;

the number of dwell areas is at least two.

13. The method of claim 10, wherein moving the control interface element toward a location at which a pressing point of the pressing operation is located comprises:

determining a movement speed of the interface element;

determining the movement direction of the interface element, wherein the movement direction is the ray direction from the position of the interface element to the preset stopping position;

and controlling the interface element to move towards the position of the pressing point of the pressing operation along the ray direction from the position of the interface element to the preset stop position at the movement speed corresponding to the interface element.

14. The method of claim 13, wherein the interface element comprises a first interface element and a second interface element;

the time for the first interface element to reach the preset stop position is first time;

the time for the second interface element to reach the preset stop position is a second time;

the first time is different from the second time.

15. The method of any one of claims 10 to 14, wherein at most one interface element is stopped at the predetermined stopping position at the same time.

16. The method according to any one of claims 10 to 14, wherein the interface element is located on the terminal display interface within a circular range on the terminal display interface centered on the location of the pressed point.

17. The method of any of claims 10 to 14, further comprising:

when the interface element moves to a preset stop position and the condition that the user triggers off-screen operation in the exit area is detected, the interface element at the preset stop position is not operated;

18. An apparatus for selecting an interface element, comprising:

the device comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring the pressing operation input by a user on a terminal display interface and receiving the off-screen operation triggered by the user at the staying position where an object interface element to be selected stays;

the processing unit is used for acquiring the position of a pressing point of the pressing operation and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point according to the pressing operation acquired by the acquiring unit; determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector; determining the staying position of the interface element according to the position of the pressing point; controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same moment; when the obtaining unit receives an off-screen operation triggered by a user at a staying position where a target interface element to be selected stays, operating the target interface element;

19. The apparatus according to claim 18, wherein the processing unit determines the resting position of the interface element according to the position of the pressing point by:

20. The apparatus of claim 19, wherein the number of interface elements in the actuation range is at least two;

the processing unit determines the dwell areas to be at least two.

21. The apparatus according to claim 18, wherein the processing unit determines an action range of the pressing operation on the terminal display interface according to a position of the pressing point and a size of the vertical vector in the following manner:

determining a radius according to the size of the vertical vector;

22. The device according to any one of claims 18 to 21, wherein the processing unit controls the movement of the interface element located in the range of action to the rest position of the interface element in particular in the following manner:

acquiring the position coordinates of the interface element in the action range at the previous moment and the position coordinates of the interface element in the action range at the current moment;

23. The device of any one of claims 18 to 21, wherein the number of interface elements in the actuation range is at least two;

the processing unit is specifically configured to control the interface element located in the action range to move to the stop position of the interface element in the following manner, including:

24. The apparatus according to any one of claims 18 to 21, wherein the processing unit is configured to control the stopping of at most one interface element at the same time at the stopping location in a manner comprising:

25. The apparatus as recited in claim 24, said processing unit to further:

after replacing the stopped interface element by the motion interface element, the replaced interface element which is stopped at the stopping position is not placed in the action range.

26. The device according to any one of claims 18 to 21, wherein the acquiring unit is further configured to acquire an off-screen operation triggered by a user in an exit area;

the processing unit is further configured to:

when the interface element moves to the stop position and the obtaining unit obtains that the interface element at the stop position is not operated under the condition that the off-screen operation triggered by the user in the exit area is obtained;

27. An apparatus for selecting an interface element, comprising:

the detection unit is used for detecting the pressing operation input by a user on the terminal display interface and detecting the off-screen operation triggered by the user at the stop position to which the object interface element to be selected moves;

the control unit is used for controlling an interface element to move towards the position where the pressing point of the pressing operation detected by the detection unit is located, wherein the position of the interface element on the terminal display interface is different from the position where the pressing point is located; and running the target interface element under the condition that the target interface element to be selected moves to a preset stop position and the detection unit detects that the user triggers off-screen operation at the stop position.

28. The device of claim 27, wherein the predetermined rest position comprises a position at which the pressing point is located; or

29. The apparatus of claim 28, wherein the number of interface elements is at least two and the number of dwell regions is at least two.

30. The device according to any one of claims 27 to 29, wherein the control unit controls the movement of the interface element towards the position of the pressing point of the pressing operation in particular by:

determining at least one interface element moving towards the position where the pressing point of the pressing operation is located;

determining a speed of movement of the at least one interface element;

determining the movement direction of the at least one interface element, wherein the movement direction is the ray direction from the position of the interface element to the preset stopping position;

and controlling each interface element to move towards the position of the pressing point of the pressing operation along the ray direction from the position of the interface element to the preset stop position at the movement speed corresponding to the interface element.

31. The apparatus of any one of claims 27 to 29, wherein the interface element comprises a first interface element and a second interface element;

the first time is different from the second time.

32. The apparatus of claim 31, wherein the predetermined dwell position dwells at the same time for at most one interface element.

33. The apparatus of claim 31, wherein the location of the interface element on the terminal display interface is within a circle on the terminal display interface centered on the location of the pressed point.

34. The apparatus of claim 27,

the detection unit is also used for acquiring off-screen operation triggered by a user in an exit area;

the control unit is further configured to:

when the interface element moves to the preset stop position and the detection unit detects that the user triggers off-screen operation in the exit area, the interface element at the preset stop position is not operated;

35. A terminal comprising an input device, an output device, a processor, a memory, and a bus, wherein the input device, the output device, and the memory are all connected to the processor via the bus, wherein,

the memory is used for storing program codes executed by the processor;

the input equipment is used for acquiring the pressing operation input by a user on a terminal display interface and receiving the off-screen operation triggered by the user at the stop position where the target interface element to be selected stays;

the output device is used for outputting the interface element;

the processor is used for calling a program stored in the memory and obtaining the pressing operation according to the input equipment; acquiring the position of a pressing point of the pressing operation and a vertical vector which is formed by the pressing operation and is vertical to a terminal display interface at the pressing point; determining the action range of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector; determining the staying position of the interface element according to the position of the pressing point; controlling the interface elements positioned in the action range to move to the stopping positions of the interface elements, and controlling the stopping positions to stop at most one interface element at the same moment; and when the input equipment receives an off-screen operation triggered by a user at a stop position where the target interface element to be selected stays, operating the target interface element.

36. The terminal of claim 35, wherein the processor determines the dwell position of the interface element based on the location of the pressed point by:

37. The terminal of claim 36, wherein the number of interface elements in the actuation range is at least two;

the processor determines the dwell areas to be at least two.

38. The terminal of claim 35, wherein the processor determines the range of action of the pressing operation on the terminal display interface according to the position of the pressing point and the size of the vertical vector by:

determining a radius according to the size of the vertical vector;

39. A terminal as claimed in any one of claims 35 to 38, wherein said processor is configured to control movement of an interface element within said reach to a dwell position of said interface element by:

40. A terminal as claimed in any one of claims 35 to 38, wherein the number of interface elements in the active range is at least two;

the processor specifically controls the interface element located in the action range to move to the stop position of the interface element in the following manner, including:

41. A terminal as claimed in any one of claims 35 to 38, wherein said processor is configured to control the dwell of at most one interface element at the same time at the dwell position in a manner including:

42. The terminal of claim 41, wherein the processor is further configured to:

43. The terminal of claim 35, wherein the input device is further configured to obtain an off-screen operation triggered by a user in an exit area;

the processor is further configured to:

when the interface element moves to the stop position and the input device acquires the off-screen operation triggered by the exit area of the user, the interface element at the stop position is not operated;

44. A terminal comprising an input device, an output device, a processor, a memory, and a bus, wherein the input device, the output device, and the memory are all connected to the processor via the bus, wherein,

the memory is used for storing program codes executed by the processor;

the input device is used for detecting the pressing operation input by a user on the terminal display interface and detecting the off-screen operation triggered by the user at the stop position to which the interface element of the object to be selected moves;

the output device is used for outputting the interface element;

the processor is used for controlling an interface element to move towards a position where a pressing point of the pressing operation detected by the input device is located, wherein the position of the interface element on a terminal display interface is different from the position where the pressing point is located; and running the target interface element under the condition that the target interface element to be selected moves to a preset stop position and the input equipment detects that the user triggers off-screen operation at the stop position.

45. The terminal of claim 44, wherein the predetermined rest position comprises a position at which the pressing point is located; or

46. The terminal of claim 45, wherein the number of interface elements is at least two and the number of dwell regions is at least two.

47. The terminal of claim 44, wherein the processor controls movement of the interface element toward a location of a pressing point of the pressing operation in particular by:

determining a speed of movement of the at least one interface element;

48. The terminal of claim 47, wherein the interface element comprises a first interface element and a second interface element;

the first time is different from the second time.

49. A terminal as claimed in any one of claims 44 to 48, wherein the predetermined dwell position is at most one interface element at a time.

50. The terminal according to any one of claims 44 to 48, wherein the interface element is located on the terminal display interface within a circular range on the terminal display interface centered on the location of the pressed point.

51. The terminal according to any of claims 44 to 48,

the input equipment is also used for acquiring off-screen operation triggered by a user in an exit area;

the processor is further configured to not run the interface element at the preset stop position when the interface element moves to the preset stop position and the input device detects that the user triggers the off-screen operation in the exit area;