WO2017185264A1

WO2017185264A1 - Interface element selection method and apparatus, and terminal

Info

Publication number: WO2017185264A1
Application number: PCT/CN2016/080375
Authority: WO
Inventors: 余亮
Original assignee: 华为技术有限公司
Priority date: 2016-04-27
Filing date: 2016-04-27
Publication date: 2017-11-02
Also published as: CN108351717B; CN108351717A

Abstract

An interface element selection method and apparatus, and a terminal. The method comprises: obtaining a pressing operation inputted by a user on a terminal display interface; obtaining, according to the pressing operation, the location of a pressing point of the pressing operation and a vertical vector that is formed at the pressing point by the pressing operation and that is perpendicular to the terminal display interface; determining an action range of the pressing operation on the terminal display interface according to the location of the pressing point and the magnitude of the vertical vector; determining a stay location of the interface element according to the location of the pressing point; controlling an interface element in the action range to move toward the stay location of the interface element, and controlling that at most one interface element stays in the stay location at the same time point; and receiving an off-screen operation triggered by the user in the stay location in which a to-be-selected target interface element stays, and operating the target interface element, so that the user can select the interface element when not able to touch the display location of the interface element.

Description

Method, device and terminal for selecting interface elements

Technical field

The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a terminal for selecting an interface element.

Background technique

With the development of communication technology, the functional requirements that users can achieve on the terminal are getting higher and higher.

When a user uses a terminal, it is often necessary to select an interface element displayed on the terminal interface before the corresponding function can be performed. An interface element generally refers to any element on the terminal display interface that responds to a user operation and is identified by a user-recognizable appearance, including but not limited to an application icon and a running control, such as a desktop icon button, a list item of a list, The thumbnail of the album preview (because clicking on the thumbnail will open the original image) and so on. At present, if the user wants to select the interface element displayed on the terminal display interface, the user usually selects the interface element by performing operations such as clicking on the interface element display position, and if the user cannot touch the display position of the interface element. , you can not select the interface elements to be selected.

Summary of the invention

Embodiments of the present invention provide a method, device, and terminal for selecting an interface element, so as to implement selection of an interface element when the user cannot touch the display position of the interface element.

In a first aspect, a method for selecting an interface element is provided. a user inputs a pressing operation on a terminal display interface, and the terminal acquires a pressing operation input by the user on the terminal display interface, and controls the terminal to display the vertical position according to the pressing operation. The interface element in the range of the vector action moves toward the pressing point. When the target interface element to be selected moves to a position that the user can touch, the user triggers the off-screen operation to realize the selection of the target interface element, and the interface element is executed by the terminal. The corresponding function is selected to select the interface element if the user cannot touch the display position of the interface element.

In a possible design, the terminal acquires a position of the pressing point of the pressing operation according to the pressing operation, and is formed by the pressing operation at the pressing point and perpendicular to the terminal display interface. a vertical vector, determining a range of action of the pressing operation on the display interface of the terminal according to a position of the pressing point and a size of the vertical vector, wherein the working range is used to determine the pressing point Interface elements that move in the direction. Determining, by the terminal, the staying position of the interface element according to the location of the pressing point, controlling the interface element located in the working range to move to the staying position of the interface element, and controlling the staying position to stay at the same time at the same time An interface element. The terminal receives an off-screen operation triggered by the user at a stay position where the target interface element to be selected stays, and runs the target interface element.

The determining the position of the interface element according to the location of the pressing point includes: determining a location of the pressing point as a stopping position of the interface element. Or determining a staying area at a distance from the position where the pressing point is located is less than or equal to a set threshold position as a staying position of the interface element. The number of interface elements in the range of action is at least two, and the number of the staying areas is at least two.

The action range of the pressing operation on the display interface of the terminal is determined according to the location of the pressing point and the size of the vertical vector, including:

Determining a radius according to the size of the vertical vector; determining a circular range according to the radius at a position where the pressing point is located; determining the determined circular range as the pressing operation at the terminal Display the scope of the interface.

The controlling the movement of the interface element located in the active range to the staying position of the interface element includes:

Controlling, during the movement of the interface element to the staying position of the interface element, performing the following steps until the interface element moves to the staying position: acquiring a position coordinate of a moment before the interface element and a position coordinate of a current moment; Drawing the interface element at the position coordinates of the current time, and canceling the drawing of the interface element at the position coordinate of the previous time.

The number of the interface elements in the range of the action is at least two; the controlling the movement of the interface element in the range of the action to the stop position of the interface element includes:

Determining an initial motion speed of each of the at least two interface elements; determining a distance between each of the at least two interface elements and a staying position of the interface element; Determining, according to the distance between each interface element and the staying position of the interface element, and the initial moving speed of each interface element, the time at which each interface element reaches the staying position of the interface element; adjusting the interface with the same arrival time The moving speed of the element is such that the time at which each interface element reaches the resting position of the interface element is different; the adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the unadjusted moving speed. a speed of movement of the interface element; controlling each of the at least two interface elements to move to a stop position of the interface element at a speed of motion corresponding to the interface element.

In the embodiment of the present invention, the position of the motion interface element in the range of motion is obtained; if the position of the motion interface element coincides with the stop position, it is determined whether the stop position has been stopped. Having an interface element; if the interface element has been left at the stop position, replacing the already-used interface element with the motion interface element; if there is no existing interface element at the stop position, the The moving interface element stays at the staying position, and controls at least one interface element at the same time at the stop position to avoid ambiguity when the user selects the interface element.

In another possible design, after the interface element has been replaced by the motion interface element, the interface element that has been replaced and has stayed at the stop position is no longer placed within the scope of the action, Avoid moving the interface element towards the pressing point again.

In another possible design, an exit area may be set, where the exit area is an area that triggers an off-screen operation when the user does not need to select an interface element, and the interface element moves to the stop position, and the user is acquired. In the case of the off-screen operation triggered by the exit area, the interface element at the stop position is not operated, so as to avoid the user selecting an interface element that does not need to be selected when the off-screen operation is triggered.

In a second aspect, a method for selecting an interface element is provided, in which a terminal detects a pressing operation input by a user on a terminal display interface, and controls a position of the interface element toward a pressing point of the pressing operation, wherein the interface element The position on the terminal display interface is different from the position where the pressing point is located, and when the target interface element to be selected is moved to the preset stay position, and the user is detected to trigger the off-screen operation at the stop position, the operation is performed. The target interface element to achieve The interface element is selected near the pressing point to facilitate user operation.

The preset stay position includes a position where the pressing point is located; or the preset stay position includes a stay area at a distance from a position where the pressing point is located less than or equal to a set threshold position. In the case where the number of the interface elements is at least two, the number of the staying areas is at least two.

In a possible design, the moving speed and the moving direction of the interface element are determined, and the moving direction is a ray direction in which the interface element is located to the preset staying position. The interface element is controlled to move at a position corresponding to the pressing point of the pressing operation at a moving speed corresponding to the interface element along a ray direction of the position of the interface element to the preset stopping position.

In another possible design, the interface element includes a first interface element and a second interface element. The time when the first interface element reaches the preset stay position is a first time; the time when the second interface element reaches the preset stay position is a second time; the first time and the first time The second time is different.

In yet another possible design, wherein the preset stop position stays at most one interface element at the same time.

The position of the interface element on the display interface of the terminal is located in a circular range of the terminal display interface with the position where the pressing point is located as a center.

In another possible design, when the interface element moves to the preset stay position, and detects that the user triggers the off-screen operation in the exit area, the interface element at the preset stop position is not operated; The exit area is an area where the user triggers the off-screen operation without selecting the interface element, thereby triggering the off-screen operation, but the interface element is not selected, so as to avoid the user not selecting the off-screen operation. Selected interface elements.

In a third aspect, there is provided an apparatus for selecting an interface element, the apparatus for selecting an interface element having a function of implementing the method of selecting an interface element related to the first aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. For example, the device for selecting an interface element includes an obtaining unit and a processing unit, and the obtaining unit is configured to acquire a pressing operation input by the user on the terminal display interface. And receiving an off-screen operation triggered by the user at a stay position where the target interface element to be selected stays. The processing unit is configured to acquire, according to the pressing operation acquired by the acquiring unit, a location of a pressing point of the pressing operation, and a pressing operation formed at the pressing point and perpendicular to the terminal display interface a vertical vector; determining a range of action of the pressing operation on the display interface of the terminal according to a location of the pressing point and a size of the vertical vector; determining the interface element according to a location of the pressing point a stop position; controlling an interface element located within the range of action to move to a stop position of the interface element, and controlling at the same time at the stop position to stay at most one interface element; receiving, at the acquisition unit, the user is to be selected The target interface element is run when the off-screen operation triggered at the dwell position where the target interface element stays.

In a fourth aspect, an apparatus for selecting an interface element is provided, the apparatus for selecting an interface element having a function in a method for implementing the selected interface element related to the second aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. For example, the device for selecting an interface element includes a detecting unit and a control unit, and the detecting unit is configured to detect a pressing operation input by the user on the terminal display interface, and detect that the user triggers at a parking position where the target interface element to be selected moves to Off-screen operation. The control unit is configured to control a position motion of the pressing point of the pressing operation of the interface element detected by the input unit, wherein a position of the interface element on the terminal display interface is different from a position of the pressing point The target interface element is run when the target interface element to be selected is moved to a preset stay position, and the input unit detects that the user triggers an off-screen operation at the stop position.

In a fifth aspect, a terminal is provided, the terminal having a function in a method for implementing the selected interface element related to the first aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. For example, the terminal includes an input device, an output device, a processor, a memory, and a bus, wherein the input device, the output device, and the memory are all connected to the processor through the bus, wherein a memory for storing program code executed by the processor. The input device is configured to obtain a pressing operation input by the user on the terminal display interface, and the receiving user is to be selected The off-screen operation triggered at the dwell position where the target interface element stays.

The output device is configured to output the interface element. The processor, configured to invoke a program stored in the memory, according to the pressing operation acquired by the input device; acquiring a location of a pressing point of the pressing operation, and at the pressing point by the a pressing operation forms a vertical vector perpendicular to the display interface of the terminal; determining, according to the position of the pressing point and the size of the vertical vector, a range of action of the pressing operation on the display interface of the terminal; Positioning, determining a staying position of the interface element; controlling an interface element located within the active range to move to a stop position of the interface element, and controlling at least one interface element at the same time at the stop position; When the input device receives the off-screen operation triggered by the user at the stay position where the target interface element to be selected stays, the target interface element is run.

In a sixth aspect, a terminal is provided, the terminal having a function in a method for implementing the selected interface element related to the second aspect. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. For example, the terminal includes an input device, an output device, a processor, a memory, and a bus, wherein the input device, the output device, and the memory are all connected to the processor through the bus, wherein a memory for storing program code executed by the processor. The input device is configured to detect a pressing operation input by the user on the terminal display interface, and detect an off-screen operation triggered by the user at a parking position to which the target interface element to be selected moves. The output device is configured to output the interface element. The processor is configured to control a position motion of a pressing point of the pressing operation of the interface element detected by the input device, where a position of the interface element on the terminal display interface is different from a position of the pressing point The target interface element is run when the target interface element to be selected is moved to a preset stay position, and the input device detects that the user triggers an off-screen operation at the stop position.

DRAWINGS

FIG. 1 is a flowchart of a method for selecting an interface element according to an embodiment of the present invention;

2 is a schematic diagram of determining a vertical vector according to an embodiment of the present invention;

3 is a schematic diagram of determining a circular radius when a range of action is a circular area according to an embodiment of the present invention;

4 is a first schematic diagram showing a motion process of two interface elements when a stop position is a pressing point according to an embodiment of the present invention;

FIG. 5 is a second schematic diagram showing the movement process of two interface elements when the stop position is a pressing point according to an embodiment of the present invention; FIG.

6 is a third schematic diagram showing the motion process of two interface elements when the stop position is a pressing point according to an embodiment of the present invention;

FIG. 7 is a first schematic diagram showing the movement process of four interface elements when the stop position is a pressing point according to an embodiment of the present invention; FIG.

FIG. 8 is a second schematic diagram showing the movement process of four interface elements when the stop position is a pressing point according to an embodiment of the present invention; FIG.

FIG. 9 is a third schematic diagram showing the movement process of four interface elements when the stop position is a pressing point according to an embodiment of the present invention; FIG.

FIG. 10 is a first schematic diagram showing a motion process of an interface element when a stop position is a preset area according to an embodiment of the present invention; FIG.

11 is a second schematic diagram of a motion process of an interface element when a stop position is a preset area according to an embodiment of the present invention;

12 is a third schematic diagram of a motion process of an interface element when a stop position is a preset area according to an embodiment of the present invention;

FIG. 13 is a fourth schematic diagram of a motion process of an interface element when a stop position is a preset area according to an embodiment of the present invention; FIG.

14 is a timing diagram of implementing a control interface element motion by a terminal during a duration of a pressing operation according to an embodiment of the present invention;

FIG. 15 is a timing diagram of control after a terminal receives an off-screen operation triggered by a user according to an embodiment of the present invention;

FIG. 16 is a schematic structural diagram of an apparatus for selecting an interface element according to an embodiment of the present disclosure;

FIG. 17 is a schematic structural diagram of another apparatus for selecting an interface element according to an embodiment of the present disclosure;

FIG. 18 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly described below with reference to the accompanying drawings in the embodiments of the present invention.

The method, device, and terminal for selecting an interface element provided by the embodiment of the present invention can be applied to a scenario in which a user needs to select an interface element but cannot touch a display position of the interface element. For example, the user needs to select a terminal display interface with a touch screen through a finger. Interface elements, but the terminal and other objects in the hand (such as holding a wallet and terminal at the same time, or holding the terminal at the same time), or the screen is too large to touch the target interface elements that need to be selected, or the terminal Displays any other situation in which the target interface element on the interface is outside the range of the finger touch.

In the embodiment of the present invention, the user inputs a pressing operation on the terminal display interface, and forms a vertical vector perpendicular to the terminal display interface at the pressing point, and the terminal controls the interface in the vertical vector range of the terminal display interface according to the vertical vector. The element moves toward the pressing point, and when the target interface element to be selected moves to a position that the user can touch, the user triggers an off-screen operation, thereby implementing selection of the target interface element, and the interface element is selected by the terminal. The corresponding function.

FIG. 1 is a flowchart of a method for selecting an interface element according to an embodiment of the present invention. The execution body of the method shown in FIG. 1 is a terminal. It is to be understood that the terminal involved in the embodiment of the present invention may also be referred to as a mobile terminal, a mobile station (MS), a user equipment (UE), etc., and the terminal may be wireless. A Radio Access Network (RAN) communicates with one or more core networks. For example, the terminal may be a mobile phone (or a cellular phone), a computer with a mobile terminal, etc., for example, the terminal may also be portable. Pocket, handheld, computer built-in or in-vehicle mobile devices that exchange voice and/or data with a wireless access network.

As shown in FIG. 1 , a method for selecting an interface element according to an embodiment of the present invention includes:

S101: Detect and acquire a pressing operation input by the user on the terminal display interface.

In the embodiment of the present invention, the location where the user inputs the pressing operation on the terminal display interface is not limited, but in order to avoid triggering the terminal to execute other unnecessary response procedures, the input pressing operation is usually performed. The location is selected in the terminal display interface where there is no defined response action.

S102: Acquire a position where the pressing point of the pressing operation is located according to the pressing operation, and a vertical vector formed by the pressing operation and perpendicular to the terminal display interface at the pressing point.

In the embodiment of the present invention, after the user inputs the pressing operation, the input device (for example, the touch screen) of the terminal can detect and acquire the position of the pressing point of the user input pressing operation, and obtain the coordinates (X0, Y0) of the pressing point.

Similarly, the input device of the terminal can acquire a vertical vector formed at the pressing point and pressed perpendicular to the terminal display interface by a pressing operation input by the user.

In the embodiment of the present invention, the vector refers to a vector of a three-dimensional space, and is used to describe a geometric object whose direction is perpendicular to the plane of the terminal screen and has a size. For example, a touch screen with a pressure touch function can obtain a vertical action on the screen. The pressure of the plane, this pressure is a three-dimensional vector, perpendicular to the surface of the screen and has a size. For example, in the case of Force touch, the vector y perpendicular to the screen is the pressure of the pressing operation.

It should be noted that the implementation of the present invention includes, but is not limited to, using the pressure of the force touch as a vector formed by the pressing operation perpendicular to the terminal display interface, and any touch screen factor that can be used or understood as a vector of the pressing operation perpendicular to the terminal display interface It belongs to the protection scope of the embodiments of the present invention.

S103: Determine a range of action of the pressing operation on the display interface of the terminal according to a location of the pressing point and a size of the vertical vector.

In an embodiment of the invention, the range of action is used to determine an interface element that moves in the direction in which the pressed point is located.

In the embodiment of the present invention, according to the location of the pressing point and the size of the vertical vector, determining the range of the pressing operation on the display interface of the terminal, the following manner may be adopted:

Determining a radius r according to the size of the vertical vector, where r satisfies r=|y|/tan a, where y is the vertical vector, |y| is the value of the vertical vector, and a is a preset angle. For example, as shown in FIG. 3, the horizontal line represents the surface of the screen, and the range of the pressing point is set to be centered on the pressing point and limited to the circular range in the current interface. Set the preset angle value a, and use the value of a and the vertical vector y |y| to determine the radius r of the range of action, then r=|y|/tan a. Taking the position of the pressing point as the center of the circle, with a large radius Small is r to determine the circular range. The determined circular range is determined as the range of action of the pressing operation on the terminal display interface.

The scope of the present invention may have different shapes, which are not limited in the embodiment of the present invention, and may be, for example, a circular shape as described above or a rectangular shape. For example, if the position coordinates of the known pressing point are (X0, Y0), it can be determined that the rectangular area between X0+L, X0-L, Y0+M, Y0-M is the range of action.

S104: Determine a staying position of the interface element according to a location where the pressing point is located.

In the embodiment of the present invention, the terminal can control the position of the interface element toward the pressing point of the pressing operation to facilitate the user to touch the interface element.

In the embodiment of the present invention, the stay position after the movement of the interface element can be set, and the principle of the stop position setting is set at a position convenient for the user to touch. In the embodiment of the present invention, the position where the pressing point is located may be determined as the staying position of the interface element. The staying area at a position where the distance between the pressed point and the position of the pressed point is less than or equal to the set threshold position may also be determined as the staying position of the interface element. Wherein, the number of the staying areas may be more than one, especially when the number of the interface elements is multiple, a plurality of staying areas may be set, and each of the staying areas may be independent of each other, and each staying area is occupied by one interface element. Of course, each of the stay areas can also be coherent into a whole area of stay to accommodate multiple elements in one stop area. In the embodiment of the present invention, the stay area may have a set shape on the terminal display interface, and the shape is not limited.

S105: Control an interface element located in the range of action to move to a stop position of the interface element, and control at least one interface element to stay at the same time at the stop position.

In the embodiment of the present invention, the terminal can determine each interface element (Xi, Yi) located within the range of the pressing point by traversing the coordinates of all interface elements on the current terminal display interface.

Generally, the interface elements located in the range of action may be one or multiple (at least two). In the embodiment of the present invention, a motion speed of each interface element located in the range of the action may be determined, and a motion direction of each interface element located in the range of the action is determined, where the motion direction is a position where the interface element is located to the interface. The ray direction of the dwell position of the element controls each interface element in the range of action, with the corresponding moving speed of the interface element, along the position of the interface element The ray direction of the resting position of the interface element moves toward the resting position of the interface element.

It should be noted that, in the embodiment of the present invention, the terminal controls the movement of the interface element to the parking position of the interface element, that is, the effect of moving the interface element toward the position where the pressing point of the pressing operation is located.

In the embodiment of the present invention, the trajectory of the movement of the interface element to the stop position is not limited. In the embodiment of the present invention, only the line whose motion trajectory is the position where the interface element is located to the stop position of the interface element is taken as an example, and any other The motion trajectory is within the scope of the invention.

In the embodiment of the present invention, at least one interface element is stopped at the same time at the stop position to avoid ambiguity when the user selects the interface element.

S106: Receive an off-screen operation input by the user at a stay position where the target interface element to be selected stays, and implement selection of the target interface element.

In the embodiment of the present invention, when the target interface element to be selected is moved to the preset stay position, or the distance between the stop position is less than or equal to the set threshold, the user may stay at the target interface element. The off-screen operation is triggered at the location to select the target interface element, and the terminal runs the target interface element. For example, if the stop position is the position where the pressing point is located, the target interface element can be moved to the position of the pressing point, and the user directly releases the finger pressing the touch screen to realize the selection of the target interface element. If the stop position is a stay area near the pressing point, when the target interface element moves to the stay area, the user presses the terminal interface and does not release the finger and moves the finger to the stay area where the target element stays, then releases the finger to realize the target interface. The selection of elements.

In the embodiment of the present invention, the pressing point position movement of the pressing operation is input to the user by the control interface element, and when the interface element moves to the vicinity of the pressing point, the off-screen operation is triggered to realize the selection of the interface element, and the interface element is selected near the pressing point. The method is convenient for the user to operate.

Embodiments of the Invention Hereinafter, the steps S105 and S106 in the above embodiment will be exemplified in combination with practical applications.

In the embodiment of the present invention, each interface element located on the current terminal display interface according to the vertical vector action range is given a motion speed of a centripetal motion toward the stop position, and the motion speed can be determined according to the size of the vertical variable. For example, the formula Vi=|y|*Ki can be used to determine the interface elements. The speed of motion, where y is the vertical vector, |y| is the value of the vertical vector, Ki is a normal number, and Vi is the motion speed of the i-th interface element.

It should be noted that, in the embodiment of the present invention, the motion speed of the interface element is set to be uniform motion and directly proportional to the vertical vector, but is not limited thereto. For example, the motion speed may be changed into various acceleration motions, and Interface elements can be assigned priority weights, and different speeds can be set according to different priorities.

Optionally, in the embodiment of the present invention, to ensure that at most one interface element moves to the stop position at the same time, the motion speed determined according to the above formula may be used as the initial motion speed, and then each interface element in the scope of the action is determined. a distance Li from the dwell position of the interface element, the distance Li being determined by the dwell position coordinates acquired by the terminal and the coordinates of the interface element, and then according to the dwell position of each interface element and the interface element The distance Li, and the initial velocity of motion Vi of each interface element, determines the time Ti at which each interface element reaches the resting position of the interface element, where Ti = Li / Vi. By determining the time when each interface element reaches the stop position, it can be determined whether there is an interface element having the same time to reach the stop position. If present, the motion speed of the interface element with the same arrival time can be adjusted in the embodiment of the present invention, so that each interface The time at which the element reaches the staying position of the interface element is different, that is, the interface element includes a first interface element and a second interface element, wherein the time at which the first interface element reaches the preset stay position is At a time, the time when the second interface element reaches the preset stay position is the second time, and the first time is different from the second time.

In the embodiment of the present invention, the motion speed of the interface element with the same arrival time can be adjusted as follows:

Assuming that there are indeed k interface elements expected to reach the same position for the same time, the k interface elements can be numbered. For example, if the number of the k interface elements is 1, 2, 3, ..., k, then T1 = T2=T3=...=Tk, in order to prevent the interface elements from reaching the stop position at the same time, the terminal can randomly sort the k interface elements. The specific sorting rule is not limited in the embodiment of the present invention, and then the k interface elements are adjusted. The speed Vi, in order of sorting, causes them to reach the pressing point in this order. First, the terminal determines a speed reduction amplitude unit u, for example, u=1/k. Then according to Randomly sorting results, adjusting the motion speed of the kth interface element after sorting to Vi'=Vi*(1–u*k), where Vi′ is the adjusted motion speed, and Vi is the i-th interface element The initial motion speed, u is the preset motion speed reduction magnitude, and k is the number of interface elements that determine the same arrival time. If an interface element is found to have the same expected arrival time again after adjusting the speed, the interface elements are again adjusted in the same manner as described above until the expected time for each interface element to reach the pressing point is different.

It should be noted that, in the embodiment of the present invention, the motion speed adjustment scheme for avoiding multiple interface elements simultaneously reaching the parking position is not limited, including but not limited to the foregoing description.

In the embodiment of the present invention, the adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the moving speed of the interface element without adjusting the moving speed.

After determining the motion speed and direction of each interface element within the scope of the action in the embodiment of the present invention, each interface element in the range controllable by the terminal moves to the stop position according to the motion speed and the motion direction corresponding to each interface element, and Displayed on the terminal display interface. In the embodiment of the present invention, the position coordinates of the interface elements displayed on the terminal display interface satisfy the formula during the movement of the interface elements in the range of the action to the stop position of the interface elements:

(Xi, Yi) = (Xi _t-1 , Yi _t-1 ) + Tunit * (Vix _t-1 , Viy _t-1 );

Where (Xi, Yi) is the position coordinate of the i-th interface element displayed on the terminal display interface at time t, (Xi _t-1 , Yi _t-1 ) is the i-th interface element at time t-1 The position coordinate displayed on the terminal display interface, Tunit is the time difference between adjacent moments, Vix _t-1 is the velocity component of the i-th interface element in the x-axis direction, and Viy _t-1 is the i-th interface a velocity component of the element in the y-axis direction, wherein the x-axis and the y-axis are based on an original display position coordinate of the i-th interface element on the terminal display interface, and are established on a plane where the terminal display interface is located The horizontal coordinate system is the x-axis and the y-axis.

Preferably, in the embodiment of the present invention, the coordinates of each interface element are determined in the above manner at each new moment, and the motion speed of the interface element is adjusted to prevent re-generation between interface elements between adjacent moments. The new conflict (while reaching the stop position) also prevents changes in the stop position caused by the change in the press point.

In particular, if the size of the vertical variable formed by the pressing operation detected by the system becomes smaller at a certain moment, the interface element in the range of the pressing point at the previous moment is no longer within the range of the pressing point at the current moment, In the embodiment of the present invention, during the pressing operation, the previous moments are within the range of the pressing point, and the interface elements that are no longer within the action range of the pressing point at the current moment remain in the currently arriving position. Of course, the embodiments of the present invention include, but are not limited to, the foregoing processing manners.

In the embodiment of the present invention, in order to control at most one interface element at the same time at the stop position, in addition to adjusting the motion speed of the interface element according to the above manner, the interface element that has stayed at the stop position is also controlled.

In the embodiment of the present invention, each of the interface elements assigned to the motion may arrive at the stop position in sequence according to the distance and speed to the stop position, so that the latter arrives at the stop position at the stop position, so that each stop position is At most, there is only one interface element at a time. The specific implementation process is as follows: obtaining the position of the motion interface element in the range of motion after the motion; and determining the stay after the position of the motion interface element is coincident with the stop position. Whether the interface element has been stayed at the location; if the interface element has been stayed at the location, the interface element has been replaced by the interface element; if there is no interface element that has stayed at the stop location And leaving the interface element at the stop position.

Optionally, after the interface element has been replaced by the motion interface element, the interface element that has been replaced and has stayed at the stop position may not be placed within the scope of the action to prevent the already staying The interface element has moved to the stop position again.

In the embodiment of the present invention, when the non-target interface element reaches the staying position, the user can hold the original position and let it be replaced by the subsequent interface element; when the target interface element reaches the staying position, the user can stay at the stop position. The pressing action is released (ie, the off-screen operation is triggered), and the selection of the target interface element is achieved, and when the terminal receives the off-screen operation, the response effect of the selected function of the interface element is performed.

In the embodiment of the present invention, the stop position is the position where the pressing point is located, or the plurality of staying areas set at the position where the pressing point is located may have different stopping modes.

FIG. 4 to FIG. 6 are schematic diagrams showing the movement process of two interface elements when the stop position is a pressing point.

In FIG. 4, the user's finger inputs a pressing operation on the terminal display interface, and the vertical distance vector of the pressing point is determined by the pressing point as the center of the pressing point, thereby forming a range of the pressing point, and the range of the pressing point is within the range. The interface element 1 and the interface element 2 are linearly moved at a constant speed toward the pressing point at speeds V1 and V2, respectively. The interface element 3 is not within the range of the pressing point, so no motion is performed. In Fig. 5, the interface element 2 first reaches the pressing point and stays at the pressing point, and the interface element 1 is still moving toward the pressing point. When the interface element 1 reaches the pressing point in Fig. 6, the interface element 2 that has been at the pressing point is replaced and disappears.

FIG. 7 to FIG. 9 are schematic diagrams showing the movement process of four interface elements when the stop position is a pressing point.

In FIG. 7, the user's finger inputs a pressing operation on the terminal display interface to form a rectangular action range centering on the pressing point, setting the length and the width, and the interface element 1, the interface element 2, the interface element 4, and the interface within the range. The element 5 is given a motion of moving toward a pressing point and performing a uniform linear motion at respective speeds. The interface element 3 is not within the range of the pressing point, so no motion is performed. In Fig. 8, the interface element 4 first reaches the pressing point and stays at the pressing point, and the remaining interface elements in the range of motion continue to move to the position where the pressing point is located. When the interface element 5 reaches the pressing point in FIG. 9, the interface element 4 that has been at the pressing point is replaced and disappears, and the interface element 1 and the interface element 2 continue to move.

In the embodiment of the present invention, if the target interface element moves to the position where the pressing point is located or the position where the pressing point is located is less than the set value, the user can directly release the finger to achieve the selection of the target interface element.

In the embodiment of the present invention, a limited number of non-overlapping stay areas may be preset around the position where the pressing point is located, and the staying areas are used as the staying positions of the interface elements, and the staying areas are numbered to determine the order, when there are interface elements. If the coordinate center is smaller than the set threshold from the coordinate center of the staying area, the interface element is considered to have reached the staying area, and the arriving interface element is placed in the smallest number of the idle staying area; if no staying area is idle, then The new arrival interface element replaces the interface element that stays in the lowest numbered stay area.

FIG. 10 to FIG. 13 are schematic diagrams showing the movement process of the interface element by the staying position being preset in the staying area near the pressing point.

In Fig. 10, two staying areas are set near the pressing point, which are the staying area 1 and the staying area, respectively. 2. The interface element 1 moves toward the staying area. In FIG. 11, after the interface element reaches the stay area, it stays in the idle stay area with a smaller number, such as the stay area 1 in FIG. In Figure 12, there are interface elements in the stay area, that is, the stay area 1 has the interface element 1, and the stay area 2 has the interface element 2, and there are other interface elements (interface element 3, interface element 4, and interface). Element 5) moves towards the dwell area. In FIG. 13, the interface element 3 and the interface element 4 reach the staying area, and the interface element 5 continues to move. Then the interface element 3 stays in the staying area 1 and replaces the interface element 1, and the interface element 4 stays in the staying area 2 and replaces the interface element 2.

In the embodiment of the present invention, if the target interface element moves to the staying area, the user can press and hold the terminal display interface and move the pressing point in a short distance, move the pressing point to the staying area where the target element stays, and then release the finger to realize The selection of the target interface element.

In the embodiment of the present invention, a limited number of non-overlapping parking areas are preset around the position where the pressing point is located, and multiple interface elements may be stayed at the same time near the pressing point, and the interface elements staying in the remaining area may not be The finger on the pressing point is blocked, so that the user can clearly recognize the interface element where the staying area stays.

It should be noted that, regardless of whether the position of the pressing point is used as the stopping position or the staying area is used as the stopping position, if the pressing point is not released at the stopping position where any interface element is located (triggering the off-screen operation), the pressing process is performed. Do not select any interface elements.

Optionally, when the target interface element is selected, all interface elements that perform centripetal motion to the resting position may be returned to each other. If any of the interface elements are not selected, all of the moved interface elements are also home.

Optionally, in the embodiment of the present invention, an exit area may be set on the terminal display interface according to an actual application scenario, where the exit area is an area that triggers an off-screen operation when the user does not need to select an interface element, so as to avoid the user being When the offscreen operation is triggered, the interface elements that do not need to be selected are selected.

For example, when a list item is selected, each list item is an interface element. Therefore, when the list item at the bottom or top of the screen is pressed and a press point is formed thereon, the list items in the range of the press point will be Moving in the direction of the pressing point, and passing through the pressing point in turn, that is, there is always one and only one list item appearing at the pressing point position, in order to prevent the user from selecting the off-screen operation, After taking the interface element that does not need to be selected, an exit area can be set near the pressing point, and the pressing point is moved to the exit area to trigger the off-screen operation. When the terminal receives the off-screen operation triggered by the user in the exit area, the execution interface is executed. The function that the element is not selected can trigger the off-screen operation, but the list item is not selected.

The following is a description of the internal implementation process of the selected interface element involved in the foregoing embodiment.

FIG. 14 is a timing diagram of implementing a control interface element motion in a terminal during a duration of a pressing operation according to an embodiment of the present invention. The terminal involved in the embodiment of the present invention includes an input device (eg, a touch screen), a processor, and an output device (eg, Screen), as shown in Figure 4, includes:

S201: The processor of the terminal acquires coordinates of each interface element on the terminal display interface.

S202: The processor of the terminal acquires a pressing point coordinate of the pressing operation input by the user through the input device at the current time and a vector perpendicular to the display interface of the terminal.

In the embodiment of the present invention, the pressing point is allowed to move in a single pressing process, so that the processor of the terminal needs to acquire the pressing point coordinate and the vector perpendicular to the terminal display interface in real time in the embodiment of the present invention.

It should be noted that, in the embodiment of the present invention, the visible appearance of the pressing point on the terminal display interface may or may not be drawn.

S203: Calculate the action range of the pressing point according to the vector of the pressing point current perpendicular to the terminal display interface, and control the interface element in the active range to move to the parking position.

S204: determining whether the coordinates of the interface element at time t are the same as the coordinates at time t-1. If they are different, the interface element moves relative to the previous moment, so the interface element is redrawn at the coordinates of time t. The element is outputted through the output device of the terminal and displayed on the terminal display interface. The redrawing the interface element includes canceling the element drawing of the previous position and drawing the element drawing at the current position, that is, realizing the motion process of the interface element to the staying position.

The embodiment of the present invention does not limit the implementation of the element drawing at the original position of the interface element during the movement of the interface element. For example, a representative object may be created for the interface element within the range of the pressing point (such as a virtual element of the interface element). Shadow), making the interface element or its representative Only one moves in the direction of the pressing point and the other stays in place to prompt the user.

S205: determining whether there is a motion interface element with the same coordinates of the stop time and the coordinates of the stop position in the interface element. If the motion interface element exists and the coordinate of the previous time of the motion interface element is not equal to the stop position coordinate, indicating that the motion interface element is the current time After moving to the parking position, it is further determined whether the interface element has been stopped at the parking position, and if it is determined that the interface element has been stopped at the parking position, the drawing of the stopped interface element is canceled and drawn at the parking position. The drawing of the motion interface element, the process of replacing the interface element with the stop position to the interface element after the stop position.

In the embodiment of the present invention, for each element that has passed the pressed point and is replaced, the coordinate is temporarily set to a null value, indicating that it no longer appears on the interface during the present pressing action.

S206: Calculate and set the coordinates of the time t+1 for each interface element in the range, and use the coordinates of the interface elements at the time t+1 as the coordinates of the interface element acquired in S201, and perform the above steps cyclically until the terminal The processor receives an off-screen operation triggered by the user through the input device.

Wherein, the coordinates of each interface element in time t+1 are the coordinates of the interface element according to time t, according to the formula (Xi t+1, Yi t+1)=(Xit,Yi t)+Tunit*(Vixt, Viyt ) Calculated. Where (Xi t+1, Yi t+1) is the position coordinate displayed by the i-th interface element on the terminal display interface at time t+1, and (Xit, Yi t) is the i-th interface element. The position coordinate displayed on the terminal display interface at time t, Tunit is the time difference between adjacent moments, Vixt is the velocity component of the i-th interface element in the x-axis direction at time t, Viyt is the i-th interface The velocity component of the element in the y-axis direction at time t.

It should be noted that, in the embodiment of the present invention, the motion speed of the interface element at the stop position is 0, and the coordinate hold is the same as the time t at the time t+1.

Set the aforementioned calculation result as the next time coordinate of the element for use when looping back to the first step.

FIG. 15 is a timing diagram of control after the terminal receives the user's triggered off-screen operation.

S301: The user triggers an off-screen operation through an input device of the terminal, and the input device sends off-screen operation information to the processor.

S302: The processor of the terminal acquires the position coordinates of the pressing point at the previous moment, that is, the pressing point The last coordinate before the screen.

S303: Compare the coordinates of all interface elements at the current time with the position coordinates of the pressed points acquired in S102.

S304: If it is found that the current coordinate of the interface element is equal to the pressing point coordinate in S102, perform a predetermined operation when the element is selected; if there is no interface element whose current coordinate of the interface element is equal to the pressing point coordinate in the second step, Then no operation is performed for any interface elements being selected.

S305: If an interface element is selected in S304, outputting a display effect of the corresponding action selected by the element to the output device.

S306: If the terminal display interface is not switched, control all interface elements to return to the original position.

In the embodiment of the present invention, there are two possibilities for the terminal display interface not to be switched. One possibility is that after the interface element is selected in S304 and the corresponding action effect of the interface element is selected, the interface remains in the execution interface element selection. The front terminal display interface. Another possibility is that no interface elements are selected in S304, so the terminal display interface before the execution of the interface element selection is maintained.

In the embodiment of the present invention, by the method for selecting an interface element involved in the foregoing embodiment, an effect similar to the simulated gravitation is achieved by controlling the interface element to move to the rest position, wherein the gravitation point is the position of the stop position, and the interface element is When moving to the vicinity of the stop position, the off-screen operation is triggered to realize the selection of the interface elements, and the method of selecting the interface elements near the pressing point is realized, which is convenient for the user to operate.

The above method can be applied to a scene in which the user's finger cannot reach the target interface element, such as holding something in the hand and holding the mobile device or the mobile device is a large screen, etc., by simulating the gravitational effect, the interface element is directed to the user's finger (ie, forming gravity) The position of the point) moves, avoiding the target that is close at hand but not enough, enhances the user experience, and can also bring certain operational interest.

Based on the method for selecting an interface element provided by the foregoing embodiment, the embodiment of the present invention further provides an apparatus 100 for selecting an interface element, and FIG. 16 is a schematic structural diagram of an apparatus 100 for selecting an interface element according to an embodiment of the present invention. As shown in FIG. 16, the apparatus 100 for selecting an interface element includes an acquisition unit 101 and a processing unit 102.

The obtaining unit 101 is configured to acquire a pressing operation input by the user on the terminal display interface, and receive The off-screen operation triggered by the user at the dwell position where the target interface element is to be selected.

The processing unit 102 is configured to acquire, according to the pressing operation acquired by the acquiring unit 101, a location where the pressing point of the pressing operation is located, and a pressing operation formed at the pressing point and perpendicular to the terminal display interface Vertical vector. Determining a range of action of the pressing operation on the display interface of the terminal according to a location of the pressing point and a size of the vertical vector. The staying position of the interface element is determined according to the location of the pressing point. Controlling an interface element located within the range of action to move to a stop position of the interface element, and controlling at most one interface element at the same time at the stop position. The target interface element is executed when the obtaining unit 101 receives an offscreen operation triggered by the user at a stay position where the target interface element to be selected stays.

Wherein, the range of action is used to determine an interface element that moves in the direction in which the pressing point is located.

Optionally, the processing unit 102 determines the staying position of the interface element according to the location of the pressing point according to the following manner:

The position at which the pressing point is located is determined as the resting position of the interface element. Or determining a staying position at a distance from the position where the pressing point is located is less than or equal to a set threshold position as a staying position of the interface element.

Optionally, in the case where the number of interface elements in the range of action is at least two, the staying area determined by the processing unit 102 is at least two.

Optionally, the processing unit 102 determines, according to the location of the pressing point and the size of the vertical vector, the scope of the pressing operation on the display interface of the terminal according to the following manner:

The radius is determined according to the size of the vertical vector. The circular range is determined according to the radius, with the position where the pressing point is located as a center. The determined circular range is determined as the range of action of the pressing operation on the terminal display interface.

Optionally, the processing unit 102 specifically controls, by using the following manner, an interface element located in the active range to move to a stop position of the interface element:

Controlling the movement of the interface element within the range of action to the dwell position of the interface element performs the following steps until the interface element moves to the dwell position:

Obtaining the position coordinates of the previous moment of the interface element in the range of action and the position coordinates of the current time. Drawing the interface element at the position coordinates of the current time, and canceling the drawing of the interface element at the position coordinate of the previous time.

Optionally, the number of interface elements in the range of action is at least two. The processing unit 102 specifically controls the movement of the interface element located in the working range to the staying position of the interface element, including:

Determining an initial speed of motion of each of the at least two interface elements. A distance between each of the at least two interface elements and a dwell position of the interface element is determined. The time at which each interface element reaches the stop position of the interface element is determined according to the distance between each interface element and the dwell position of the interface element, and the initial movement speed of each interface element. The speed of movement of the interface elements having the same arrival time is adjusted such that the time at which each interface element reaches the position of the interface element is different. The adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the moving speed of the interface element having no adjusted moving speed. Controlling each of the at least two interface elements to move to a dwell position of the interface element at a speed of motion corresponding to the interface element.

Optionally, the processing unit 102 specifically controls, by using the following manner, a maximum of one interface element at the same time at the stop position, including:

Obtaining the position of the motion interface element in the range of motion after the motion. In a case where the position after the motion interface element moves coincides with the stop position, it is determined whether an interface element has been stayed at the stop position. If the interface element has been retained at the stop position, the already-interested interface element is replaced with the motion interface element. If there is no interface element that has stayed at the stop position, the motion interface element stays at the stop position.

Optionally, the processing unit 102 is further configured to: after replacing the already-used interface element by using the motion interface element, no longer be placed in the scope of the replacement and has been stopped at the staying position Interface elements.

Optionally, the obtaining unit 101 is further configured to acquire an off-screen operation triggered by the user in the exit area.

The processing unit 102 is further configured to: move the interface element to the staying position, and the The obtaining unit 101 acquires the interface element at the stop position without acquiring the off-screen operation triggered by the user in the exit area. The exit area is an area where the user triggers an off-screen operation without selecting an interface element.

The apparatus 100 for selecting an interface element provided by the embodiment of the present invention has all the functions in the process of selecting the interface element involved in the foregoing method embodiment. For the specific implementation process, refer to the related descriptions of the foregoing embodiment and the drawings, and no longer Narration.

Based on the method for providing an interface element, the embodiment of the present invention provides an apparatus 200 for selecting an interface element, and FIG. 17 is a schematic structural diagram of an apparatus 200 for selecting an interface element according to an embodiment of the present invention. The apparatus 200 for selecting an interface element provided by the embodiment of the present invention includes a detecting unit 201 and a control unit 202.

The detecting unit 201 is configured to detect a pressing operation input by the user on the terminal display interface, and detect an off-screen operation triggered by the user at the stopping position to which the target interface element to be selected moves.

The control unit 202 is configured to control a position motion of the pressing point of the pressing operation of the interface element detected by the detecting unit 201, wherein a position of the interface element on the terminal display interface is different from a position of the pressing point . The target interface element is operated when the target interface element to be selected is moved to a preset stay position, and the detecting unit 201 detects that the user triggers an off-screen operation at the stay position.

Optionally, the preset stay position includes a location where the pressing point is located. Or the preset stay position includes a stay area at a distance from a position where the press point is located less than or equal to a set threshold position.

Optionally, the number of the interface elements is at least two, and the number of the staying areas is at least two.

Optionally, the control unit 202 specifically controls the position of the interface element toward the pressing point of the pressing operation in the following manner:

At least one interface element that moves toward a position at which the pressing point of the pressing operation is located is determined. A speed of movement of the at least one interface element is determined. Determining a direction of motion of the at least one interface element, the direction of motion being a ray direction from where the interface element is located to the predetermined dwell position. Control Each interface element is moved at a position corresponding to a pressing point of the pressing operation at a moving speed corresponding to the interface element along a ray direction of the position of the interface element to the preset stopping position.

Optionally, the interface element includes a first interface element and a second interface element. The time when the first interface element reaches the preset stay position is the first time. The time when the second interface element reaches the preset stay position is the second time. The first time is different from the second time.

Optionally, at the same time, the preset staying position stays at most one interface element.

Optionally, the position of the interface element on the terminal display interface is located in a circular range of the terminal display interface with the position where the pressing point is located as a center.

Optionally, the detecting unit 201 is further configured to acquire an off-screen operation triggered by the user in the exit area.

The control unit 202 is further configured to: when the interface element moves to the preset stay position, and the detecting unit 201 detects that the user triggers the off-screen operation in the exit area, does not run the preset stay Interface element at the location. The exit area is an area where the user triggers an off-screen operation without selecting an interface element.

The apparatus 200 for selecting an interface element provided by the embodiment of the present invention has all the functions in the process of selecting the interface element involved in the foregoing method embodiment. For the specific implementation process, reference may be made to the related description of the foregoing embodiment and the drawings, and no longer Narration.

Based on the method for selecting an interface element provided by the foregoing embodiment, the embodiment of the present invention further provides a terminal 300, and FIG. 18 is a schematic structural diagram of the terminal 300 according to an embodiment of the present invention. As shown in FIG. 18, the terminal 300 provided by the embodiment of the present invention includes an input device 301, an output device 302, a processor 303, a memory 304, and a bus 305, wherein the input device 301, the output device 302, and the memory are 304 is coupled to the processor 303 via the bus 305.

The input device 301 can be a touch screen.

The output device 302 can be the screen of the terminal.

The processor 303 can be a general purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more An integrated circuit that controls the execution of the program of the present invention. One or more memories included in the computer system, which may be read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (RAM) or Other types of dynamic storage devices that store information and instructions may also be disk storage. These memories are connected to the processor via a bus.

The memory 304, such as a RAM, holds an operating system and a program for executing the inventive arrangements. The operating system is a program that controls the running of other programs and manages system resources.

The bus 305 can include a path for communicating information between various components of the computer.

In a possible design, the memory 304 is configured to store program code executed by the processor 303.

The input device 301 is configured to acquire a pressing operation input by the user on the terminal display interface, and receive an off-screen operation triggered by the user at a stay position where the target interface element to be selected is located.

The output device 302 is configured to output the interface element.

The processor 303 is configured to invoke a program stored in the memory 304 according to the pressing operation acquired by the input device 301. Obtaining a position at which the pressing point of the pressing operation is located, and a vertical vector formed by the pressing operation at the pressing point and perpendicular to the terminal display interface. Determining a range of action of the pressing operation on the display interface of the terminal according to a location of the pressing point and a size of the vertical vector. The staying position of the interface element is determined according to the location of the pressing point. Controlling an interface element located within the range of action to move to a stop position of the interface element, and controlling at most one interface element at the same time at the stop position. The target interface element is run when the input device 301 receives an off-screen operation triggered by the user at a stay position where the target interface element to be selected stays.

Optionally, the processor 303 determines the staying position of the interface element according to the location of the pressing point according to the following manner:

The number of interface elements in the range of action is at least two. The staying area determined by the processor 303 is at least two.

The processor 303 is specifically configured to determine, according to the location of the pressing point and the size of the vertical vector, the scope of the pressing operation on the display interface of the terminal:

The processor 303 is configured to perform the following steps during the movement of the interface element in the range of action to the staying position of the interface element, until the interface element moves to the staying position: obtaining the range of action The position coordinates of the interface element at the previous moment and the position coordinates of the current time. Re-rendering the drawing of the interface element at the position coordinate of the current moment, and canceling the drawing of the interface element at the position coordinate of the previous moment to control the interface element located within the scope of the interface to the interface element The position of the stop movement.

The number of interface elements in the range of action is at least two.

The processor 303 specifically controls, by using the following manner, the movement of the interface element located in the working range to the staying position of the interface element, including: determining an initial moving speed of each of the at least two interface elements. A distance between each of the at least two interface elements and a dwell position of the interface element is determined. The time at which each interface element reaches the stop position of the interface element is determined according to the distance between each interface element and the dwell position of the interface element, and the initial movement speed of each interface element. The speed of movement of the interface elements having the same arrival time is adjusted such that the time at which each interface element reaches the position of the interface element is different. The adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the moving speed of the interface element having no adjusted moving speed. Controlling each of the at least two interface elements to move to a dwell position of the interface element at a speed of motion corresponding to the interface element.

The processor 303 is configured to control at most one interface element at the same time at the stop position, including: acquiring the motion interface element in the range of motion s position. In a case where the position after the motion interface element moves coincides with the stop position, it is determined whether an interface element has been stayed at the stop position. If the interface element has been retained at the stop position, the already-interested interface element is replaced with the motion interface element. If there is no interface element that has stayed at the stop position, the motion interface element stays at the stop position.

Optionally, the processor 303 is further configured to: after replacing the already-used interface element by using the motion interface element, no longer be placed in the scope of the replacement and has been stopped at the staying position Interface elements.

Optionally, the input device 301 is further configured to acquire an off-screen operation triggered by the user in the exit area.

The processor 303 is further configured to: when the interface element moves to the staying position, and the input device 301 acquires an off-screen operation triggered by the user in the exit area, does not run the stop position Interface element. The exit area is an area where the user triggers an off-screen operation without selecting an interface element.

In another possible design, the memory 304 is configured to store program code executed by the processor 303.

The input device 301 is configured to detect a pressing operation input by the user on the terminal display interface, and detect an off-screen operation triggered by the user at a parking position to which the target interface element to be selected moves.

The output device 302 is configured to output the interface element.

The processor 303 is configured to control a position motion of a pressing point of the pressing operation of the interface element detected by the input device 301, where a position of the interface element on the terminal display interface is different from the pressing point Location. The target interface element is run when the target interface element to be selected is moved to a preset stay position, and the input device 301 detects that the user triggers an off-screen operation at the stop position.

Wherein the preset stay position includes a location where the pressing point is located. Or the preset stay position includes a stay area at a distance from a position where the press point is located less than or equal to a set threshold position.

Wherein the number of the interface elements is at least two, and the number of the staying areas is at least two One.

The processor 303 specifically controls the position of the interface element toward the pressing point of the pressing operation in the following manner:

At least one interface element that moves toward a position at which the pressing point of the pressing operation is located is determined. A speed of movement of the at least one interface element is determined. Determining a direction of motion of the at least one interface element, the direction of motion being a ray direction from where the interface element is located to the predetermined dwell position. The interface element is controlled to move at a position corresponding to the pressing point of the pressing operation at a moving speed corresponding to the interface element along a ray direction of the position where the interface element is located to the preset stopping position.

The interface element includes a first interface element and a second interface element. The time when the first interface element reaches the preset stay position is the first time. The time when the second interface element reaches the preset stay position is the second time. The first time is different from the second time.

Wherein, at the same time, the preset staying position stays at most one interface element.

The position of the interface element on the display interface of the terminal is located in a circular range of the terminal display interface with the position of the pressing point as a center.

The processor 303 is further configured to: when the interface element moves to the preset stay position, and the input device 301 detects that the user triggers the off-screen operation in the exit area, the preset stop position is not operated. Interface element at the place. The exit area is an area where the user triggers an off-screen operation without selecting an interface element.

The apparatus 300 for selecting an interface element provided by the embodiment of the present invention has all the functions in the process of selecting the interface element involved in the foregoing method embodiment. For the specific implementation process, refer to the related descriptions of the foregoing embodiment and the drawings, and no longer Narration.

It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be performed by a program, and the program may be stored in a computer readable storage medium, which is non-transitory ( English: non-transitory) media, such as random access memory, read-only memory, flash memory, hard disk, solid state disk, tape (English: magnetic Tape), floppy disk (English: floppy disk), optical disc (English: optical disc) and any combination thereof.

The present invention has been described with reference to the respective flowcharts and block diagrams of the method and apparatus of the embodiments of the invention. It will be understood that each flow and block of the flowchart illustrations. FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. A device that implements the functions specified in one or more blocks of a flowchart or a plurality of flows and block diagrams.

The above is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or within the technical scope disclosed by the present invention. Alternatives are intended to be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

A method for selecting an interface element, comprising:

Obtaining a pressing operation input by the user on the terminal display interface;

Acquiring a position at which the pressing point of the pressing operation is located according to the pressing operation, and a vertical vector formed by the pressing operation and perpendicular to the terminal display interface at the pressing point;

Determining a range of action of the pressing operation on the terminal display interface according to a position of the pressing point and a size of the vertical vector, wherein the acting range is used to determine moving in a direction of the pressing point Interface element

Determining a staying position of the interface element according to a location of the pressing point;

Controlling an interface element located within the range of action to move to a stop position of the interface element, and controlling at most one interface element at the same time at the stop position;

Receiving an offscreen operation triggered by the user at a stay position where the target interface element to be selected stays, and running the target interface element.
The method according to claim 1, wherein determining the staying position of the interface element according to the location of the pressing point comprises:

Determining a position at which the pressing point is located as a resting position of the interface element; or

A staying area at a position that is less than or equal to a set threshold position from a position at which the pressed point is located is determined as a staying position of the interface element.
The method according to claim 2, wherein the number of interface elements in the range of action is at least two;

The number of the staying areas is at least two.
The method according to any one of claims 1 to 3, wherein the action range of the pressing operation on the display interface of the terminal is determined according to the position of the pressing point and the size of the vertical vector, include:

Determining a radius according to the size of the vertical vector;

Taking a position of the pressing point as a center, determining a circular range according to the radius;

The determined circular range is determined as the range of action of the pressing operation on the terminal display interface.
The method according to any one of claims 1 to 4, wherein the controlling the movement of the interface element located in the range of action to the rest position of the interface element comprises:

The following steps are performed during the movement of the interface element to the dwell position of the interface element until the interface element moves to the dwell position:

Obtaining a position coordinate of a moment before the interface element and a position coordinate of the current time;

Drawing the interface element at the position coordinates of the current time, and canceling the drawing of the interface element at the position coordinate of the previous time.
The method according to any one of claims 1 to 5, wherein the number of interface elements located within the range of action is at least two;

The controlling the movement of the interface element located in the range of action to the staying position of the interface element comprises:

Determining an initial motion speed of each of the at least two interface elements;

Determining a distance between each of the at least two interface elements and a dwell position of the interface element;

Determining, according to a distance between each interface element and a staying position of the interface element, and an initial moving speed of each interface element, a time at which each interface element reaches a staying position of the interface element;

Adjusting the speed of movement of the same interface elements at the same time of arrival, so that the time at which each interface element reaches the stop position of the interface elements is different;

The adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the moving speed of the interface element without adjusting the moving speed;

Controlling each of the at least two interface elements to move to a dwell position of the interface element at a speed of motion corresponding to the interface element.
The method according to any one of claims 1 to 6, wherein said controlling said staying position to stay at most one interface element at the same time comprises:

Obtaining a position of the motion interface element in the range of motion;

In a case where the position after the motion interface element moves coincides with the stop position, it is determined whether an interface element has been stayed at the stop position;

If the interface element has been stayed at the stop position, replacing the already staying interface element with the motion interface element;

If there is no interface element that has stayed at the stop position, the motion interface element stays at the stop position.
The method of claim 7, wherein after the replacing the interface element that has stayed with the motion interface element, the method further comprises:

Interface elements that have been replaced and have stayed at the dwelling position are no longer placed within the scope of action.
The method of any of claims 1 to 8, wherein the method further comprises:

When the interface element moves to the staying position, and the user obtains the off-screen operation triggered by the exit area, the interface element at the stop position is not operated;

The exit area is an area where the user triggers an off-screen operation without selecting an interface element.
A method for selecting an interface element, comprising:

Detecting a pressing operation input by the user on the terminal display interface;

Controlling an interface element to move toward a position where the pressing point of the pressing operation is located, wherein a position of the interface element on the terminal display interface is different from a position where the pressing point is located;

The target interface element is run when the target interface element to be selected is moved to a preset stay position and the user is detected to trigger an off-screen operation at the stop position.
The method of claim 10 wherein said predetermined dwell position comprises a location at which said press point is located; or

The preset stay position includes a stay area at a distance from a position where the press point is located less than or equal to a set threshold position.
The method of claim 11 wherein the number of interface elements is Less than two;

The number of the staying areas is at least two.
The method according to any one of claims 10 to 12, wherein the movement of the control interface element toward the pressing point of the pressing operation comprises:

Determining a speed of movement of the interface element;

Determining a direction of motion of the interface element, the direction of motion being a ray direction from a position where the interface element is located to the preset stay position;

The interface element is controlled to move at a position corresponding to the pressing point of the pressing operation at a moving speed corresponding to the interface element along a ray direction of the position of the interface element to the preset stopping position.
The method according to any one of claims 10 to 13, wherein the interface element comprises a first interface element and a second interface element;

The time when the first interface element reaches the preset stay position is the first time;

The time when the second interface element reaches the preset stay position is a second time;

The first time is different from the second time.
The method according to any one of claims 10 to 14, wherein at the same time, the preset staying position stays at most one interface element.
The method according to any one of claims 10 to 15, wherein a position of the interface element on the terminal display interface is located on the terminal display interface with the position of the pressing point as a center Within the circular range.
The method of any of claims 10 to 16, wherein the method further comprises:

When the interface element moves to the preset stay position, and detects that the user triggers the off-screen operation in the exit area, the interface element at the preset stop position is not operated;

The exit area is an area where the user triggers an off-screen operation without selecting an interface element.
A device for selecting an interface element, comprising:

An obtaining unit, configured to acquire a pressing operation input by the user on the terminal display interface, and receive an off-screen operation triggered by the user at a staying position where the target interface element to be selected stays;

a processing unit, configured to acquire, according to the pressing operation acquired by the acquiring unit, a location where the pressing point of the pressing operation is located, and a vertical direction formed by the pressing operation and perpendicular to the terminal display interface at the pressing point Determining, according to the location of the pressing point and the size of the vertical vector, the range of action of the pressing operation on the display interface of the terminal; determining the stay of the interface element according to the location of the pressing point Positioning: controlling an interface element located in the range of action to move to a stop position of the interface element, and controlling at least one interface element at the same time at the stop position; receiving, at the acquisition unit, a target interface to be selected by the user Running the target interface element when the off-screen operation triggered by the dwell position where the element stays;

Wherein, the range of action is used to determine an interface element that moves in the direction in which the pressing point is located.
The device according to claim 18, wherein the processing unit determines the staying position of the interface element according to the position of the pressing point according to the following manner:

Determining a position at which the pressing point is located as a resting position of the interface element; or

A staying area at a position that is less than or equal to a set threshold position from a position at which the pressed point is located is determined as a staying position of the interface element.
The device according to claim 19, wherein the number of interface elements in the range of action is at least two;

The staying area determined by the processing unit is at least two.
The device according to any one of claims 18 to 20, wherein the processing unit determines that the pressing operation is in accordance with the position of the pressing point and the size of the vertical vector in the following manner. The scope of the terminal display interface:

Determining a radius according to the size of the vertical vector;

Taking a position of the pressing point as a center, determining a circular range according to the radius;

The determined circular range is determined as the range of action of the pressing operation on the terminal display interface.
The apparatus according to any one of claims 18 to 21, wherein the processing unit specifically controls the movement of the interface element located in the range of action to the staying position of the interface element in the following manner:

Controlling the movement of the interface element within the range of action to the dwell position of the interface element performs the following steps until the interface element moves to the dwell position:

Obtaining a position coordinate of a moment before the interface element in the range of action and a position coordinate of the current moment;

Drawing the interface element at the position coordinates of the current time, and canceling the drawing of the interface element at the position coordinate of the previous time.
The apparatus according to any one of claims 18 to 22, wherein the number of interface elements in the range of action is at least two;

The processing unit specifically controls the movement of the interface element located in the working range to the staying position of the interface element, including:

Determining an initial motion speed of each of the at least two interface elements;

Determining a distance between each of the at least two interface elements and a dwell position of the interface element;

Determining, according to a distance between each interface element and a staying position of the interface element, and an initial moving speed of each interface element, a time at which each interface element reaches a staying position of the interface element;

Adjusting the speed of movement of the same interface elements at the same time of arrival, so that the time at which each interface element reaches the stop position of the interface elements is different;

The adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the moving speed of the interface element without adjusting the moving speed;

Controlling each of the at least two interface elements to move to a dwell position of the interface element at a speed of motion corresponding to the interface element.
The device according to any one of claims 18 to 23, wherein the processing unit specifically controls to stay at most one interface element at the same time at the staying position, as follows. include:

Obtaining a position of the motion interface element in the range of motion;

In a case where the position after the motion interface element moves coincides with the stop position, it is determined whether an interface element has been stayed at the stop position;

If the interface element has been stayed at the stop position, replacing the already staying interface element with the motion interface element;

If there is no interface element that has stayed at the stop position, the motion interface element stays at the stop position.
The device according to claim 24, wherein the processing unit is further configured to:

After replacing the already existing interface element with the motion interface element, no interface elements that have been replaced and have stayed at the stop position are no longer placed within the scope of action.
The device according to any one of claims 18 to 25, wherein the obtaining unit is further configured to acquire an off-screen operation triggered by the user in the exit area;

The processing unit is further configured to:

When the interface element moves to the staying position, and the acquiring unit acquires an off-screen operation triggered by the user in the exit area, the interface element at the staying position is not operated;

The exit area is an area where the user triggers an off-screen operation without selecting an interface element.
A device for selecting an interface element, comprising:

a detecting unit, configured to detect a pressing operation input by the user on the terminal display interface, and detect an off-screen operation triggered by the user at a parking position to which the target interface element to be selected moves to;

a control unit, configured to control a positional motion of the pressing point of the interface element toward the pressing operation detected by the detecting unit, wherein a position of the interface element on the terminal display interface is different from a position of the pressing point; The target interface element is run when the selected target interface element moves to a preset stay position, and the detecting unit detects that the user triggers the off-screen operation at the stay position.
The device of claim 27 wherein said predetermined dwell position comprises Describe the location of the compression point; or

The preset stay position includes a stay area at a distance from a position where the press point is located less than or equal to a set threshold position.
The apparatus according to claim 28, wherein said number of interface elements is at least two, and said number of said staying areas is at least two.
The device according to any one of claims 27 to 29, wherein the control unit specifically controls the positional movement of the interface element toward the pressing point of the pressing operation in the following manner:

Determining at least one interface element moving toward a position at which the pressing point of the pressing operation is located;

Determining a speed of movement of the at least one interface element;

Determining a direction of motion of the at least one interface element, the direction of motion being a ray direction from a position where the interface element is located to the preset stay position;

The interface element is controlled to move at a position corresponding to the pressing point of the pressing operation at a moving speed corresponding to the interface element along a ray direction of the position where the interface element is located to the preset stopping position.
The apparatus according to any one of claims 27 to 30, wherein the interface element comprises a first interface element and a second interface element;

The time when the first interface element reaches the preset stay position is the first time;

The time when the second interface element reaches the preset stay position is a second time;

The first time is different from the second time.
The apparatus according to any one of claims 27 to 31, wherein at least one interface element is stopped at the same time at the preset stay position.
The device according to any one of claims 27 to 32, wherein the location of the interface element on the terminal display interface is located on the terminal display interface with the position of the pressing point as a center Within the circular range.
A device according to any one of claims 27 to 33, wherein

The detecting unit is further configured to acquire an off-screen operation triggered by the user in the exit area;

The control unit is further configured to:

Moving the interface element to the preset stay position, and the detecting unit detects that the user triggers the off-screen operation in the exit area, and does not run the interface element at the preset stay position;

The exit area is an area where the user triggers an off-screen operation without selecting an interface element.
A terminal, comprising: an input device, an output device, a processor, a memory, and a bus, wherein the input device, the output device, and the memory are all connected to the processor through the bus, wherein ,

The memory is configured to store program code executed by the processor;

The input device is configured to acquire a pressing operation input by the user on the terminal display interface, and receive an off-screen operation triggered by the user at a stay position where the target interface element to be selected is located;

The output device is configured to output the interface element;

The processor, configured to invoke a program stored in the memory, according to the pressing operation acquired by the input device; acquiring a location of a pressing point of the pressing operation, and at the pressing point by the a pressing operation forms a vertical vector perpendicular to the display interface of the terminal; determining, according to the position of the pressing point and the size of the vertical vector, a range of action of the pressing operation on the display interface of the terminal; Positioning, determining a staying position of the interface element; controlling an interface element located within the active range to move to a stop position of the interface element, and controlling at least one interface element at the same time at the stop position; When the input device receives the off-screen operation triggered by the user at the stay position where the target interface element to be selected stays, the target interface element is run.
The terminal according to claim 35, wherein the processor determines the staying position of the interface element according to the location of the pressing point in the following manner:

Determining a position at which the pressing point is located as a resting position of the interface element; or

A staying area at a position that is less than or equal to a set threshold position from a position at which the pressed point is located is determined as a staying position of the interface element.
The terminal according to claim 36, wherein the interface element in the range of action The number of primes is at least two;

The stay area determined by the processor is at least two.
The terminal according to any one of claims 35 to 37, wherein the processor determines, according to the position of the pressing point and the size of the vertical vector, the pressing operation in the following manner. The scope of the terminal display interface:

Determining a radius according to the size of the vertical vector;

Taking a position of the pressing point as a center, determining a circular range according to the radius;

The determined circular range is determined as the range of action of the pressing operation on the terminal display interface.
The terminal according to any one of claims 35 to 38, wherein the processor specifically controls the movement of the interface element located in the range of action to the staying position of the interface element in the following manner:

Controlling the movement of the interface element within the range of action to the dwell position of the interface element performs the following steps until the interface element moves to the dwell position:

Obtaining a position coordinate of a moment before the interface element in the range of action and a position coordinate of the current moment;

Drawing the interface element at the position coordinates of the current time, and canceling the drawing of the interface element at the position coordinate of the previous time.
The terminal according to any one of claims 35 to 39, wherein the number of interface elements in the range of action is at least two;

The processor specifically controls the movement of the interface element located in the range of action to the staying position of the interface element, including:

Determining an initial motion speed of each of the at least two interface elements;

Determining a distance between each of the at least two interface elements and a dwell position of the interface element;

Determining, according to a distance between each interface element and a staying position of the interface element, and an initial moving speed of each interface element, determining a dwelling position of each interface element reaching the interface element time;

Adjusting the speed of movement of the same interface elements at the same time of arrival, so that the time at which each interface element reaches the stop position of the interface elements is different;

The adjusted moving speed is taken as the moving speed of the interface element of the adjusted moving speed, and the initial moving speed is taken as the moving speed of the interface element without adjusting the moving speed;

Controlling each of the at least two interface elements to move to a dwell position of the interface element at a speed of motion corresponding to the interface element.
The terminal according to any one of claims 35 to 40, wherein the processor, in particular, controls at least one interface element at the same time at the stop position, including:

Obtaining a position of the motion interface element in the range of motion;

In a case where the position after the motion interface element moves coincides with the stop position, it is determined whether an interface element has been stayed at the stop position;

If the interface element has been stayed at the stop position, replacing the already staying interface element with the motion interface element;

If there is no interface element that has stayed at the stop position, the motion interface element stays at the stop position.
The terminal according to claim 41, wherein the processor is further configured to:

After replacing the already existing interface element with the motion interface element, no interface elements that have been replaced and have stayed at the stop position are no longer placed within the scope of action.
The terminal according to any one of claims 35 to 42, wherein the input device is further configured to acquire an off-screen operation triggered by the user in the exit area;

The processor is further configured to:

When the interface element moves to the staying position, and the input device acquires an off-screen operation triggered by the user in the exit area, the interface element at the stop position is not operated;

The exit area is an area where the user triggers an off-screen operation without selecting an interface element.
A terminal, comprising: an input device, an output device, a processor, a memory, and a bus, wherein the input device, the output device, and the memory are all connected to the processor through the bus, wherein ,

The memory is configured to store program code executed by the processor;

The input device is configured to detect a pressing operation input by the user on the terminal display interface, and detect an off-screen operation triggered by the user at a parking position to which the target interface element to be selected moves to;

The output device is configured to output the interface element;

The processor is configured to control a position motion of a pressing point of the pressing operation of the interface element detected by the input device, where a position of the interface element on the terminal display interface is different from a position of the pressing point The target interface element is run when the target interface element to be selected is moved to a preset stay position, and the input device detects that the user triggers an off-screen operation at the stop position.
The terminal according to claim 44, wherein said preset stay position includes a position at which said press point is located; or

The preset stay position includes a stay area at a distance from a position where the press point is located less than or equal to a set threshold position.
The terminal according to claim 45, wherein the number of the interface elements is at least two, and the number of the staying areas is at least two.
The terminal according to any one of claims 44 to 46, wherein the processor specifically controls the positional movement of the interface element toward the pressing point of the pressing operation in the following manner:

Determining at least one interface element moving toward a position at which the pressing point of the pressing operation is located;

Determining a speed of movement of the at least one interface element;

Determining a direction of motion of the at least one interface element, the direction of motion being a ray direction from a position where the interface element is located to the preset stay position;

The interface element is controlled to move at a position corresponding to the pressing point of the pressing operation at a moving speed corresponding to the interface element along a ray direction of the position where the interface element is located to the preset stopping position.
The terminal according to any one of claims 44 to 47, wherein the interface element comprises a first interface element and a second interface element;

The time when the first interface element reaches the preset stay position is the first time;

The time when the second interface element reaches the preset stay position is a second time;

The first time is different from the second time.
The terminal according to any one of claims 44 to 48, wherein at the same time, the preset staying position stays at most one interface element.
The terminal according to any one of claims 44 to 49, wherein the location of the interface element on the terminal display interface is located on the terminal display interface with the position of the pressing point as a center Within the circular range.
A terminal according to any one of claims 44 to 50, characterized in that

The input device is further configured to acquire an off-screen operation triggered by the user in the exit area;

The processor is further configured to: when the interface element moves to the preset stay position, and the input device detects that the user triggers the off-screen operation in the exit area, does not run the preset stop position Interface element

The exit area is an area where the user triggers an off-screen operation without selecting an interface element.