CN112445323B - Data processing method, device, equipment and machine-readable medium - Google Patents

Abstract

Embodiments of the present application provide a data processing method, device, equipment and machine-readable medium. The method includes: determining the target interface element corresponding to the user's hand from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display static interface elements; the second display layer is used to display interface elements in a motion state; based on the first movement information of the user's hand in the three-dimensional space , controlling the movement of the target interface element between the first display layer and the second display layer. The embodiments of this application can reduce the memory cost and learning cost of gesture interaction and improve user experience.

Description

A data processing method, device, equipment and machine-readable medium

Technical field

The present application relates to the field of computer technology, and in particular, to a data processing method, a data processing device, a device and a machine-readable medium.

Background technique

With the development of society and technology, gesture interaction, as a non-contact human-computer interaction method, has gradually been applied to human-computer interaction games, computer control and other fields with its real experience and flexible usability.

A gesture interaction method that can provide users with N gestures, where different gestures can represent different functions, so that users can achieve different functions through different gestures. However, in practical applications, the value of N usually matches the number of functions, and the value of N is usually greater than 5, thus increasing the memory cost and learning cost of gestures.

Contents of the invention

The technical problem to be solved by the embodiments of this application is to provide a data processing method that can reduce the memory cost and learning cost of gesture interaction and improve the user experience.

Correspondingly, embodiments of the present application also provide a data processing device, a device, and a machine-readable medium to ensure the implementation and application of the above method.

In order to solve the above problems, embodiments of the present application disclose a data processing method, including:

The target interface element corresponding to the user's hand is determined from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display static interface elements; the second display layer is used to display static interface elements. Interface elements used to display motion status;

The target interface element is controlled to move between the first display layer and the second display layer according to the first movement information of the user's hand in the three-dimensional space.

On the other hand, the embodiment of the present application also discloses a data processing method, including:

The target interface element corresponding to the user's hand is determined from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display unselected interface elements; the second display layer Used to display selected interface elements;

The target interface element is controlled to move between the first display layer and the second display layer according to the first movement information of the user's hand in the three-dimensional space.

On the other hand, the embodiment of the present application also discloses a data processing device, which includes:

The determination module is used to determine the target interface element corresponding to the user's hand from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display static interface elements; The second display layer is used to display interface elements of motion status; and

A control module configured to control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space.

On the other hand, the embodiment of the present application also discloses a data processing device, which includes:

The determination module is used to determine the target interface element corresponding to the user's hand from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display unselected interface elements; The second display layer is used to display the selected interface element; and

A control module configured to control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space.

On the other hand, the embodiment of the present application also discloses a device, including:

one or more processors; and

One or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the device to perform one or more of the aforementioned methods.

In another aspect, embodiments of the present application disclose one or more machine-readable media having instructions stored thereon that, when executed by one or more processors, cause the device to perform one or more of the aforementioned methods.

The embodiments of this application include the following advantages:

The embodiment of the present application divides the interface into multiple display layers that are stacked and displayed. The multiple display layers may include: a first display layer and a second display layer; the first display layer is used to display static interface elements, and the second display layer is used to display static interface elements. The display layer is used to display interface elements of motion status.

Embodiments of the present application control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space. In this way, the interface elements in a moving state can be displayed stacked up and down with the static interface elements, so that a three-dimensional effect can be achieved through a two-dimensional display device, so that the target interface elements follow the user's hand on the first display layer and the second display layer movement between them; therefore, the functions corresponding to the target interface elements can be realized through the three-dimensional effect of the interface. For example, it can be used to adjust the position of the target interface element in the interface, or it can trigger the function corresponding to the target interface element, etc. Since the embodiments of the present application can support the user to realize the function corresponding to the target interface element through the movement of the user's hand, the embodiment of the present application can enable the user to perform the movement of the user's hand according to the actual functional requirements, thus reducing the memory cost of gesture interaction. and learning costs to improve user experience.

Description of the drawings

Figure 1 is a schematic diagram of a three-dimensional coordinate system according to an embodiment of the present application;

Figure 2 is a step flow chart of Embodiment 1 of a data processing method of the present application;

Figure 3 is a schematic diagram of an interface according to an embodiment of the present application;

Figure 4 is a schematic diagram of a process of adjusting the interface layout through spatial gestures according to an embodiment of the present application;

Figure 5 is a step flow chart of Embodiment 2 of a data processing method of the present application;

Figure 6 is a step flow chart of Embodiment 3 of a data processing method of the present application;

Figure 7 is a step flow chart of Embodiment 4 of a data processing method of the present application;

Figure 8 is a structural block diagram of an embodiment of a data processing device of the present application; and

Figure 9 is a schematic structural diagram of equipment provided by an embodiment of the present application.

Detailed ways

In order to make the above objects, features and advantages of the present application more obvious and understandable, the present application will be described in further detail below in conjunction with the accompanying drawings and specific implementation modes.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art fall within the scope of protection of this application.

The concepts of the present application are susceptible to various modifications and alternative forms, specific embodiments of which have been illustrated by way of drawings and will be described in detail herein. It should be understood, however, that the foregoing is not intended to limit the concepts of the application to the specific forms disclosed, but on the contrary, the specification and appended claims are intended to cover all modifications, equivalents, and alternatives.

"One embodiment", "an embodiment", "a specific embodiment", etc. in this specification mean that the described embodiment may include specific features, structures or characteristics, but each embodiment may or may not necessarily include that particular characteristic, structure or characteristic. Furthermore, such phrases are not necessarily referring to the same embodiment. In addition, where a particular feature, structure or characteristic is described in connection with one embodiment, whether explicitly described or not, it is considered that such feature, structure or characteristic is also relevant to other embodiments within the scope known to those skilled in the art. In addition, it should be understood that the entries in the list included in the form "at least one of A, B and C" may include the following possible items: (A); (B); (C); ( A and B); (A and C); (B and C); or (A, B and C). Likewise, an item listed of the form "at least one of A, B, or C" might mean (A); (B); (C); (A and B); (A and C); (B and C); or (A, B and C).

In some cases, the disclosed embodiments may be implemented as hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored in one or more transitory or non-transitory machine-readable (eg, computer-readable) storage media, which instructions may be executed by one or more processors. Machine-readable storage media may be implemented as a storage device, mechanism, or other physical structure (such as a volatile or nonvolatile memory, a media disk, or other media) for storing or transmitting information in a form that can be read by a machine. physical structure device).

In the drawings, certain structural or method features may be shown in specific arrangements and/or ordering. Preferably, however, such specific arrangement and/or ordering is not necessary. Rather, in some embodiments, such features may be arranged in a different manner and/or order than as illustrated in the figures. Furthermore, the inclusion of structural or methodological features in a particular figure is not meant to imply that such features are required in all embodiments, and in some embodiments these features may not be included, or may be These characteristics are combined with other characteristics.

In view of the technical problem of high memory cost and high learning cost of gestures, embodiments of the present application provide a data processing solution. The solution may specifically include: determining the target interface element corresponding to the user's hand from the interface; the above interface may include : the first display layer and the second display layer; the above-mentioned first display layer is used to display static interface elements; the above-mentioned second display layer is used to display interface elements in a moving state; according to the first position of the user's hand in the three-dimensional space Movement information controls the movement of the target interface element between the first display layer and the second display layer.

In the embodiment of the present application, the interface may be the abbreviation of UI (User Interface), which can realize interaction between the user and the application program by displaying content. Examples of interfaces may include: web pages or interfaces provided by application programs. It can be understood that the embodiments of the present application do not limit specific interfaces. Interface element refers to a series of elements contained in the software or system interface that meet user interaction requirements.

The embodiment of the present application divides the interface into multiple display layers that are stacked and displayed. The multiple display layers may include: a first display layer and a second display layer; the first display layer is used to display static interface elements, and the second display layer is used to display static interface elements. The display layer is used to display interface elements of motion status.

Embodiments of the present application control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space. In this way, the interface elements in a moving state can be displayed stacked up and down with the static interface elements, so that a three-dimensional effect can be achieved through a two-dimensional display device, so that the target interface elements follow the user's hand on the first display layer and the second display layer movement between.

Referring to Figure 1 , a schematic diagram of a three-dimensional coordinate system according to an embodiment of the present application is shown, in which the XOY plane is the plane where the display device is located, or is parallel to the plane where the display device is located; the Z axis is perpendicular to the plane where the interface is located. Embodiments of the present application introduce Z-axis space to achieve a three-dimensional effect through a two-dimensional display device.

The embodiment of the present application controls the movement of the above-mentioned target interface elements between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space, and can realize the corresponding functions of the target interface elements through the three-dimensional effect of the interface. . For example, it can be used to adjust the position of the target interface element in the interface, or it can trigger the function corresponding to the target interface element, etc. Since the embodiments of the present application can support the user to realize the function corresponding to the target interface element through the movement of the user's hand, the embodiment of the present application can enable the user to perform the movement of the user's hand according to the actual functional requirements, thus reducing the memory cost of gesture interaction. and learning costs to improve user experience.

According to an embodiment, the embodiment of the present application is used to adjust the position of the target interface element in the interface, then the first motion information of the user's hand can be used to pick up the target interface element from the source position of the first display layer, passing through the The movement of the second display layer, and then move the target interface element to the target position of the first display layer and put it down. The logic of the above first movement information is equivalent to moving an object in reality, so it can reduce the memory cost and learning cost of gesture interaction. , improve user experience.

According to another embodiment, the embodiment of the present application is used to trigger the function corresponding to the target interface element. Then the first movement information of the user's hand can be used to press the target interface element. In this case, the target interface element can be controlled to move downward. When the display layer (such as the desktop layer) of the first display layer moves, the logic of the above-mentioned first motion information is simple, so the memory cost and learning cost of gesture interaction can be reduced, and the user experience can be improved.

The data processing method provided by the embodiment of the present application can be applied in the application environment corresponding to the client and the server. The client and the server are located in a wired or wireless network. Through the wired or wireless network, the client and the server interact with each other. .

Optionally, the client can run on the device. For example, the client can be an APP (Application) running on the device, such as a voice assistant APP, a remote control APP, an instant messaging APP, or one that comes with the operating system. APP, etc., the embodiment of this application does not limit the specific APP corresponding to the client.

Optionally, the above-mentioned device may have a built-in or external display device such as a screen, and the above-mentioned display device is used to display an interface.

Optionally, the above-mentioned device may have a built-in or external microphone, and the above-mentioned microphone is used to collect the user's voice information. The above-mentioned devices can also have built-in or external speakers, and the above-mentioned speakers are used to play information.

Optionally, the above device can have a built-in or external three-dimensional sensor. The above-mentioned three-dimensional sensor can be used to detect the position information of the user's hand in the three-dimensional space, thereby obtaining the first movement information of the user's hand in the three-dimensional space.

Optionally, the three-dimensional sensor emits radiation of a known frequency, detects the energy returned by the surface of the object (user's hand) within the observed light field, and determines the position information of the user's hand in the three-dimensional space based on the energy. The above-mentioned three-dimensional sensors may include: low-frequency magnetic field sensors (such as infrared sensors) and ultrasonic sensors.

Optionally, the above-mentioned device may have a built-in or external image acquisition device, and the above-mentioned image acquisition device is used to collect image data to determine gestures based on the image data, thereby realizing gesture interaction functions.

The above-mentioned devices may specifically include but are not limited to: smartphones, tablets, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer III) Level 4, Moving Picture Experts Group Audio Layer IV) players, laptop computers, vehicle equipment, PC (Personal Computer), set-top boxes, smart TVs, wearable devices, smart home devices, etc. Smart home devices may include: smart speakers, smart door locks, smart access control, etc. It can be understood that the embodiments of the present application do not limit specific devices.

Embodiments of the present application can be applied to devices that support gesture interaction, and therefore can be applied to scenarios that require gesture interaction that are inconvenient for touch operations, such as vehicle scenarios, smart TV scenarios, somatosensory game scenarios, etc.

Examples of in-vehicle devices include: HUD (Head Up Display). HUD is usually installed in front of the driver and can provide the driver with some necessary information during driving, such as vehicle speed, fuel consumption, navigation, and even mobile phone calls, Message reminders, entertainment information, etc.; in other words, HUD can integrate multiple functions to facilitate the driver to pay attention to driving conditions and meet the driver's entertainment needs.

Method Embodiment 1

Referring to Figure 2, a step flow chart of Embodiment 1 of a data processing method of the present application is shown, which may specifically include the following steps:

Step 201: Determine the target interface element corresponding to the user's hand from the interface; the above-mentioned interface may include: a first display layer and a second display layer; the above-mentioned first display layer is used to display static interface elements; the above-mentioned second display layer Interface elements used to display motion status;

Step 202: Control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space.

At least one step included in the data processing method shown in Figure 2 can be executed by a client on the device.

In step 201, the interface may include at least one interface element. The target interface element may refer to the interface element selected by the user.

Optionally, the above interface elements may include at least one of the following elements: icons, cards, and list items. It can be understood that the above interface elements are only as optional embodiments. In fact, the interface elements in the embodiments of the present application can also include: text, audio, animation, video, etc. It can be understood that the embodiments of the present application do not specify specific interface elements. limit.

Cards may refer to digital cards, which may include information such as pictures and text. Optionally, the card can be a rectangle containing rich pictures and text content. In practical applications, it can be used as the entrance to the details page.

Optionally, the above interface may be a card interface. The card interface is a display interface containing one or more cards. The embodiment of the present application does not limit the number of cards included in the card interface. When the card interface includes multiple cards, a single card can have a corresponding display area, and the information contained in the card can be displayed in the display area corresponding to the card. For example, the card interface includes three cards, namely card A, card B and card C. The information contained in card A is recorded as information a, the information contained in card B is recorded as information b, and the information contained in card C is recorded as information c. wait.

The embodiment of the present application can determine the target card corresponding to the user's hand from the card interface, so as to realize the function corresponding to the target card.

The embodiment of the present application can determine the target interface element corresponding to the user's hand through the position information of the user's hand. Optionally, step 201 determines the target interface element corresponding to the user's hand from the interface. Specifically, it may include: determining the above-mentioned target interface element from the interface based on the matching between the projection object of the user's hand on the display device and the interface element. The target interface element corresponding to the user's hand, so that the target interface element matches the above-mentioned projection object. The above matching situation may include: overlap situation, etc., which will not be described in detail here.

The embodiments of this application do not limit the specific gestures corresponding to the user's hands. Gestures corresponding to the user's hands may include: fist gestures, palm unfold gestures, palm half unfold gestures, etc.

In step 202, all or part of the target interface element can follow the movement of the user's hand between the first display layer and the second display layer. That is, the movement range of the target interface element on the Z-axis can be determined by the first display layer and the second display layer. The second display layer is determined.

The target interface element may correspond to the second motion information, and the first motion information and the second motion information may match. The first motion information or the second motion information may include: motion type and motion direction.

The above-mentioned motion types may include at least one of the following types: flipping, moving, and rotating.

Rotation can transform the target interface element at any angle on the corresponding plane.

Flip can arbitrarily rotate the target interface element around the flip axis and perpendicular to the corresponding plane. The flip axis corresponding to the target interface element may include: the outer edge of the interface element, or the central axis of the interface element. Taking a rectangular interface element as an example, its outer edges can be: upper edge, lower edge, left edge, or right edge, etc.

Movement can be used to change the position of the target interface element. It can be understood that the movement direction corresponding to the movement can include: one movement direction or multiple movement directions.

Optionally, the movement direction of the user's hand or the target interface element may include: a vertical movement direction perpendicular to the interface, and/or a parallel movement direction parallel to the interface. It can be understood that embodiments of the present application can determine the movement direction of the user's hand based on changes in position information of the user's hand in the three-dimensional space. The movement direction of the user's hand may include any one or a combination of vertical movement directions and parallel movement directions.

It should be noted that in the embodiment of the present application, the displacement of the user's hand or the target interface element may include: displacement in one movement direction or multiple movement directions. Taking the three-dimensional coordinate system shown in Figure 1 as an example, in the embodiment of the present application, the movement direction of the user's hand may be parallel to the Z-axis, or may have an angle greater than 0 degrees with the Z-axis.

Optionally, the embodiment of the present application is used to adjust the position of the target interface element between the first display layer and the second display layer, then the first movement information of the user's hand can be used to pick up from the source position of the first display layer. The target interface element passes through the second display layer in the middle, moves the target interface element to the target position of the first display layer and puts it down. The logic of the above-mentioned first motion information is equivalent to moving an object in reality.

According to an embodiment, the trajectory points of the target interface element may include, in order from first to last in time: a source position in the first display layer, a position in the second display layer, and a position in the first display layer. target location.

According to another embodiment, the movement directions of the target interface element may include: a first movement direction, a second movement direction and a third movement direction in order from first to last;

The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction may be a direction from the first display layer to the second display layer; The three movement directions may be directions from the second display layer to the first display layer.

According to yet another embodiment, the trajectory points of the target interface element may include, in order from first to last in time: a position in the first display layer, a position in the second display layer, and a target position in the third display layer. . The second display layer may be located between the first display layer and the third display layer.

Embodiments of the present application can use interface processing technology to control the movement of the above-mentioned target interface elements between the first display layer and the second display layer. For example, animation technology or image processing technology can be used to control the target interface element to flip in the space corresponding to the first display layer and the second display layer.

In this embodiment of the present application, optionally, the target interface element can be controlled to move in a direction perpendicular to the interface by changing the display layer corresponding to the target interface element.

It can be understood that the number of the second display layer may be one or more. The second display layer may be located above the first display layer, or the second display layer may be located below the first display layer. For example, the target interface element can be moved downward from the first display layer, through the second display layer, and finally to the third display layer. The third display layer is used to display the preset interface corresponding to the target interface element, and the target interface element corresponds to The preset interfaces can include: music interface, video interface, etc. For example, if the target interface element is a card corresponding to the music APP, the default interface can be the interface corresponding to the music APP.

Optionally, the second display layer can be obtained based on the displacement of the user's hand in the first movement direction.

For example, as the displacement of the user's hand in the first movement direction increases, the distance between the second display layer and the first display layer increases. For example, the number of the first display layer is 1, and the number of the second display layer is i. i can be a natural number greater than 1, and then i can increase as the displacement of the user's hand in the first movement direction increases.

For another example, as the displacement of the user's hand in the first movement direction decreases, the distance between the second display layer and the first display layer decreases. For example, the number of the first display layer is 1, the number of the second display layer is i, and i can be a natural number greater than 1, then i can decrease as the displacement of the user's hand in the first movement direction decreases. .

In this embodiment of the present application, optionally, the above interface may include: controls corresponding to the above target interface elements. Control refers to the encapsulation of data and methods. Controls can have their own properties and methods, where properties are simple accessors to the control's data, and methods are simple and visible functions of the control.

In this embodiment of the present application, optionally, the usage frequency corresponding to the control corresponding to the target interface element in the above interface can meet the preset conditions. For example, the preset conditions may include: usage frequency exceeds a threshold, etc., so as to advance high-frequency controls corresponding to the target interface element, thereby improving the operation efficiency corresponding to the target interface element.

In an optional embodiment of the present application, the above-mentioned interface may specifically include: multiple display layers arranged in a stack, and the above-mentioned multiple display layers may include in order from bottom to top:

Desktop layer; used to display the desktop;

The first display layer; used to display static cards; and

The second display layer is used to display cards with motion status.

Multiple display layers arranged in a stack can realize the corresponding functions of the card through the movement of the card in the space, and can improve the depth of field effect of the interface.

Referring to Figure 3, a schematic diagram of an interface according to an embodiment of the present application is shown. The interface may include: multiple cards. The multiple cards 301 may include: a target card 301A selected by the user's hand, and unselected cards. 301B, card 301C, card 301D and card 301E, the interface may also include: a control 302 corresponding to the target card 301A. Optionally, the display layers corresponding to multiple cards may be located below the display layer corresponding to the control 302 . Optionally, the interface may also include: a desktop layer, and the display layer corresponding to the desktop layer may be located under the display layers corresponding to multiple cards.

In an optional embodiment of the present application, interface elements such as cards and icons can serve as entrances to the preset interface. The preset interface may be the interface of an application program. Application categories can include: music category, address book category, navigation category, video category, audiobook category, etc.

For example, the control functions corresponding to the music category may include: play function, forward function, or backward function, etc. The control functions corresponding to the address book category may include: short message function, dialing function, contact function, etc. The control functions corresponding to the navigation category may include: navigation function, home page function, assistant function, etc. The control functions corresponding to the video category can include: playback function, comment function, search function, etc. The control functions corresponding to the audiobook category may include: play function, forward function, or rewind function, etc. It can be understood that those skilled in the art can determine the control functions corresponding to the interface elements according to actual application requirements. The embodiments of the present application do not limit the specific control functions corresponding to the interface elements.

In an optional embodiment of the present application, when the user's hand presents the first gesture, the user's hand can be supported to move in a three-dimensional space. In this case, the above-mentioned first motion information may include: a motion direction perpendicular to the interface. The first gesture may include: a fist gesture, etc. The embodiment of the present application can control the movement of the target interface element between the first display layer and the second display layer through the movement direction of the user's hand perpendicular to the interface. Of course, in the case where the user's hand presents the first gesture, the first movement information may include: a movement direction parallel to the interface.

In an optional embodiment of the present application, when the user's hand performs the second gesture, the movement of the user's hand in the two-dimensional plane corresponding to the interface may only be supported. In this case, the first motion information may include: a motion direction parallel to the interface, so that the target interface element is updated along with the movement of the user's hand. The second gesture may include: palm open gesture, palm half open gesture, etc. The embodiment of the present application can realize the update of the target interface element through the second movement direction of the user's hand. Taking the interface shown in Figure 3 as an example, when the user's hand corresponding to the second gesture moves from card 301A to card 301B, the target interface element is updated to card 301B, so the controls corresponding to card 301B can be displayed.

Of course, in the case where the user's hand exhibits the first gesture, the first movement information may include: a movement direction perpendicular to the interface. For example, if the user's hand corresponding to the second gesture moves in the direction from the first display layer to the desktop layer, the target interface element may move in the direction from the first display layer to the desktop layer. For example, the target interface element can be moved downward from the first display layer, through the second display layer, and finally to the third display layer. The third display layer is used to display the preset interface corresponding to the target interface element, and the target interface element corresponds to The preset interfaces can include: music interface, video interface, etc.

For another example, if all or part of the second gesture is flipped in the three-dimensional space, the target interface element can be flipped in the interface, and the flip information of the target interface element can match the flip information of the second gesture. The flip information can include : Flip axis, flip direction, or flip angle, etc.

In this embodiment of the present application, optionally, when the user's hand performs a first gesture, the first movement information may include: a movement direction perpendicular to the interface.

In this embodiment of the present application, optionally, when the user's hand performs a second gesture, the first movement information may include: a movement direction parallel to the interface;

The above methods can also include:

When the user's hand exhibits the second gesture, the target interface element is updated according to the movement direction parallel to the interface.

In summary, the data processing method of the embodiment of the present application controls the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space. In this way, the interface elements in a moving state can be displayed stacked up and down with the static interface elements, so that a three-dimensional effect can be achieved through a two-dimensional display device, so that the target interface elements follow the user's hand on the first display layer and the second display layer movement between them; therefore, the functions corresponding to the target interface elements can be realized through the three-dimensional effect of the interface. For example, it can be used to adjust the position of the target interface element in the interface, or it can trigger the function corresponding to the target interface element, etc. Since the embodiments of the present application can support the user to realize the function corresponding to the target interface element through the movement of the user's hand, the embodiment of the present application can enable the user to perform the movement of the user's hand according to the actual functional requirements, thus reducing the memory cost of gesture interaction. and learning costs to improve user experience.

To enable those skilled in the art to better understand the embodiments of the present application, specific examples are provided here.

In this example, the interface may include multiple interface elements, and the multiple interface elements may be arranged horizontally and/or vertically.

The embodiment of the present application can support the user to select the target interface element through the second gesture. Optionally, based on the matching between the projection object of the user's hand on the display device and the interface element, the target interface element corresponding to the user's hand is determined from the interface. Optionally, if the second gesture moves in a second movement direction parallel to the interface, then the target interface element is updated along with the movement of the second gesture.

According to an embodiment, if all or part of the second gesture is flipped in the three-dimensional space, the target interface element can be flipped in the interface, and the flip information of the target interface element can match the flip information of the second gesture. The information may include: flip axis, flip direction, or flip angle, etc.

According to another embodiment, if the user's hand corresponding to the second gesture moves in the direction from the first display layer to the desktop layer, the target interface element can move in the direction from the first display layer to the desktop layer. For example, the target interface element can move in the direction from the first display layer to the desktop layer. The target interface element moves from the first display layer to the third display layer located below the first display layer. In this case, the preset interface corresponding to the target interface element can be entered, for example, entering the music interface, video interface, etc.

According to yet another embodiment, the embodiment of the present application is used to adjust the position of the target interface element in the interface. Specifically, after the target interface element is determined through the second gesture, if the user's hand changes from the second gesture to the first gesture and moves in the first movement direction, the target interface element will be displayed on the first display in the first movement direction. Movement between the layer and the second display layer, for example, the target interface element can be moved from the first display layer to the second display layer located above the first display layer. Next, if the first gesture of the user's hand moves according to the second movement direction, the target interface element moves between the first display layer and the second display layer according to the second movement direction. Then, if the first gesture of the user's hand moves according to the third movement direction, the target interface element moves in the three-dimensional space according to the third movement direction until the user's hand changes from the first gesture to the second gesture, that is, When the user's hand changes from the first gesture to the second gesture, the target interface element stops moving.

This embodiment can be used to move the position of the target interface element in the interface. Taking the interface shown in Figure 3 as an example, if the position of the card 301A in the interface needs to be adjusted, the card 301A can be picked up from the source position in the first display layer and passed through the first display layer based on the first motion information of the user's hand. Second display layer, and place the card 301A to the target position in the first display layer. Optionally, if a first non-target interface element is provided at the target position in the interface (the non-target interface element may refer to an interface element other than the target interface element), the first non-target interface element may be moved away. For example, the first non-target interface element can be moved to the above-mentioned source position. For another example, the first non-target interface element can be moved to the position corresponding to the second non-target interface element, and the second non-target interface element can be moved to the above-mentioned source position. Source location.

Taking the interface shown in Figure 3 as an example, based on the first movement information of the user's hand, the card 301A can be picked up from the source position in the first display layer, pass through the second display layer, and put the card 301A to the first display layer. Displays the target location in the layer. Assume that the target position is the position of card 301C. Optionally, when the projected object of the user's hand on the display device matches the position of the card 301C, and the user's hand moves according to the third movement direction, the card 301B and the card 301C can be controlled to move to the left, as the card 301C. 301A sets aside the target location. Optionally, when the projected object of the user's hand on the display device matches the position of the card 301C and the displacement of the user's hand in the third movement direction exceeds the displacement threshold, the cards 301B and 301C can be controlled to move toward Move left.

In summary, the first movement information of the user's hand can be used to pick up the target interface element from the source position of the first display layer, pass through the second display layer in the middle, move the target interface element to the target position in the second display layer, and put it down. , the logic of the above first motion information is equivalent to moving an object in reality, so it can reduce the memory cost and learning cost of gesture interaction and improve the user experience.

Referring to Figure 4, a schematic diagram of a process of adjusting the interface layout through spatial gestures according to an embodiment of the present application is shown. The first display layer of the interface may include: card 1, card 2, card 3, card 4 and card For cards such as 5, space gestures are used to adjust the position of the card in the interface.

Figure 4 may include the following steps:

Step S1: Based on the matching between the palm gesture's projection object on the display device and the card, determine the target card corresponding to the palm gesture from the interface (card 3 in Figure 4), so that the user can move the palm left and right to achieve Choose the purpose of the card.

Step S2: In response to the movement of the fist gesture on the Z-axis, the layout adjustment mode is entered, so that the user can enter the layout adjustment mode by making a fist and pulling it back.

Specifically, the target card is controlled to move between the first display layer and the second display layer. For example, the target card can be controlled to move along the first movement direction.

Step S3: In response to the movement of the fist gesture parallel to the interface, control the target card to move in a direction parallel to the interface to achieve the purpose of moving the fist left and right and dragging the card to adjust its position.

Optionally, during the process of the target card moving left and right, the non-target cards in the first display layer that match the projection object of the target card can move accordingly. For example, in Figure 4, the target card 3 moves to the position corresponding to the card 4, Then card 4 moves to the left accordingly.

It can be understood that if there is no non-target card matching the projection object of the target card in the first display layer, the non-target card may not be moved.

Step S4: In response to the change from the fist gesture to the palm gesture, control the target card to move along the third movement direction to place the target card at the target position in the first display layer. That is, the user can exit the adjustment layout mode by clenching the fist.

Method Example 2

Referring to Figure 5, a step flow chart of Embodiment 2 of a data processing method of the present application is shown, which may specifically include the following steps:

Step 501: Determine how long the gesture stays on the interface; the above interface may include: multiple cards;

Step 502: Switch the positions of at least two cards in the above interface according to the above stay duration.

Embodiments of the present application can adjust the layout of the interface, that is, adjust the positions of at least two cards in the interface, based on how long the gesture stays on the interface, thereby reducing the memory cost and learning cost of gesture interaction and improving the user experience.

Adjust the layout of the interface, specifically including: switching the positions of at least two cards in the interface. For example, the positions of card 1 and card 2 are interchanged; another example is, after the positions of card 1 and card 2 are interchanged, the positions of card 1 and card 3 are interchanged, etc.

In the embodiment of the present application, at least two cards corresponding to the location switching (hereinafter referred to as target cards) can be obtained based on the length of stay.

Optionally, different stay durations can correspond to different numbers of target cards. For example, the longer the stay, the greater the number of target cards.

Optionally, the target card may be determined based on the matching between the gesture projection object on the display device and the card. For example, the matching condition can be matching degree, and at least two target cards can be selected from the interface in descending order of matching degree. For example, if the interface includes card 1 to card 5 from left to right, and the gesture is located in the middle of card 3 and card 4, then card 3 and card 4 can be used as target cards. For another example, the interface includes: Card 1 to Card 5 from left to right, and the gesture is located on Card 3, then Card 2, Card 3 and Card 4 can be used as target cards.

Method Example 3

Referring to Figure 6, a step flow chart of Embodiment 3 of a data processing method of the present application is shown, which may specifically include the following steps:

Step 601: Determine how long the gesture stays on the interface; the above interface may include: multiple cards;

Step 602: Move at least two cards in the above interface according to the above stay time.

Embodiments of the present application can adjust the layout of the interface, that is, adjust the positions of at least two cards in the interface, based on how long the gesture stays on the interface, thereby reducing the memory cost and learning cost of gesture interaction and improving the user experience.

Adjust the layout of the interface, specifically including: moving at least two cards in the interface.

The above movement can switch the positions of different cards. For details, refer to the embodiment shown in FIG. 4 . For example, card 1 is moved from a first position to a second position, and card 2 is moved from a third position to a fourth position, where the second position is the same as the third position, or the first position is the same as the fourth position.

Alternatively, the above movement may not involve switching corresponding positions of different cards. For example, move card 1 from the first position to the second position, move card 2 from the third position to the third position, where the second position is different from the third position, and the first position is different from the fourth position, etc.

Optionally, different stay durations can correspond to different numbers of target cards. For example, the longer the stay, the greater the number of target cards.

Optionally, the target card may be determined based on the matching between the gesture projection object on the display device and the card.

Optionally, different stay durations can correspond to different moving distances. For example, the longer the stay, the longer the movement distance.

Method Example 4

Referring to Figure 7, a step flow chart of Embodiment 3 of a data processing method of the present application is shown, which may specifically include the following steps:

Step 701: Determine the target interface element corresponding to the user's hand from the interface; the above-mentioned interface may include: a first display layer and a second display layer; the above-mentioned first display layer is used to display unselected interface elements; the above-mentioned second display Layers are used to display selected interface elements;

Step 702: Control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space.

In this embodiment of the present application, the first display layer may display unselected interface elements (referred to as non-target interface elements), so that the user can select target interface elements therefrom. The second display layer can display selected interface elements, such as target interface elements. Embodiments of the present application can control the movement of selected interface elements between the above-mentioned first display layer and the above-mentioned second display layer.

Embodiments of the present application can determine the selected interface element based on gestures, voice, or touch.

In the embodiment of the present application, unselected interface elements can be displayed stacked up and down with selected interface elements, thereby achieving a three-dimensional effect through a two-dimensional display device, so that the target interface element follows the user's hand on the first display layer and Movement between the second display layers; therefore, the functions corresponding to the target interface elements can be realized through the three-dimensional effect of the interface. For example, it can be used to adjust the position of the target interface element in the interface, or it can trigger the function corresponding to the target interface element, etc. Since the embodiments of the present application can support the user to realize the function corresponding to the target interface element through the movement of the user's hand, the embodiment of the present application can enable the user to perform the movement of the user's hand according to the actual functional requirements, thus reducing the memory cost of gesture interaction. and learning costs to improve user experience.

In this embodiment of the present application, optionally, the second display layer is located above the first display layer, or the second display layer is located below the first display layer.

In this embodiment of the present application, optionally, the trajectory points of the target interface element may include, in order from first to last in time: the source position in the first display layer, the position in the second display layer, and the above-mentioned third display layer. A target location in the display layer.

In this embodiment of the present application, optionally, the trajectory points of the target interface element may include, in order of time from first to last: the position in the first display layer, the position in the second display layer, and the third display position in the layer. Optionally, the second display layer is located between the first display layer and the third display layer.

In the embodiment of the present application, optionally, the movement directions of the target interface elements may include: a first movement direction, a second movement direction, and a third movement direction in order from first to last in time;

The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is the direction from the first display layer to the second display layer; the third movement direction is perpendicular to the interface. The movement direction may be a direction from the second display layer to the first display layer.

It should be noted that for the sake of simple description, the method embodiments are expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present application are not limited by the described action sequence, because According to the embodiments of the present application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily necessary for the embodiments of the present application.

An embodiment of the present application also provides a data processing device.

Referring to Figure 8, a structural block diagram of an embodiment of a data processing device of the present application is shown. The above device may specifically include the following modules:

The determination module 801 is used to determine the target interface element corresponding to the user's hand from the interface; the above-mentioned interface includes: a first display layer and a second display layer; the above-mentioned first display layer is used to display static interface elements; the above-mentioned second display layer The display layer is used to display interface elements of motion status; and

The control module 802 is configured to control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space.

Optionally, the above-mentioned interface may also include: a desktop layer located below the above-mentioned first display layer.

Optionally, the trajectory points of the target interface element may include, in order from first to last in time: the source position in the first display layer, the position in the second display layer, and the target position in the first display layer. .

Optionally, the movement type of the target interface element may include at least one of the following types: flipping, moving, and rotating.

Optionally, the movement directions of the above-mentioned target interface elements may include: a first movement direction, a second movement direction, and a third movement direction in order from first to last in time;

The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is the direction from the first display layer to the second display layer; the third movement direction is perpendicular to the interface. The movement direction is the direction from the second display layer to the first display layer.

Optionally, the above interface elements may include at least one of the following elements: icons, cards, and list items.

Optionally, the determining module 801 may include:

The matching determination module is used to determine the target interface element corresponding to the user's hand from the interface based on the matching between the projection object of the user's hand on the display device and the interface element.

Optionally, when the user's hand performs a first gesture, the first motion information may include: a motion direction perpendicular to the interface.

Optionally, in the case where the user's hand exhibits a second gesture, the first movement information may include: a movement direction parallel to the interface;

The above device may further include: an update module, configured to update the target interface element according to the movement direction parallel to the interface when the user's hand performs the second gesture.

The embodiment of the present application also provides a data processing device, which may specifically include the following modules:

The determination module is used to determine the target interface element corresponding to the user's hand from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display unselected interface elements; The second display layer is used to display the selected interface element; and

A control module configured to control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space.

In this embodiment of the present application, optionally, the second display layer is located above the first display layer, or the second display layer is located below the first display layer.

In this embodiment of the present application, optionally, the trajectory points of the target interface element may include, in order from first to last in time: the source position in the first display layer, the position in the second display layer, and the above-mentioned third display layer. A target location in the display layer.

In this embodiment of the present application, optionally, the trajectory points of the target interface element may include, in order of time from first to last: the position in the first display layer, the position in the second display layer, and the third display position in the layer. Optionally, the second display layer is located between the first display layer and the third display layer.

In the embodiment of the present application, optionally, the movement directions of the target interface elements may include: a first movement direction, a second movement direction, and a third movement direction in order from first to last in time;

The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is the direction from the first display layer to the second display layer; the third movement direction is perpendicular to the interface. The movement direction may be a direction from the second display layer to the first display layer.

As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment.

Each embodiment in this specification is described in a progressive manner. Each embodiment focuses on its differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other.

Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Embodiments of the embodiments of the present application may be implemented as a system or device configured as desired using any suitable hardware and/or software. Figure 9 schematically illustrates an exemplary device 1300 that may be used to implement various embodiments described above in this application.

For one embodiment, Figure 9 illustrates an exemplary device 1300 that may include: one or more processors 1302, a system control module (chipset) 1304 coupled with at least one of the processors 1302, and a system System memory 1306 coupled to the control module 1304, non-volatile memory (NVM)/storage devices 1308 coupled to the system control module 1304, one or more input/output devices 1310 coupled to the system control module 1304, and system control Module 1306 is coupled to network interface 1312 . The system memory 1306 may include instructions 1362 , which may be executed by one or more processors 1302 .

Processor 1302 may include one or more single-core or multi-core processors, and processor 1302 may include any combination of general-purpose processors or special-purpose processors (eg, graphics processors, applications processors, baseband processors, etc.). In some embodiments, the device 1300 can serve as the server, target device, wireless device, etc. mentioned above in the embodiments of this application.

In some embodiments, device 1300 may include one or more machine-readable media (eg, system memory 1306 or NVM/storage device 1308) having instructions and configured in combination with the one or more machine-readable media to One or more processors 1302 that execute instructions to implement modules included in the aforementioned devices, thereby performing the actions described above in the embodiments of the present application.

The system control module 1304 of one embodiment may include any suitable interface controller for providing any suitable interface to at least one of the processors 1302 and/or any suitable device or component in communication with the system control module 1304 .

The system control module 1304 of one embodiment may include one or more memory controllers for providing an interface to the system memory 1306 . The memory controller may be a hardware module, a software module, and/or a firmware module.

System memory 1306 of one embodiment may be used to load and store data and/or instructions 1362 . For one embodiment, system memory 1306 may include any suitable volatile memory, such as suitable DRAM (dynamic random access memory). In some embodiments, system memory 1306 may include double data rate type quad synchronous dynamic random access memory (DDR4SDRAM).

The system control module 1304 of one embodiment may include one or more input/output controllers to provide interfaces to the NVM/storage 1308 and input/output device(s) 1310 .

The NVM/storage device 1308 of one embodiment may be used to store data and/or instructions 1382 . NVM/storage 1308 may include any suitable non-volatile memory (e.g., flash memory, etc.) and/or may include any suitable non-volatile storage device(s), e.g., one or more hard drives ( HDD), one or more compact disc (CD) drives and/or one or more digital versatile disc (DVD) drives, etc.

NVM/storage 1308 may include storage resources that are physically part of the device on which device 1300 is installed, or that may be accessed by the device without necessarily being part of the device. For example, NVM/storage 1308 may be accessed over the network via network interface 1312 and/or through input/output devices 1310 .

The input/output device(s) 1310 of one embodiment may provide an interface for the device 1300 to communicate with any other suitable device, and the input/output device 1310 may include communication components, audio components, sensor components, and the like.

Network interface 1312 of one embodiment may provide an interface for device 1300 to communicate over one or more networks and/or with any other suitable device, which may be in accordance with any of one or more wireless network standards and/or protocols. and/or protocols to communicate wirelessly with one or more components of a wireless network, such as access to a wireless network based on a communications standard such as WiFi, 2G or 3G or 4G, or a combination thereof.

For one embodiment, at least one of the processors 1302 may be packaged with the logic of one or more controllers (eg, memory controllers) of the system control module 1304 . For one embodiment, at least one of the processors 1302 may be packaged with the logic of one or more controllers of the system control module 1304 to form a system-in-package (SiP). For one embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the system control module 1304 on the same device. For one embodiment, at least one of the processors 1302 may be integrated on the same chip with the logic of one or more controllers of the system control module 1304 to form a system on a chip (SoC).

In various embodiments, device 1300 may include, but is not limited to, a computing device such as a desktop computing device or a mobile computing device (eg, laptop computing device, handheld computing device, tablet, netbook, etc.). In various embodiments, device 1300 may have more or fewer components and/or a different architecture. For example, in some embodiments, device 1300 may include one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touch screen display), a non-volatile memory port, a plurality of antennas, a graphics chip, an application specific integrated circuit (ASIC) and speakers.

Wherein, if the display includes a touch panel, the display screen may be implemented as a touch screen display to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action.

Embodiments of the present application also provide a non-volatile readable storage medium. One or more modules (programs) are stored in the storage medium. When the one or more modules are applied to a device, they can cause the device to execute Instructions for each method in the embodiments of this application.

In one example, an apparatus is provided, including: one or more processors; and instructions stored thereon in one or more machine-readable media that, when executed by the one or more processors, result in The device performs the method in the embodiment of the present application, and the method may include: the method shown in Figure 1 or Figure 2 or Figure 3.

In one example, one or more machine-readable media are also provided, with instructions stored thereon. When executed by one or more processors, the device performs the method as in the embodiment of the present application. The method may include: The method shown in Figure 1 or Figure 2 or Figure 3.

Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here. For relevant information, please refer to the partial description of the method embodiments. Can.

Each embodiment in this specification is described in a progressive manner. Each embodiment focuses on its differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other.

Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing apparatus produce a A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction apparatus, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

Although preferred embodiments of the embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once the basic inventive concepts are understood. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

Finally, it should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or any such actual relationship or sequence between operations. Furthermore, the terms "comprises," "comprises," or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements, but also those not expressly listed other elements, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article, or apparatus that includes the stated element.

The above has introduced in detail a data processing method, a data processing device, a device, and a machine-readable medium provided by this application. Specific examples are used in this article to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and the core idea of the present application; at the same time, for those of ordinary skill in the field, there will be some differences in the specific implementation methods and application scope based on the ideas of the present application. Changes, in summary, the content of this specification should not be construed as a limitation on this application.

Claims (14)

1. A data processing method, characterized in that the method includes: The target interface element corresponding to the user's hand is determined from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display static interface elements; the second display layer is used to display static interface elements. Interface elements used to display motion status; Control the movement of the target interface element between the first display layer and the second display layer according to the first movement information of the user's hand in the three-dimensional space; Wherein, when used to adjust the position of the target interface element in the interface, the trajectory points of the target interface element include in order from first to last in time: the source position in the first display layer, the second display layer and the target position in the first display layer; the movement directions of the target interface elements include, in order from first to last in time, the first movement direction, the second movement direction and the third movement direction; The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is from the first display layer to the second The direction of the display layer; the third movement direction is the direction from the second display layer to the first display layer. 2. The method of claim 1, wherein the interface further includes: a desktop layer located below the first display layer. 3. The method according to claim 1, characterized in that the movement type of the target interface element includes at least one of the following types: flipping, moving and rotating. 4. The method according to any one of claims 1 to 3, characterized in that the interface elements include at least one of the following elements: icons, cards and list items. 5. The method according to any one of claims 1 to 3, characterized in that determining the target interface element corresponding to the user's hand from the interface includes: Based on the matching between the projection object of the user's hand on the display device and the interface element, the target interface element corresponding to the user's hand is determined from the interface. 6. The method according to any one of claims 1 to 3, characterized in that, when the user's hand presents a first gesture, the first motion information includes: a motion direction perpendicular to the interface. 7. The method according to any one of claims 1 to 3, characterized in that, when the user's hand presents a second gesture, the first motion information includes: a motion direction parallel to the interface; The method also includes: When the user's hand exhibits the second gesture, the target interface element is updated according to the movement direction parallel to the interface. 8. A data processing method, characterized in that the method includes: The target interface element corresponding to the user's hand is determined from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display unselected interface elements; the second display layer Used to display selected interface elements; Control the movement of the target interface element between the first display layer and the second display layer according to the first movement information of the user's hand in the three-dimensional space; Wherein, when used to adjust the position of the target interface element in the interface, the trajectory points of the target interface element include in order from first to last in time: the source position in the first display layer, the second display layer and the target position in the first display layer; the movement directions of the target interface elements include, in order from first to last in time, the first movement direction, the second movement direction and the third movement direction; The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is from the first display layer to the second The direction of the display layer; the third movement direction is the direction from the second display layer to the first display layer. 9. A data processing device, characterized in that the device includes: The determination module is used to determine the target interface element corresponding to the user's hand from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display static interface elements; The second display layer is used to display interface elements of motion status; and A control module configured to control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space; Wherein, when used to adjust the position of the target interface element in the interface, the trajectory points of the target interface element include in order from first to last in time: the source position in the first display layer, the second display layer and the target position in the first display layer; the movement directions of the target interface elements include, in order from first to last in time, the first movement direction, the second movement direction and the third movement direction; The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is from the first display layer to the second The direction of the display layer; the third movement direction is the direction from the second display layer to the first display layer. 10. A data processing device, characterized in that the device includes: The determination module is used to determine the target interface element corresponding to the user's hand from the interface; the interface includes: a first display layer and a second display layer; the first display layer is used to display unselected interface elements; The second display layer is used to display the selected interface element; and A control module configured to control the movement of the target interface element between the first display layer and the second display layer based on the first movement information of the user's hand in the three-dimensional space; Wherein, when used to adjust the position of the target interface element in the interface, the trajectory points of the target interface element include in order from first to last in time: the source position in the first display layer, the second display layer and the target position in the first display layer; the movement directions of the target interface elements include, in order from first to last in time, the first movement direction, the second movement direction and the third movement direction; The second movement direction is parallel to the interface; the first movement direction and the third movement direction are perpendicular to the interface; the first movement direction is from the first display layer to the second The direction of the display layer; the third movement direction is the direction from the second display layer to the first display layer. 11. A device, characterized in that it includes: one or more processors; and One or more machine-readable media having instructions stored thereon which, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 1-7. 12. One or more machine-readable media having instructions stored thereon which, when executed by one or more processors, cause a device to perform the method of any one of claims 1-7. 13. A device, characterized in that it includes: one or more processors; and One or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the device to perform the method of claim 8. 14. One or more machine-readable media having instructions stored thereon that, when executed by one or more processors, cause a device to perform the method of claim 8.