WO2022126775A1

WO2022126775A1 - Cursor control method and apparatus, device and medium

Info

Publication number: WO2022126775A1
Application number: PCT/CN2020/141781
Authority: WO
Inventors: 朱理森
Original assignee: 安徽鸿程光电有限公司
Priority date: 2020-12-14
Filing date: 2020-12-30
Publication date: 2022-06-23

Abstract

A cursor control method and apparatus, a device, and a medium. The method comprises: acquiring a video of a gesture and the size of a display area of an interactive terminal (S310); according to the position of the gesture in at least two video frames of the video, obtaining the moving speed and a first moving distance of the gesture (S320); determining the moving distance ratio of the gesture to a cursor according to the moving speed, the reference movement amplitude corresponding to the gesture, and the size of the display area (S330); determining a target moving distance of the cursor according to the moving distance ratio and the first moving distance (S340); and controlling the cursor to move according to the target moving distance (S350). The movement of the cursor can be controlled according to the moving speed of the gesture, the reference movement amplitude of the gesture, and the first moving distance of the gesture, thereby improving the control accuracy of the cursor.

Description

Cursor control method, device, device and medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of Chinese Patent Application No. 202011465353.0 filed on December 14, 2020, entitled "Cursor Control Method, Apparatus, Device and Medium", the entire content of which is incorporated herein by reference.

technical field

The present application belongs to the field of terminal equipment, and in particular, relates to a cursor control method, apparatus, device and medium.

Background technique

With the gradual development of interactive terminals such as interactive electronic whiteboards, video display stands, LCD writing screens, and interactive writing screens, users can use external devices such as mice and keyboards, or users can directly or indirectly touch Interactive terminal for manipulation.

With the further development of interactive technology, at this stage, people can track human body movements through an image acquisition device, so that the interactive technology that uses human movements to control the interactive terminal is becoming more and more mature. At present, gestures are usually used to control the cursor movement on the interactive terminal, so as to realize the manipulation of the interactive terminal.

However, in the solution in the prior art that uses gestures to control the movement of the cursor, there is a technical problem that the control accuracy of the cursor is low.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a cursor control method, apparatus, device, and medium, which can control the cursor movement according to the movement speed of the gesture, the reference movement range of the gesture, and the first movement distance of the gesture, so as to improve the control accuracy of the cursor.

In a first aspect, an embodiment of the present application provides a cursor control method, which includes:

Get the video of the gesture and the size of the display area of the interactive terminal. The gesture is the gesture of the target object to manipulate the interactive terminal;

Obtain the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video;

Determine the movement distance ratio between the gesture and the cursor according to the movement speed, the reference movement range corresponding to the gesture and the size of the display area, wherein the reference movement range is the reference value of the movement range of the gesture;

Determine the target moving distance of the cursor according to the moving distance ratio and the first moving distance;

Control the cursor in the display area and move according to the target moving distance

In an optional implementation manner, the ratio of the movement distance between the gesture and the cursor is determined according to the movement speed, the reference movement range corresponding to the gesture, and the size of the display area, which specifically includes:

Obtain the first coefficient corresponding to the moving speed;

determining the first movement range of the gesture according to the product of the first coefficient and the reference movement range;

The moving distance ratio is determined according to the ratio of the size of the display area to the first moving amplitude.

In an optional implementation manner, when the moving speed is less than a preset speed threshold, the first coefficient is negatively correlated with the moving speed;

When the moving speed is greater than or equal to the preset speed threshold, the first coefficient is a fixed value.

In an optional embodiment, the first coefficient is negatively correlated with the moving speed, including:

The first coefficient decreases proportionally with the increase of the moving speed;

Or, the first coefficient decreases according to the cosine variation law as the moving speed increases.

In an optional implementation manner, the first movement distance includes a plurality of gesture movement sub-distances, wherein each gesture movement sub-distance is the movement distance of the gesture between two adjacent moments;

Correspondingly, the target movement distance includes: a plurality of cursor movement sub-distances corresponding to the plurality of gesture movement sub-distances one-to-one respectively.

In an optional implementation manner, the first movement distance is obtained according to the position of the gesture in at least two video frames of the video, which specifically includes:

Obtain the respective acquisition moments of at least two video frames;

between the respective acquisition moments of the at least two video frames, determining a plurality of first moments;

According to the position of the gesture in at least three video frames of the video, determine the gesture movement sub-distance between every two adjacent first moments, and obtain a plurality of gesture movement sub-distances;

Wherein, the at least three video frames include at least two video frames.

In an optional implementation manner, according to the position of the gesture in at least three video frames of the video, the gesture movement sub-distance between every two adjacent first moments is determined, and a plurality of gesture movement sub-distances are obtained. include:

Calculate the movement speed of the gesture based on the position of the gesture in at least two video frames;

and calculating the movement acceleration of the gesture based on the position of the gesture in at least three video frames;

According to the movement speed, the movement acceleration, and the position of the gesture in any one of the at least two video frames, the gesture movement sub-distance between every two adjacent first moments is determined to obtain a plurality of gesture movement sub-distances.

In an optional implementation manner, before obtaining the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video, the method further includes:

In the process of acquiring multiple video frames of the video, if the first video frame containing the gesture is not received within the preset time period, the position of the gesture in the first video frame is determined based on the position of the gesture in the second video frame ;

The preset time period is a preset time period starting from receiving the second video frame including the gesture.

In an optional embodiment, the reference movement magnitude is related to the target object;

Before determining the ratio of the gesture movement distance to the cursor movement distance according to the movement speed, the reference movement range corresponding to the gesture and the display area size, the method further includes:

Get the body shape information of the target object;

The reference movement range corresponding to the body shape information is determined.

In a second aspect, an embodiment of the present application provides a cursor control device, the device comprising:

The first acquisition module is used to acquire the video of the gesture and the size of the display area of the interactive terminal, and the gesture is the gesture of the target object to manipulate the interactive terminal;

a first processing module, configured to obtain the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video;

The second processing module is used for determining the ratio of the movement distance between the gesture and the cursor according to the movement speed, the reference movement range corresponding to the gesture and the size of the display area, wherein the reference movement range is the reference value of the movement range of the gesture;

The third processing module is used for determining the target moving distance of the cursor according to the moving distance ratio and the first moving distance;

The cursor control module is used to control the cursor to move in the display area according to the target moving distance.

In a third aspect, a cursor control device is provided, including:

a processor and a memory storing computer program instructions;

When the processor executes the computer program instructions, the cursor control method provided by the first aspect or any optional implementation manner of the first aspect is implemented.

A fourth aspect provides a computer storage medium, where computer program instructions are stored on the computer storage medium, and when the computer program instructions are executed by a processor, the cursor control method provided by the first aspect or any optional implementation manner of the first aspect is implemented .

The cursor control method, device, device, and medium of the embodiments of the present application can determine the movement distance ratio of the gesture and the cursor according to the movement speed of the gesture, the reference movement range of the gesture, and the size of the display area, and determine the movement distance ratio of the gesture and the cursor according to the movement distance ratio and the first movement distance. Distance, to determine the target moving distance of the cursor in the display area. Since the movement speed of the gesture, the reference movement range of the gesture, the first movement distance and other factors can affect the movement distance of the cursor, it is possible to control the movement of the cursor according to the movement speed of the gesture, the reference movement range of the gesture and the first movement distance, and improve the accuracy of the cursor movement. control accuracy.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that need to be used in the embodiments of the present application. For those of ordinary skill in the art, without creative work, the Additional drawings can be obtained from these drawings.

Fig. 1 is a scene schematic diagram of a related cursor control technology;

FIG. 2 is a schematic diagram of a scenario of a cursor control solution provided by an embodiment of the present application;

3 is a schematic flowchart of a cursor control method provided by the first embodiment of the present application;

4 is a flowchart of another cursor control method provided by the first embodiment of the present application;

5 is a schematic diagram of an exemplary interpolation position point provided by an embodiment of the present application;

6 is a schematic flowchart of another cursor control method provided by the first embodiment of the present application;

FIG. 7 is a specific flowchart of another cursor control method provided by the first embodiment of the present application;

8 is a schematic diagram of a cursor control scheme provided by an embodiment of the present application when a video frame containing a gesture is not received;

FIG. 9 is a flowchart of still another cursor control method provided by the first embodiment of the present application;

FIG. 10 is a schematic structural diagram of a cursor control device provided by an embodiment of the present application;

FIG. 11 is a schematic structural diagram of a cursor control device provided by an embodiment of the present application.

Detailed ways

The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, but not to limit the present application. It will be apparent to those skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely to provide a better understanding of the present application by illustrating examples of the present application.

It should be noted that, in this document, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion such that a process, method, article or device comprising a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element defined by the phrase "comprises" does not preclude the presence of additional identical elements in a process, method, article, or device that includes the element.

With the rapid development of human-computer interaction technology, people can use gestures to control interactive terminals at this stage. The interactive terminal can acquire a video containing gestures through the image acquisition device, and track the movement trajectory of the gesture in the video. The virtual cursor on the display screen of the interactive terminal is controlled to move by using the gesture movement trajectory obtained by the tracking.

In a related art, during the cursor control process, the actual moving distance of the gesture can be scaled by a fixed ratio to obtain the target moving distance of the cursor. For ease of understanding, FIG. 1 is a schematic diagram of a scene related to a cursor control technology. Figure 1 shows an interactive terminal 10, and a cursor 11 on the interactive terminal. The gesture trajectory of the user in the time period t1 to t6 is shown as the curve 21 . The time period t1 to t6 can be specifically divided into the following five sub-time periods with the same time interval: sub-time period t1-t2, sub-time period t2-t3, sub-time period t3-t4, sub-time period t4-t5 and Sub-period t5-t6.

Specifically, after the interactive terminal 10 scales the actual moving distance of the gesture by a fixed ratio, a cursor movement track as shown in the curve 22 is obtained, and the cursor is controlled to move along the track 22 . As can be seen from FIG. 1 , the gesture movement trace 21 is similar to the cursor movement trace 22 , and the cursor movement trace 22 can be regarded as an equal reduction of the gesture movement trace 21 .

In this control method, only the actual movement distance of the gesture is used as the only basis for the cursor movement control, and the factors to be considered are relatively simple. Accordingly, the control accuracy of the cursor needs to be improved.

Therefore, there is a need for a technical solution that can improve the accurate control of the cursor.

The applicant found through research that, in the above-mentioned related scheme, since the ratio of the movement distance between the gesture and the cursor is always fixed, the control accuracy of the cursor in the related scheme is always consistent, and correspondingly, the control accuracy of the cursor is relatively low. In the actual process, the user sometimes wishes to perform a coarse control over the cursor, and sometimes wishes to perform a finer control over the cursor. For example, when the user wishes to quickly move the cursor from a certain position on the screen to another position, he wishes to perform coarse control over the cursor. And, when the user wants to move little by little from one location to another, he wants fine control over the cursor.

Based on this, the embodiments of the present application provide a cursor control method, apparatus, device, and medium, which can be applied to an application scenario in which an interactive terminal is controlled by using human gestures. Exemplarily, it can be specifically applied to a specific application scenario in which a human gesture is used to control a cursor on an interactive terminal such as an electronic whiteboard, a video display stand, and a liquid crystal writing screen to move. Compared with the above-mentioned related technologies, the technical solutions of the embodiments of the present application can use factors such as the first movement distance of the gesture, the movement speed of the gesture, and the reference movement range of the gesture to control the cursor, thereby improving the control accuracy of the cursor.

For ease of understanding, before introducing the cursor control solution provided by the embodiment of the present application, an application scenario of the cursor control method of the embodiment of the present application will be described with reference to FIG. 2 .

FIG. 2 is a schematic diagram of a scenario of a cursor control solution provided by an embodiment of the present application. As shown in FIG. 2 , when the user makes the gesture trajectory 21 in the time period t1 to t6 , the gesture trajectory 21 and the cursor movement trajectory 23 are not completely similar.

Comparing Figure 1 and Figure 2, the following differences can be found: (1) In the sub-time period t1-t2, the gesture moves slowly, and the actual movement distance of the control cursor between t1-t2 in the related scheme shown in Figure 1 In comparison, in the solution of the embodiment of the present application, the actual moving distance of the control cursor within t1-t2 is shorter. (2) In the sub-time period t2-t3, the gesture moves faster. Compared with the actual moving distance of the control cursor between t2-t3 in the related scheme shown in FIG. The actual moving distance between t2-t3 is longer.

After a preliminary understanding of the cursor control solution provided by the embodiment of the present application is obtained through the application scenario of the embodiment of the present application shown in FIG. 2 , the following part of the embodiment of the present application will firstly describe the cursor control method provided by the embodiment of the present application. Introduce.

FIG. 3 is a schematic flowchart of a cursor control method provided by the first embodiment of the present application. As shown in FIG. 3 , the cursor control method 300 includes S310 to S350.

S310, acquiring the video of the gesture and the size of the display area of the interactive terminal.

First, for the gesture in S310, it is the gesture of the target object to manipulate the interactive terminal. The gesture may refer to a gesture of the target terminal's hand. It should be noted that, the gestures in the embodiments of the present application may be a gesture of making a fist, a gesture of extending five fingers, an OK gesture, a V-shaped gesture, etc., and the specific actions of the gesture are not limited. The target objects may refer to users with interactive terminal control capabilities, and may specifically include different user groups such as the elderly, children, and adults.

Secondly, for the video in S310, it may be a video obtained by tracking the hand of the target object, which may include multiple video frames. Specifically, the video in S310 may be obtained by tracking a complete gesture, or may be obtained by tracking multiple gestures, which is not limited. Exemplarily, when the user is waving his hand, he can track his hand to obtain one or more videos.

Thirdly, for the display area size of the interactive terminal, it is used to indicate the size of the display area. Exemplarily, it can be represented by the resolution res of the display screen of the interactive terminal. For example res=1600×1200.

In some embodiments, in order to improve the efficiency of image processing, after the video frames of the video are acquired, the video frames may be preprocessed. Exemplarily, the preprocessing may include at least one of the following: image scaling processing, image enhancement processing, and the like. Wherein, if the image scaling processing is performed on the video frames, the resolution difference between the video frames can be reduced. If image enhancement processing is performed on the video frame, the blur can be removed and the clarity of the video frame can be improved.

In some embodiments, after acquiring the video, in order to facilitate subsequent processing, after S310, the position of the gesture in each video frame of the video may also be determined. Specifically, each video frame of the video can be input into the gesture tracking model to obtain the position of the gesture in each video frame. Illustratively, the gesture tracking model may be a deep neural network model. In an optional embodiment, after the motion trajectory of the hand is determined by the gesture tracking model, the obtained motion trajectory of the hand may be smoothed. Specifically, it can be smoothed using filtering technology.

S320: Obtain the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video.

First, the meanings of the movement speed of the gesture and the first movement distance are specifically described as follows.

Exemplarily, the movement speed Vi of the gesture can be expressed as

And, in order to facilitate the control of the cursor, the first moving distance ΔL _i can be represented by a component in the X direction and a component in the Y direction, such as (ΔXi, ΔYi). It should be noted that it can also be represented in other forms according to specific scenarios and actual conditions, for example, for a circular screen, it can be represented in the form of polar coordinates, which is not limited.

In some embodiments, the movement speed Vi of the gesture may be the movement speed between the first position (Xi, Yi) and the second position (Xj, Yj). Accordingly, the first movement distance may represent the movement distance of the gesture between the first position and the second position.

Exemplarily, the first position may be the position of the gesture in a certain video frame of the video, and the second position may be the position of the gesture in another video frame of the video. Exemplarily, if the video includes N video frames, i and j may be any positive integers less than or equal to N.

In one example, in order to facilitate fine-grained control of the cursor, the first position and the second position may be the positions of the gesture in two adjacent video frames. For example, if the first position of the gesture in the fourth video frame is (X4, Y4), the second position of the gesture in the fifth video frame is (X5, Y5).

Next, after introducing the meanings of the moving speed Vi and the first moving distance ΔL _i , the following parts of the embodiments of the present application will specifically describe the specific calculation methods of the moving speed and the first moving distance ΔL _i .

For the first moving distance ΔL _i can be expressed as (ΔXi, ΔYi), where the two components can each satisfy formula (1):

For the moving speed Vi, it is discussed in two cases as follows:

The first case: if the first position and the second position are the positions of the gesture in two adjacent video frames, the movement speed of the gesture at the first position can be determined, and the speed is determined as the position of the gesture at the first position and the second position. The speed of movement between the second positions. At this time, j=i+1.

Exemplarily, if the first position is the position of the gesture in the ith video frame, use at least one video frame before the ith video frame and at least one video frame after the ith video frame to determine that the gesture is in the ith video frame. The moving speed in the ith video frame, and determining the moving speed as the moving speed of the gesture between the first position and the second position.

As a specific example, the position (X _im , Y _im ) of the gesture in the ith video frame and the position (X _i+m , Y _i+m ) of the gesture in the i+m th video frame can be used, Determines the movement speed of the gesture in the ith video frame. Among them, m can be any positive integer, for example, m can be equal to 1. It should be noted that i+m should be guaranteed to be less than or equal to the total number of image frames of the video, and im should be greater than or equal to 1.

Specifically, the moving speed Vi can be expressed as

The two components can each be expressed as Equation (2):

It should be noted that, in order to improve the calculation accuracy of calculating the moving speed, at least three video frames may be used to calculate the moving speed. For example, you can use the position of the gesture on the i-1th video frame and the position of the gesture on the i+1th video frame to calculate a speed value; then use the position of the gesture on the i-2th video frame and the position of the gesture on the i+2 th video frame, calculate a speed value, and then use the average of the two speed values as the movement speed of the gesture in the ith video frame.

(2) If the first position and the second position are the positions of the gesture in two non-adjacent video frames, the movement can be determined according to the position of the gesture in all video frames between the two non-adjacent video frames speed.

Specifically, the movement speed of the gesture in any two adjacent video frames between the two non-adjacent video frames can be calculated, and the average value of the obtained multiple moving speeds can be calculated, and the average value of the multiple speeds can be used as the gesture. The speed of movement between the two non-adjacent video frames.

Exemplarily, if the first position is the position of the gesture in the third video frame, and the second position is the position of the gesture in the fifth video frame, it can be determined that the gesture is between the third video frame and the fourth video frame. The movement speed V1, and the movement speed V2 of the gesture between the 4th video frame and the 5th video frame, and then the average value of V1 and V2 is determined as the movement speed of the gesture between the 3rd video frame and the 5th video frame. It should be noted that, for the specific implementation manner of calculating the movement speed of the gesture in any two adjacent video frames, reference may be made to the relevant description of the previous embodiment, which will not be repeated here.

S330 , according to the movement speed Vi, the reference movement range Span0 corresponding to the gesture, and the size of the display area Res, determine the movement distance ratio rate of the gesture and the cursor.

First, for the reference movement range Span0 corresponding to the gesture, it is a reference value of the movement range of the gesture. Exemplarily, considering the arm movement range of the human body, the gesture reference movement range may be between 0.4m and 1.6m.

In some embodiments, the reference movement magnitude Span0 corresponding to the gesture is related to the target object. For objects in the same group, the reference movement range Span0 of all gestures is the same. For different groups of objects, the reference movement range of the same gesture is different.

In a specific embodiment, the objects may be grouped according to age groups, such as children and adults. For example, for Child A and Child B, the reference amplitude values of their gestures are both 0.4m. For adults C and D, the reference amplitude values of their gestures are both 1.5m. In another specific embodiment, the objects may be grouped according to body size, such as tall users and short users. For example, gesture 1 of tall user E and gesture 1 of short user F have different reference movement ranges. The reference amplitude value of the gesture of the tall user E is 1.6 m, and the reference amplitude value of the gesture of the short user F is both 1.2 m.

Secondly, for the movement distance ratio rate of the gesture and the cursor, it is affected by parameters such as the movement speed Vi and the reference movement range Span0 corresponding to the gesture. Specifically, the larger the value of the movement speed Vi of the gesture, the larger the value of the ratio rate. The smaller the reference movement range Span0 corresponding to the gesture, the larger the value of rate.

In some embodiments, considering the rationality, the embodiments of the present application set certain boundary conditions for the relationship between the movement speed Vi of the gesture and the movement distance ratio rate. That is, when the movement speed Vi of the gesture is less than the preset speed threshold Vu, the movement distance ratio rate increases as the movement speed Vi increases. When the movement speed Vi of the gesture is greater than or equal to the preset speed threshold Vu, as the movement speed Vi increases, the movement distance ratio rate remains unchanged. The preset speed threshold Vu may be set according to specific scenarios and actual needs, for example, may be any value between 2-5 m/s, which is not limited.

S340: Determine the target moving distance of the cursor according to the moving distance ratio and the first moving distance.

First, for the target moving distance Δli of the cursor, it is the moving distance of the cursor in the display area. Specifically, for the specific content of the target moving distance, reference may be made to the relevant description of the first moving distance, which will not be repeated here.

In some embodiments, the target moving distance Δli of the cursor can be expressed as (Δxi, Δyi), which can satisfy formula (3):

S350, control the cursor to move in the display area according to the target moving distance Δli.

That is, the control cursor moves from the position at the previous moment in the display area by a distance Δxi in the X direction and a distance Δyi in the Y direction.

In the cursor control method of the embodiment of the present application, the ratio of the movement distance between the gesture and the cursor can be determined according to the movement speed of the gesture, the reference movement range of the gesture, and the size of the display area, and according to the ratio of the movement distance and the first movement distance, it can be determined that the cursor is displayed on the display. The distance the target moves within the area. Since the movement speed of the gesture, the reference movement range of the gesture, the first movement distance and other factors can affect the movement distance of the cursor, it is possible to control the movement of the cursor according to the movement speed of the gesture, the reference movement range of the gesture and the first movement distance, and improve the accuracy of the cursor movement. control accuracy.

In some embodiments, in S330, the first movement range Span1 of the gesture may be determined according to the movement speed Vi and the reference movement range Span0. Then, the moving distance ratio rate is determined according to the ratio of the screen size Res to the first moving range Span1.

The above-mentioned embodiment of determining the moving distance ratio rate according to the first moving range Span1 will be described in detail below with reference to FIG. 4 .

FIG. 4 is a flowchart of another cursor control method provided by the first embodiment of the present application. The difference between FIG. 4 and FIG. 3 is that step S330 in FIG. 3 is specifically refined into steps S331 to S333 in FIG. 4 .

S331: Obtain a first coefficient α corresponding to the moving speed Vi.

In some embodiments, the first coefficient α is inversely related to the movement speed Vi. That is, the first coefficient α decreases as the moving speed Vi increases.

In other embodiments, considering the rationality of control, a certain boundary is set for the relationship between the two. That is, when the moving speed Vi is less than the preset speed threshold Vu, the first coefficient α is negatively correlated with the moving speed Vi. When the moving speed Vi is greater than or equal to the preset speed threshold Vu, the first coefficient α is a fixed value. Specifically, when the moving speed Vi is less than the preset speed threshold Vu, the first coefficient α may decrease proportionally with the increase of the moving speed Vi, or may decrease according to the cosine variation law. The following will be divided into two examples, and the specific relationship between the first coefficient α and the moving speed Vi will be described in detail.

In one example, when the moving speed Vi is less than the preset speed threshold Vu, the first coefficient decreases proportionally as the moving speed increases.

Illustratively, the first coefficient α can be expressed as formula (4):

Among them, λ is a proportional coefficient, and its value range can be between 0 and 1, and its specific value can be set according to specific scenarios and actual needs, which is not limited.

In another example, when the moving speed Vi is less than the preset speed threshold Vu, the first coefficient decreases according to a cosine variation law as the moving speed increases.

Illustratively, the first coefficient α can be expressed as formula (5):

In a specific application scenario, an appropriate first coefficient α calculation formula can be selected according to the moving habit of the target object. For example, if the moving speed of the target object is relatively average, formula (4) is selected to calculate the first coefficient α. If the moving speed of the target object is relatively two-level, that is, whether it is moving at a high speed or moving at a low speed, formula (5) is selected to calculate the first coefficient α. It should be noted that when formula (5) is selected, since the first coefficient changes in a cosine law, when the moving speed is too fast or too slow, the change of the first coefficient is relatively stable, which improves the control stability.

Exemplarily, the historical movement speed data of the target user can be used to determine whether the user's speed is relatively average. For example, the moving speed of other gestures that the user has performed in the user history video may be used. Alternatively, it can be determined whether the speed of the user is average according to the moving speed of the gesture in the same video in the previous multiple frames of video.

Exemplarily, parameters such as variance and mean square error of historical moving speed data may be calculated to determine whether the user's moving speed is average. For example, if the variance is greater than the preset variance threshold, it is determined that the speed is divided into two levels, and if it is less than the preset variance threshold, it is determined that the speed is relatively average.

S332: Determine the first movement range Span1 of the gesture according to the product of the first coefficient α and the reference movement range Span0.

Exemplarily, the first movement range Span1 of the gesture can be expressed as formula (6):

Span1=Span0*α (6)

The first coefficient α may be expressed as the above formula (5) or the above formula (6), which will not be repeated here.

In some embodiments, in order to improve the rationality of the control, the reference movement range Span0 may be determined according to the body shape of the target object. At this time, before S332, the cursor control method may further include steps A and B of determining the reference movement amplitude Span0.

Step A, acquiring the body shape information H1 of the target object. The body shape information represents information that can reflect the body shape of the target object, for example, height information and/or width information. Exemplarily, the body type information H1 may be the height of a person.

Step B: Determine the reference movement width Span0 corresponding to the body shape information H1. Among them, the relationship between the body shape information H1 and the reference movement range Span0 can be set according to specific scenarios and actual needs, and there is a positive correlation between the two. For example, the reference movement width Span0 increases as the body type information H1 increases. For another example, when the body shape information H1 falls within a certain value range, the reference movement width Span0 corresponding to the value range is used as the reference movement width Span0 corresponding to the body shape information H1 .

In this embodiment, different reference movement amplitudes are set for target objects with different heights. A small distance of movement of a short or slender object such as a child, and a larger distance of a tall or wide object such as an adult male, can control the cursor to move the same distance. Short or slender users don't need to perform the same gesture multiple times when moving the cursor in a wide range. Shorter or slender users can move the cursor at a smaller distance, improving fine-grained control of the cursor.

S333: Determine the moving distance ratio rate according to the ratio of the display area size res to the first moving range Span1.

Exemplarily, the moving distance ratio rate can be expressed as formula (7):

rate=res/Span1 (7)

In some embodiments, if the first movement distance is calculated only by the position of the gesture on the video frame, and then the cursor movement is controlled, the target movement distance of the cursor is related to the movement distance of the gesture between two video frames. If the sampling interval of the video frames is large, for example, the sampling interval is 30 frames/second or 15 frames/second, or if the gesture moves fast, it will cause the gesture to move more between two adjacent video frames. Correspondingly, As the cursor moves, it moves one large distance at a time. Visually, the user feels that the movement of the cursor is not coherent, but there is a certain delay, which affects the visual experience.

In order to improve the visual experience, M interpolation position points of the gesture may be inserted between the video frames by means of interpolation. At this time, through the video, N+M positions of the gesture can be acquired in total. Specifically, it includes the position of the gesture in N video frames, and the position of the gesture in M interpolation position points. Wherein, M can be any positive integer, and the value of M can be set according to specific scenarios and actual requirements, which is not limited.

Compared with the original N positions, the distances between the N+M positions are reduced, and the target moving distance of each cursor movement is also reduced accordingly, thereby improving the visual experience and improving the cursor control accuracy.

In one embodiment, the position corresponding to the gesture at the interpolation moment may be estimated, so that multiple interpolation positions are inserted between video frames. For example, k interpolation positions may be inserted at equal time intervals Δt between two adjacent video frames. Specifically, if the sampling times of any two adjacent video frames are T and T+ΔT respectively, and if an interpolation position point is inserted every interval Δt, the time t corresponding to the k interpolation position points is T+Δt, T respectively +2Δt, ..., T+kΔt. Among them, ΔT represents the sampling interval between two adjacent video frames, ΔT/Δt=k+1. That is to say, the position of the gesture in any two adjacent video frames respectively represents the position of the gesture at time T and the position of the gesture at time T+ΔT, correspondingly, the k interpolation position points respectively represent the position of the gesture at time T+ΔT. The position at time T+Δt, time T+2Δt, ..., time T+kΔt. where k is any positive integer. Illustratively, the time interval Δt may be 1/50 second.

In order to facilitate the intuitive representation of the interpolation position point, FIG. 5 is a schematic diagram of an exemplary interpolation position point provided by an embodiment of the present application. As shown in FIG. 5 , between the i-th video frame and the i+1-th video frame, 7 interpolation position points can be inserted. Specifically, if the position of the gesture in the i-th video frame is Ai, and the position in the i+1-th video frame is Ai+1, the seven interpolation position points can be represented as Bi1 to Bi7 respectively. If the curve between Ai and Ai+1 represents the motion trajectory of the gesture from the sampling time Ti of the i-th video frame to the sampling time Ti+ΔT of the i+1-th video frame, then the n-th interpolation position point is Ti The estimated gesture position at time +nΔt. where n is any integer between 1 and 7.

In some embodiments, after the interpolation position point is inserted, the first movement distance ΔL _i may be divided into k+1 sub-distances, that is to say, the first movement distance ΔL _i includes k gesture movement sub-distances ΔL _i1 to ΔL _{i (k+1)} . Wherein, each gesture movement sub-distance is the movement distance of the gesture between two adjacent moments. Continue to refer to FIG. 5 , if the first moving distance is the distance between Ai and Ai+1, then the first moving distance can be subdivided into 8 sub-distances, which are the sub-distances between Ai and Bi1 and between Bi1 and Bi2 The sub-distance of , ..., the sub-distance between Bi7 and Ai+1.

Correspondingly, the target movement distance includes: k+1 cursor movement sub-distances corresponding to the k+1 gesture movement sub-distances one-to-one respectively. The ratio between any cursor movement sub-distance and its corresponding gesture movement sub-distance is equal to the movement distance ratio rate.

Specifically, a specific implementation of acquiring the moving sub-distance is described in detail below with reference to FIG. 6 . FIG. 6 is a schematic flowchart of another cursor control method provided by the first embodiment of the present application. The difference between FIG. 6 and FIG. 3 is that the step S340 of determining the gesture movement distance in FIG. 3 is specifically refined into steps S341 to S343 in FIG. 6 .

S341 , acquiring the respective acquisition moments of at least two video frames.

Exemplarily, taking two adjacent video frames as an example, the acquisition moment of the i-th video frame is Ti, and the acquisition moment of the i+1-th video frame is Ti+ΔT.

S342, between the respective acquisition moments of the at least two video frames, determine a plurality of first moments.

Exemplarily, if k interpolation position points are inserted, their respective first time points are respectively T+Δt time, T+2Δt time, ..., T+kΔt time.

S343 , according to the positions of the gesture in at least three video frames of the video, determine the gesture movement sub-distance between each two adjacent first moments, and obtain a plurality of gesture movement sub-distances.

The at least three video frames include at least two video frames in S341.

In some embodiments, FIG. 7 is a specific flowchart of another cursor control method provided by the first embodiment of the present application. As shown in FIG. 7 , S343 may be specifically implemented as S3431 to S3433.

S3431: Calculate the movement speed v of the gesture based on the position of the gesture in at least two video frames.

For the specific implementation manner of calculating the movement speed of the gesture in S3431, reference may be made to the relevant description of the calculation of the movement speed in S320 in the embodiment of the present application, and details are not repeated here. Exemplarily, the movement speed of the gesture can be represented as (v _X , v _Y ).

In one embodiment, if multiple interpolation position points are inserted between two adjacent video frames, the movement speed of the previous video frame in the adjacent two video frames can be determined as the movement calculated in S3431 speed.

Exemplarily, if multiple interpolation position points are inserted between the i-th video frame and the i+1-th video frame, then according to the position of the gesture in the i-1-th video frame and the gesture in the i+1-th frame The position of the video frame, and the movement speed of the gesture in the ith video frame is calculated.

S3432: Calculate the movement acceleration a of the gesture based on the position of the gesture in at least three video frames.

In one embodiment, if multiple interpolation position points are inserted between two adjacent video frames, the movement acceleration a of the gesture can be calculated according to the adjacent video frame and the video frame preceding the adjacent video frame. where a can be represented as (ax, aY).

Exemplarily, if multiple interpolation position points are inserted between the i-th video frame and the i+1-th video frame, then according to the position of the gesture in the i-1-th video frame, the gesture is in the i-th video frame. The position of the gesture and the position of the gesture in the i+1th video frame, calculate the movement acceleration of the gesture in the i-th video frame.

Specifically, the calculation formula of the movement acceleration a of the gesture may include formula (8):

S3433, according to the movement speed v, the movement acceleration a, and the position of the gesture in any one of the at least two video frames, determine the gesture movement sub-distance between every two adjacent first moments, and obtain a plurality of gesture movements sub-distance.

Continue to take the example of inserting a plurality of interpolation position points between the i-th video frame and the i+1-th video frame, where the position of the p-th interpolation position point is (Xp, Yp).

Specifically, the calculation formula of the position (Xp, Yp) of the p-th interpolation position point may include formula (9):

where p can be any positive integer not greater than k.

Then, the position difference of every two adjacent interpolation position points is used as a moving sub-distance.

In the actual process, there are at least the following two situations: 1. One or part of the time frame of the video frame is lost. For example, after the i-th video frame is acquired and after the preset time period Ta, the i-th video frame is not received. +1 video frame. Wherein, the preset time period Ta is greater than or equal to the sampling interval ΔT. 2. After the preset time period Ta, a video frame is received, but the hand position cannot be determined in the video frame.

In consideration of the above situation, the applicant also provides a solution capable of performing cursor control without receiving a video frame containing a gesture.

In order to understand the solution intuitively, FIG. 8 is a schematic diagram of a cursor control solution provided by an embodiment of the present application in a case where a video frame containing a gesture is not received. As shown in Figure 8, after receiving the i-th video frame and the i+1-th video frame, if the i+2-th video frame is lost, it is possible to predict Estimate the position of the gesture in the i+2th video frame.

The following parts of the embodiments of the present application will specifically describe the specific implementation of the solution for cursor control in the case of not receiving a video frame including a gesture.

FIG. 9 is a flowchart of still another cursor control method provided by the first embodiment of the present application. The difference between FIG. 9 and FIG. 3 is that step S360 is further included before step S320.

S360, in the process of acquiring the multi-frame video frames of the video, if the first video frame containing the gesture is not received within the preset time period, determine that the gesture is in the first video frame based on the position of the gesture in the second video frame s position.

It should be noted that, for the specific manner of how to estimate the position of the gesture in the first video frame, reference may be made to the relevant description of how to obtain multiple gesture movement sub-distances in conjunction with S3431 to S3433 in the above embodiments of the present application.

It should be noted that the first video frame can be regarded as the k+2 th insertion position point (the i+1 th video frame is regarded as the k+1 th insertion position point) and substituted into formula (9) to calculate the gesture at the th position within a video frame.

Specifically, the calculation formula of the position (Xi+2, Yi+2) of the gesture in the first video frame may include formula (10):

Based on the same application concept, the embodiments of the present application not only provide a cursor control method, but also provide a cursor control device corresponding thereto.

The cursor control apparatus according to the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

FIG. 10 is a schematic structural diagram of a cursor control apparatus provided by an embodiment of the present application. As shown in FIG. 10 , the cursor control apparatus 1000 includes a first acquisition module 1010 , a first processing module 1020 , a second processing module 1030 , a third processing module 1040 and a cursor control module 1050 .

The first acquiring module 1010 is configured to acquire the video of the gesture and the size of the display area of the interactive terminal, and the gesture is a gesture by which the target object manipulates the interactive terminal.

The first processing module 1020 is configured to obtain the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video.

The second processing module 1030 is configured to determine the ratio of the movement distance between the gesture and the cursor according to the movement speed, the reference movement range corresponding to the gesture, and the size of the display area.

The reference movement range is a reference value of the movement range of the gesture.

The third processing module 1040 is configured to determine the target moving distance of the cursor according to the moving distance ratio and the first moving distance.

The cursor control module 1050 is configured to control the cursor to move in the display area according to the target moving distance.

The cursor control device of the embodiment of the present application can determine the ratio of the movement distance between the gesture and the cursor according to the movement speed of the gesture, the reference movement range of the gesture, and the size of the display area, and determine whether the cursor is displayed on the display according to the ratio of the movement distance and the first movement distance. The distance the target moves within the area. Since the movement speed of the gesture, the reference movement range of the gesture, the first movement distance and other factors can affect the movement distance of the cursor, it is possible to control the movement of the cursor according to the movement speed of the gesture, the reference movement range of the gesture and the first movement distance, and improve the accuracy of the cursor movement. control accuracy.

In some embodiments, the second processing module 730 specifically includes a first obtaining unit, a first processing unit and a second processing unit.

a first obtaining unit for obtaining a first coefficient corresponding to the moving speed;

a first processing unit, configured to determine the first movement range of the gesture according to the product of the first coefficient and the reference movement range;

The second processing unit is configured to determine the moving distance ratio according to the ratio of the size of the display area to the first moving amplitude.

In some embodiments, the first coefficient is negatively correlated with the movement speed when the movement speed is less than a preset speed threshold.

In some embodiments, the first coefficient is negatively related to movement speed, including:

In some embodiments, the first movement distance includes a plurality of gesture movement sub-distances, wherein each gesture movement sub-distance is a movement distance of the gesture between two adjacent moments.

In some embodiments, the first processing module 720 specifically includes: a second obtaining unit, a third processing unit and a fourth processing unit.

The second acquiring unit is configured to acquire the respective acquisition moments of the at least two video frames.

The third processing unit is configured to determine a plurality of first moments between the respective acquisition moments of the at least two video frames.

The fourth processing unit is configured to determine the gesture movement sub-distance between every two adjacent first moments according to the position of the gesture in at least three video frames of the video, and obtain a plurality of gesture movement sub-distances.

Wherein, the at least three video frames include at least two video frames.

In some embodiments, a gesture movement sub-distance between every two adjacent first moments is determined according to the position of the gesture in at least three video frames, and a plurality of gesture movement sub-distances are obtained, which specifically includes:

In some embodiments, the cursor control apparatus 1000 further includes a fourth processing module.

The fourth processing module is used for, in the process of acquiring the multi-frame video frames of the video, if the first video frame containing the gesture is not received within the preset time period, based on the position of the gesture in the second video frame, determine that the gesture is in the first video frame. position within a video frame.

In some embodiments, the reference movement magnitude is related to the target object, and the cursor control apparatus 1000 further includes a second acquiring module and a fifth processing module.

The second acquiring module is used for acquiring the body shape information of the target object.

The fifth processing module is used for determining the reference movement amplitude corresponding to the body shape information.

Other details of the cursor control apparatus according to the embodiments of the present application are similar to the cursor control methods described above with reference to the examples shown in FIG. 1 to FIG. 9 , and can achieve its corresponding technical effects.

FIG. 11 shows a schematic diagram of a hardware structure of a cursor control device provided by an embodiment of the present application.

The cursor control device may include a processor 1101 and a memory 1102 storing computer program instructions.

Specifically, the above-mentioned processor 1101 may include a central processing unit (CPU), or a specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

Memory 1102 may include mass storage for data or instructions. By way of example and not limitation, memory 1102 may include a Hard Disk Drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (USB) drive or two or more A combination of more than one of the above. Memory 1102 may include removable or non-removable (or fixed) media, where appropriate. Where appropriate, memory 1102 may be internal or external to the cursor control device. In certain embodiments, memory 1102 is non-volatile solid state memory.

Memory may include read only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical/tangible memory storage devices. Thus, typically, a memory includes one or more tangible (non-transitory) computer-readable storage media (eg, memory devices) encoded with software including computer-executable instructions, and when the software is executed (eg, by a or multiple processors), it is operable to perform the operations described with reference to a method according to an aspect of the present disclosure.

The processor 1101 reads and executes the computer program instructions stored in the memory 1102 to implement any one of the cursor control methods in the foregoing embodiments.

In one example, the cursor control device may also include a communication interface 1103 and a bus 1110 . Among them, as shown in FIG. 11 , the processor 1101 , the memory 1102 , and the communication interface 1103 are connected through the bus 1110 and complete the mutual communication.

The communication interface 1103 is mainly used to implement communication between modules, apparatuses, units and/or devices in the embodiments of the present application.

The bus 1110 includes hardware, software, or both, coupling the components of the online data flow metering device to each other. By way of example and not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), HyperTransport (HT) Interconnect, Industry Standard Architecture (ISA) Bus, Infiniband Interconnect, Low Pin Count (LPC) Bus, Memory Bus, Microchannel Architecture (MCA) Bus, Peripheral Component Interconnect (PCI) Bus, PCI-Express (PCI-X) Bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or a combination of two or more of the above. Bus 310 may include one or more buses, where appropriate. Although embodiments of this application describe and illustrate a particular bus, this application contemplates any suitable bus or interconnect.

The cursor control device may execute the cursor control method in the embodiments of the present application, thereby implementing the cursor control method and apparatus described in conjunction with FIG. 1 to FIG. 10 .

In addition, in combination with the cursor control method in the foregoing embodiment, the embodiment of the present application may provide a computer storage medium for implementation. Computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by the processor, any one of the cursor control methods in the foregoing embodiments is implemented.

To be clear, the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above-described embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the sequence of steps after comprehending the spirit of the present application.

The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, elements of the present application are programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted over a transmission medium or communication link by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transmit information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, and the like. The code segments may be downloaded via a computer network such as the Internet, an intranet, or the like.

It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above steps, that is, the steps may be performed in the order mentioned in the embodiment, or may be different from the order in the embodiment, or several steps may be performed simultaneously.

Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus, devices, and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine such that execution of the instructions via the processor of the computer or other programmable data processing apparatus enables the Implementation of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. Such processors may be, but are not limited to, general purpose processors, special purpose processors, application specific processors, or field programmable logic circuits. It will also be understood that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can also be implemented by special purpose hardware that performs the specified functions or actions, or that special purpose hardware and/or A combination of computer instructions is implemented.

The above are only specific implementations of the present application. Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the above-described systems, modules and units may refer to the foregoing method embodiments. The corresponding process in , will not be repeated here. It should be understood that the protection scope of this application is not limited to this, and any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should all cover within the scope of protection of this application.

Claims

A cursor control method, comprising:

acquiring the video of the gesture and the size of the display area of the interactive terminal, the gesture being a gesture by the target object to manipulate the interactive terminal;

obtaining the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video;

The ratio of the movement distance between the gesture and the cursor is determined according to the movement speed, the reference movement range corresponding to the gesture, and the size of the display area, where the reference movement range is a reference for the movement range of the gesture value;

Determine the target moving distance of the cursor according to the moving distance ratio and the first moving distance;

The cursor is controlled to move in the display area according to the moving distance of the target.
The method according to claim 1, wherein the determining the ratio of the moving distance between the gesture and the cursor according to the movement speed, the reference movement range corresponding to the gesture, and the size of the display area, specifically includes:

obtaining a first coefficient corresponding to the moving speed;

determining the first movement range of the gesture according to the product of the first coefficient and the reference movement range;

The moving distance ratio is determined according to the ratio of the size of the display area to the first moving amplitude.
The method of claim 2, wherein,

When the moving speed is less than a preset speed threshold, the first coefficient is negatively correlated with the moving speed;

When the moving speed is greater than or equal to the preset speed threshold, the first coefficient is a fixed value.
The method of claim 3, wherein,

The first coefficient is negatively related to the moving speed, including:

the first coefficient decreases proportionally with the increase of the moving speed;

Alternatively, as the moving speed increases, the first coefficient decreases according to a cosine variation law.
The method of claim 1, wherein,

The first movement distance includes a plurality of gesture movement sub-distances, wherein each gesture movement sub-distance is a movement distance of the gesture between two adjacent moments;

Correspondingly, the target movement distance includes: a plurality of cursor movement sub-distances corresponding to the plurality of gesture movement sub-distances one-to-one respectively.
The method of claim 5, wherein,

The obtaining the first moving distance according to the position of the gesture in at least two video frames of the video specifically includes:

acquiring the respective acquisition moments of the at least two video frames;

between the respective acquisition moments of the at least two video frames, determining a plurality of first moments;

According to the position of the gesture in at least three video frames of the video, determine the gesture movement sub-distance between every two adjacent first moments, and obtain a plurality of the gesture movement sub-distances;

Wherein, the at least three video frames include the at least two video frames.
The method of claim 6, wherein,

According to the position of the gesture in at least three video frames of the video, determining the gesture movement sub-distance between every two adjacent first moments, and obtaining a plurality of the gesture movement sub-distances, specifically including:

calculating the movement speed of the gesture based on the position of the gesture in at least two video frames;

and calculating the movement acceleration of the gesture based on the position of the gesture in the at least three video frames;

According to the movement speed, the movement acceleration, and the position of the gesture in any one of the at least two video frames, determine the gesture movement sub-distance between every two adjacent first moments, and obtain A plurality of the gestures move a sub-distance.
The method of claim 1, wherein,

Before obtaining the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video, the method further includes:

In the process of acquiring multiple video frames of the video, if the first video frame containing the gesture is not received within a preset time period, the gesture is determined based on the position of the gesture in the second video frame the position in the first video frame;

The preset time period is a preset time period starting from receiving the second video frame including the gesture.
The method of claim 1, wherein the reference movement magnitude is related to the target object;

Before determining the ratio of the gesture movement distance to the cursor movement distance according to the movement speed, the reference movement range corresponding to the gesture, and the size of the display area, the method further includes:

obtain the body shape information of the target object;

The reference movement range corresponding to the body size information is determined.
A cursor control device comprising:

a first acquiring module, configured to acquire the video of the gesture and the size of the display area of the interactive terminal, and the gesture is a gesture by the target object to manipulate the interactive terminal;

a first processing module, configured to obtain the movement speed and the first movement distance of the gesture according to the position of the gesture in at least two video frames of the video;

The second processing module is configured to determine the ratio of the movement distance between the gesture and the cursor according to the movement speed, the reference movement range corresponding to the gesture and the size of the display area, wherein the reference movement range is the the reference value of the movement range of the gesture;

a third processing module, configured to determine the target moving distance of the cursor according to the moving distance ratio and the first moving distance;

A cursor control module, configured to control the cursor to move in the display area according to the target moving distance.
A cursor control device comprising: a processor and a memory storing computer program instructions;

When the processor executes the computer program instructions, the cursor control method according to any one of claims 1-9 is implemented.
A computer storage medium, where computer program instructions are stored thereon, and when the computer program instructions are executed by a processor, the cursor control method according to any one of claims 1-9 is implemented.