WO2023216613A1

WO2023216613A1 - Control method, electronic device and computer storage medium

Info

Publication number: WO2023216613A1
Application number: PCT/CN2022/141461
Authority: WO
Inventors: 李雅欣
Original assignee: Oppo广东移动通信有限公司
Priority date: 2022-05-10
Filing date: 2022-12-23
Publication date: 2023-11-16
Also published as: CN114840086B; CN114840086A

Abstract

Embodiments of the present application disclose a control method which is applied to an electronic device. The method comprises: when the non-contact touch control function of the electronic device is enabled, obtaining a video sequence corresponding to the non-contact touch operation; performing touch recognition on the video sequence to obtain a target object and a touch type; determining a first distance between the target object and the electronic device; determining a touch operation parameter under the first distance; and controlling the electronic device to execute a target function corresponding to the touch type according to the touch operation parameter. The embodiments of the present application further provide an electronic device and a computer storage medium.

Description

A control method, electronic device and computer storage medium

Cross-references to related applications

This application is filed based on a Chinese patent application with application number 202210507343.1 and a filing date of May 10, 2022, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference into this application in full. .

Technical field

The present application relates to non-contact touch control technology in electronic equipment, and in particular, to a control method, electronic equipment and computer storage media.

Background technique

At present, with the rapid development of smart phones in recent years, people use mobile phones more and more time and in more scenarios. At present, the mainstream human-computer interaction method is mainly touch operation. On this basis, gesture interaction is a new type of Interaction methods are constantly developing in applications such as driving and dining. Gesture interaction can realize a variety of controls on the page, such as sliding up and down the page, turning pages, taking pictures, taking screenshots, ending recording, etc.

However, when controlling electronic devices through changes in gesture types or changes in other parts of the body, the electronic device can only be controlled to realize its own functions, resulting in insufficient control. It can be seen from this that the existing The non-contact touch control method is not refined enough.

Contents of the invention

The technical solution of this application is implemented as follows:

Embodiments of the present application provide a control method, which is applied to electronic devices and includes:

When the non-contact touch control function of the electronic device is turned on, obtain a video sequence corresponding to the non-contact touch operation;

Perform touch recognition on the video sequence to obtain the target object and touch type;

determining a first distance between the target object and the electronic device;

Determine touch operation parameters at the first distance;

According to the touch operation parameters, the electronic device is controlled to perform a target function corresponding to the touch type.

An embodiment of the present application provides an electronic device, including:

An acquisition module configured to acquire a video sequence corresponding to a non-contact touch operation when the non-contact touch control function of the electronic device is turned on;

A processing module configured to perform touch recognition on the video sequence to obtain the target object and touch type;

a first determination module configured to determine a first distance between the target object and the electronic device;

a second determination module configured to determine touch operation parameters at the first distance;

A control module configured to control the electronic device to perform a target function corresponding to the touch type according to the touch operation parameters.

A processor and a storage medium storing instructions executable by the processor. The storage medium relies on the processor to perform operations through a communication bus. When the instructions are executed by the processor, one or more of the above implementations are performed. The control method described in the example.

Embodiments of the present application provide a computer storage medium that stores executable instructions. When the executable instructions are executed by one or more processors, the processor performs the control described in one or more embodiments. method.

Description of the drawings

Figure 1 is a schematic flowchart of an optional control method provided by an embodiment of the present application;

Figure 2 is a schematic flow chart of a page control method in related technologies;

Figure 3a is a schematic diagram of Example 1 of an optional gesture box provided by the embodiment of the present application;

Figure 3b is a schematic diagram of Example 2 of an optional gesture box provided by the embodiment of the present application;

Figure 3c is a schematic diagram of Example 3 of an optional gesture box provided by the embodiment of the present application;

Figure 3d is a schematic diagram of Example 4 of an optional gesture box provided by the embodiment of the present application;

Figure 4 is a schematic diagram of Example 1 of an optional control method provided by the embodiment of the present application;

Figure 5 is a schematic diagram of Example 2 of an optional control method provided by the embodiment of the present application;

Figure 6a is a schematic diagram of Example 5 of an optional gesture box provided by the embodiment of the present application;

Figure 6b is a schematic diagram of Example 6 of an optional gesture box provided by the embodiment of the present application;

Figure 6c is a schematic diagram of Example 7 of an optional gesture box provided by the embodiment of the present application;

Figure 7a is a schematic layout diagram of Example 1 of an optional screen provided by the embodiment of the present application;

Figure 7b is a schematic layout diagram of Example 2 of an optional screen provided by the embodiment of the present application;

Figure 7c is a schematic layout diagram of Example 3 of an optional screen provided by the embodiment of the present application;

Figure 8 is a schematic structural diagram of an optional electronic device provided by an embodiment of the present application;

FIG. 9 is a schematic structural diagram of another optional electronic device provided by an embodiment of the present application.

Detailed ways

In a first aspect, embodiments of the present application provide a control method, which method is applied to an electronic device and includes:

Determine touch operation parameters at the first distance;

In an optional embodiment, determining the first distance between the target object and the electronic device includes:

Select the boundary information of a target object from the boundary information of the target object in each image frame of the video sequence;

A first distance between the target object and the electronic device is determined according to the selected boundary information of the target object.

In an optional embodiment, when the boundary information is represented by a bounding box, determining the first distance between the target object and the electronic device according to the boundary information of the selected target object includes:

determining a second distance between each boundary of the bounding box and a corresponding edge of the screen of the electronic device;

Determine the target boundary according to the second distance between each boundary and the corresponding edge of the screen;

According to the length value of the target boundary, the first distance between the target object and the electronic device is determined using the relationship between the preset boundary length value and the distance from the target object to the electronic device.

In an optional embodiment, determining the target boundary based on the second distance between each boundary of the bounding box and the corresponding edge of the screen includes:

When the second distance between each boundary and the corresponding edge of the screen is greater than a preset threshold, select one boundary from each boundary;

When only one of the second distances between the boundaries and the corresponding edge of the screen has a second distance less than or equal to the preset threshold, select the The second distance between the corresponding edges of the screen is less than or equal to the boundary of the preset threshold;

The selected boundary is determined as the target boundary.

In an optional embodiment, according to the length value of the target boundary, the target is calculated using the relationship between the preset boundary length value and the distance from the target object to the electronic device. The first distance between the object and the electronic device includes:

When the target boundary is a width boundary, according to the length value of the target boundary, using the relationship between the preset boundary width value and the distance from the target object to the electronic device, the target object and the electronic device are calculated. A first distance between the electronic devices.

When the target boundary is a height boundary, according to the length value of the target boundary, using the relationship between the preset boundary height value and the distance from the target object to the electronic device, the target object and the electronic device are calculated. A first distance between the electronic devices.

Determine the distance between the target object in each image frame and the electronic device according to the boundary information in the target object in each image frame in the video sequence;

The average value of the distances between the target object and the electronic device in each image frame is determined as the first distance between the target object and the electronic device.

In an optional embodiment, the average value of the distance between the target object and the electronic device in each image frame is determined as the distance between the target object and the electronic device. The first distance includes:

When the absolute value of the difference between any two distances between the target object in each image frame and the electronic device is less than or equal to the preset error threshold, the target object in each image frame is The average value of the distances to the electronic device is determined as the first distance between the target object and the electronic device.

In an optional embodiment, the method further includes:

When the absolute value of the difference between any two of the distances between the target object and the electronic device in each image frame has an absolute value greater than the preset error threshold, according to the preset standard The touch operation parameters under the distance control the electronic device to perform the target function corresponding to the touch type.

In an optional embodiment, determining the touch operation parameters at the first distance includes:

Calculate the sensitivity coefficient at the first distance based on the preset corresponding relationship between the distance and the sensitivity coefficient;

Touch operation parameters at the first distance are determined according to the sensitivity coefficient at the first distance.

In an optional embodiment, determining the touch operation parameters at the first distance based on the sensitivity coefficient at the first distance includes:

The touch operation parameters at the first distance are calculated using the sensitivity coefficient at the first distance and the preset touch operation parameters at the standard distance.

In an optional embodiment, performing touch recognition on the video sequence to obtain the target object and touch type includes:

Perform touch recognition on the video sequence to obtain the target object, the bounding box of the target object, and the confidence value of the touch operation of the target object; wherein the bounding box represents boundary information;

The touch type is determined based on the confidence value of the touch operation of the target object.

In an optional embodiment, determining the touch type based on the confidence value of the touch operation of the target object includes:

The type of the touch operation corresponding to the maximum value of the confidence value of the touch operation of the target object is determined as the touch type.

In an optional embodiment, the touch operation parameters include any of the following:

The sliding distance of the sliding operation, the sliding speed of the sliding operation, the page turning speed of the page turning operation, the long pressing time of the long pressing operation and the click frequency of the clicking operation.

In an optional embodiment, controlling the electronic device to perform a target function corresponding to the touch type according to the touch operation parameters includes:

According to the touch operation parameters, control the controlled object of the screen of the electronic device to perform a target function corresponding to the touch type;

Wherein, the controlled objects include any of the following: pages, interfaces and controls.

In an optional embodiment, controlling a controlled object on the screen of the electronic device according to the touch operation parameters to perform a target function corresponding to the touch type includes:

According to the sliding distance of the sliding operation, the page of the screen is controlled to perform the sliding function.

In a second aspect, embodiments of the present application also provide an electronic device, including:

A control module configured to control the electronic device according to the touch operation parameters to perform the target function corresponding to the touch type.

In an optional embodiment, the first determination module is specifically configured to:

In an optional embodiment, when the boundary information is represented by a bounding box, the first determination module determines the first distance between the target object and the electronic device according to the boundary information of the selected target object. Distance includes:

In an optional embodiment, the first determination module determines the target boundary according to the second distance between each boundary of the bounding box and the corresponding edge of the screen, including:

The selected boundary is determined as the target boundary.

In an optional embodiment, the first determination module calculates, based on the length value of the target boundary, using the relationship between the preset boundary length value and the distance from the target object to the electronic device. Obtaining the first distance between the target object and the electronic device includes:

In an optional embodiment, the first determining module determines the first distance between the target object and the electronic device, including:

In an optional embodiment, the first determination module determines the average distance between the target object and the electronic device in each image frame as the value between the target object and the electronic device. The first distance between devices includes:

In an optional embodiment, the electronic device is further configured to:

In an optional embodiment, the second determination module is specifically configured to:

In an optional embodiment, the second determination module determines the touch operation parameters at the first distance according to the sensitivity coefficient at the first distance, including:

In an optional embodiment, the processing module is specifically configured to:

In an optional embodiment, the processing module determines the touch type based on the confidence value of the touch operation of the target object, including:

In an optional embodiment, the control module is specifically configured to:

In an optional embodiment, the control module controls the controlled object on the screen of the electronic device according to the touch operation parameters to perform a target function corresponding to the touch type, including:

In a third aspect, embodiments of the present application also provide an electronic device, including:

In a fourth aspect, embodiments of the present application further provide a computer storage medium that stores executable instructions. When the executable instructions are executed by one or more processors, the processor executes one or more of the above steps. The control method described in the embodiment.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

The embodiment of the present application provides a control method, which is applied to electronic equipment. Figure 1 is a schematic flowchart of an optional control method provided by the embodiment of the present application. As shown in Figure 1, the control method can include:

S101: When the non-contact touch control function of the electronic device is turned on, obtain the video sequence corresponding to the non-contact touch operation;

Figure 2 is a schematic flow chart of a page control method in related technologies. As shown in Figure 2, taking gesture control as an example, the page control method may include:

S201: Turn on the front camera;

S202: Capture pictures;

S203: Continuous gesture detection;

S204: Gesture judgment;

S205: Operation in response to gesture.

Among them, the electronic device turns on the front camera, uses the front camera to capture a picture containing the gesture, and after capturing the picture, continuously detects the gesture in the picture, obtains the gesture, and judges the gesture. After the judgment, the corresponding value of the gesture is obtained. Operation, for example, move up operation, and finally, operation in response to the gesture. However, when using this method, the electronic device can only be controlled to realize its own functions, resulting in insufficient control precision.

In order to improve the refinement of non-contact touch control, embodiments of the present application provide an optional control method. First, when the non-contact touch control function of the electronic device is turned on, that is to say, the electronic device is turned on. Non-contact touch control function. At this time, the front camera of the electronic device is turned on to capture the front of the screen of the electronic device. When the target object is detected through the captured picture, a video sequence is obtained to obtain the non-contact A video sequence corresponding to the touch operation, wherein the video sequence includes multiple consecutive image frames.

The above-mentioned touch operations may include slide-up operations, slide-down operations, long-press operations, page-turning operations, page-turning operations, and click operations. Here, the embodiments of the present application do not specifically limit this.

S102: Perform touch recognition on the video sequence to obtain the target object and touch type;

When obtaining a video sequence of a non-contact touch operation, it is necessary to perform touch recognition on the video sequence, so that the target object and touch type contained in the video sequence can be obtained.

The above-mentioned target objects may be body parts of the human body, such as hands, heads, eyes, etc., which are not specifically limited in the embodiments of the present application.

For the target object, the user can use gestures to control the electronic device to perform the target function corresponding to the touch type corresponding to the gesture, or can use changes in the head, for example, using the left and right shaking of the head to control the electronic device to perform head movements. The target function corresponding to the touch type corresponding to the left and right shaking can also use the changes of the eyes. For example, the blinking action is used to control the electronic device to perform the target function corresponding to the touch type corresponding to the blinking action. Here, the embodiment of the present application does not do this. Specific limitations.

Based on the description of the above touch operation, it can be seen that the touch type can include sliding type, page turning type, click type, and long press type. Among them, the upward sliding operation and the sliding downward operation belong to the sliding type, and the long pressing operation belongs to the long pressing type. The page turning operation and the page turning operation belong to the page turning type, and the clicking operation belongs to the clicking type. Here, the embodiment of the present application does not specifically limit this.

In an optional embodiment, S102 may include:

Perform touch recognition on the video sequence to obtain the target object, the bounding box of the target object, and the confidence value of the target object's touch operation;

The touch type is determined based on the confidence value of the target object's touch operation.

In touch recognition of video sequences, the target object, the bounding box of the target object, and the confidence value of the touch operation of the target object can be obtained, where the bounding box represents the boundary information of the target object, and the boundary information of the target object refers to is the outline information of the target object, where the outline information may include the shape of the outline, the area of the outline, and the size information of the outline lines; the above-mentioned bounding box is a rectangular box that wraps the above-mentioned target object, and the bounding box includes the height and width of the border.

That is to say, by touch recognition of the video sequence, not only the target object can be obtained, but also the boundary information of the target object can be obtained. At the same time, the gesture category of the target object can be matched to obtain the touch operation of the target object. Here , it should be noted that the touch operations of one or more target objects can be matched, and the confidence value of the touch operation of the target object can also be obtained during touch recognition, that is, the confidence level of the touch operation of the target object. value, in order to determine the touch type, the touch type can be determined based on the confidence value of the touch operation of the target object.

Understandably, when only the touch operation of one target object is matched, the type of the touch operation of the matched target object is directly determined as the touch type; for the touch operations of more than one target object that are matched, When , in an optional embodiment, determining the touch type based on the confidence value of the target object's touch operation includes:

Among them, the confidence value of each touch operation of the target object can reflect the credibility of each touch operation. The greater the confidence value, the higher the credibility of the touch operation. Therefore, here, the target object Select the maximum value of the confidence value of the touch operation, and determine the type of the touch operation corresponding to the maximum value as the touch type. In this way, the touch type can be determined more accurately by using the confidence value. Expose touch types to accurately achieve refined control of electronic devices.

S103: Determine the first distance between the target object and the electronic device;

Here, after the target object is obtained through touch recognition, it is necessary to further determine the first distance between the target object and the electronic device. It should be noted that the first distance here may be between the target object and the screen of the electronic device. The first distance may also be the first distance between the target object and the backplane of the electronic device, or it may be the first distance between the target object and the image sensor of the electronic device. Here, the embodiment of the present application does not do this. Specific limitations.

It can be understood that if each image frame in the video sequence acquired by the front camera also corresponds to a depth image, then the first distance between the target object and the electronic device can be determined based on the depth image, and the first distance between the target object and the electronic device can also be determined based on the depth image. The first distance between the target object and the electronic device is determined based on the boundary information of the object. Here, the embodiment of the present application does not specifically limit this.

In order to determine the first distance between the target object and the electronic device through the boundary information of the target object, since each image frame in the video sequence corresponds to a boundary information, here, it is possible to determine the first distance between the target object and the electronic device according to the boundary information of the target object in each image frame. The first distance between the target object and the electronic device can be determined based on the boundary information of one of the target objects in each image frame. The distance is not specifically limited in the embodiment of the present application.

In order to determine the first distance between the target object and the electronic device according to the boundary information of the target object in each image frame, in an optional embodiment, S103 may include:

According to the selected boundary information of the target object, a first distance between the target object and the electronic device is determined.

Here, after obtaining the boundary information of the target object in each image frame of the video sequence through touch recognition, the boundary information of a target object is selected from the boundary information of the target object in each image frame, and based on the selected The boundary information of the target object is used to determine the first distance between the target object and the electronic device.

determining a second distance between each edge of the bounding box and a corresponding edge of the screen of the electronic device;

According to the length value of the target boundary, the first distance between the target object and the electronic device is determined using the relationship between the preset boundary length value and the distance between the target object and the electronic device.

It can be understood that when the boundary information is represented by a bounding box, in determining the first distance between the target object and the electronic device according to the selected bounding box of the target object, the first distance between each boundary of the bounding box and the corresponding edge of the screen is determined. The second distance between each boundary can be determined by judging the second distance from each boundary to the corresponding edge of the screen to determine whether the bounding box locks the complete target object, that is, whether the target object is cut off by the screen.

After determining the second distance between each boundary of the bounding box and the corresponding edge of the screen, whether the target object is intercepted by the screen can be determined based on the second distance between each boundary and the corresponding edge of the screen. Based on this, from One boundary selected from each boundary is the target boundary. The length value of the target boundary is the width or height value available for the target boundary when the target object is not truncated or is partially truncated. In this way, the length value of the selected target boundary is used to A first distance between the target object and the electronic device is determined.

It should be noted that you can select two boundaries of the target boundary, for example, select both a width value and a height value, and simultaneously use the width value and height value of the bounding box to determine the first distance between the target object and the electronic device.

In this way, when the boundary is screened out, the target boundary can be used to determine the first distance between the target object and the electronic device, and then the touch operation parameters at the first distance can be determined.

In order to select untruncated or partially truncated target objects to obtain usable target boundaries to improve the accuracy of the first distance between the target object and the electronic device, in an optional embodiment, according to The second distance between each edge of the bounding box and the corresponding edge of the screen of the electronic device determines the target boundary, including:

When the second distance between each boundary and the corresponding edge of the screen is greater than the preset threshold, select a boundary from each boundary;

When only one of the second distances between each boundary and the corresponding edge of the screen has a second distance less than or equal to the preset threshold, select the second distance from each boundary to the corresponding edge of the screen. The boundary is less than or equal to the preset threshold;

Determine the selected boundary as the target boundary.

That is to say, the second distance between each boundary and the corresponding edge of the screen is compared with the preset threshold. If both are greater than the preset threshold, it means that the target object in the bounding box is not cut off by the screen. Therefore, One boundary can be selected from each boundary as the target boundary; if there is only one boundary and the second distance between the corresponding edge of the screen is less than or equal to the preset threshold, it means that the target object in the boundary box is cut off by the screen, and although The target object is cut off, but the boundary corresponding to the boundary where the second distance between the corresponding edge of the screen is less than or equal to the preset threshold can reflect the size of the target object. Therefore, the second distance between the corresponding edge of the screen and the boundary can be selected. The boundary whose distance is less than or equal to the preset threshold is used as the target boundary, and the length value of the target boundary is used to determine the first distance between the target object and the electronic device.

In addition, if both are less than or equal to the preset threshold, it means that the target object in the bounding box is cut off by the screen, and the height value and width value in the bounding box do not reflect the size of the target object, so the bounding box cannot be used. The length value and/or the width value is used to calculate the first distance between the target object and the electronic device. At this time, prompt information can be generated to prompt that the target object does not fall within the control range of the electronic device.

The following takes the target object as a hand and the bounding box as a gesture frame as an example to illustrate the bounding box. Figure 3a is a schematic diagram of an optional gesture frame example 1 provided by the embodiment of the present application, as shown in Figure 3a. The second distance between each boundary of the gesture box and the corresponding edge of the screen is greater than the preset threshold. Therefore, the gesture is not cut off by the screen. Any boundary in the gesture box can be selected as the target boundary to determine the hand and electronic device. The first distance between each other; Figure 3b is a schematic diagram of Example 2 of an optional gesture box provided by the embodiment of the present application. As shown in Figure 3b, the second distance between each boundary of the gesture box and the corresponding edge of the screen Among the distances, there is only one width boundary whose second distance from the corresponding edge of the screen is less than or equal to the preset threshold. Therefore, the hand is cut off by the screen. However, the width boundary in the gesture box can be selected as the target boundary to determine the distance between the hand and the electronic device. The first distance between; Figure 3c is a schematic diagram of Example 3 of an optional gesture frame provided by the embodiment of the present application. As shown in Figure 3c, the second distance between each boundary of the gesture frame and the corresponding edge of the screen There is only a second distance between the height boundary and the corresponding edge of the screen that is less than or equal to the preset threshold. Therefore, the hand is cut off by the screen, but the height boundary in the gesture box can be selected as the target boundary to determine the distance between the hand and the electronic device. The first distance; Figure 3d is a schematic diagram of Example 4 of an optional gesture box provided by the embodiment of the present application. As shown in Figure 3d, the second distance between each boundary of the gesture box and the corresponding edge of the screen There are two boundaries whose second distances from the corresponding edges of the screen are less than or equal to the preset threshold, namely the height boundary and the width boundary. Therefore, the hand is cut off by the screen. In this case, the boundary in the gesture box cannot be selected as the target boundary. Determining the first distance between the hand and the electronic device can generate prompt information for prompting that the target object does not fall within the control range of the electronic device.

In an optional embodiment, according to the length value of the target boundary, the first distance between the target object and the electronic device is calculated using the relationship between the preset boundary length value and the distance between the target object and the electronic device. ,include:

When the target boundary is a width boundary, according to the length value of the target boundary, the first distance between the target object and the electronic device is calculated using the relationship between the preset boundary width value and the distance between the target object and the electronic device.

Among them, the relationship between the boundary width value and the distance between the target object and the electronic device is pre-stored in the electronic device. Then, after the width value of the target boundary is known, the preset boundary width can be used according to the target boundary width value. The relationship between the value and the distance between the target object and the electronic device is used to calculate the first distance between the target object and the electronic device.

Understandably, there is a certain relationship between the boundary width value and the distance between the target object and the electronic device. Using this relationship, the first distance between the target object and the electronic device can be calculated. Taking the target object as the hand, the bounding box is Taking the gesture box as an example, the relationship between the border width value and the distance from the target object to the electronic device can be determined in the following way:

Record the width of the gesture frame W1 when the distance between the user's hand and the electronic device is D1; record the width of the gesture frame W2 when the distance between the user's hand and the electronic device is D2; therefore, when the distance is D, the current gesture frame W can be calculated as:

W＝W1+(D-D1)(W2-W1)/(D2-D1) (1)

It can be determined that the relationship between the boundary width value and the distance from the target object to the electronic device can be:

D＝(W-W1)(D2-D1)/(W2-W1)+D1 (2)

Among them, the above-mentioned W1 and W2 are both the width values of the gesture frame when the hand is not cut off by the screen.

When the target boundary is a height boundary, the first distance between the target object and the electronic device is calculated according to the length value of the target boundary and the relationship between the preset boundary height value and the distance between the target object and the electronic device.

Among them, the relationship between the boundary height value and the distance between the target object and the electronic device is pre-stored in the electronic device. Then, after knowing the height value of the target boundary, the preset boundary height value can be used according to the boundary height value. The first distance between the target object and the electronic device is calculated based on the relationship between the distance between the target object and the electronic device.

Understandably, there is a certain relationship between the boundary height value and the distance between the target object and the electronic device. Using this relationship, the first distance between the target object and the electronic device can be calculated. Taking the target object as the hand, the bounding box is Taking the gesture frame as an example, the relationship between the boundary height value and the distance from the target object to the electronic device can be determined in the following way:

When the distance between the user's hand and the electronic device is recorded as D1, the width of the gesture frame H1 is recorded; when the distance between the user's hand and the electronic device is recorded as D2, the width of the gesture frame is H2; therefore, when the distance is D, the current gesture frame H is can be calculated as:

H＝H1+(D-D1)(H2-H1)/(D2-D1) (3)

From this, it can be determined that the relationship between the boundary width value and the distance from the target object to the electronic device can be:

D＝(H-H1)(D2-D1)/(H2-H1)+D1 (4)

Among them, the above H1 and H2 are both the height value of the gesture frame when the hand is not cut off by the screen.

In addition to using the boundary information of a target object selected above to determine the first distance between the target object and the electronic device, the distance between the target object and the electronic device can also be determined based on the boundary information of the target object in each image frame. In an optional embodiment, after obtaining the boundary information of the target object in each image frame of the video sequence, the above method further includes:

Determine the distance between the target object in each image frame and the electronic device according to the boundary information in the target object in each image frame;

It can be understood that the distance between the target object and the electronic device in each image frame is determined using the boundary information of the target object in each image frame. Specifically, the distance between the target object and the electronic device is determined based on the selected boundary information of the target object. The first distance between electronic devices is implemented in the same manner, which will not be described again here.

After determining the distance between the target object and the electronic device in each image frame, an average algorithm can be used to calculate the average value of the distance between the target object and the electronic device in each image frame, and calculate the average value Determine as the first distance between the target object and the electronic device.

Further, in order to determine the accurate first distance, in an optional embodiment, the average distance between the target object and the electronic device in each image frame is determined as the distance between the target object and the electronic device. The first distance between, including:

When the absolute value of the difference between any two distances between the target object and the electronic device in each image frame is less than or equal to the preset error threshold, the distance between the target object and the electronic device in each image frame is The average of the distances is determined as the first distance between the target object and the electronic device.

Here, before calculating the average value, it is first determined whether the absolute value of the difference between any two distances between the target object and the electronic device in each image frame is less than or equal to the preset error threshold. If it is less than or equal to the preset error threshold, then This shows that the distance between the target object and the electronic device jitters within the preset error threshold and does not change much. Therefore, the average value can be used to determine the first distance between the target object and the electronic device.

In addition, in an optional embodiment, the above method further includes:

When the absolute value of the difference between any two of the distances between the target object and the electronic device in each image frame is greater than the preset error threshold, the touch screen will be triggered according to the preset touch point at the standard distance. Control operating parameters to control the electronic device to perform target functions corresponding to the touch type.

That is to say, it is determined that the absolute value of the difference between any two of the distances between each target object and the electronic device is greater than the preset error threshold, indicating that the distance between the target object and the electronic device The distance jitters greatly and changes greatly, so the first distance between the target object and the electronic device cannot be determined. Therefore, the electronic device can be controlled directly according to the preset touch operation parameters at the standard distance. to perform the target function corresponding to the touch type.

S104: Determine the touch operation parameters at the first distance;

After determining the first distance, the touch operation parameters at the first distance can be determined. For example, for each touch operation or touch type, the distance and the touch operation parameter are stored in the electronic device. Here, the corresponding relationship can be used to determine the touch operation parameters at the first distance, and the preset parameter calculation formula can also be used to calculate the touch operation parameters at the first distance. Here, this The application examples do not specifically limit this.

In an optional embodiment, the touch operation parameters include any of the following: sliding distance of the sliding operation, sliding speed of the sliding operation, page turning speed of the page turning operation, long pressing time of the long pressing operation, click operation frequency of clicks.

That is to say, the touch operation of the target object can be a sliding operation, a long press operation or a click operation, etc. The operating parameters for the sliding operation can include the sliding distance and sliding speed, and the operating parameters for the long pressing operation can include the long pressing time. The operating parameters of the click operation may include click frequency, which is not specifically limited in this embodiment of the present application.

In order to determine the touch operation parameters at the first distance, in an optional embodiment, S104 may include:

Based on the preset corresponding relationship between distance and sensitivity coefficient, calculate the sensitivity coefficient at the first distance;

According to the sensitivity coefficient at the first distance, the touch operation parameters at the first distance are determined.

Here, after the first distance is determined, the corresponding relationship between the first distance and the sensitivity coefficient is pre-stored in the electronic device. Then, based on the corresponding relationship, the sensitivity coefficient at the first distance can be calculated, and then based on the corresponding relationship at the first distance, the sensitivity coefficient at the first distance can be calculated. The sensitivity coefficient at a distance determines the touch operation parameters at the first distance.

In an optional embodiment, determining the touch operation parameters at the first distance according to the sensitivity coefficient at the first distance includes:

Using the sensitivity coefficient at the first distance and the preset touch operation parameters at the standard distance, the touch operation parameters at the first distance are calculated.

It can be understood that the touch operation parameters corresponding to each touch operation are stored in the electronic device. Therefore, in determining the touch operation parameters at the first distance according to the sensitivity coefficient at the first distance, exemplarily , the product of the sensitivity coefficient at the first distance and the preset touch operation parameter at the standard distance is determined as the touch operation parameter at the first distance.

That is to say, the sensitivity coefficient at the first distance is used to determine the touch operation parameters at the first distance, so that for target objects with different distances from the electronic device, even if the touch operation parameters corresponding to the same touch operation are Different, thereby expanding the function of non-contact touch control, making the user's non-contact touch operation more refined control of electronic devices, and improving the user experience.

S105: According to the parameters of the touch operation, control the electronic device to perform the target function corresponding to the touch type.

After determining the touch operation parameters, the electronic device performs the target function corresponding to the touch type according to the determined touch operation parameters. Among them, the electronic device can control the page of the screen to perform the target function corresponding to the touch type according to the touch operation parameters. The electronic device can also perform data processing according to the touch operation parameters, such as the image processing function. Here, the application implements The example does not specifically limit this.

In order to control the screen of the electronic device, in an optional embodiment, S105 may include:

According to the touch operation parameters, control the controlled object on the screen of the electronic device to perform the target function corresponding to the touch type;

Among them, the controlled objects include any of the following: pages, interfaces, and controls; that is to say, the above control method can not only control the pages on the screen, but also control the interface, or control the items on the screen. The control of a certain control is not specifically limited in the embodiments of this application.

Taking page sliding as an example, in an optional embodiment, the controlled object on the screen of the electronic device is controlled according to the touch operation parameters to perform the target function corresponding to the touch type, including:

According to the sliding distance of the sliding operation, control the page of the screen to perform the sliding function.

For example, when the user slides the page with his palm, the electronic device responds to the sliding action of the palm, determines that the operation corresponding to the sliding action is a sliding operation, determines the distance between the palm and the screen, and then determines the sliding operation at this distance. Distance, the electronic device control page performs the sliding function corresponding to the sliding operation according to the sliding distance of the sliding operation at this distance. In this way, when palms with different distances from the screen send sliding actions, the same sliding action corresponds to different sliding operations. The sliding distance makes the user's control of the page more refined and improves the user experience.

The following is an example to describe the control method in one or more of the above embodiments.

The above control method is explained below by taking the target object as a hand and the bounding box as a gesture frame as an example. Figure 4 is a schematic diagram of Example 1 of an optional control method provided by the embodiment of the present application. As shown in Figure 4, This control method can include:

S401: Capture gesture picture;

In S401, the gesture interaction application will turn on the front camera and capture gesture images through the front camera.

S402: Gesture detection;

S403: Get the gesture box;

In S401-S402, after the picture is captured, the picture is detected to obtain the gesture category, gesture confidence and gesture frame; during gesture detection, Figure 5 is an optional control provided by the embodiment of the present application. A schematic diagram of Example 2 of the method is shown in Figure 5. The gesture detection method may include:

S501: Obtain pictures containing gestures;

S502: Perform model inference on images;

S503: Model post-processing;

S504: Non-maximum suppression;

S505: Get the gesture frame.

Here, after obtaining a picture containing a gesture, the detection of the picture mainly includes operations such as model inference, model post-processing, and non-maximum suppression, so that the gesture in a picture can be detected, and each detection result Including gesture box, gesture category (referring to the category corresponding to the hand posture change, this category corresponds to the touch type) and gesture confidence (referring to the confidence of the touch type corresponding to the gesture category, for example, 0.9), If there are detection results for multiple gesture categories in the picture, the gesture category with the highest confidence will be used as the final detection result.

S404: Calculate the distance between the hand and the screen;

Here, according to the gesture frame, the distance between the user's hand and the mobile phone screen is calculated, which is the distance between the hand and the screen. Among them, the distance between the hand and the screen can be calculated in the following way:

First, record the width and height of the gesture frame when the distance between a group of hands and the screen is D1. Figure 6a is a schematic diagram of Example 5 of an optional gesture frame provided by the embodiment of the present application. As shown in Figure 6a, record the user When the distance between the hand and the screen is D1, the width W1 and height H1 of the gesture frame;

Then, record the width and height of the gesture frame when the distance between a group of hands and the screen is D2. Figure 6b is a schematic diagram of Example 6 of an optional gesture frame provided by the embodiment of the present application. As shown in Figure 6b, record When the distance between the user's hand and the screen is D2, the width W2 and height H2 of the gesture frame;

Finally, Figure 6c is a schematic diagram of Example 7 of an optional gesture frame provided by the embodiment of the present application. As shown in Figure 6c, when the distance is D, the calculation method of the current gesture frames W and H is formula (1) and formula (3).

In this way, it can be obtained by inference that when the width and height of the gesture frame are W and H, the distance D between the current hand and the screen can be obtained through formula (2) and formula (4).

It should be noted that when calculating the distance between the hand and the screen, the width or height of the gesture box can be used. When the hand is at the edge of the screen, the hand may be cut off by the screen. In this case, the distance from the four sides of the gesture box to the edge of the screen can be calculated. distance, to determine whether the width or height of the gesture frame is available when the hand is cut off, you need to select an available border to calculate the distance between the hand and the screen. If neither width nor height is available, the distance between the hand and the screen cannot be calculated.

S405: Update the sensitivity coefficient of the touch type corresponding to the gesture;

In S405, the sensitivity coefficient of the touch type corresponding to the gesture is adjusted according to the distance between the user's hand and the mobile phone screen.

S406: Control the page sliding distance.

In S406, the sliding distance of the page is calculated based on the sensitivity coefficient of the touch type corresponding to the current gesture.

After calculating the distance between the hand and the screen through S403, the sensitivity coefficient of the touch type corresponding to the gesture can be adjusted. Assume that when the distance between the hand and the screen is 25cm, the sensitivity coefficient is 1, then the distance is D (10cm<D<60 cm), the sensitivity coefficient K of the touch type corresponding to the updated gesture is:

K＝1-0.01*(D-25) (5)

That is to say, when the distance between the hand and the screen is less than 25cm, the sensitivity coefficient of the touch type corresponding to the gesture is improved; when the distance between the hand and the screen is greater than 25cm, the sensitivity coefficient of the touch type corresponding to the gesture is reduced.

When calculating the sliding distance on the mobile phone page based on the sensitivity coefficient of the touch type corresponding to the current gesture, taking the touch type corresponding to the gesture as sliding type as an example, when the preset distance between the hand and the screen is 25cm, each time the hand makes a In the sliding operation, the sliding distance of the mobile phone page is M0. When the distance between the hand and the screen is D, every time the gesture sends a sliding operation, the sliding distance M of the mobile phone page is:

M＝M0*K＝1-0.01*(D-25) (6)

Finally, by substituting formula (2) or formula (4), the distance D between the hand and the screen can be calculated, and then the sliding function corresponding to the sliding operation is executed on the control page according to D.

Figure 7a is a schematic layout diagram of Example 1 of an optional screen provided by the embodiment of the present application. As shown in Figure 7a, a communication record list is displayed on the screen. The user can use four fingers except the thumb to Swing up and down to control the electronic device to slide the screen page; Figure 7b is a schematic layout diagram of Example 2 of an optional screen provided by the embodiment of the present application. As shown in Figure 7b, when the distance between the user's hand and the screen is 25cm, each time the four fingers swing up and down, the page slides by the distance of one communication record. Therefore, the first communication record displayed on the page is "4-17 Sister Access"; Figure 7c is a picture provided by the embodiment of the present application. A schematic diagram of the arrangement of Example 3 of an optional screen is shown in Figure 7c. When the distance between the user's hand and the screen is 26cm, each time the four fingers swing up and down, the page slides two lines of communication records. distance, so the first communication record displayed on the page is "4-16 Johnnie called out"; in this way, the distance between the hand and the screen is used to determine the sliding distance of the page corresponding to each up and down swing of the four fingers. Different distances correspond to different sliding distances.

In this example, the gesture sensitivity coefficient based on gesture detection intelligently adjusts the sliding distance. The current distance between the hand and the screen can be calculated through the gesture detection results, and the current gesture sensitivity coefficient is adjusted according to the distance between the hand and the screen, and acts on the user's operation of the mobile phone. The sliding distance control of the page. When the user's hand is farther from the screen, a lower sensitivity coefficient can be obtained, and when the user's hand is closer to the screen, a higher sensitivity coefficient can be obtained.

In this way, more refined page control is achieved. Users can choose a comfortable distance to control the page with gestures according to their own usage habits, which improves the user experience of gesture control of the page.

In addition, it should be noted that this example can not only be used to adjust the sensitivity coefficient of the sliding distance in gesture interaction, but can also adjust the sliding speed of the sliding operation, the clicking frequency of the clicking operation, the page turning speed of the page turning operation, and the long press operation. long press time, response time to return to the previous level operation, movement distance to control the movement of characters in the game, etc.), and can also be applied to control the sensitivity coefficient of new interactions such as face recognition, body recognition, and human eye gaze. , providing a more comfortable user experience for the above scenarios.

Embodiments of the present application provide a control method, which includes: when the non-contact touch control function of the electronic device is turned on, obtaining a video sequence corresponding to the non-contact touch operation, performing touch recognition on the video sequence, and obtaining Target object and touch type, determine a first distance between the target object and the electronic device, determine touch operation parameters at the first distance, and control the electronic device to perform a target corresponding to the touch type according to the touch operation parameters function; that is to say, in the embodiment of the present application, in the implementation of the non-contact touch control function of the electronic device, the first distance between the target object and the electronic device is determined, and then the touch operation at the first distance is determined. parameters, and then control the controlled object of the electronic device to perform the target function corresponding to the touch type according to the touch operation parameters. In this way, for the same touch type, different first distances can determine different touch operation parameters. Then, the electronic device The device can respond to the touch type according to the distance between the target object and the electronic device. Compared with the existing method that only controls the target function corresponding to the touch type, the same touch type can be used to utilize the touch at different distances. The control operation parameters are different, making the non-contact touch control more refined.

Based on the same inventive concept of the previous embodiments, an embodiment of the present application provides an electronic device. Figure 8 is a schematic structural diagram of an optional electronic device provided by an embodiment of the present application. As shown in Figure 8, the electronic device includes:

The acquisition module 81 is configured to acquire the video sequence corresponding to the non-contact touch operation when the non-contact touch control function of the electronic device is turned on;

The processing module 82 is configured to perform touch recognition on the video sequence to obtain the target object and touch type;

The first determination module 83 is configured to determine the first distance between the target object and the electronic device;

The second determination module 84 is configured to determine the touch operation parameters at the first distance;

The control module 85 is configured to control the electronic device according to the touch operation parameters to perform the target function corresponding to the touch type.

In an optional embodiment, the first determination module 83 is specifically configured to:

A first distance between the target object and the screen of the electronic device is determined according to the selected boundary information of the target object.

In an optional embodiment, when the boundary information is represented by a bounding box, the first determination module 83 determines the first distance between the target object and the electronic device according to the boundary information of the selected target object, including:

In an optional embodiment, the first determination module 83 determines the target boundary according to the second distance between each boundary of the bounding box and the corresponding edge of the screen, including:

Determine the selected boundary as the target boundary.

In an optional embodiment, the first determination module 83 calculates the distance between the target object and the electronic device according to the length value of the target boundary, using the relationship between the preset boundary length value and the distance between the target object and the electronic device. The first distance between includes:

When the target boundary is a width boundary, the first distance between the target object and the electronic device is calculated based on the length value of the target boundary and the relationship between the preset boundary width value and the distance between the target object and the electronic device.

In an optional embodiment, the first determination module 83 determines the average value of the distance between the target object and the electronic device in each image frame as the first distance between the target object and the electronic device, include:

In an optional embodiment, the electronic device is further configured to:

In an optional embodiment, the second determination module 84 is specifically configured to:

In an optional embodiment, the second determination module 84 determines the touch operation parameters at the first distance according to the sensitivity coefficient at the first distance, including:

In an optional embodiment, the processing module 82 performs touch recognition on the video sequence to obtain the target object and touch type, including:

Perform touch recognition on the video sequence to obtain the target object, the bounding box of the target object, and the confidence value of the touch operation of the target object; where the bounding box represents the boundary information;

In an optional embodiment, the processing module 82 determines the touch type based on the confidence value of the target object's touch operation, including:

In an optional embodiment, the touch operation parameters include any of the following: sliding distance of the sliding operation, sliding speed of the sliding operation, page turning speed of the page turning operation, long pressing time of the long pressing operation and click operation. frequency of clicks.

In an optional embodiment, the control module 85 is specifically configured to:

According to the touch operation parameters, controlled objects on the screen of the electronic device are controlled to perform target functions corresponding to the touch type; wherein the controlled objects include any of the following: pages, interfaces, and controls.

In an optional embodiment, the control module 85 controls the controlled object on the screen of the electronic device according to the touch operation parameters to perform target functions corresponding to the touch type, including:

In practical applications, the above-mentioned acquisition module 81, processing module 82, first determination module 83, second determination module 84 and control module 85 can be implemented by a processor located on the electronic device, specifically a central processing unit (CPU). ), microprocessor (MPU, Microprocessor Unit), digital signal processor (DSP, Digital Signal Processing) or field programmable gate array (FPGA, Field Programmable Gate Array) and other implementations.

Figure 9 is a schematic structural diagram of another optional electronic device provided by an embodiment of the present application. As shown in Figure 9, an embodiment of the present application provides an electronic device 900, including:

The processor 91 and the storage medium 92 that stores instructions executable by the processor 91. The storage medium 92 relies on the processor 91 to perform operations through the communication bus 93. When the instructions are executed by the processor 91, The control method performed in one or more of the above embodiments is executed.

It should be noted that in actual application, various components in the terminal are coupled together through the communication bus 93 . It can be understood that the communication bus 93 is used to implement connection communication between these components. In addition to the data bus, the communication bus 93 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the various buses are labeled as communication bus 93 in FIG. 9 .

Embodiments of the present application provide a computer storage medium that stores executable instructions. When the executable instructions are executed by one or more processors, the processor executes the first step in one or more of the above embodiments. An electronic device executes the control method.

Among them, the computer-readable storage medium can be magnetic random access memory (ferromagnetic random access memory, FRAM), read-only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), programmable read-only memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash Memory, Magnetic Surface Memory , optical disk, or Compact Disc Read-Only Memory (CD-ROM) and other memories.

Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, magnetic disk storage and optical storage, etc.) embodying computer-usable program code therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

The above descriptions are only preferred embodiments of the present application and are not intended to limit the protection scope of the present application.

Industrial applicability

The control method, electronic device and computer storage medium provided in the embodiments of the present application are applied to electronic devices and include: when the non-contact touch control function of the electronic device is on, obtaining the non-contact touch operation Corresponding video sequence, perform touch recognition on the video sequence, obtain the target object and touch type, determine the first distance between the target object and the electronic device, determine the touch operation parameters at the first distance, and follow the touch operation parameters to control the electronic device to perform the target function corresponding to the touch type. Compared with the existing control that only controls the target function corresponding to the touch type, the same touch type is used to control using touch operation parameters at different distances. There are differences, making non-contact touch control more refined.

Claims

A control method, the method is applied to electronic equipment, including:

When the non-contact touch control function of the electronic device is turned on, obtain a video sequence corresponding to the non-contact touch operation;

Perform touch recognition on the video sequence to obtain the target object and touch type;

determining a first distance between the target object and the electronic device;

Determine touch operation parameters at the first distance;

According to the touch operation parameters, the electronic device is controlled to perform a target function corresponding to the touch type.
The method of claim 1, wherein determining the first distance between the target object and the electronic device includes:

Select the boundary information of a target object from the boundary information of the target object in each image frame of the video sequence;

A first distance between the target object and the electronic device is determined according to the selected boundary information of the target object.
The method of claim 2, wherein when the boundary information is represented by a bounding box, determining the first distance between the target object and the electronic device according to the boundary information of the selected target object includes: :

determining a second distance between each boundary of the bounding box and a corresponding edge of the screen of the electronic device;

Determine the target boundary according to the second distance between each boundary and the corresponding edge of the screen;

According to the length value of the target boundary, the first distance between the target object and the electronic device is determined using the relationship between the preset boundary length value and the distance from the target object to the electronic device.
The method of claim 3, wherein determining the target boundary based on a second distance between each boundary of the bounding box and a corresponding edge of the screen includes:

When the second distance between each boundary and the corresponding edge of the screen is greater than a preset threshold, select one boundary from each boundary;

When only one of the second distances between the boundaries and the corresponding edge of the screen has a second distance less than or equal to the preset threshold, select the The second distance between the corresponding edges of the screen is less than or equal to the boundary of the preset threshold;

The selected boundary is determined as the target boundary.
The method according to claim 3, wherein the calculation is based on the length value of the target boundary and using a relationship between a preset boundary length value and a distance from the target object to the electronic device. The first distance between the target object and the electronic device includes:

When the target boundary is a width boundary, according to the length value of the target boundary, using the relationship between the preset boundary width value and the distance from the target object to the electronic device, the target object and the electronic device are calculated. A first distance between the electronic devices.
The method according to claim 3, wherein the calculation is based on the length value of the target boundary and using a relationship between a preset boundary length value and a distance from the target object to the electronic device. The first distance between the target object and the electronic device includes:

When the target boundary is a height boundary, according to the length value of the target boundary, using the relationship between the preset boundary height value and the distance from the target object to the electronic device, the target object and the electronic device are calculated. A first distance between the electronic devices.
The method of claim 1, wherein determining the first distance between the target object and the electronic device includes:

Determine the distance between the target object in each image frame and the electronic device according to the boundary information in the target object in each image frame in the video sequence;

The average value of the distances between the target object and the electronic device in each image frame is determined as the first distance between the target object and the electronic device.
The method according to claim 7, wherein the average value of the distance between the target object and the electronic device in each image frame is determined as the distance between the target object and the electronic device. The first distance includes:

When the absolute value of the difference between any two distances between the target object in each image frame and the electronic device is less than or equal to the preset error threshold, the target object in each image frame is The average value of the distances to the electronic device is determined as the first distance between the target object and the electronic device.
The method of claim 8, further comprising:

When the absolute value of the difference between any two of the distances between the target object and the electronic device in each image frame has an absolute value greater than the preset error threshold, according to the preset standard The touch operation parameters under the distance control the electronic device to perform the target function corresponding to the touch type.
The method of claim 1, wherein the determining touch operation parameters at the first distance includes:

Calculate the sensitivity coefficient at the first distance based on the preset corresponding relationship between the distance and the sensitivity coefficient;

Touch operation parameters at the first distance are determined according to the sensitivity coefficient at the first distance.
The method of claim 10, wherein determining the touch operation parameters at the first distance according to the sensitivity coefficient at the first distance includes:

The touch operation parameters at the first distance are calculated using the sensitivity coefficient at the first distance and the preset touch operation parameters at the standard distance.
The method according to claim 1, wherein performing touch recognition on the video sequence to obtain the target object and touch type includes:

Perform touch recognition on the video sequence to obtain the target object, the bounding box of the target object, and the confidence value of the touch operation of the target object; wherein the bounding box represents boundary information;

The touch type is determined based on the confidence value of the touch operation of the target object.
The method of claim 12, wherein determining the touch type based on a confidence value of a touch operation of the target object includes:

The type of the touch operation corresponding to the maximum value of the confidence value of the touch operation of the target object is determined as the touch type.
The method according to any one of claims 1 to 13, wherein the touch operation parameters include any of the following:

The sliding distance of the sliding operation, the sliding speed of the sliding operation, the page turning speed of the page turning operation, the long pressing time of the long pressing operation and the click frequency of the clicking operation.
The method according to any one of claims 1 to 13, wherein the controlling the electronic device to perform a target function corresponding to the touch type according to the touch operation parameters includes:

According to the touch operation parameters, control the controlled object of the screen of the electronic device to perform a target function corresponding to the touch type;

Wherein, the controlled objects include any of the following: pages, interfaces and controls.
The method according to claim 15, wherein the controlling the controlled object of the screen of the electronic device according to the touch operation parameter to perform a target function corresponding to the touch type includes:

According to the sliding distance of the sliding operation, the page of the screen is controlled to perform the sliding function.
An electronic device including:

An acquisition module configured to acquire a video sequence corresponding to a non-contact touch operation when the non-contact touch control function of the electronic device is turned on;

A processing module configured to perform touch recognition on the video sequence to obtain the target object and touch type;

a first determination module configured to determine a first distance between the target object and the electronic device;

a second determination module configured to determine touch operation parameters at the first distance;

A control module configured to control the electronic device to perform a target function corresponding to the touch type according to the touch operation parameters.
The electronic device according to claim 17, wherein the first determining module is specifically configured to:

Select the boundary information of a target object from the boundary information of the target object in each image frame of the video sequence;

A first distance between the target object and the electronic device is determined according to the selected boundary information of the target object.
An electronic device including:

A processor and a storage medium storing instructions executable by the processor. The storage medium relies on the processor to perform operations through a communication bus. When the instructions are executed by the processor, the above-mentioned claims 1 to 1 are executed. The control method described in any one of 16.
A computer storage medium stores executable instructions. When the executable instructions are executed by one or more processors, the processor executes the control method according to any one of claims 1 to 16.