CN104571513A - A method and system for simulating touch commands by shielding camera areas - Google Patents

Abstract

The invention provides a method and a system for simulating a touch instruction by shielding a camera shooting area. Acquiring an image sequence of one shielding operation captured by a camera; identifying an acquired image sequence, separating two areas with and without a shelter in each image, and converting each separated image into a binary image; analyzing the change condition of the shielding object of each image in the image sequence, and identifying an operation event occurring in the image sequence; judging whether the identified operation event is consistent with a preset event in a preset event sequence or not, and if so, generating a corresponding simulation touch instruction; if not, generating no simulation touch instruction; and executing corresponding simulated touch operation according to the generated simulated touch instruction. Compared with the existing hand touch recognition, the invention greatly reduces the requirement on the system operation capability; compared with the existing touch input mode, the method saves keys or touch input elements.

Description

A method and system for simulating touch commands by shielding camera areas

technical field

The present invention relates to the field of Internet of Things terminal user command input and device control, in particular to a method and system for simulating a touch command by shielding a camera area.

Background technique

Camera systems are more and more widely used in various application scenarios, and various IoT terminal products with camera functions have been derived, such as network surveillance cameras for security, baby monitors, driving recorders, video doorbells, etc. wait. In addition to being remotely used by remote users through the Internet, these IoT devices also have the function of being directly (face-to-face) manipulated and used by near-end users. For example, in the intercom function of the network surveillance camera, the near-end user can control the volume of the intercom sound; the night light function of some baby monitors allows the near-end user to directly adjust the brightness and color of the light; Most of them also have the function of directly controlling the light or sound. It can be seen that the near-end user has a requirement for near-end control of some functional subsystems of the device.

Existing camera systems generally have certain video recognition computing capabilities, so the camera can be used as an input device, and the existing method is to realize the control by recognizing the user's instruction input subject (human touch), but this The method has the following defects: since the human hand recognition based on vision needs to involve the recognition operation of skin color and hand shape, and the amount of calculation is relatively large, the requirements for the computing power of the embedded camera system are relatively high; end input elements, which increases the complexity of the system.

Contents of the invention

One of the technical problems to be solved by the present invention is to provide a method for simulating touch commands by shielding the camera area, by mapping different masking operations on the camera area into different simulated touch commands, and using the generated simulated touch commands to control electronic devices. Control, so as to achieve non-touch operation, and reduce the requirements for system computing power.

One of the technical problems to be solved by the present invention is achieved in this way: a method for simulating a touch command by shielding the imaging area, the method comprising the following steps:

Step 10, collecting an image sequence of a masking operation captured by the camera;

Step 20, identifying the acquired image sequence, separating the two regions with and without occlusion in each image, and converting each separated image into a binary image;

Step 30. Analyzing the change of the occluder of each image in the image sequence, and identifying the operation event occurring in the image sequence;

Step 40, determine whether the recognized operation event matches the preset event in the preset event sequence, if so, generate a corresponding simulated touch command, and proceed to step 50; otherwise, do not generate a simulated touch command, and return to step 10 Wait for the next masking operation;

Step 50: Execute a corresponding simulated touch operation according to the generated simulated touch instruction.

Further, the step 30 is specifically: if the area with the occluder in the image sequence becomes larger from small to large, and finally the ratio of the area with the occluder to the entire imaging area reaches the preset upper limit of the occlusion ratio, then identify it as an occlusion event, Then go to step 40; if the unoccluded area in the image sequence grows from small to large, and finally the proportion of the unoccluded area to the entire imaging area reaches the preset upper limit of the unmasked ratio, then it is recognized as an unoccluded event, and then enters the step 40; If the ratio of the area with occluders to the entire camera area does not reach the preset upper limit of the masking ratio, or the ratio of the area without occluders to the entire camera area does not reach the preset upper limit of the unmasked ratio, it will not be selected Identify, and return to step 10 to wait for the next masking operation.

Further, each of the shading events and unshading events has an event occurrence direction and an event occurrence speed; the event occurrence direction includes a linear movement direction parallel to the imaging area and an entry angle of β, and a direction perpendicular to the imaging area. The divergence direction of or perpendicular to the contraction direction of the imaging area, where 0°≤β≤360°; the event occurrence speed is the set of speeds of each stage in the event occurrence process or the average speed of the event occurrence.

Further, the preset event includes event type, event direction and preset speed, and each preset event is mapped to an analog touch command; the preset speed is a range value with upper and lower limits; the simulated The touch instruction includes a directional slide instruction and a click instruction.

Further, the step 40 is specifically: judging whether the recognized operation event is consistent with the preset event in the preset event sequence, if the recognized operation event is consistent with the event type, event direction and preset speed of the preset event , generate a simulated touch instruction corresponding to the operation event, and enter step 50; if the recognized operation event does not match the event type, event direction, and preset speed of the preset event, then no simulated touch instruction is generated, and the control of the operation is terminated. The processing of this masking operation returns to step 10 to wait for the next masking operation.

The second technical problem to be solved by the present invention is to provide a system for simulating touch commands by shading the imaging area, by mapping different shading operations on the imaging area into different simulating touch commands, and using the generated simulating touch commands to control electronic devices. Control, so as to achieve non-touch operation, and reduce the requirements for system computing power.

The second technical problem to be solved by the present invention is achieved in the following way: a system for simulating touch commands by shielding the imaging area, the system includes a camera unit, an image preprocessing unit, a shading recognition unit, a simulated touch command generating unit, and a simulated touch command execution unit;

The camera unit is used to collect an image sequence captured by the camera for a shading operation;

The image pre-processing unit is used to identify the acquired image sequence, separate the two areas with occluded objects and unoccluded objects in each image, and convert each separated image into a binary image ;

The occlusion identification unit is used to analyze the change of the occlusion of each image in the image sequence, and identify the operation events that occur in the image sequence;

The simulated touch instruction generation unit is used to judge whether the recognized operation event matches the preset event in the preset event sequence, and if so, generate a corresponding simulated touch instruction and enter the simulated touch instruction execution unit; No , then no simulated touch instruction is generated, and the camera unit is returned to wait for the next shielding operation;

The simulated touch command execution unit is configured to perform a corresponding simulated touch operation according to the generated simulated touch command.

Further, the occlusion identification unit is specifically: if the area with an occluder in the image sequence grows from small to large, and finally the ratio of the area with an occluder to the entire imaging area reaches the preset upper limit of the occlusion ratio, identify it as an occlusion event , and then enter the simulated touch command generation unit; if the unobstructed area in the image sequence increases from small to large, and finally the ratio of the unoccluded area to the entire imaging area reaches the preset upper limit of the unmasked ratio, then it is recognized as a release A shading event, and then enter the analog touch command generation unit; if the ratio of the area with an occluder to the entire imaging area does not finally reach the preset upper limit of the occlusion ratio, or the ratio of the area without an occlusion to the entire imaging area does not finally reach The preset upper limit of the unmasked ratio is not recognized, and returns to the camera unit to wait for the next shading operation.

Further, each of the shading events and unshading events has an event occurrence direction and an event occurrence speed; the event occurrence direction includes a linear movement direction parallel to the imaging area and an entry angle of β, and a direction perpendicular to the imaging area. The divergence direction of or perpendicular to the contraction direction of the imaging area, where 0°≤β≤360°; the event occurrence speed is the set of speeds of each stage in the event occurrence process or the average speed of the event occurrence.

Further, the preset event includes event type, event direction and preset speed, and each preset event is mapped to an analog touch command; the preset speed is a range value with upper and lower limits; the simulated The touch instruction includes a directional slide instruction and a click instruction.

Further, the simulated touch command generating unit is specifically: judging whether the recognized operation event is consistent with the preset event in the preset event sequence, if the recognized operation event is consistent with the event type, event direction and expected event of the preset event If the speed matches, the simulated touch instruction corresponding to the operation event will be generated and entered into the simulated touch instruction execution unit; if the recognized operation event does not match the event type, event direction and preset speed of the preset event, no simulation will be generated. Touch the command, and terminate the processing of this shielding operation, and return to the camera unit to wait for the next shielding operation.

The present invention has the following advantages: different shielding operations on the imaging area are mapped into different simulated touch commands, and electronic equipment is controlled by using the generated simulated touch commands. Compared with the existing human touch recognition, the requirement for the computing power of the system is greatly reduced; compared with the existing touch input method, keys or touch input components are saved.

Description of drawings

The present invention will be further described below in conjunction with the embodiments with reference to the accompanying drawings.

Fig. 1 is a flow chart of the execution of the method of the present invention.

FIG. 2 is a schematic diagram of the masking of the imaging area of the present invention.

FIG. 3 is a schematic diagram of occlusion events in the linear movement direction (a angle entry) in the present invention.

FIG. 4 is a schematic diagram of an unmasking event in a linear movement direction (b angular movement out) in the present invention.

FIG. 5 is a schematic diagram of shading events in the divergent direction in the present invention.

FIG. 6 is a schematic diagram of an unshading event in a shrinking direction in the present invention.

Fig. 7 is a schematic diagram of the system structure of the present invention.

Detailed ways

Please refer to FIG. 1 to FIG. 6, a preferred embodiment of a method for simulating a touch command by covering an imaging area, the method includes:

Step 10, collecting an image sequence of a masking operation captured by the camera;

When the user wants to perform a near-end operation on the electronic device, the user uses a shielding object to shield the lens near the camera lens, and the camera will capture the image sequence of the shielding operation, and the image sequence will be completely recorded The whole process of user masking operation. The shield used to shield the imaging area can be a finger or any shielding sheet, as shown in Figure 2, as long as the area covered by the shield is larger than the imaging area with a diameter of D (lens).

The masking operations include:

I. The process of the occluder from the unshielded camera area to the covered camera area;

II. The process of the occluder from covering the camera area to being removed from the camera area;

And the above two processes I and II can occur in any direction.

Wherein, the non-occluded imaging area refers to an image in which no occluder appears in the imaging area, and the covered imaging area refers to an image in which an occluder exists in the imaging area.

Step 20, identifying the acquired image sequence, separating the two regions with and without occlusion in each image, and converting each separated image into a binary image;

For example, when identifying the captured image sequence, the area with occluded objects can be identified as the foreground area, and the area without occluded objects can be identified as the background area, then each identified image will be converted to include the foreground area and Binarized image of the background region.

Step 30, analyze the change of the occluder of each image in the image sequence, and identify the operation event that occurred in the image sequence; the step 30 is specifically:

If the area with an occluder in the image sequence (ie, the foreground area) becomes larger from small to large, and finally the ratio of the area with an occluder to the entire camera area reaches the preset upper limit of the occlusion ratio, then it is recognized as an occlusion event, and then enter step 40; If the unoccluded area in the image sequence (that is, the background area) grows from small to large, and the proportion of the unoccluded area to the entire camera area reaches the preset upper limit of the unoccluded ratio, it is recognized as an unoccluded event, and then enters the step 40; If the ratio of the area with occluders to the entire camera area does not reach the preset upper limit of the masking ratio, or the ratio of the area without occluders to the entire camera area does not reach the preset upper limit of the unmasked ratio, it will not be selected Identify, and return to step 10 to wait for the next masking operation.

Each of the shading event and unshading event has an event occurrence direction, which is used to reflect the shading event implemented by the user from a certain orientation of the camera to another orientation; the event occurrence direction includes parallel to the camera area and an entry angle of The linear movement direction of β, the divergence direction perpendicular to the imaging area, or the shrinking direction perpendicular to the imaging area, wherein 0°≤β≤360°. As shown in Figures 3 to 6, among them, Figure 3 shows a shading process of a shading event parallel to the linear movement direction (a angle entering) of the imaging area; Figure 4 shows a shading process parallel to the imaging area An unmasking process of the unmasking event in the linear moving direction (b angle moves out); Figure 5 shows a shading process of the shading event perpendicular to the divergence direction of the imaging area, that is, the occluder moves along the direction perpendicular to the imaging area area and move away from the direction of the camera area; Figure 6 shows a release process of the masking event perpendicular to the contraction direction of the camera area, that is, the occluder moves along the direction perpendicular to the camera area and close to the camera area direction to move.

The occlusion event and the unmasking event also have an event velocity, which is a set of velocities at each stage in the event occurrence process or an average velocity of the event occurrence, and the event velocity is mainly used to describe the time characteristics of the event. In this embodiment, a simple average speed is used to describe the speed of occurrence of occlusion events and unocclusion events.

Step 40, judging whether the recognized operation event matches the preset event in the preset event sequence, if the recognized operation event matches the event type, event direction and preset speed of the preset event, generate the corresponding operation event If the recognized operation event does not match the event type, event direction and preset speed of the preset event, the simulated touch command will not be generated, and the processing of this masking operation will be terminated. At the same time return to step 10 to wait for the next masking operation. The simulated touch instruction includes a directional slide instruction and a click instruction.

The preset events of this embodiment include:

The occlusion event in the direction of 0 degrees (that is, the occlusion is occluded horizontally to the right along the camera area);

Unblocking events in the 0-degree direction (that is, the occlusion is unblocked horizontally to the right along the camera area);

The occlusion event in the 90-degree direction (that is, the occluder covers vertically upward along the camera area);

Unblocking events in the 90-degree direction (that is, the occluder is unblocked vertically upward along the camera area);

The occlusion event in the 180-degree direction (that is, the occlusion is occluded horizontally to the left along the camera area);

Unblocking event in 180-degree direction (that is, the occluder is unblocked horizontally to the left along the camera area);

Covering events in the 270-degree direction (that is, the cover is covered vertically downward along the camera area);

Unblock event in 270-degree direction (that is, the occluder unblocks vertically downward along the camera area);

Occlusion events in the divergent direction (the occlusion is close to the camera);

Unocclusion events in the shrinking direction (the occlusion moves away from the camera).

In this embodiment, the mapping relationship between preset events and simulated touch commands:

  Under the preset speed limit, the masking event in the 0-degree direction plus the un-masking event in the 0-degree direction: the horizontal slide command to the right;

90-degree shading event plus 90-degree unshading event under the preset speed limit: Horizontal upward slide command;

180-degree shading event under the preset speed limit plus 180-degree unshading event: Horizontal left swipe command:

270-degree shading event at preset speed limit plus 270-degree unshading event: Horizontal downward slide command:

  Covering events in the divergence direction under the preset speed limit: click on the command;

Unmasking event in the contraction direction under the preset speed limit: release the click command.

The preset speed is a range value with an upper and lower limit, and the shading event and the unshading event under the preset speed limit mean that the speed of the shading event and the unshading event is higher than the lower limit of the preset speed and lower than the lower limit of the preset speed. at the upper limit of the preset speed.

Step 50: Execute a corresponding simulated touch operation according to the generated simulated touch instruction.

For example, in a camera system with lighting function, the generated upward slide command can be used to control the increase of light brightness, and the generated downward slide command can be used to control the decrease of light brightness. For another example, in a camera system with a music playback function, the generated upward sliding command can be used to control the volume increase, the generated downward sliding command can be used to control the volume down, and the generated right sliding command can be used to control the song to be played. Switch to the previous song, use the generated left sliding command to control the switching of the playing song to the next song, and use the click command and release the click command to switch between playing and pausing.

Please refer to Fig. 2 to Fig. 7, a preferred implementation of a system for simulating a touch command by shielding the camera area, the system includes a camera unit, an image preprocessing unit, a occlusion recognition unit, a simulated touch command generation unit, and a simulated touch instruction execution unit;

The camera unit is used to collect an image sequence captured by the camera for a shading operation;

When the user wants to perform a near-end operation on the electronic device, the user uses a shielding object to shield the lens near the camera lens, and the camera will capture the image sequence of the shielding operation, and the image sequence will be completely recorded The whole process of user masking operation. The shield used to shield the imaging area can be a finger or any shielding sheet, as shown in Figure 2, as long as the area covered by the shield is larger than the imaging area with a diameter of D (lens).

The masking operations include:

I. The process of the occluder from the unshielded camera area to the covered camera area;

II. The process of the occluder from covering the camera area to being removed from the camera area;

And the above two processes I and II can occur in any direction.

Among them, the unoccluded imaging area refers to the image without occlusions in the imaging area, and the shaded imaging area refers to the image with the occlusion in the imaging area.

The image pre-processing unit is used to identify the acquired image sequence, separate the two areas with occluded objects and unoccluded objects in each image, and convert each separated image into a binary image ;

For example, when identifying the captured image sequence, the area with occluded objects can be identified as the foreground area, and the area without occluded objects can be identified as the background area, then each identified image will be converted to include the foreground area and Binarized image of the background region.

The occlusion identification unit is used to analyze the change of the occlusion of each image in the image sequence, and identify the operation events that occur in the image sequence; the occlusion identification unit is specifically:

If the area with occluders in the image sequence (that is, the foreground area) grows from small to large, and finally the ratio of the area with occluders to the entire camera area reaches the preset upper limit of the occlusion ratio, it will be recognized as an occlusion event, and then enter the simulation Touch command generation unit; if the unobstructed area in the image sequence (that is, the background area) grows from small to large, and the proportion of the unoccluded area in the entire camera area reaches the preset upper limit of the unmasked ratio, it will be recognized as unmasked event, and then enter the analog touch command generating unit; if the ratio of the area with a occluder to the entire imaging area does not finally reach the preset upper limit of the occlusion ratio, or the ratio of the area without an occluder to the entire imaging area does not finally reach the preset If the upper limit of the unmasked ratio is set, it will not be recognized, and return to the camera unit to wait for the next shading operation.

Each of the shading event and unshading event has an event occurrence direction, which is used to reflect the shading event implemented by the user from a certain orientation of the camera to another orientation; the event occurrence direction includes parallel to the camera area and an entry angle of The linear movement direction of β, the divergence direction perpendicular to the imaging area, or the shrinking direction perpendicular to the imaging area, wherein 0°≤β≤360°. As shown in Figures 3 to 6, among them, Figure 3 shows a shading process of a shading event parallel to the linear movement direction (a angle entering) of the imaging area; Figure 4 shows a shading process parallel to the imaging area An unmasking process of the unmasking event in the linear moving direction (b angle moves out); Figure 5 shows a shading process of the shading event perpendicular to the divergence direction of the imaging area, that is, the occluder moves along the direction perpendicular to the imaging area area and move away from the direction of the camera area; Figure 6 shows a release process of the masking event perpendicular to the contraction direction of the camera area, that is, the occluder moves along the direction perpendicular to the camera area and close to the camera area direction to move.

The occlusion event and the unmasking event also have an event velocity, which is a set of velocities at each stage in the event occurrence process or an average velocity of the event occurrence, and the event velocity is mainly used to describe the time characteristics of the event. In this embodiment, a simple average speed is used to describe the speed of occurrence of occlusion events and unocclusion events.

The simulated touch instruction generation unit is used to judge whether the recognized operation event is consistent with the preset event in the preset event sequence, if the recognized operation event is consistent with the event type, event direction and preset speed of the preset event , generate a simulated touch command corresponding to the operation event, and enter the simulated touch command execution unit; if the recognized operation event does not match the event type, event direction and preset speed of the preset event, no simulated touch command is generated, And terminate the processing of this shading operation, and return to the camera unit to wait for the next shading operation. The simulated touch instruction includes a directional slide instruction and a click instruction.

The preset events of this embodiment include:

The occlusion event in the direction of 0 degrees (that is, the occlusion is occluded horizontally to the right along the camera area);

Unblocking events in the 0-degree direction (that is, the occlusion is unblocked horizontally to the right along the camera area);

The occlusion event in the 90-degree direction (that is, the occluder covers vertically upward along the camera area);

Unblocking events in the 90-degree direction (that is, the occluder is unblocked vertically upward along the camera area);

The occlusion event in the 180-degree direction (that is, the occlusion is occluded horizontally to the left along the camera area);

Unblocking event in 180-degree direction (that is, the occluder is unblocked horizontally to the left along the camera area);

Covering events in the 270-degree direction (that is, the cover is covered vertically downward along the camera area);

Unblock event in 270-degree direction (that is, the occluder unblocks vertically downward along the camera area);

Occlusion events in the divergent direction (the occlusion is close to the camera);

Unocclusion events in the shrinking direction (the occlusion moves away from the camera).

In this embodiment, the mapping relationship between preset events and simulated touch commands:

  Under the preset speed limit, the masking event in the 0-degree direction plus the un-masking event in the 0-degree direction: the horizontal slide command to the right;

90-degree shading event plus 90-degree unshading event under the preset speed limit: Horizontal upward slide command;

180-degree shading event under the preset speed limit plus 180-degree unshading event: Horizontal left swipe command:

270-degree shading event at preset speed limit plus 270-degree unshading event: Horizontal downward slide command:

  Covering events in the divergence direction under the preset speed limit: click on the command;

Unmasking event in the contraction direction under the preset speed limit: release the click command.

The preset speed is a range value with an upper and lower limit, and the shading event and the unshading event under the preset speed limit mean that the speed of the shading event and the unshading event is higher than the lower limit of the preset speed and lower than the lower limit of the preset speed. at the upper limit of the preset speed.

The simulated touch command execution unit is configured to execute a corresponding simulated touch operation according to the generated simulated touch command.

For example, in a camera system with a lighting function, the generated upward sliding command can be used to control the increase of the brightness of the light, and the generated downward sliding command can be used to control the reduction of the brightness of the light. For another example, in a camera system with a music playback function, the generated upward sliding command can be used to control the volume increase, the generated downward sliding command can be used to control the volume down, and the generated right sliding command can be used to control the song to be played. Switch to the previous song, use the generated left sliding command to control the switching of the playing song to the next song, and use the click command and release the click command to switch between playing and pausing.

To sum up, the present invention maps different shielding operations on the imaging area into different simulated touch commands, and uses the generated simulated touch commands to control the electronic device. Compared with the existing human touch recognition, the requirement for the computing power of the system is greatly reduced; compared with the existing touch input method, keys or touch input elements are saved.

Although the specific embodiments of the present invention have been described above, those skilled in the art should understand that the specific embodiments we have described are only illustrative, rather than used to limit the scope of the present invention. Equivalent modifications and changes made by skilled personnel in accordance with the spirit of the present invention shall fall within the protection scope of the claims of the present invention.

Claims (10)

1. A method for simulating a touch command by covering the imaging area, is characterized in that: comprises the steps: Step 10, collecting an image sequence of a masking operation captured by the camera; Step 20, identifying the acquired image sequence, separating the two regions with and without occlusion in each image, and converting each separated image into a binary image; Step 30. Analyzing the change of the occluder of each image in the image sequence, and identifying the operation event occurring in the image sequence; Step 40, determine whether the recognized operation event matches the preset event in the preset event sequence, if so, generate a corresponding simulated touch command, and proceed to step 50; otherwise, do not generate a simulated touch command, and return to step 10 Wait for the next masking operation; Step 50: Execute a corresponding simulated touch operation according to the generated simulated touch instruction. 2. The method for simulating touch commands by covering the imaging area according to claim 1, characterized in that: the step 30 is specifically: if the area with the occluder in the image sequence grows from small to large, and finally there is an occluder If the proportion of the area occupying the entire imaging area reaches the preset upper limit of the occlusion ratio, it will be identified as an occlusion event, and then go to step 40; if the area without occlusion in the image sequence becomes larger from small to large, and finally the area without occlusion occupies the entire imaging area If the ratio of the ratio reaches the preset upper limit of the unmasked ratio, it is recognized as an unmasked event, and then enters step 40; If the proportion of the area occupying the entire imaging area does not reach the preset upper limit of the unmasked proportion, it will not be recognized, and return to step 10 to wait for the next shading operation. 3. A method for simulating a touch command by shielding an imaging area according to claim 2, wherein: each of said shielding event and unshading event has an event occurrence direction and an event occurrence speed; said event occurrence direction includes parallel A linear movement direction in the imaging area and an entry angle of β, a diverging direction perpendicular to the imaging area, or a shrinking direction perpendicular to the imaging area, wherein 0°≤β≤360°; the event occurrence speed is The collection of velocities for each stage in the course of an event or the average velocity of an event. 4. A method for simulating a touch command by covering an imaging area according to claim 3, wherein the preset event includes event type, event direction and preset speed, and each preset event is mapped to a An analog touch command; the preset speed is a range value with upper and lower limits; the simulated touch command includes a direction slide command and a click command. 5. A method for simulating a touch command by shielding an imaging area according to claim 4, wherein the step 40 is specifically: judging whether the recognized operation event matches a preset event in a preset event sequence, If the identified operation event matches the event type, event direction and preset speed of the preset event, an analog touch instruction corresponding to the operation event is generated and enters step 50; if the identified operation event is consistent with the preset event If the type, event direction, and preset speed do not match, no simulated touch command will be generated, and the processing of this shielding operation will be terminated, and at the same time, return to step 10 to wait for the next shielding operation. 6. A system for simulating a touch command by covering an imaging area, characterized in that it includes a camera unit, an image preprocessing unit, a occlusion recognition unit, a simulated touch command generation unit, and a simulated touch command execution unit; The camera unit is used to collect an image sequence captured by the camera for a shading operation; The image pre-processing unit is used to identify the acquired image sequence, separate the two areas with occluded objects and unoccluded objects in each image, and convert each separated image into a binary image ; The occlusion identification unit is used to analyze the change of the occlusion of each image in the image sequence, and identify the operation events that occur in the image sequence; The simulated touch instruction generation unit is used to judge whether the recognized operation event matches the preset event in the preset event sequence, and if so, generate a corresponding simulated touch instruction and enter the simulated touch instruction execution unit; No , then no simulated touch instruction is generated, and the camera unit is returned to wait for the next shielding operation; The simulated touch command execution unit is configured to perform a corresponding simulated touch operation according to the generated simulated touch command. 7. The system for simulating touch commands by shielding the imaging area according to claim 6, wherein the shielding recognition unit is specifically: if the region with a shield in the image sequence becomes larger from small to large, and finally there is a shield If the proportion of the area occupied by the entire imaging area reaches the preset upper limit of the occlusion ratio, it will be recognized as an occlusion event, and then enter the analog touch command generation unit; If the proportion of the area occupied by the entire imaging area reaches the preset upper limit of the unmasked ratio, it will be recognized as an unmasking event, and then enter the analog touch command generation unit; If the upper limit of the occlusion ratio is set, or the ratio of the unoccluded area to the entire imaging area does not finally reach the preset upper limit of the unmasking ratio, it will not be recognized and return to the camera unit to wait for the next occlusion operation. 8. A system for simulating touch commands by shielding the imaging area according to claim 7, characterized in that: each of the shielding events and unshading events has an event occurrence direction and an event occurrence speed; the event occurrence direction includes parallel A linear movement direction in the imaging area and an entry angle of β, a diverging direction perpendicular to the imaging area, or a shrinking direction perpendicular to the imaging area, wherein 0°≤β≤360°; the event occurrence speed is The collection of velocities for each stage in the course of an event or the average velocity of an event. 9. A system for simulating touch commands by shielding camera areas according to claim 8, wherein the preset events include event types, event directions and preset speeds, and each preset event is mapped to a An analog touch command; the preset speed is a range value with upper and lower limits; the simulated touch command includes a direction slide command and a click command. 10. A system for simulating a touch command by shielding an imaging area according to claim 9, wherein the simulating touch command generating unit is specifically: judging whether the recognized operation event is consistent with the preset event sequence in the preset event sequence The event matches, if the identified operation event matches the event type, event direction and preset speed of the preset event, an analog touch instruction corresponding to the operation event will be generated and entered into the analog touch instruction execution unit; if the identified operation event If the event type, event direction and preset speed of the preset event do not match, no simulated touch command is generated, and the processing of this shielding operation is terminated, and at the same time, it returns to the camera unit to wait for the next shielding operation.