CN115437499A - Virtual video identification control system and method - Google Patents

Abstract

The invention relates to the technical field of virtual videos, and particularly discloses a virtual video identification control system which comprises a camera, an operation module, a display medium and a control signal output module, wherein the operation module is connected with the camera through a wire, the display medium is connected with the operation module through a wire, and the control signal output module is connected with the display medium through a wire. The setting of above system can carry out the contactless and carry out the button to operating panel for the human body does not contact with operating panel, reduces the propagation of disease, can contactless control complicated computer interface, wisdom blackboard, computer, projection etc. make user's control mode leave the constraint situation that mouse keyboard and handheld electronic equipment come the operation, provides the opening to freely controlling in the sky with both hands in the field of vision environment and operating computer, thing networking.

Description

Virtual video identification control system and method

Technical Field

The invention relates to the technical field of virtual videos, in particular to a virtual video identification control system and a virtual video identification control method.

Background

At present, when the operation panel is pressed, the operation panel is usually pressed by a physical button, an electronic whiteboard is used for teaching, a speaker needs to be held in front of a computer to operate by a mouse or stand on a touch screen by hands, and the speaker can only turn pages up and down when playing slides due to the flexibility of a laser pen.

However, in the prior art, the operation panel needs to be touched manually, so that infectious diseases are easy to spread, the operation panel cannot be recovered after being pressed wrongly, and when electronic whiteboard teaching is performed, the position of a speaker cannot be away from the range of a touch screen, so that interactivity between classrooms is reduced, and short-distance communication with all people is lacked.

Disclosure of Invention

The invention aims to provide a virtual video recognition control system and a virtual video recognition control method, aims to solve the technical problem that infectious diseases are easy to propagate because an operation panel needs to be touched in the prior art, and aims to solve the problem that electronic equipment such as a mouse and a keyboard directly controls a computer interface by fingers and palms in a virtual space mode due to the constraint of the electronic equipment on the activities of people and hands.

In order to achieve the above purpose, the virtual video identification control system adopted by the invention comprises a camera, an operation module, a display medium and a control signal output module, wherein the operation module is connected with the camera through a wire, the display medium is connected with the operation module through a wire, and the control signal output module is connected with the display medium through a wire.

The operation module comprises an action recognition module, a control interface module, a superposition module and a signal trigger module, wherein the action recognition module is connected with the camera through a wire, the control interface module is connected with the action recognition module through a wire, the superposition module is connected with the control interface module through a wire, and the signal trigger module is connected with the superposition module through a wire.

Wherein, the display medium may adopt any one of, but not limited to, a display screen, a monitor, a display or a projection.

The invention also provides a virtual video identification control method, which is applied to the virtual video identification control system and comprises the following steps:

identifying fingers, a pointer and a palm through the camera and the action identification module;

the identification module and the control interface module are used for identifying the fingers, so that the camera field image in the image and the control interface in the image can be seen through the display medium, and further, when an operator moves the fingers, the fingers in the display medium move along with the display medium;

moving the finger to the corresponding virtual position;

at the moment, clicking or dragging is carried out;

calculating a video algorithm through the superposition module and the signal triggering module to judge the correctness of the action;

and after the action is confirmed to take effect, sending an instruction for executing the corresponding action, receiving the instruction by the control signal output module, and finally sending the instruction to execution equipment such as an elevator, a computer, an internet of things and the like.

The invention relates to a virtual video identification control system and a method, wherein an operator sees a camera field image in an image and a control interface in the image through a display medium, the operator sees a corresponding virtual position in the video image by moving a finger, a pointer and an infrared light finger mouse in the video image, so that the operator identifies an object through an action identification module and a control interface module, at the moment, a click dragging action is performed, in the identification range and the identification action of the action identification module, an identification program performs video algorithm calculation to judge the correctness of the action, and confirms that an action validation program sends out a command for executing the corresponding action.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating the operation of a virtual video recognition control system according to the present invention.

Fig. 2 is a schematic structural diagram of a virtual video recognition control system according to the present invention.

Fig. 3 is a flow chart of method steps of a virtual video recognition control method of the present invention.

Fig. 4 is a schematic diagram illustrating the operation steps of a virtual video recognition control method according to the present invention.

Fig. 5 is a schematic diagram illustrating the operation of a virtual video recognition control system according to the present invention on a computer.

The system comprises a camera 1, a display medium 2, a control signal output module 3, an action recognition module 4, a control interface module 5, a superposition module 6 and a signal trigger module 7.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative and intended to explain the present invention and should not be construed as limiting the present invention.

Referring to fig. 1 and 2, the present invention provides a virtual video identification control system, which includes a camera 1, an operation module, a display medium 2, and a control signal output module 3, where the operation module is connected to the camera 1 through a wire, the display medium 2 is connected to the operation module through a wire, and the control signal output module 3 is connected to the display medium 2 through a wire.

In this embodiment, the camera 1 collects an image of a finger or a pointer, the operation module recognizes the movement of the finger, the display medium 2 displays the operation panel and the finger, and finally the selected data is transmitted through the control signal output module 3.

Further, the operation module comprises an action recognition module 4, a control interface module 5, a superposition module 6 and a signal trigger module 7, wherein the action recognition module 4 is connected with the camera 1 through a wire, the control interface module 5 is connected with the action recognition module 4 through a wire, the superposition module 6 is connected with the control interface module 5 through a wire, and the signal trigger module 7 is connected with the superposition module 6 through a wire.

In this embodiment, the motion recognition module 4 recognizes a motion trajectory and a motion direction of a finger or a pointer, and simultaneously determines whether the motion is within a recognition range and a motion recognition range, the control interface module 5 is an operation background of an operation panel and can be a desktop interface of a general computer, the superposition module 6 performs superposition operation on the motion of the operation background and the motion of the finger, and feeds the motion back to the display medium 2, so that an operator can conveniently select a required key, and the signal trigger module 7 reads the selected key so as to transmit the key to the control signal output module 3.

Further, the display medium 2 may employ any one including, but not limited to, a display screen, a monitor, a display, or a projection.

In this embodiment, different display media 2 can be selected according to different requirements.

Referring to fig. 3 to fig. 5, the present invention further provides a virtual video identification control method, which is applied to the virtual video identification control system described above, and includes the following steps:

s1: identifying fingers, a pointer and a palm through the camera 1 and the action identification module 4;

s2: the fingers are identified through the identification module and the control interface module 5, so that the camera 1 field image in the image and the control interface in the image can be seen through the display medium 2, and further, when an operator moves the fingers, the fingers in the display medium 2 move along with the display medium;

s3: moving the finger to the corresponding virtual position;

s4: at the moment, clicking or dragging is carried out;

s5: the superposition module 6 and the signal trigger module 7 are used for calculating a video algorithm to judge the correctness of the action;

s6: and after the action is confirmed to take effect, sending an instruction for executing the corresponding action, receiving the instruction by the control signal output module 3, and finally sending the instruction to execution equipment such as an elevator, a computer, an internet of things and the like.

An operator sees a site video image and an elevator key operation interface in the image presented on the display medium 2 in the elevator, extends a finger to the image range, selects the content to be selected after adjusting to a proper distance from the camera 1, and performs a key action of clicking the position, performs real-time key number display or language prompt or a prompt mode of key color change on the display medium 2 after the action takes effect, and knows that the key action takes effect and so on to perform the next key action;

judging corresponding identification, presetting a range with a certain pixel size, identifying a slightly sharp object at the top, and identifying the characteristics of the pointer and the finger;

identifying the screen-scratching action, presetting a range with a certain pixel size, and quickly moving in the horizontal direction after the distance from the far moving range to the near moving range is too long;

under special conditions, in order to achieve the purpose that the interface is clear and not affected by video images, a small video induction sleeve can be worn on the finger tip of a finger, the blurring of field personnel in the images is changed into a light semitransparent shape, and only the small video induction sleeve on the finger can be seen, so that the definition of the interface is guaranteed.

The virtual video identification control method takes an elevator button as an example, but is not limited to the elevator button, and can control a complex operation computer interface, a teaching intelligent blackboard, a large-size touch screen and computer projection, so that a user control mode is separated from a constrained situation operated by a mouse keyboard and a handheld electronic device, and a starting situation is provided for operating a computer and an internet of things by using free virtual space control of two hands in a visual field environment; the simple original key-type equipment such as an elevator button, a unit door button and various entrance guard equipment buttons are controlled in a non-contact manner, disease transmission through the buttons is avoided, specific moving object tracking identification can be carried out on the camera 1 for the scene requiring a controller to move more flexibly to demonstrate the speech, so that the camera 1 can carry out behavior identification, automatic focal length adjustment and automatic tracking of moving objects, and an operator or a speaker can freely move to reach in a relatively large range to control an operation software interface; in order to improve the accuracy of capturing and judging the moving object, a reflective sleeve sensitive to infrared rays is sleeved on the finger, so that the finger is moved when the brightness of the recognition camera is reduced to blur the image, and the finger can be naturally a characteristic recognition object such as a palm or a pointer and the like and can be highlighted in a control interface.

While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (4)

1. A virtual video recognition control system is characterized in that,

the camera comprises a camera, an operation module, a display medium and a control signal output module, wherein the operation module is connected with the camera through a wire, the display medium is connected with the operation module through a wire, and the control signal output module is connected with the display medium through a wire.

2. The virtual video recognition control system of claim 1,

the operation module comprises an action recognition module, a control interface module, a superposition module and a signal trigger module, wherein the action recognition module is connected with the camera through a wire, the control interface module is connected with the action recognition module through a wire, the superposition module is connected with the control interface module through a wire, and the signal trigger module is connected with the superposition module through a wire.

3. The virtual video recognition control system of claim 2,

the display medium may take any of a variety of forms including, but not limited to, a display screen, a monitor, a display, or a projection.

4. A virtual video recognition control method applied to the virtual video recognition control system according to claim 3, comprising the steps of:

identifying fingers, a pointer and a palm through the camera and the action identification module;

the identification module and the control interface module are used for identifying the fingers, so that the camera field image in the image and the control interface in the image can be seen through the display medium, and further, when an operator moves the fingers, the fingers in the display medium move along with the display medium;

moving the finger to the corresponding virtual position;

at this time, a click or drag action is performed,

calculating a video algorithm through the superposition module and the signal triggering module to judge the correctness of the action;

and after the action is confirmed to take effect, sending an instruction for executing the corresponding action, receiving the instruction by the control signal output module, and finally sending the instruction to execution equipment such as an elevator, a computer, an internet of things and the like.

Images