CN115909500A - Gesture recognition-based equipment control method, device, equipment and medium - Google Patents
Gesture recognition-based equipment control method, device, equipment and medium Download PDFInfo
- Publication number
- CN115909500A CN115909500A CN202211597505.1A CN202211597505A CN115909500A CN 115909500 A CN115909500 A CN 115909500A CN 202211597505 A CN202211597505 A CN 202211597505A CN 115909500 A CN115909500 A CN 115909500A
- Authority
- CN
- China
- Prior art keywords
- gesture
- hand
- target
- preset
- degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
According to the device control method based on gesture recognition, gesture information of a target object is obtained and recognized based on a video image sequence including a hand area, and when the gesture information is a target gesture behavior, multimedia operations corresponding to the target gesture behavior are controlled to be executed by multimedia equipment aiming at the target multimedia information. And the target gesture behavior meets the condition that the gesture posture of the target hand is a preset gesture posture, the target hand keeps the preset gesture posture to a preset condition, and the preset gesture posture is that the bending degree of at least one finger is different from the bending degrees of other fingers. The target gesture information meeting the conditions is greatly different from the daily actions, and the problem that the device control error recognition rate is high due to the fact that the hand waving action in the prior art is avoided.
Description
Technical Field
The present application relates to the field of image analysis technologies, and in particular, to a method, an apparatus, a device, and a medium for controlling a device based on gesture recognition.
Background
Gesture recognition techniques are used to accurately estimate gesture information of the corresponding hand, such as 1,2,3,4,5, fist making, like, ok, etc. The gesture recognition technology can be applied to various human-computer interactions and the field of intelligent application. The air-separating gesture operation technology makes designated gestures through hands, and after characteristic analysis is carried out, air-separating control over the multimedia equipment is achieved.
The prior art device control based on gesture recognition generally performs the operation of the multimedia device by waving hands. The prior art has the problem that the device control misrecognition rate is high due to the fact that hand waving is too similar to daily actions.
Disclosure of Invention
The embodiment of the application provides a method, a device, equipment and a medium for controlling equipment based on gesture recognition, and aims to solve the problem that the error recognition rate of equipment control is high in the existing scheme of controlling multimedia equipment through gestures.
The application provides a device control method based on gesture recognition, which comprises the following steps:
acquiring a video image sequence containing a hand region, and identifying gesture information of a target object based on the video image sequence;
responding to the gesture information as a target gesture behavior, and controlling the multimedia equipment to execute a multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information; wherein:
the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
Further, the target hand keeping the preset gesture posture to a preset condition comprises:
the time for the target hand to keep the preset gesture posture meets first preset time; and/or
And the target hand moves a first distance to a target direction while keeping the preset gesture posture.
Further, the target multimedia information comprises any one or more of document information, image information, video information and audio information;
the multimedia operation comprises at least one of a moving operation, an enlarging operation, a reducing operation, a page turning operation, a switching operation, a fast forwarding operation, a backing operation and a pausing operation.
Further, the preset gesture posture comprises that a first finger in the target hand is a first bending degree, a second finger in the target hand is a second bending degree, the first bending degree is smaller than the second bending degree, and the first number of the first finger is smaller than the second number of the second finger.
Further, the first degree of flexion characterizes a corresponding first finger parallel to a palmar face of the target hand.
Further, the target direction is a pointing direction of the first finger.
Further, the air conditioner is provided with a fan, the preset gesture posture is a like gesture posture.
Further, the preset gesture posture includes that a third number of fingers in the target hand are in a third bending degree, a fourth number of fingers in the target hand are in a fourth bending degree, the third bending degree is smaller than the fourth bending degree, and the third number is larger than the fourth number.
Further, the preset gesture is a pinch gesture or a semi-pinch gesture.
Further, the preset gesture comprises a double-gesture-fit gesture.
Further, the preset gesture includes a fifth degree of curvature of the finger of the first hand being greater than a sixth degree of curvature of the finger of the second hand.
Further, the holding of the preset gesture posture by the target hand to a preset condition includes:
the first hand moves a second distance to the target direction while keeping the gesture posture of the first hand;
and the time for the second hand to keep the gesture posture of the second hand meets the second preset time of the pre-examination.
Further, the gesture posture of the first hand is a grabbing gesture posture, and the gesture posture of the second hand is a finger stretching gesture posture.
Further, the preset gesture comprises:
a third finger of the first hand having a seventh degree of flexion, a fourth finger having an eighth degree of flexion, the seventh degree of flexion being less than the eighth degree of flexion, a fifth number of the third fingers being less than a sixth number of the fourth fingers;
the ninth degree of curvature of the fingers in the second hand is greater than said seventh degree of curvature.
Further, the holding of the preset gesture posture by the target hand to a preset condition includes:
the first hand moves a third distance to the pointing direction of the third finger while keeping the gesture posture of the first hand;
and the time for the second hand to keep the gesture posture of the second hand meets a third preset time.
Further, the gesture posture of the first hand is a finger pointing gesture posture, and the gesture posture of the second hand is a fist making gesture posture.
In another aspect, the present application provides a device control apparatus based on gesture recognition, the apparatus including:
the identification module is used for acquiring a video image sequence containing a hand region and identifying gesture information of a target object based on the video image sequence;
the control module is used for controlling the multimedia equipment to execute the multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information, wherein the gesture information is the target gesture behavior; wherein:
the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
In another aspect, the present application provides an electronic device, including a processor, a communication interface, a memory and a communication bus, where the processor, the communication interface and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
a processor for implementing any of the above method steps when executing a program stored in the memory.
In yet another aspect, the present application provides a computer readable storage medium having stored therein a computer program which, when executed by a processor, performs the method steps of any of the above.
The application provides a method, a device, equipment and a medium for controlling equipment based on gesture recognition, wherein the method comprises the following steps: acquiring a video image sequence containing a hand region, and identifying gesture information of a target object based on the video image sequence; responding to the gesture information as a target gesture behavior, and controlling the multimedia equipment to execute a multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information; wherein: the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
The technical scheme has the following advantages or beneficial effects:
according to the device control method based on gesture recognition, gesture information of a target object is obtained and recognized based on a video image sequence containing a hand area, and when the gesture information is a target gesture behavior, the multimedia device is controlled to execute multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information. And the target gesture behavior meets the condition that the gesture posture of the target hand is a preset gesture posture, the target hand keeps the preset gesture posture to a preset condition, and the preset gesture posture is that the bending degree of at least one finger is different from the bending degrees of other fingers. The target gesture information meeting the conditions is different from daily actions greatly, and the problem that the error recognition rate of equipment control is high due to waving actions in the prior art is solved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of a device control process based on gesture recognition provided in the present application;
FIG. 2 is a schematic diagram illustrating exemplary key points of a hand provided herein;
FIG. 3 is a schematic diagram illustrating exemplary gesture information provided herein;
fig. 4 is an exemplary schematic diagram of a preset gesture provided in the present application;
FIG. 5 is a schematic diagram of a preset gesture provided herein;
FIG. 6 is a schematic diagram of a preset gesture provided herein;
FIG. 7 is a schematic diagram of a preset gesture provided herein;
FIG. 8 is a flowchart illustrating overall control of a device based on gesture recognition provided herein;
fig. 9 is a schematic structural diagram of a device control apparatus based on gesture recognition according to the present application;
fig. 10 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.
Fig. 1 is a schematic diagram of a device control process based on gesture recognition, where the process includes the following steps:
s101: the method comprises the steps of obtaining a video image sequence containing a hand area, and identifying gesture information of a target object based on the video image sequence.
S102: responding to the gesture information as a target gesture behavior, and controlling the multimedia equipment to execute a multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information; wherein: the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
The device control method based on gesture recognition is applied to electronic devices, and the electronic devices can be a PC, a tablet computer and other devices, and can also be video acquisition devices such as a camera. If the electronic equipment is video acquisition equipment, the video acquisition equipment acquires a video image sequence containing a hand area and then carries out the subsequent step of identifying the gesture information of the target object based on the video image sequence. If the electronic equipment is equipment such as a PC (personal computer) and a tablet personal computer, after the video image sequence containing the hand region is acquired by the video acquisition equipment, the video image sequence is firstly sent to the electronic equipment, and the electronic equipment carries out the subsequent step of identifying the gesture information of the target object based on the video image sequence.
Specifically, for each image in the video image sequence, a target detection network is used to perform target detection on a hand region in the image, and a hand region of a target object in the image is acquired. Or firstly, the human body area of the target object in the image is detected by using the target detection network to obtain the human body area in the image, and then, the hand area of the target object is obtained by using the target detection network to perform target detection on the hand area in the human body area. The target detection network may be a network of the architecture Resnet, hrnet, YOLO, etc. And then, sending the hand region data to a key point detection network or identifying fine hand features such as hand key points by using image algorithms such as corner point detection and the like. According to the key points of the hand of each image in the video image sequence, the gesture information of the target object can be determined. Fig. 2 is a schematic diagram illustrating an example of a hand key point provided by the present application, and fig. 3 is a schematic diagram illustrating an example of gesture information provided by the present application. As shown in fig. 3, for example, include a 1 gesture, a 2 gesture, a 3 gesture, an ok gesture, a like gesture, a fist-making gesture, and so on.
After the electronic equipment determines the gesture information, whether the gesture information is a target gesture behavior is judged, and the target gesture behavior is a gesture behavior in a preset multimedia control rule. And responding to the gesture information as the target gesture behavior, and controlling the multimedia equipment to execute the multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information. The target multimedia information comprises any one or more of document information, image information, video information and audio information; the multimedia operation includes at least one of a move operation, an enlarge operation, a reduce operation, a page turn operation, a switch operation, a fast forward operation, a reverse operation, and a pause operation. It should be noted that the target multimedia information and the multimedia operation have a corresponding relationship, for example, the target multimedia information is document information such as word, PDF, and the like, and the corresponding multimedia operation is, for example, a page turning operation, a page enlarging operation, a page reducing operation, a document switching operation, and the like. For example, the target multimedia information is video information or audio information, and the corresponding multimedia operation is, for example, a video/audio switching operation, a fast forward operation, a backward operation, a pause operation, etc. Different and harmonious gesture behaviors correspond to different multimedia operations.
In the application, the target gesture behavior comprises that the gesture posture of the target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to reach a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
The target hand may be the left hand of the human body, or the right hand of the human body, or both hands of the human body. The degree of curvature of at least one finger of the target hand is different from the degree of curvature of the other fingers. The degree of finger curvature may be determined by the location of the hand keypoints. Specifically, for each finger, according to the position of a key point of a hand in the finger, the bending degree of the finger compared with the straightened state can be determined, and the bending degree is the bending degree of the finger. And if the bending degree of at least one finger of the target hand is different from the bending degrees of other fingers, determining the gesture posture of the target hand as a preset gesture posture.
And when the target hand keeps the preset gesture posture to the preset condition, determining the gesture information as the target gesture behavior. Specifically, the step of keeping the preset gesture posture of the target hand to the preset condition includes: the time for keeping the preset gesture posture of the target hand meets first preset time; and/or the target hand moves the first distance towards the target direction while maintaining the preset gesture posture.
The target hand keeping the preset gesture posture to the preset condition comprises the following three steps:
first, the time for the target hand to keep the preset gesture posture satisfies a first preset time, and the first preset time is, for example, 2 seconds, 3 seconds, and the like.
And secondly, the target hand moves towards the target direction by a first distance while keeping the preset gesture posture. At this time, the time for the target hand to keep the preset gesture posture is not limited, as long as the target hand keeps the preset gesture posture and moves towards the target direction by the first distance. The first distance is, for example, the width of a human shoulder, or 10 cm, 20 cm, etc.
And thirdly, the time for the target hand to keep the preset gesture meets the first preset time, and meanwhile, the target hand keeps the preset gesture and moves the first distance to the target direction.
And finally, responding to the gesture information as the target gesture behavior, and controlling the multimedia equipment to execute the multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information. And if the gesture information is not the target gesture behavior, not correspondingly controlling the multimedia equipment.
According to the device control method based on gesture recognition, gesture information of a target object is obtained and recognized based on a video image sequence containing a hand area, and when the gesture information is a target gesture behavior, the multimedia device is controlled to execute multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information. And the target gesture behavior meets the condition that the gesture posture of the target hand is the preset gesture posture, the target hand keeps the preset gesture posture to the preset condition, and the preset gesture posture is that the bending degree of at least one finger is different from the bending degrees of other fingers. The target gesture information meeting the conditions is greatly different from the daily actions, and the problem that the device control error recognition rate is high due to the fact that the hand waving action in the prior art is avoided.
In this application, predetermine the gesture and include that first finger is first crooked degree in the target hand, and the second finger is the second crooked degree, and first crooked degree is less than the second crooked degree, and the first quantity of first finger is less than the second quantity of second finger.
The first finger may be any one finger, or any number of fingers, of the target hand. But it is necessary to ensure that the first number of first fingers is smaller than the second number of second fingers. For example, the target hand is the left hand of the target object, the first finger is the thumb, the second fingers are the index finger, the middle finger, the ring finger and the little finger, or the first finger is the thumb and the index finger, the second finger is the middle finger, the ring finger and the little finger, and so on. The first degree of curvature of the first finger is less than the second degree of curvature of the second finger. For example, the first finger is in a straightened state and the second finger is in a bent state, or both the first finger and the second finger are in a bent state, but the first degree of bending is less than the second degree of bending.
The first degree of flexion characterizes a corresponding first finger parallel to the volar surface of the target hand. That is to say that first finger is the state of unbending, and first finger is arbitrary one or more finger, and the first quantity of first finger is less than the second quantity of second finger.
In this application, the target hand keeps predetermineeing the gesture to predetermineeing the condition and includes: the time for the target hand to keep the preset gesture posture meets first preset time; and/or the target hand moves the first distance towards the target direction while maintaining the preset gesture posture. Specifically, the target direction is a pointing direction of the first finger. In addition, if the first finger is a single finger, the pointing direction of the first finger is the target direction, and if the first finger is a plurality of fingers, the pointing direction of any one first finger can be the target direction. Specifically, fig. 4 is an exemplary schematic diagram of the preset gesture provided in the present application, where the preset gesture is a like gesture. And if the thumbs in the praise gesture points at different directions and the moving directions are different, the corresponding multimedia operations are different. As shown in the left diagram of fig. 4, which moves downward, the multimedia device is controlled to perform a corresponding multimedia operation, such as a page-turning operation. As in the right diagram of fig. 4, which moves to the left, the multimedia device is controlled to perform the corresponding multimedia operation. Such as a switching operation.
In addition, in this application preset gesture includes the finger of third quantity is third degree of curvature in the target hand, and the finger of fourth quantity is the fourth degree of curvature, the third degree of curvature is less than the fourth degree of curvature, the third quantity is greater than the fourth quantity.
Taking the target hand as a single hand for example, the third number of fingers is, for example, 3 fingers, and the fourth number of fingers is, for example, 2 fingers; or the third number of fingers is for example 4 fingers and the fourth number of fingers is for example 1 finger. The third degree of curvature of the third number of fingers is less than the fourth degree of curvature of the fourth number of fingers.
Fig. 5 is a schematic diagram of a preset gesture provided in the present application, and as shown in fig. 5, the preset gesture is a pinch gesture or a half pinch gesture. The pinch gesture is a persistent gesture, and is reflected in a video image sequence, and the pinch gesture involves three finger gestures, a half-grip gesture and a pinch gesture.
In addition, in this application the preset gesture comprises a double-gesture-matched gesture.
The preset gesture includes a fifth degree of curvature of the finger of the first hand being greater than a sixth degree of curvature of the finger of the second hand. The fingers of the second hand can be in a straight state, and the fingers of the first hand can be in a bent state. This ensures that the fifth degree of flexion of the fingers of the first hand is greater than the sixth degree of flexion of the fingers of the second hand. Alternatively, the fingers of the first hand and the fingers of the second hand are both flexed, but the fifth degree of flexion of the fingers of the first hand is greater than the sixth degree of flexion of the fingers of the second hand.
Specifically, fig. 6 is a schematic diagram of a preset gesture provided in the present application, as shown in fig. 6, the gesture posture of the first hand is a grabbing gesture posture, and the gesture posture of the second hand is a finger stretching gesture posture.
The target hand maintaining the preset gesture posture to a preset condition comprises:
the first hand moves a second distance to the target direction while keeping the gesture posture of the first hand;
and the time for the second hand to keep the gesture posture of the second hand meets the second preset time of pre-examination.
Wherein the target direction may be any of a left, right, up or down direction. The multimedia operations corresponding to different directions are different. The second distance is the same or different than the first distance. The second preset time is the same as or different from the first preset time.
In addition, in this application the preset gesture includes:
in the first hand, the third finger has a seventh degree of curvature and the fourth finger has an eighth degree of curvature, the seventh degree of curvature being less than the eighth degree of curvature, the fifth number of the third fingers being less than the sixth number of the fourth fingers;
the ninth degree of curvature of the finger in the second hand is greater than the seventh degree of curvature.
For example, the number of the third fingers is one, and the number of the fourth fingers is four; or the number of the third fingers is two, and the number of the fourth fingers is three. The third finger can be in a straight state, and the fourth finger is in a bent state, so that the seventh bending degree of the third finger is smaller than the eighth bending degree of the fourth finger. Or both the third finger and the fourth finger are in a flexed state, but the seventh degree of flexion of the third finger is less than the eighth degree of flexion of the fourth finger.
The ninth degree of curvature of the fingers in the second hand is greater than the seventh degree of curvature. And the ninth bending degree of all the fingers of the second hand is greater than the seventh bending degree, or the ninth bending degree of any one or more fingers of the second hand is greater than the seventh bending degree.
Fig. 7 is a schematic diagram of preset gesture postures provided in the present application, and as shown in fig. 7, the gesture posture of the first hand is a finger pointing gesture posture, and the gesture posture of the second hand is a fist making gesture posture.
The target hand maintaining the preset gesture posture to a preset condition comprises:
the first hand moves a third distance to the pointing direction of the third finger while keeping the gesture posture of the first hand;
and the time for the second hand to keep the gesture posture of the second hand meets a third preset time.
The third distance may be the same as or different from the second distance, and the third preset time may be the same as or different from the second preset time.
Fig. 8 is an overall flowchart of the device control based on gesture recognition provided in the present application, including: acquiring a hand area corresponding to a human body; performing gesture recognition and hand key point detection and recognition by utilizing a deep learning or traditional image algorithm; defining a finger pointing action protocol, a single-hand grabbing action protocol and a double-hand action protocol; judging predefined actions according to the gesture characteristics; the action matching success equipment executes the relevant operation.
Fig. 9 is a schematic structural diagram of a device control apparatus based on gesture recognition, which includes:
the recognition module 91 is configured to acquire a video image sequence including a hand region, and recognize gesture information of a target object based on the video image sequence;
the control module 92 is configured to, in response to that the gesture information is a target gesture behavior, control the multimedia device to execute a multimedia operation corresponding to the target gesture behavior with respect to the target multimedia information; wherein:
the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
The present application also provides an electronic device, as shown in fig. 10, including: the system comprises a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor 301, the communication interface 302 and the memory 303 are communicated with each other through the communication bus 304;
the memory 303 has stored therein a computer program which, when executed by the processor 301, causes the processor 301 to perform any of the above method steps.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface 302 is used for communication between the above-described electronic apparatus and other apparatuses.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a central processing unit, a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like.
A computer-storage-readable storage medium is provided, in which a computer program executable by an electronic device is stored, which program, when run on the electronic device, causes the electronic device to carry out any of the above method steps when executed.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (19)
1. A method for controlling a device based on gesture recognition, the method comprising:
acquiring a video image sequence containing a hand region, and identifying gesture information of a target object based on the video image sequence;
responding to the gesture information as a target gesture behavior, and controlling the multimedia equipment to execute a multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information;
wherein: the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
2. The method of claim 1, wherein the target hand maintaining the preset gesture pose to a preset condition comprises:
the time for the target hand to keep the preset gesture posture meets first preset time; and/or
And the target hand moves a first distance to a target direction while keeping the preset gesture posture.
3. The method of claim 1, wherein the target multimedia information includes any one or more of document information, image information, video information, audio information;
the multimedia operation comprises at least one of a moving operation, an enlarging operation, a reducing operation, a page turning operation, a switching operation, a fast forwarding operation, a backing operation and a pausing operation.
4. The method of claim 2, wherein the preset gesture pose includes a first degree of curvature for a first finger and a second degree of curvature for a second finger in the target hand, the first degree of curvature being less than the second degree of curvature, the first number of first fingers being less than the second number of second fingers.
5. The method of claim 4, wherein the first degree of curvature characterizes a corresponding first finger being parallel to a palmar face of the target hand.
6. The method of claim 5, wherein the target direction is a pointing direction of the first finger.
7. The method of claim 5, wherein the preset gesture is a like gesture.
8. The method of claim 1, wherein the preset gesture pose includes a third number of fingers in the target hand being a third degree of curvature and a fourth number of fingers being a fourth degree of curvature, the third degree of curvature being less than the fourth degree of curvature, the third number being greater than the fourth number.
9. The method of claim 8, wherein the preset gesture is a pinch gesture or a semi-pinch gesture.
10. The method of claim 1, wherein the preset gesture pose comprises a two-gesture fit gesture pose.
11. The method of claim 10, wherein the preset gesture pose comprises a fifth degree of curvature of a finger of the first hand being greater than a sixth degree of curvature of a finger of the second hand.
12. The method of claim 11, wherein the target hand maintaining the preset gesture pose to a preset condition comprises:
the first hand moves a second distance to the target direction while keeping the gesture posture of the first hand;
and the time for the second hand to keep the gesture posture of the second hand meets the second preset time of pre-examination.
13. The method of claim 11, wherein the first hand gesture pose is a grab gesture pose and the second hand gesture pose is a finger stretch gesture pose.
14. The method of claim 10, wherein the preset gesture pose comprises:
in the first hand, the third finger has a seventh degree of curvature and the fourth finger has an eighth degree of curvature, the seventh degree of curvature being less than the eighth degree of curvature, the fifth number of the third fingers being less than the sixth number of the fourth fingers;
the ninth degree of curvature of the fingers in the second hand is greater than said seventh degree of curvature.
15. The method of claim 14, wherein the target hand maintaining the preset gesture pose to a preset condition comprises:
the first hand moves a third distance to the pointing direction of the third finger while keeping the gesture posture of the first hand;
and the time for the second hand to keep the gesture posture of the second hand meets a third preset time.
16. The method of claim 14, wherein the first hand gesture pose is a finger pointing gesture pose and the second hand gesture pose is a fist making gesture pose.
17. An apparatus for controlling a device based on gesture recognition, the apparatus comprising:
the identification module is used for acquiring a video image sequence containing a hand region and identifying gesture information of a target object based on the video image sequence;
the control module is used for responding to the gesture information as a target gesture behavior and controlling the multimedia equipment to execute the multimedia operation corresponding to the target gesture behavior aiming at the target multimedia information; wherein:
the target gesture behavior comprises that the gesture posture of a target hand is a preset gesture posture, and the target hand keeps the preset gesture posture to a preset condition; the target hand comprises at least one of two hands of a human body, and the preset gesture is that the bending degree of at least one finger is different from the bending degrees of other fingers.
18. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1 to 16 when executing a program stored in the memory.
19. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 16.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211597505.1A CN115909500A (en) | 2022-12-12 | 2022-12-12 | Gesture recognition-based equipment control method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211597505.1A CN115909500A (en) | 2022-12-12 | 2022-12-12 | Gesture recognition-based equipment control method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115909500A true CN115909500A (en) | 2023-04-04 |
Family
ID=86472430
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211597505.1A Pending CN115909500A (en) | 2022-12-12 | 2022-12-12 | Gesture recognition-based equipment control method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115909500A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117373135A (en) * | 2023-12-07 | 2024-01-09 | 湖北星纪魅族集团有限公司 | Sliding gesture recognition method and system based on vision and related equipment |
-
2022
- 2022-12-12 CN CN202211597505.1A patent/CN115909500A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117373135A (en) * | 2023-12-07 | 2024-01-09 | 湖北星纪魅族集团有限公司 | Sliding gesture recognition method and system based on vision and related equipment |
| CN117373135B (en) * | 2023-12-07 | 2024-03-15 | 湖北星纪魅族集团有限公司 | Sliding gesture recognition method and system based on vision and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108960163B (en) | Gesture recognition method, device, equipment and storage medium | |
| US8570383B2 (en) | Apparatus, method and computer program for recognizing a gesture in a picture, and apparatus, method and computer program for controlling a device | |
| JP2011253292A (en) | Information processing system, method and program | |
| KR101559502B1 (en) | Method and recording medium for contactless input interface with real-time hand pose recognition | |
| GB2491473A (en) | Recognising hands in a gesture-based interface using features identified during system operation | |
| US20190339858A1 (en) | Method and apparatus for adjusting virtual key of mobile terminal | |
| CN107450717B (en) | Information processing method and wearable device | |
| CN115909500A (en) | Gesture recognition-based equipment control method, device, equipment and medium | |
| CN115291724A (en) | Man-machine interaction method and device, storage medium and electronic equipment | |
| CN111103981A (en) | Control instruction generation method and device | |
| CN116766213B (en) | Bionic hand control method, system and equipment based on image processing | |
| US20210117080A1 (en) | Method and apparatus for adjusting virtual key of mobile terminal | |
| CN113961067B (en) | Non-contact doodling drawing method and recognition interaction system based on deep learning | |
| US20220050528A1 (en) | Electronic device for simulating a mouse | |
| CN112381709B (en) | Image processing method, model training method, device, equipment and medium | |
| CN111522447B (en) | Display switching method, display terminal, electronic device and storage medium | |
| Nikhil et al. | Design and development of a DSP processor based reconfigurable hand Gesture Recognition System for real time applications | |
| CN109725722B (en) | Gesture control method and device for screen equipment | |
| Kopinski et al. | Touchless interaction for future mobile applications | |
| CN113126753B (en) | Implementation method, device and equipment for closing equipment based on gesture | |
| Lee et al. | Vision-based fingertip-writing character recognition | |
| CN111160173B (en) | Gesture recognition method based on robot and robot | |
| CN115223002B (en) | Model training method, door opening motion detection device and computer equipment | |
| WO2023123473A1 (en) | Man-machine interaction method and system, and processing device | |
| Nakamura et al. | Distinction system of left and right hands placed on a keyboard of laptop computers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |