CN107371307B - A kind of lamp effect control method and system based on gesture identification - Google Patents
A kind of lamp effect control method and system based on gesture identification Download PDFInfo
- Publication number
- CN107371307B CN107371307B CN201710577064.1A CN201710577064A CN107371307B CN 107371307 B CN107371307 B CN 107371307B CN 201710577064 A CN201710577064 A CN 201710577064A CN 107371307 B CN107371307 B CN 107371307B
- Authority
- CN
- China
- Prior art keywords
- hand
- image
- brightness
- gray value
- lamp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000000694 effects Effects 0.000 title claims abstract description 27
- 230000008859 change Effects 0.000 claims description 56
- 230000001795 light effect Effects 0.000 claims description 19
- 238000000605 extraction Methods 0.000 claims description 14
- 230000009471 action Effects 0.000 claims description 8
- 230000003247 decreasing effect Effects 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 6
- 238000004891 communication Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 230000003750 conditioning effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000001143 conditioned effect Effects 0.000 description 2
- 238000005260 corrosion Methods 0.000 description 2
- 230000007797 corrosion Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000003628 erosive effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Multimedia (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a kind of lamp effect control methods and system based on gesture identification, the image for including hand captured by image taking module is obtained first, then the image of hand in described image is extracted, according to the image of the hand extracted, it identifies the stretching degree of hand, and is used to adjust come the control instruction of the brightness of lamp according to the variation generation of hand stretching degree.Implement the effect control method of the lamp based on gesture identification and system of the present invention, operating personnel on the premise of any remote control is not carried, can realize the adjusting of the brightness to lamp, convenient and simple.
Description
Technical Field
The invention relates to the field of lamps, in particular to the field of equivalent control of lamps, and relates to a gesture recognition-based lamp effect control method and system.
Background
The lamp is an indispensable part in daily life and work of people, and besides the necessary on-off, the brightness of the lamp is also required to be adjusted in many times, so that the lamp is set at different brightness. The brightness of the lamp is adjusted by adjusting a switch manually and adjusting the switch to different gears or different opening degrees. However, the manual adjustment of the switch requires the operator to be at the switch for operation, which is sometimes inconvenient.
In order to solve the above problems, the prior art provides a method for solving the above problems by using a handheld remote control device, and an operator triggers a switch on the handheld remote control device to adjust the brightness of a lamp. However, on the one hand the hand-held remote control is easily lost and on the other hand the hand-held remote control needs to occupy one hand of the operator, which is inconvenient in certain situations, such as when a handshake, hug or the like interaction with a person is required.
Disclosure of Invention
The invention aims to solve the technical problems that a manual adjusting mode and a handheld remote control device adjusting switch mode are adopted when the brightness of a lamp is adjusted, the use is inconvenient, and the handheld remote control device is easy to lose, and provides a lamp effect control method and system based on gesture recognition.
According to a first aspect of the present invention, to solve the technical problem, there is provided a light effect control system based on gesture recognition, including:
the image acquisition module is used for acquiring the image which is shot by the image shooting module and contains the hand of the operator;
the hand extraction module is used for extracting images of hands in the images;
the motion recognition module is used for recognizing the opening degree of the hand according to the extracted hand image;
and the brightness adjusting module is used for generating a control instruction for adjusting the brightness of the incoming light according to the change of the opening degree of the hand.
In the gesture recognition-based lamp effect control system of the present invention, the control command satisfies, when applied to the lamp: when the degree of openness of the hand is increased, the brightness of the lamp is increased, and when the degree of openness of the hand is increased, the brightness of the lamp is decreased.
In the gesture recognition-based lamp effect control system, each opening degree of the hand from full closing to full opening corresponds to each brightness of the lamp from minimum brightness to maximum brightness one by one; or,
each change of the degree of opening of the hand from the fully closed state to the fully opened state corresponds to each change from the minimum brightness change amount to the minimum brightness change amount, respectively.
In the light effect control system based on gesture recognition of the present invention, further comprising:
and the color adjusting module is used for generating a control instruction for switching the color of the lamp when the change speed of the opening degree is greater than a preset value.
In the gesture recognition-based light effect control system of the present invention, the hand extraction module comprises:
the graying processing module is used for performing graying processing on the shot image;
the inter-class variance traversing module is used for calculating the inter-class variance of the gray value of each pixel in the image after the graying treatment according to the following formula to obtain the gray value which enables the inter-class variance to be maximum;
g＝ω1×ω2×(μ1-μ2)2，
wherein g is the inter-class variance, ω1The proportion of the number of pixels with the gray value larger than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu1Average gray value, ω, of pixels in the grayed image having gray values greater than the currently selected gray value2The proportion of the number of pixels with the gray value smaller than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu2The average gray value of the pixels with the gray values smaller than the currently selected gray value in the image after the graying processing;
and the binarization processing module is used for performing binarization processing on the image subjected to the graying processing by taking the obtained gray value which enables the inter-class variance to be maximum as a segmentation threshold value to obtain an image of the hand.
According to another aspect of the present invention, to solve the technical problem, the present invention further provides a light effect control method based on gesture recognition, including:
an image acquisition step: acquiring an image of a hand of an operator including the operator captured by an image capturing module;
a hand extraction step: extracting an image of a hand in the image;
and (3) action recognition: recognizing the opening degree of the hand according to the extracted hand image;
and a brightness adjusting step: and generating a control instruction for adjusting the brightness of the incoming light according to the change of the hand opening degree.
In the gesture recognition-based lamp effect control system of the present invention, the control command satisfies, when applied to the lamp: when the degree of openness of the hand is increased, the brightness of the lamp is increased, and when the degree of openness of the hand is increased, the brightness of the lamp is decreased.
In the gesture recognition-based lamp effect control system, each opening degree of the hand from full closing to full opening corresponds to each brightness of the lamp from minimum brightness to maximum brightness one by one; or, the change of each opening degree of the hand from full opening to full closing to full opening respectively corresponds to each change of the brightness from zero change to the minimum change of the brightness in a one-to-one mode.
In the light effect control system based on gesture recognition of the present invention, further comprising:
and a color adjusting step for generating a control command for switching the color of the lamp when the speed of change of the opening degree is greater than a preset value.
In the gesture recognition-based light effect control system of the present invention, the hand extraction step includes:
a graying processing step of graying the photographed image;
an inter-class variance traversing step, which is used for calculating the inter-class variance of the gray value of each pixel in the image after the graying treatment according to the following formula, and obtaining the gray value which enables the inter-class variance to be maximum;
g＝ω1×ω2×(μ1-μ2)2，
wherein g is the inter-class variance, ω1The proportion of the number of pixels with the gray value larger than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu1The gray value of the image after the graying treatment is larger than the current valueMean gray value of the pixels of the selected gray value, ω2The proportion of the number of pixels with the gray value smaller than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu2The average gray value of the pixels with the gray values smaller than the currently selected gray value in the image after the graying processing;
and a binarization processing step of performing binarization processing on the image after the graying processing by using the obtained gray value which enables the inter-class variance to be maximum as a segmentation threshold value to obtain an image of the hand.
The light effect control method and the light effect control system based on gesture recognition firstly acquire the image including the hand part, which is shot by the image shooting module, then extract the image of the hand part in the image, recognize the opening degree of the hand part according to the extracted image of the hand part, and generate a control instruction for adjusting the brightness of the incoming light according to the change of the opening degree of the hand part. By implementing the gesture recognition-based lamp effect control method and system, an operator can adjust the brightness of the lamp on the premise of not carrying any remote control device, and the method and system are convenient and simple, and have simple algorithm, high operation speed and low manufacturing cost.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a functional block diagram of a preferred embodiment of a gesture recognition based lamp effect control system of the present invention;
fig. 2 is a flowchart of a gesture recognition-based light effect control method according to a preferred embodiment of the present invention.
Detailed Description
For a more clear understanding of the technical features, objects and effects of the present invention, embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
Fig. 1 is a schematic block diagram of a preferred embodiment of the gesture recognition-based light effect control system according to the present invention. The light effect control system of this embodiment has a gesture recognition end 1 and a light effect control end 2, and the gesture control end 1 has an image shooting module 11, a hand extraction module 12, an action recognition module 13, a brightness adjustment module 14 and a bluetooth module 15 which are connected in sequence. The lamp effect control end 2 is provided with a second Bluetooth module 22 and a lamp effect control module 21 which are connected. The first Bluetooth module 15 and the second Bluetooth module 22 are in communication connection.
In this embodiment, the image capturing module 11 employs a camera with a fixed capturing angle in this embodiment, the camera captures an image of a hand of a lamp effect operator, the hand of the operator appearing at will in the capturing range of the camera is taken as the hand of the operator for capturing, and the captured hand image is taken as an effective image. In another embodiment of the present invention, the image capturing module 11 is a pan-tilt camera, the pan-tilt camera automatically tracks the corresponding person according to the preset person image, captures the gesture of the person for processing, and regards the captured hand images of other persons as invalid images, and the invalid images do not participate in the generation or action of the control command.
The hand extraction module 12 has a signal conditioning circuit and a hand extraction unit connected to the signal conditioning circuit. The signal conditioning circuit is connected with the image shooting module 11, conditions the image shot by the image shooting module 11, amplifies the signal to a preset range, then performs filtering processing, filters noise in the signal, and transmits the filtered signal to the hand extracting unit, and the hand extracting unit processes the conditioned image to extract the image of the hand.
The motion recognition module 13 is connected to the hand extraction module 12, and recognizes the degree of opening of the hand from the extracted hand image.
The brightness adjustment module 14 generates a control command for controlling the brightness of the lamp according to the change of the opening degree of the hand. After the control instruction is generated, the first bluetooth module 15 connected with the brightness adjusting module 14 sends out the control instruction. In the process of opening the hand, the opening degree is gradually increased; the hand is held tightly, and the opening degree gradually reduces.
After receiving the control instruction, the second bluetooth module 22 transmits the control instruction to the lamp effect control device 21 connected with the second bluetooth module, and the lamp effect control device 21 responds to the control instruction to adjust the brightness of the lamp and adjust the brightness up or down.
In another embodiment of the present invention, the gesture control end 1 and the light effect control end 2 may use other transmission methods instead of using the two bluetooth modules of the present invention, that is, the two bluetooth modules may be replaced by any one of the following modules at the same time: an RS232 communication module, an RS485 communication module, an RS422 communication module, an spi (serial peripheral interface) communication module, an Inter-Integrated Circuit (IIC) communication module, a Zigbee communication module, and an NRF communication module.
The hand extraction module 12 processes the processed image, and the extraction of the hand image can be realized by the following modules.
And the graying processing module is used for performing graying processing on the photographed conditioned image. The image information collected by the camera is an RGB color image, in order to reduce the calculated amount, the RGB image is firstly subjected to gray processing, and the pixel value of each processed pixel is as follows:
Gray＝R*0.299+G*0.587+B*0.114
where Gray is a pixel value of a Gray image formed after the graying process, and R, G, B is a pixel value corresponding to red, green, and blue in a color image before the graying process.
The inter-class variance traversing module is used for calculating the inter-class variance of the gray value of each pixel in the image after the graying treatment according to the following formula to obtain the gray value which enables the inter-class variance to be maximum
g＝ω1×ω2×(μ1-μ2)2，
Wherein g is the inter-class variance, ω1The proportion of the number of pixels with the gray value larger than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu1Average gray value, ω, of pixels in the grayed image having gray values greater than the currently selected gray value2The proportion of the number of pixels with the gray value smaller than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu2The average gray value of the pixels with the gray values smaller than the currently selected gray value in the image after the graying processing;
and the binarization processing module is connected with the inter-class variance traversing module and is connected with a second processor of the action identification module, the obtained gray value which enables the inter-class variance to be maximum is used as a segmentation threshold value, the image after the graying processing is subjected to binarization processing, and then expansion operation and corrosion operation are carried out to filter out the background, so that the image of the hand is obtained. In the present embodiment, the gradation value is smaller thanThe pixels of (a) are binarized into "0", otherwise are binarized into "1", all the pixels binarized into "1" constitute the image of the hand of the present invention, and the pixels binarized into "0" constitute the image of the background on which the back of the hand of the present invention is located.
The motion recognition module 13 recognizes the degree of opening of the hand from the extracted hand image. In order to reduce the calculation error of the area in the invention, after the binarization processing, an expansion operation and an erosion operation can be further adopted to filter noise in the background, i.e. to filter a small number of "1" surrounded by the pixel binarized to "0". And then summing the images after the binarization processing, which is equivalent to summing the areas of the images of the hands, and adding all the '1's to obtain a sum, wherein the size of the sum represents the opening degree of the hands, the change speed of the sum can also reflect the change speed of the opening degree of the hands, and the faster the sum is, the larger the change of the opening degree is, and the slower the change is, the smaller the change of the opening degree is. Preferably, the opening degree is (the current sum of the hands and the minimum sum of the hands)/(the maximum sum of the hands and the minimum sum of the hands), wherein the maximum sum of the hands and the maximum sum of the hands are obtained in a preset manner, and the average value of the adults can be obtained, and the opening degree can be collected for different operators in advance.
The brightness adjusting module 14 generates a control instruction for adjusting the brightness of the coming lamp according to the change of the opening degree of the hand, and the control instruction meets the following requirements when acting on the lamp: when the degree of openness of the hand is increased, the brightness of the lamp is increased, and when the degree of openness of the hand is increased, the brightness of the lamp is decreased. After the brightness of the lamp is adjusted to the maximum value, the hand is continuously opened, and the brightness of the lamp is not increased any more; after the brightness of the lamp is adjusted to the minimum brightness, the hands are continuously closed, and the brightness is not reduced. There are two ways to implement the above control command: 1. each opening degree of the hand from full closing (fist making) to full opening (finger straightening) is in one-to-one correspondence with each brightness of the lamp from minimum brightness (such as lamp closing) to maximum brightness (such as lamp saturation), and the opening degree in the process is preferably in direct proportion to the brightness of the lamp; 2. the change of each opening degree of the hand from full opening to full closing to full opening is respectively in one-to-one correspondence with each change of brightness from zero change to minimum change of brightness, namely, the minimum change of the hand from opening to full closing is-30% (brightness is reduced by 30%), the maximum change of the hand from full closing to full opening is (brightness is increased by 30%), the brightness is increased by 15% if the hand is fully closed to opening 50% at a certain time, and when the brightness which needs to be adjusted for many times is larger (larger than 30%), the adjustment can be carried out for many times. When the hand performs the opening or closing action, the brightness of the lamp can be gradually changed along with the opening/closing action of the hand, or the brightness can be directly adjusted to the final result after the opening/closing action of the hand is completed.
The lamp effect control system is also provided with a color adjusting module which is used for generating a control instruction for switching the color of the lamp when the variation speed of the opening and closing degree is greater than a preset value. That is, when the variation speed of the sum is greater than the preset value, the light effect control device 21 responds to the control command to switch the color of the lamp from the current color to another color, where the color is a single color or a combination of multiple colors.
It may take several hundred milliseconds for a person to complete one hand opening and closing, taking a time interval Δ t (Δ t)<100ms) is determined as a unit time, and the area of the hand image before Δ t (i.e., the sum obtained, the same applies hereinafter) is obtained as StThe area of the current hand image is St+ΔtThe change speed of the area of the hand image is obtained by using a formula:
thus, the change speed v of the area of the hand image in Δ t can be obtaineds. Further determine upsilonsWhether positive or negative, if upsilonsIs positive, indicating that the motion state of the hand is open, and if upsilon issA negative value indicates that the operating state of the hand is in the state.
Fig. 2 is a flowchart of a gesture recognition-based light effect control method according to a preferred embodiment of the present invention. In this embodiment, the lamp efficiency control method includes the following steps:
and S1, acquiring the image which is shot by the image shooting module and contains the hand of the operator. In the present embodiment, the image is captured by a camera, and the captured image is a color image.
And S2, extracting the image of the hand in the image. In this embodiment, step S2 specifically includes:
firstly, performing graying processing on an RGB image, wherein the pixel value of each pixel after processing is as follows:
Gray＝R*0.299+G*0.587+B*0.114
where Gray is a pixel value of a Gray image formed after the graying process, and R, G, B is a pixel value corresponding to red, green, and blue in a color image before the graying process.
Secondly, calculating the inter-class variance of the gray value of each pixel in the image after the graying treatment according to the following formula to obtain the gray value which enables the inter-class variance to be maximum
g＝ω1×ω2×(μ1-μ2)2，
Wherein g is the inter-class variance, ω1The proportion of the number of pixels with the gray value larger than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu1Average gray value, ω, of pixels in the grayed image having gray values greater than the currently selected gray value2The proportion of the number of pixels with the gray value smaller than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu2The average gray value of the pixels with the gray values smaller than the currently selected gray value in the image after the graying processing;
then, the obtained gray value which enables the inter-class variance to be maximum is used as a segmentation threshold, the image after the gray processing is subjected to binarization processing, then expansion operation and corrosion operation are carried out to filter out the background, and the image of the hand is obtained. In the present embodiment, the gradation value is smaller thanThe pixels of (a) are binarized into "0", otherwise are binarized into "1", all the pixels binarized into "1" constitute the image of the hand of the present invention, and the pixels binarized into "0" constitute the image of the background on which the back of the hand of the present invention is located.
And S3, recognizing the opening degree of the hand according to the extracted hand image. In order to reduce the calculation error of the area in the invention, after the binarization processing, an expansion operation and an erosion operation can be further adopted to filter noise in the background, i.e. to filter a small number of "1" surrounded by the pixel binarized to "0". And then summing the images after the binarization processing, wherein the sum is expressed by equivalently summing the areas of the images of the hands, the sum is obtained by adding all the '1's, the size of the sum represents the opening degree of the hands, the change speed of the sum can also reflect the change speed of the opening degree of the hands, and the faster the sum is changed, the larger the opening degree is changed, the slower the change is, and the smaller the opening degree is changed.
S4, generating a control command for adjusting the brightness of the coming lamp according to the change of the hand opening degree, wherein the control command satisfies the following conditions when acting on the lamp: when the degree of openness of the hand is increased, the brightness of the lamp is increased, and when the degree of openness of the hand is increased, the brightness of the lamp is decreased. There are two ways to implement the above control command: 1. each opening degree of the hand from full closing (fist making) to full opening (finger straightening) is in one-to-one correspondence with each brightness of the lamp from minimum brightness (such as lamp closing) to maximum brightness (such as lamp saturation), and the opening degree in the process is preferably in direct proportion to the brightness of the lamp; 2. the change of each opening degree of the hand from full opening to full closing to full opening is respectively in one-to-one correspondence with each change of brightness from zero change to minimum change of brightness, namely, the minimum change of the hand from opening to full closing is-30% (brightness is reduced by 30%), the maximum change of the hand from full closing to full opening is (brightness is increased by 30%), the brightness is increased by 15% if the hand is fully closed to opening 50% at a certain time, and when the brightness which needs to be adjusted for many times is larger (larger than 30%), the adjustment can be carried out for many times.
The lamp effect control method also comprises the following color adjusting steps: and when the variation speed of the opening and closing degree is greater than a preset value, generating a control instruction for switching the color of the lamp. That is, when the variation speed of the sum is greater than the preset value, the light effect control device 21 responds to the control command to switch the color of the lamp from the current color to another color, where the color is a single color or a combination of multiple colors.
It may take several hundred milliseconds for a person to complete one hand opening and closing, taking a time interval Δ t (Δ t)<100ms) is determined as a unit time, and the area of the hand image before Δ t (i.e., the sum obtained, the same applies hereinafter) is obtained as StThe area of the current hand image is St+ΔtThe change speed of the area of the hand image is obtained by using a formula:
thus, the change speed v of the area of the hand image in Δ t can be obtaineds. Further determine upsilonsWhether positive or negative, if upsilonsIs positive, indicating that the motion state of the hand is open, and if upsilon issA negative value indicates that the operating state of the hand is in the state.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (8)
1. A light effect control system based on gesture recognition is characterized by comprising:
the image acquisition module is used for acquiring the image which is shot by the image shooting module and contains the hand of the operator;
the hand extraction module is used for extracting images of hands in the images;
the motion recognition module is used for recognizing the opening degree of the hand according to the extracted hand image;
the brightness adjusting module is used for generating a control instruction for adjusting the brightness of the incoming light according to the change of the opening degree of the hand;
the hand extraction module comprises:
the graying processing module is used for performing graying processing on the shot image;
the inter-class variance traversing module is used for calculating the inter-class variance of the gray value of each pixel in the image after the graying treatment according to the following formula to obtain the gray value which enables the inter-class variance to be maximum;
g＝ω1×ω2×(μ1-μ2)2，
wherein g is the inter-class variance, ω1The proportion of the number of pixels with the gray value larger than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu1Average gray value, ω, of pixels in the grayed image having gray values greater than the currently selected gray value2The proportion of the number of pixels with the gray value smaller than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu2The average gray value of the pixels with the gray values smaller than the currently selected gray value in the image after the graying processing;
the binarization processing module is used for performing binarization processing on the image subjected to the graying processing by taking the obtained gray value which enables the inter-class variance to be maximum as a segmentation threshold value to obtain an image of the hand;
in the lamp effect control system, images after binarization processing are summed, all '1' are added to obtain a sum, the size of the sum represents the opening degree of the hand, and the change speed of the sum represents the change speed of the opening degree of the hand.
2. The lamp effect control system of claim 1, wherein the control commands, when applied to the lamp, satisfy: when the degree of openness of the hand is increased, the brightness of the lamp is increased, and when the degree of openness of the hand is increased, the brightness of the lamp is decreased.
3. The lamp effect control system according to claim 2,
each opening degree of the hand from full closing to full opening is respectively in one-to-one correspondence with each brightness of the lamp from minimum brightness to maximum brightness; or,
each change of the degree of opening of the hand from the fully closed state to the fully opened state corresponds to each change from the minimum brightness change amount to the minimum brightness change amount, respectively.
4. The lamp effect control system of claim 1, further comprising:
and the color adjusting module is used for generating a control instruction for switching the color of the lamp when the change speed of the opening degree is greater than a preset value.
5. A light effect control method based on gesture recognition is characterized by comprising the following steps:
an image acquisition step: acquiring an image which is shot by an image shooting module and contains a hand of an operator;
a hand extraction step: extracting an image of a hand in the image;
and (3) action recognition: recognizing the opening degree of the hand according to the extracted hand image;
and a brightness adjusting step: generating a control instruction for adjusting the brightness of the incoming light according to the change of the opening degree of the hand;
the hand extraction step comprises:
a graying processing step of graying the photographed image;
an inter-class variance traversing step, which is used for calculating the inter-class variance of the gray value of each pixel in the image after the graying treatment according to the following formula, and obtaining the gray value which enables the inter-class variance to be maximum;
g＝ω1×ω2×(μ1-μ2)2，
wherein g is the inter-class variance, ω1The number of pixel points of which the gray value is larger than the currently selected gray value in the grayed image accounts for the whole imageThe ratio of the number of pixel points, mu1Average gray value, ω, of pixels in the grayed image having gray values greater than the currently selected gray value2The proportion of the number of pixels with the gray value smaller than the currently selected gray value in the grayed image to the number of pixels of the whole image is mu2The average gray value of the pixels with the gray values smaller than the currently selected gray value in the image after the graying processing;
a binarization processing step, which is used for carrying out binarization processing on the image after the graying processing by taking the obtained gray value which enables the inter-class variance to be maximum as a segmentation threshold value to obtain an image of the hand;
in the lamp effect control method, images after binarization processing are summed, all '1' are added to obtain a sum, the size of the sum represents the opening degree of the hand, and the change speed of the sum represents the change speed of the opening degree of the hand.
6. The lamp effect control method according to claim 5, wherein the control command, when applied to the lamp, satisfies: when the degree of openness of the hand is increased, the brightness of the lamp is increased, and when the degree of openness of the hand is increased, the brightness of the lamp is decreased.
7. The lamp effect control method according to claim 6,
each opening degree of the hand from full closing to full opening is respectively in one-to-one correspondence with each brightness of the lamp from minimum brightness to maximum brightness; or,
the change of each opening degree from full opening to full closing to full opening of the hand is respectively in one-to-one correspondence with each change from zero brightness change to minimum brightness change.
8. The lamp effect control method according to claim 5, further comprising:
and color adjustment: and when the change speed of the opening degree is greater than a preset value, generating a control instruction for switching the color of the lamp.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710577064.1A CN107371307B (en) | 2017-07-14 | 2017-07-14 | A kind of lamp effect control method and system based on gesture identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710577064.1A CN107371307B (en) | 2017-07-14 | 2017-07-14 | A kind of lamp effect control method and system based on gesture identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107371307A CN107371307A (en) | 2017-11-21 |
| CN107371307B true CN107371307B (en) | 2018-06-05 |
Family
ID=60307408
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710577064.1A Active CN107371307B (en) | 2017-07-14 | 2017-07-14 | A kind of lamp effect control method and system based on gesture identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107371307B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110636676A (en) * | 2018-06-22 | 2019-12-31 | 欧阳院红 | Stage lighting control system |
| CN111107701B (en) * | 2018-10-25 | 2022-02-01 | 松下电气机器（北京）有限公司 | Lamp controller and lighting system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104143195A (en) * | 2014-07-04 | 2014-11-12 | 华南理工大学 | Method for modifying tracking deviation caused by hand shape changes in gesture tracking process |
| CN106227350A (en) * | 2016-07-28 | 2016-12-14 | 青岛海信电器股份有限公司 | Method and the smart machine that operation controls is carried out based on gesture |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201032087A (en) * | 2009-02-19 | 2010-09-01 | Asustek Comp Inc | Command control system and method thereof |
| JP2013069224A (en) * | 2011-09-26 | 2013-04-18 | Sony Corp | Motion recognition apparatus, motion recognition method, operation apparatus, electronic apparatus, and program |
| CN105357842B (en) * | 2015-12-11 | 2018-10-02 | 北京毫米科技有限公司 | Master control intelligent lamp |
-
2017
- 2017-07-14 CN CN201710577064.1A patent/CN107371307B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104143195A (en) * | 2014-07-04 | 2014-11-12 | 华南理工大学 | Method for modifying tracking deviation caused by hand shape changes in gesture tracking process |
| CN106227350A (en) * | 2016-07-28 | 2016-12-14 | 青岛海信电器股份有限公司 | Method and the smart machine that operation controls is carried out based on gesture |
Non-Patent Citations (1)
| Title |
|---|
| 灰度图像二值化算法研究;孙少林，马志强，汤伟;《价值工程》;20100531;第1-2页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107371307A (en) | 2017-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107660039B (en) | A kind of lamp control system of identification dynamic gesture | |
| CN105141922B (en) | Security-protecting and monitoring method based on air-conditioning and air conditioner | |
| CN107371307B (en) | A kind of lamp effect control method and system based on gesture identification | |
| CN108449531A (en) | Suspension touch control camera module, electronic equipment and touch control method | |
| CN109271875B (en) | A kind of fatigue detection method based on supercilium and eye key point information | |
| RU2008111509A (en) | DEVICE AND METHOD FOR PROCESSING IMAGES CAMERAS | |
| CN103312972B (en) | Electronic installation and its its focalization method | |
| CN102871784A (en) | Positioning controlling apparatus and method | |
| CN103780957A (en) | Television terminal intelligent control system and television terminal intelligent control method | |
| CN104574285A (en) | Method for automatically removing image black eyes | |
| WO2016070688A1 (en) | Remote control method and system for virtual operation interface | |
| KR20160047196A (en) | APPARATUS FOR TRACKING EYE POINT OPERABLE AT HIGH intensity of illumination AND LOW intensity of illumination AND METHOD THEREOF | |
| WO2017134933A1 (en) | Image capture assistance device and method for operating same, and operation program | |
| CN107998670A (en) | Remote-control toy control system based on plane gesture identification | |
| CN116704553B (en) | Human body characteristic identification auxiliary system based on computer vision technology | |
| CN106934349B (en) | Dual-camera imaging and iris acquisition and recognition integrated equipment | |
| CN108732969A (en) | A kind of SCM Based automobile gesture control device and its control method | |
| CN105516577B (en) | Camera shooting control method and system | |
| CN107317969A (en) | Image defogging method, device, computer can storage medium and mobile terminals | |
| CN105513017B (en) | Image defogging processing method and device and camera equipment | |
| CN117676992A (en) | Cooperative illumination control method and system for multiple groups of intelligent lamps and mirrors | |
| JP2015537417A (en) | Video processing device using difference camera | |
| CN114565993B (en) | Intelligent lock system based on face recognition and cat eye | |
| CN101060592A (en) | Same vision field multi-spectral video stream acquiring device and method | |
| CN104794445A (en) | ARM platform based dynamic facial iris acquisition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |