Disclosure of Invention
In order to solve the technical problem or at least partially solve the technical problem, embodiments of the present application provide a gesture control apparatus, a system, a gesture recognition method and an apparatus.
In a first aspect, an embodiment of the present application provides a gesture control apparatus, including: the signal receiving component is positioned on the top layer, the grounding component is positioned on the bottom layer, and the signal transmitting component is arranged on the middle layer between the top layer and the bottom layer;
the signal receiving assembly includes: the metal grid, connect with said metal grid and fix to the first receiving pole under said metal grid, and fix to the second receiving pole around said metal grid;
the signal transmitting assembly comprises an emitter positioned below the signal receiving assembly;
and insulating materials are arranged between the top layer and the middle layer and between the middle layer and the bottom layer.
Optionally, the signal receiving component includes: at least four second receiver electrodes disposed around the metal grid.
Optionally, the signal transmitting assembly includes: a first emitter located below the metal grid, four second emitters located below the four receivers, respectively.
Optionally, the apparatus further comprises: the signal generating assembly is connected with the signal transmitting assembly;
the signal generating assembly is used for generating a pulse signal with a preset intensity range and outputting the pulse signal to the signal transmitting assembly.
Optionally, a driving amplifying circuit is further disposed between the signal generating assembly and the signal transmitting assembly.
Optionally, the apparatus further comprises: the signal processing assembly is connected with the signal receiving assembly;
the signal processing assembly is used for recognizing gesture information according to the signals sensed by the signal receiving assembly.
Optionally, the signal processing module includes: the device comprises a processor, a filtering and amplifying circuit and a digital-to-analog converter;
the input end of the filtering amplifying circuit is connected with the signal receiving assembly, the output end of the filtering amplifying circuit is connected with the input end of the digital-to-analog converter, and the output end of the digital-to-analog converter is connected with the processor.
Optionally, the apparatus further comprises an instruction generator connected to the signal processing component;
and the instruction generator is used for generating a control instruction for the controlled equipment according to the gesture information identified by the signal processing component.
In a second aspect, an embodiment of the present application provides a gesture control system, including: the gesture control device and the controlled device connected with the gesture control device in the above embodiment.
In a third aspect, an embodiment of the present application provides a gesture recognition method, where based on the gesture control apparatus in the foregoing embodiment, the method includes:
acquiring a signal sensed by a signal receiving component;
and recognizing gesture information according to the signal.
Optionally, the signal receiving assembly includes a first receiving pole connected to the metal grid;
the signal that obtains signal receiving element and sense includes:
acquiring a first voltage signal of the first receiving electrode;
the recognizing gesture information according to the signal comprises:
determining a first movement track between the hand and the metal grid in the vertical direction according to the first voltage signal;
and determining the gesture information according to the first movement track.
Optionally, the signal receiving assembly further comprises a second receiving pole located around the metal grid;
the signal that obtains signal receiving element and sense includes:
acquiring a second voltage signal sensed by the second receiver electrode;
the recognizing gesture information according to the signal comprises:
determining a second movement track of the hand in the horizontal direction according to the second voltage signal;
and determining the gesture information according to the second movement track.
In a fourth aspect, an embodiment of the present application provides a gesture recognition apparatus, including:
the acquisition module is used for acquiring signals sensed by the signal receiving assembly;
and the recognition module is used for recognizing the gesture information according to the signal.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the above method steps when executing the computer program.
In a sixth aspect, embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the above-mentioned method steps.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
utilize electric field induction principle, upwards launch the electric signal through signal transmission subassembly and form the electric field, because electric field transmission changes when the staff is close to, the gesture is discerned to the electric field change request that the signal reception subassembly sensed. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application utilizes the electric field induction principle, and the electric field is influenced when the hand approaches, and when the hand does different actions, the electric field is influenced differently. And determining gesture information by capturing the change condition of the electric field, so as to control the controlled equipment according to the gesture information.
First, a gesture control apparatus provided in an embodiment of the present invention is described below.
Fig. 1 is a schematic cross-sectional structure diagram of a gesture control apparatus according to an embodiment of the present disclosure.
As shown in fig. 1, the apparatus includes:
a signal receiving element 10 on the top layer, a ground element 30 on the bottom layer, and a signal transmitting element 20 disposed in the middle layer between the top and bottom layers. Insulating material 40 is disposed between the top layer and the middle layer and between the middle layer and the bottom layer.
The signal transmitting assembly 20 includes an emitter electrode positioned below the signal receiving assembly 10.
Fig. 2 is a schematic structural diagram of a signal receiving component according to an embodiment of the present application. Fig. 3 is a schematic structural diagram of a signal receiving assembly according to another embodiment of the present application. As shown in fig. 2 and 3, the signal receiving module 10 includes a metal grid 11, a first receiving electrode 13 connected to the metal grid 11, and a second receiving electrode 12 disposed around the metal grid 11.
As shown in fig. 3, the first receiving electrode 13 is located on the top layer together with the metal grid 11 and below the metal grid 11.
Here, the emitter may be disposed only under the metal grid 11 and the second receiver 12, or may extend over the entire intermediate layer.
Alternatively, the metal grid 11 may be made of copper, or may be made of other metal materials.
In this embodiment, utilize electric field induction principle, upwards launch the electric signal through signal transmission subassembly and form the electric field, because electric field transmission changes when the staff is close to, the gesture is discerned to the electric field change request that senses based on the signal reception subassembly. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.
On the other hand, a metal grid is arranged in the middle of the top layer of the gesture control device, and an electric signal sent by an emitting electrode in the middle layer penetrates out through the hollow-out part of the metal grid to form an electrostatic field. When the hand approaches the metal grid area, the static electric field is disturbed, and the distance change between the hand and the metal grid in the vertical direction is reflected by the disturbance of the electric field. In this way, the first receiving electrode located below the metal grid can sense the disturbance condition of the electric field at the metal grid. Through the disturbance condition of the electric field, the hand approaching or departing from the metal grid can be recognized, and the gesture control device can recognize the gesture change in the direction perpendicular to the metal grid, namely the descending or ascending action of the hand can be recognized. Therefore, the device of the embodiment can recognize gesture actions in the horizontal direction and also can recognize gesture actions in the vertical direction, so that the accuracy of gesture recognition is improved, and a user can perform more control on the controlled device through the gesture actions due to the fact that more types of gesture actions can be recognized.
Optionally, if it is further required to identify the position where the hand descends or ascends, a plurality of metal grids may be provided, each metal grid being connected to one of the first receiving electrodes, so that the position of the hand is determined according to the electric field change at each metal grid, and the gesture motion can be identified more accurately.
To recognize gesture changes, the size of the metal grid should be at least larger than the size of the user's finger.
Alternatively, the number of the receiver poles can be determined according to the accuracy requirement of gesture recognition. For example, if only a gesture motion needs to be recognized in a certain area, a second receiving pole can be set at the position of the area; if it is necessary to recognize a gesture from top to bottom or from bottom to top, the second receiver electrode 12 may be disposed only above and below the metal grid 11, respectively; if it is desired to recognize a gesture from left to right or from right to left, the second receiver electrode 12 may be provided only on the left and right sides of the metal grid 11, respectively.
In an alternative embodiment, the signal receiving element 10 may comprise at least four second receiver poles 12 arranged around the metal grid 11.
Fig. 4 is a schematic structural diagram of a signal receiving assembly according to another embodiment of the present application. As shown in fig. 4, 4 second receiver electrodes 12a, 12b, 12c, and 12d are disposed around the metal grid 11. In this way, the device may recognize gesture motions from top to bottom, bottom to top, left to right, or right to left.
In addition, if more accurate recognition of gestures is required, such as from top left to bottom right, from top right to bottom left, etc., more receiver poles need to be provided.
Fig. 5 is a schematic structural diagram of a signal transmitting assembly according to an embodiment of the present application. In an alternative embodiment, as shown in fig. 5, signal transmission assembly 20 includes: a first emitter 21 located under the metal grid, and four second emitters 22 located under the four receivers, respectively.
The controlled device in this embodiment may be a robot, and a gesture control device located on the robot is taken as an example and described in detail below.
The gesture control device of the embodiment may be disposed above the robot display screen. The size of the gesture control device is 240mm 170 mm. When the user is in the sensing area of the gesture control device, namely within 100mm, the gesture control device can recognize the gesture information of the user.
As shown in fig. 4, the signal receiving element 10 on the top layer of the gesture control device includes a metal grid 11 with the size of 170mm × 100 mm. The first receiver electrode 13 under the metal grid 11 may have a size of 170mm x 100mm and a thickness of 35 μm.
Around the metal grid 11, 2 second receiving electrodes 12a, 12c having a size of 180mm × 10mm and 2 second receiving electrodes 12b, 12d having a size of 160mm × 10mm are provided, and the thickness of the second receiving electrodes is 35 μm.
The spacing between the second receiver poles 12a and 12b, 12d is 5mm, and the spacing between the receiver poles 12c and 12b, 12d is 5 mm.
The signal emitting component 20 of the intermediate layer comprises an emitter having dimensions 240mm x 170mm and a thickness of 35 μm.
The vertical spacing between the signal receiving element 10 and the signal transmitting element 20 is 1.2 mm. The vertical spacing between the signal emitting component 20 and the ground component 30 is 0.8 mm.
The insulation between the top and middle layers and between the middle and bottom layers was rated FR-4.
In this embodiment, the sizes of the copper grid, the receiving electrode and the emitting electrode, and the distances between the signal receiving assembly, the signal transmitting assembly and the grounding assembly can be set according to the size of the gesture control device required actually, and the grade of the insulating material can also be set according to the application scene of the gesture control device, the process requirements and the like.
Fig. 6 is a block diagram of a gesture control apparatus according to another embodiment of the present application. As shown in fig. 6, the gesture control apparatus further includes: and a signal generating assembly 40 connected to the signal transmitting assembly 20. The signal generating component 40 is configured to generate a pulse signal with a preset intensity range and output the pulse signal to the signal transmitting component 20. The pulse signal may be 44-115 kHz.
Optionally, a driving amplifying circuit 50 is further disposed between the signal generating component 40 and the signal transmitting component 20.
Optionally, the driving amplifying circuit may include a driving circuit and a voltage boosting circuit, and drives and voltage-amplifies the pulse signal generated by the signal generating component 40.
Fig. 7 is a block diagram of a gesture control apparatus according to another embodiment of the present application. As shown in fig. 7, the gesture control apparatus further includes: and a signal processing module 60 connected to the signal receiving module 10. The signal processing component 60 is configured to recognize gesture information according to the signals sensed by the signal receiving component 10.
The signal processing assembly 60 includes: a filter amplifying circuit 61, a digital-to-analog converter 62 and a processor 63. The input end of the filter amplifying circuit 61 is connected with the signal receiving assembly 10, the output end of the filter amplifying circuit 61 is connected with the input end of the digital-to-analog converter 62, and the output end of the digital-to-analog converter 62 is connected with the processor 63.
In this embodiment, the number of the filtering and amplifying circuit 61 and the number of the digital-to-analog converter 62 are the same as the number of the metal grids and the number of the receiving electrodes in the signal receiving assembly. When the signal receiving section 10 includes 4 receiving poles, the signal processing section 60 includes: 5 filter amplifier circuits 61 and 5 digital-to-analog converters 62.
Optionally, as shown in fig. 7, the gesture control apparatus further includes an instruction generator 70 connected to the signal processing component 60. And the instruction generator 70 is used for generating a control instruction for the controlled device according to the gesture information recognized by the signal processing component 60. The instruction generator 70 transmits a control instruction to the controlled device.
Optionally, the signal processing component 60 and the instruction generator 70 may communicate via an I2C bus. The instruction generator 70 may be a single chip microcomputer.
Alternatively, the command generator 70 may be located in the controlled device.
Fig. 8 is a block diagram of a gesture control apparatus according to another embodiment of the present application. As shown in fig. 8, the specific structure of the gesture control device is as follows:
the processor 63 generates a pulse signal, and the pulse signal is boosted by the booster circuit 52, and then driven by the driver circuit 51 and output to the emitter 20.
The metal grid 11 and the receiving electrodes 12a, 12b, 12c and 12d sense the electric field variation and send the sensed voltage signal to the filtering and amplifying circuit 61.
The 5 filtering and amplifying circuits 61 are respectively connected to the metal grid 11 and the receiving electrodes 12a, 12b, 12c, and 12d, and filter and amplify the voltage signals sensed by the metal grid 11 and the receiving electrodes 12a, 12b, 12c, and 12d, and then transmit the filtered and amplified voltage signals to the corresponding digital-to-analog converters 52, and the digital-to-analog converters 52 convert the analog voltage signals into digital voltage signals and transmit the digital voltage signals to the processor 63.
The processor 63 determines gesture information from the received digital voltage signals and sends the gesture information to the instruction generator 70. The command generator 70 gesture information generates control commands for the controlled device and sends the control commands to the controlled device.
An embodiment of the present application further provides a gesture control system, including: the gesture control device and the controlled device connected with the gesture control device in the above embodiments. The gesture control device controls the controlled equipment, hardware cost of gesture recognition required by the controlled equipment is reduced, computing resources required by the gesture recognition are reduced, gesture recognition speed and accuracy are improved, the gesture recognition device is free from light influence, and the application is wider.
In practice, when a user's hand is placed in the sensing area of the gesture control device, the hand will interfere with the electric field between the receiver and emitter. Therefore, the voltage signal induced by the receiving electrode can change, the voltage signal is output to the digital-to-analog converter after being filtered and amplified, the analog voltage signal is converted into a digital voltage signal and then is transmitted to the processor, the processor determines that the hand approaches according to the voltage change condition, the approach gesture information is reported to the instruction generator, the instruction generator reports the approach signal to the robot, and the robot responds to the approach signal according to a preset program.
When the user slides from left to right in the sensing area (corresponding to the direction from the receiver 12d to the emitter 12b), the influence of the hand on the induced electric field generated between the receiver 12d and the emitter is weakened, and the influence on the induced electric field generated between the receiver 12b and the emitter is strengthened. The electric field change is reflected as the change of voltage on a receiving electrode, a voltage signal is transmitted to a digital-to-analog converter after being filtered and amplified and then is converted into a digital signal and then is input into a processor, the processor recognizes a 'sliding from left to right' instruction and transmits the instruction to an instruction generator, the instruction generator reports the 'sliding from left to right' instruction to the robot, and the robot makes feedback according to a preset program.
When the user slides from right to left (corresponding to the direction from the receiver 12b to the emitter 12d) in the sensing area, the influence of the hand on the induced electric field generated between the receiver 12b and the emitter is weakened, and the influence of the hand on the induced electric field generated between the receiver 12d and the emitter T is strengthened. The electric field change is reflected as the change of voltage on a receiving electrode, a voltage signal is transmitted to a digital-to-analog converter after being filtered and amplified and is converted into digital quantity to be input to a processor, the processor identifies a 'sliding from right to left' instruction and transmits the instruction to an instruction generator, the instruction generator reports the 'sliding from right to left' instruction to the robot, and the robot makes feedback according to a preset program.
When the user slides down the sensing area from above (corresponding to the direction from the receiver 12a to the emitter 12c), the influence of the hand on the induced electric field generated between the receiver 12a and the emitter is weakened, and the influence of the hand on the induced electric field generated between the receiver 12c and the emitter is strengthened. The electric field change is reflected as the change of the voltage on the receiving electrode, the voltage signal is transmitted to the digital-to-analog converter after being filtered and amplified and is converted into digital quantity which is input to the processor, the processor identifies the 'sliding from top to bottom' instruction and transmits the instruction to the instruction generator, the instruction generator reports the 'sliding from top to bottom' instruction to the robot main controller, and the robot makes feedback according to a preset program.
When the user slides from the bottom to the top (corresponding to the direction from the receiver 12c to the emitter 12a) in the sensing area, the influence of the hand on the induced electric field generated between the receiver 12c and the emitter is weakened, and the influence on the induced electric field generated between the receiver 12a and the emitter is strengthened. The electric field change is reflected as the change of the voltage on the receiving electrode, the voltage signal is transmitted to the digital-to-analog converter after being filtered and amplified and is converted into digital quantity which is input to the processor, the processor identifies a 'sliding from bottom to top' instruction and transmits the instruction to the instruction generator, the instruction generator reports the 'sliding from bottom to top' instruction to the robot main controller, and the robot makes feedback according to a preset program.
Fig. 9 is a flowchart of a gesture recognition method according to an embodiment of the present application. The gesture recognition method is based on the gesture control device in the embodiment. As shown in fig. 9, the method further comprises the steps of:
step S11, acquiring signals sensed by the signal receiving assembly;
and step S12, recognizing gesture information according to the signal.
Optionally, since the signal receiving component includes a metal grid, the step S21 includes: a first voltage signal of the metal grid is acquired. Step S22 includes: determining a first movement track between the hand and the metal grid in the vertical direction according to the first voltage signal; and determining the gesture information according to the first movement track.
Optionally, since the signal receiving element includes a receiving electrode located around the metal grid, the step S21 includes: and acquiring a second voltage signal sensed by the receiver. Step S22 includes: determining a second movement track of the hand in the horizontal direction according to the second voltage signal; and determining the gesture information according to the second movement track.
In this embodiment, utilize electric field induction principle, upwards launch the electric signal through signal transmission subassembly and form the electric field, because electric field transmission changes when the staff is close to, the gesture is discerned to the electric field change request that senses based on the signal reception subassembly. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.
On the other hand, a metal grid is arranged in the middle of the top layer of the gesture control device, and an electric signal sent by an emitting electrode in the middle layer penetrates out through a hollow part of the grid to form an electrostatic field. When the hand approaches the metal grid area, the static electric field is disturbed, and the distance change between the hand and the metal grid in the vertical direction is reflected by the disturbance of the electric field. In this way, the hand approaching or departing from the metal grid can be recognized through the electric field disturbance condition, and the gesture control device can recognize the gesture change in the direction perpendicular to the metal grid, namely, the action of descending or ascending the hand can be recognized. Therefore, the device of the embodiment can recognize gesture actions in the horizontal direction and also can recognize gesture actions in the vertical direction, so that the accuracy of gesture recognition is improved, and a user can perform more control on the controlled device through the gesture actions due to the fact that more types of gesture actions can be recognized.
Fig. 10 is a block diagram of a gesture recognition apparatus according to an embodiment of the present application, which can be used to execute the above method embodiment. The apparatus may be implemented as part or all of an electronic device through software, hardware, or a combination of both. As shown in fig. 10, the apparatus includes:
an obtaining module 91, configured to obtain a signal sensed by the signal receiving component;
and the recognition module 92 is used for recognizing the gesture information according to the signal.
An embodiment of the present application further provides an electronic device, as shown in fig. 11, the electronic device may include: the system comprises a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502 and the memory 1503 complete communication with each other through the communication bus 1504.
A memory 1503 for storing a computer program;
the processor 1501, when executing the computer program stored in the memory 1503, implements the steps of the method embodiments described below.
The communication bus mentioned in the electronic device may be a peripheral component interconnect (pci) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method embodiments described below.
It should be noted that, for the above-mentioned apparatus, electronic device and computer-readable storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
It is further noted that, herein, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.