CN111158488A - Gesture control device and system, and gesture recognition method and device - Google Patents

Gesture control device and system, and gesture recognition method and device Download PDF

Info

Publication number
CN111158488A
CN111158488A CN201911413462.5A CN201911413462A CN111158488A CN 111158488 A CN111158488 A CN 111158488A CN 201911413462 A CN201911413462 A CN 201911413462A CN 111158488 A CN111158488 A CN 111158488A
Authority
CN
China
Prior art keywords
signal
gesture
metal grid
assembly
signal receiving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911413462.5A
Other languages
Chinese (zh)
Inventor
许哲涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Haiyi Tongzhan Information Technology Co Ltd
Original Assignee
Beijing Haiyi Tongzhan Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Haiyi Tongzhan Information Technology Co Ltd filed Critical Beijing Haiyi Tongzhan Information Technology Co Ltd
Priority to CN201911413462.5A priority Critical patent/CN111158488A/en
Publication of CN111158488A publication Critical patent/CN111158488A/en
Priority to PCT/CN2020/135202 priority patent/WO2021135889A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107Static hand or arm

Abstract

The technical scheme is that an electric field sensing principle is utilized, an electric signal is upwards transmitted through a signal transmitting assembly to form an electric field, and the gesture is recognized based on an electric field change request sensed by a signal receiving assembly due to the fact that the electric field is transmitted and changed when a human hand approaches. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.

Description

Gesture control device and system, and gesture recognition method and device
Technical Field
The application relates to the field of intelligent control, in particular to a gesture control device, a system, a gesture recognition method and a device.
Background
With the development of human-computer interaction technology, the research and development of gesture recognition as an important component of human-computer interaction influence the naturalness and flexibility of human-computer interaction.
Currently, human-computer interaction is generally based on image recognition of gestures. Firstly, the gesture motion of a person is captured through the camera, and then an image shot by the camera is sent to the image processing unit for identification. And the image processing unit sends the identification result to the controlled equipment, and the controlled equipment makes a corresponding response.
However, recognizing gestures based on images has the following disadvantages:
1. the cost is high, an image acquisition module and an image processing module are needed, and the hardware cost of the two modules is high;
2. the calculation amount is large, the data amount of the image is large, and large calculation resources are consumed for image identification;
3. is easily affected by ambient light, and is easily identified as failing when the ambient environment is dark or the light is strong.
Disclosure of Invention
In order to solve the technical problem or at least partially solve the technical problem, embodiments of the present application provide a gesture control apparatus, a system, a gesture recognition method and an apparatus.
In a first aspect, an embodiment of the present application provides a gesture control apparatus, including: the signal receiving component is positioned on the top layer, the grounding component is positioned on the bottom layer, and the signal transmitting component is arranged on the middle layer between the top layer and the bottom layer;
the signal receiving assembly includes: the metal grid, connect with said metal grid and fix to the first receiving pole under said metal grid, and fix to the second receiving pole around said metal grid;
the signal transmitting assembly comprises an emitter positioned below the signal receiving assembly;
and insulating materials are arranged between the top layer and the middle layer and between the middle layer and the bottom layer.
Optionally, the signal receiving component includes: at least four second receiver electrodes disposed around the metal grid.
Optionally, the signal transmitting assembly includes: a first emitter located below the metal grid, four second emitters located below the four receivers, respectively.
Optionally, the apparatus further comprises: the signal generating assembly is connected with the signal transmitting assembly;
the signal generating assembly is used for generating a pulse signal with a preset intensity range and outputting the pulse signal to the signal transmitting assembly.
Optionally, a driving amplifying circuit is further disposed between the signal generating assembly and the signal transmitting assembly.
Optionally, the apparatus further comprises: the signal processing assembly is connected with the signal receiving assembly;
the signal processing assembly is used for recognizing gesture information according to the signals sensed by the signal receiving assembly.
Optionally, the signal processing module includes: the device comprises a processor, a filtering and amplifying circuit and a digital-to-analog converter;
the input end of the filtering amplifying circuit is connected with the signal receiving assembly, the output end of the filtering amplifying circuit is connected with the input end of the digital-to-analog converter, and the output end of the digital-to-analog converter is connected with the processor.
Optionally, the apparatus further comprises an instruction generator connected to the signal processing component;
and the instruction generator is used for generating a control instruction for the controlled equipment according to the gesture information identified by the signal processing component.
In a second aspect, an embodiment of the present application provides a gesture control system, including: the gesture control device and the controlled device connected with the gesture control device in the above embodiment.
In a third aspect, an embodiment of the present application provides a gesture recognition method, where based on the gesture control apparatus in the foregoing embodiment, the method includes:
acquiring a signal sensed by a signal receiving component;
and recognizing gesture information according to the signal.
Optionally, the signal receiving assembly includes a first receiving pole connected to the metal grid;
the signal that obtains signal receiving element and sense includes:
acquiring a first voltage signal of the first receiving electrode;
the recognizing gesture information according to the signal comprises:
determining a first movement track between the hand and the metal grid in the vertical direction according to the first voltage signal;
and determining the gesture information according to the first movement track.
Optionally, the signal receiving assembly further comprises a second receiving pole located around the metal grid;
the signal that obtains signal receiving element and sense includes:
acquiring a second voltage signal sensed by the second receiver electrode;
the recognizing gesture information according to the signal comprises:
determining a second movement track of the hand in the horizontal direction according to the second voltage signal;
and determining the gesture information according to the second movement track.
In a fourth aspect, an embodiment of the present application provides a gesture recognition apparatus, including:
the acquisition module is used for acquiring signals sensed by the signal receiving assembly;
and the recognition module is used for recognizing the gesture information according to the signal.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the above method steps when executing the computer program.
In a sixth aspect, embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the above-mentioned method steps.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
utilize electric field induction principle, upwards launch the electric signal through signal transmission subassembly and form the electric field, because electric field transmission changes when the staff is close to, the gesture is discerned to the electric field change request that the signal reception subassembly sensed. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic cross-sectional view illustrating a gesture control apparatus according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a signal receiving component according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a signal receiving component according to another embodiment of the present application;
fig. 4 is a schematic structural diagram of a signal receiving component according to another embodiment of the present application;
fig. 5 is a schematic structural diagram of a signal transmitting assembly according to an embodiment of the present disclosure;
FIG. 6 is a block diagram of a gesture control apparatus according to another embodiment of the present application;
FIG. 7 is a block diagram of a gesture control apparatus according to another embodiment of the present application;
FIG. 8 is a block diagram of a gesture control apparatus according to another embodiment of the present application;
fig. 9 is a flowchart of a gesture recognition method according to an embodiment of the present application;
fig. 10 is a block diagram of a gesture recognition apparatus according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application utilizes the electric field induction principle, and the electric field is influenced when the hand approaches, and when the hand does different actions, the electric field is influenced differently. And determining gesture information by capturing the change condition of the electric field, so as to control the controlled equipment according to the gesture information.
First, a gesture control apparatus provided in an embodiment of the present invention is described below.
Fig. 1 is a schematic cross-sectional structure diagram of a gesture control apparatus according to an embodiment of the present disclosure.
As shown in fig. 1, the apparatus includes:
a signal receiving element 10 on the top layer, a ground element 30 on the bottom layer, and a signal transmitting element 20 disposed in the middle layer between the top and bottom layers. Insulating material 40 is disposed between the top layer and the middle layer and between the middle layer and the bottom layer.
The signal transmitting assembly 20 includes an emitter electrode positioned below the signal receiving assembly 10.
Fig. 2 is a schematic structural diagram of a signal receiving component according to an embodiment of the present application. Fig. 3 is a schematic structural diagram of a signal receiving assembly according to another embodiment of the present application. As shown in fig. 2 and 3, the signal receiving module 10 includes a metal grid 11, a first receiving electrode 13 connected to the metal grid 11, and a second receiving electrode 12 disposed around the metal grid 11.
As shown in fig. 3, the first receiving electrode 13 is located on the top layer together with the metal grid 11 and below the metal grid 11.
Here, the emitter may be disposed only under the metal grid 11 and the second receiver 12, or may extend over the entire intermediate layer.
Alternatively, the metal grid 11 may be made of copper, or may be made of other metal materials.
In this embodiment, utilize electric field induction principle, upwards launch the electric signal through signal transmission subassembly and form the electric field, because electric field transmission changes when the staff is close to, the gesture is discerned to the electric field change request that senses based on the signal reception subassembly. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.
On the other hand, a metal grid is arranged in the middle of the top layer of the gesture control device, and an electric signal sent by an emitting electrode in the middle layer penetrates out through the hollow-out part of the metal grid to form an electrostatic field. When the hand approaches the metal grid area, the static electric field is disturbed, and the distance change between the hand and the metal grid in the vertical direction is reflected by the disturbance of the electric field. In this way, the first receiving electrode located below the metal grid can sense the disturbance condition of the electric field at the metal grid. Through the disturbance condition of the electric field, the hand approaching or departing from the metal grid can be recognized, and the gesture control device can recognize the gesture change in the direction perpendicular to the metal grid, namely the descending or ascending action of the hand can be recognized. Therefore, the device of the embodiment can recognize gesture actions in the horizontal direction and also can recognize gesture actions in the vertical direction, so that the accuracy of gesture recognition is improved, and a user can perform more control on the controlled device through the gesture actions due to the fact that more types of gesture actions can be recognized.
Optionally, if it is further required to identify the position where the hand descends or ascends, a plurality of metal grids may be provided, each metal grid being connected to one of the first receiving electrodes, so that the position of the hand is determined according to the electric field change at each metal grid, and the gesture motion can be identified more accurately.
To recognize gesture changes, the size of the metal grid should be at least larger than the size of the user's finger.
Alternatively, the number of the receiver poles can be determined according to the accuracy requirement of gesture recognition. For example, if only a gesture motion needs to be recognized in a certain area, a second receiving pole can be set at the position of the area; if it is necessary to recognize a gesture from top to bottom or from bottom to top, the second receiver electrode 12 may be disposed only above and below the metal grid 11, respectively; if it is desired to recognize a gesture from left to right or from right to left, the second receiver electrode 12 may be provided only on the left and right sides of the metal grid 11, respectively.
In an alternative embodiment, the signal receiving element 10 may comprise at least four second receiver poles 12 arranged around the metal grid 11.
Fig. 4 is a schematic structural diagram of a signal receiving assembly according to another embodiment of the present application. As shown in fig. 4, 4 second receiver electrodes 12a, 12b, 12c, and 12d are disposed around the metal grid 11. In this way, the device may recognize gesture motions from top to bottom, bottom to top, left to right, or right to left.
In addition, if more accurate recognition of gestures is required, such as from top left to bottom right, from top right to bottom left, etc., more receiver poles need to be provided.
Fig. 5 is a schematic structural diagram of a signal transmitting assembly according to an embodiment of the present application. In an alternative embodiment, as shown in fig. 5, signal transmission assembly 20 includes: a first emitter 21 located under the metal grid, and four second emitters 22 located under the four receivers, respectively.
The controlled device in this embodiment may be a robot, and a gesture control device located on the robot is taken as an example and described in detail below.
The gesture control device of the embodiment may be disposed above the robot display screen. The size of the gesture control device is 240mm 170 mm. When the user is in the sensing area of the gesture control device, namely within 100mm, the gesture control device can recognize the gesture information of the user.
As shown in fig. 4, the signal receiving element 10 on the top layer of the gesture control device includes a metal grid 11 with the size of 170mm × 100 mm. The first receiver electrode 13 under the metal grid 11 may have a size of 170mm x 100mm and a thickness of 35 μm.
Around the metal grid 11, 2 second receiving electrodes 12a, 12c having a size of 180mm × 10mm and 2 second receiving electrodes 12b, 12d having a size of 160mm × 10mm are provided, and the thickness of the second receiving electrodes is 35 μm.
The spacing between the second receiver poles 12a and 12b, 12d is 5mm, and the spacing between the receiver poles 12c and 12b, 12d is 5 mm.
The signal emitting component 20 of the intermediate layer comprises an emitter having dimensions 240mm x 170mm and a thickness of 35 μm.
The vertical spacing between the signal receiving element 10 and the signal transmitting element 20 is 1.2 mm. The vertical spacing between the signal emitting component 20 and the ground component 30 is 0.8 mm.
The insulation between the top and middle layers and between the middle and bottom layers was rated FR-4.
In this embodiment, the sizes of the copper grid, the receiving electrode and the emitting electrode, and the distances between the signal receiving assembly, the signal transmitting assembly and the grounding assembly can be set according to the size of the gesture control device required actually, and the grade of the insulating material can also be set according to the application scene of the gesture control device, the process requirements and the like.
Fig. 6 is a block diagram of a gesture control apparatus according to another embodiment of the present application. As shown in fig. 6, the gesture control apparatus further includes: and a signal generating assembly 40 connected to the signal transmitting assembly 20. The signal generating component 40 is configured to generate a pulse signal with a preset intensity range and output the pulse signal to the signal transmitting component 20. The pulse signal may be 44-115 kHz.
Optionally, a driving amplifying circuit 50 is further disposed between the signal generating component 40 and the signal transmitting component 20.
Optionally, the driving amplifying circuit may include a driving circuit and a voltage boosting circuit, and drives and voltage-amplifies the pulse signal generated by the signal generating component 40.
Fig. 7 is a block diagram of a gesture control apparatus according to another embodiment of the present application. As shown in fig. 7, the gesture control apparatus further includes: and a signal processing module 60 connected to the signal receiving module 10. The signal processing component 60 is configured to recognize gesture information according to the signals sensed by the signal receiving component 10.
The signal processing assembly 60 includes: a filter amplifying circuit 61, a digital-to-analog converter 62 and a processor 63. The input end of the filter amplifying circuit 61 is connected with the signal receiving assembly 10, the output end of the filter amplifying circuit 61 is connected with the input end of the digital-to-analog converter 62, and the output end of the digital-to-analog converter 62 is connected with the processor 63.
In this embodiment, the number of the filtering and amplifying circuit 61 and the number of the digital-to-analog converter 62 are the same as the number of the metal grids and the number of the receiving electrodes in the signal receiving assembly. When the signal receiving section 10 includes 4 receiving poles, the signal processing section 60 includes: 5 filter amplifier circuits 61 and 5 digital-to-analog converters 62.
Optionally, as shown in fig. 7, the gesture control apparatus further includes an instruction generator 70 connected to the signal processing component 60. And the instruction generator 70 is used for generating a control instruction for the controlled device according to the gesture information recognized by the signal processing component 60. The instruction generator 70 transmits a control instruction to the controlled device.
Optionally, the signal processing component 60 and the instruction generator 70 may communicate via an I2C bus. The instruction generator 70 may be a single chip microcomputer.
Alternatively, the command generator 70 may be located in the controlled device.
Fig. 8 is a block diagram of a gesture control apparatus according to another embodiment of the present application. As shown in fig. 8, the specific structure of the gesture control device is as follows:
the processor 63 generates a pulse signal, and the pulse signal is boosted by the booster circuit 52, and then driven by the driver circuit 51 and output to the emitter 20.
The metal grid 11 and the receiving electrodes 12a, 12b, 12c and 12d sense the electric field variation and send the sensed voltage signal to the filtering and amplifying circuit 61.
The 5 filtering and amplifying circuits 61 are respectively connected to the metal grid 11 and the receiving electrodes 12a, 12b, 12c, and 12d, and filter and amplify the voltage signals sensed by the metal grid 11 and the receiving electrodes 12a, 12b, 12c, and 12d, and then transmit the filtered and amplified voltage signals to the corresponding digital-to-analog converters 52, and the digital-to-analog converters 52 convert the analog voltage signals into digital voltage signals and transmit the digital voltage signals to the processor 63.
The processor 63 determines gesture information from the received digital voltage signals and sends the gesture information to the instruction generator 70. The command generator 70 gesture information generates control commands for the controlled device and sends the control commands to the controlled device.
An embodiment of the present application further provides a gesture control system, including: the gesture control device and the controlled device connected with the gesture control device in the above embodiments. The gesture control device controls the controlled equipment, hardware cost of gesture recognition required by the controlled equipment is reduced, computing resources required by the gesture recognition are reduced, gesture recognition speed and accuracy are improved, the gesture recognition device is free from light influence, and the application is wider.
In practice, when a user's hand is placed in the sensing area of the gesture control device, the hand will interfere with the electric field between the receiver and emitter. Therefore, the voltage signal induced by the receiving electrode can change, the voltage signal is output to the digital-to-analog converter after being filtered and amplified, the analog voltage signal is converted into a digital voltage signal and then is transmitted to the processor, the processor determines that the hand approaches according to the voltage change condition, the approach gesture information is reported to the instruction generator, the instruction generator reports the approach signal to the robot, and the robot responds to the approach signal according to a preset program.
When the user slides from left to right in the sensing area (corresponding to the direction from the receiver 12d to the emitter 12b), the influence of the hand on the induced electric field generated between the receiver 12d and the emitter is weakened, and the influence on the induced electric field generated between the receiver 12b and the emitter is strengthened. The electric field change is reflected as the change of voltage on a receiving electrode, a voltage signal is transmitted to a digital-to-analog converter after being filtered and amplified and then is converted into a digital signal and then is input into a processor, the processor recognizes a 'sliding from left to right' instruction and transmits the instruction to an instruction generator, the instruction generator reports the 'sliding from left to right' instruction to the robot, and the robot makes feedback according to a preset program.
When the user slides from right to left (corresponding to the direction from the receiver 12b to the emitter 12d) in the sensing area, the influence of the hand on the induced electric field generated between the receiver 12b and the emitter is weakened, and the influence of the hand on the induced electric field generated between the receiver 12d and the emitter T is strengthened. The electric field change is reflected as the change of voltage on a receiving electrode, a voltage signal is transmitted to a digital-to-analog converter after being filtered and amplified and is converted into digital quantity to be input to a processor, the processor identifies a 'sliding from right to left' instruction and transmits the instruction to an instruction generator, the instruction generator reports the 'sliding from right to left' instruction to the robot, and the robot makes feedback according to a preset program.
When the user slides down the sensing area from above (corresponding to the direction from the receiver 12a to the emitter 12c), the influence of the hand on the induced electric field generated between the receiver 12a and the emitter is weakened, and the influence of the hand on the induced electric field generated between the receiver 12c and the emitter is strengthened. The electric field change is reflected as the change of the voltage on the receiving electrode, the voltage signal is transmitted to the digital-to-analog converter after being filtered and amplified and is converted into digital quantity which is input to the processor, the processor identifies the 'sliding from top to bottom' instruction and transmits the instruction to the instruction generator, the instruction generator reports the 'sliding from top to bottom' instruction to the robot main controller, and the robot makes feedback according to a preset program.
When the user slides from the bottom to the top (corresponding to the direction from the receiver 12c to the emitter 12a) in the sensing area, the influence of the hand on the induced electric field generated between the receiver 12c and the emitter is weakened, and the influence on the induced electric field generated between the receiver 12a and the emitter is strengthened. The electric field change is reflected as the change of the voltage on the receiving electrode, the voltage signal is transmitted to the digital-to-analog converter after being filtered and amplified and is converted into digital quantity which is input to the processor, the processor identifies a 'sliding from bottom to top' instruction and transmits the instruction to the instruction generator, the instruction generator reports the 'sliding from bottom to top' instruction to the robot main controller, and the robot makes feedback according to a preset program.
Fig. 9 is a flowchart of a gesture recognition method according to an embodiment of the present application. The gesture recognition method is based on the gesture control device in the embodiment. As shown in fig. 9, the method further comprises the steps of:
step S11, acquiring signals sensed by the signal receiving assembly;
and step S12, recognizing gesture information according to the signal.
Optionally, since the signal receiving component includes a metal grid, the step S21 includes: a first voltage signal of the metal grid is acquired. Step S22 includes: determining a first movement track between the hand and the metal grid in the vertical direction according to the first voltage signal; and determining the gesture information according to the first movement track.
Optionally, since the signal receiving element includes a receiving electrode located around the metal grid, the step S21 includes: and acquiring a second voltage signal sensed by the receiver. Step S22 includes: determining a second movement track of the hand in the horizontal direction according to the second voltage signal; and determining the gesture information according to the second movement track.
In this embodiment, utilize electric field induction principle, upwards launch the electric signal through signal transmission subassembly and form the electric field, because electric field transmission changes when the staff is close to, the gesture is discerned to the electric field change request that senses based on the signal reception subassembly. Therefore, the gesture recognition only needs simple signal comparison calculation, consumes less calculation resources and has higher recognition speed. Moreover, the gesture recognition is only based on the change of the electric field and is not influenced by light rays, so that the application universality and the accuracy of the gesture recognition are improved. In addition, the hardware cost required by the gesture recognition device is reduced.
On the other hand, a metal grid is arranged in the middle of the top layer of the gesture control device, and an electric signal sent by an emitting electrode in the middle layer penetrates out through a hollow part of the grid to form an electrostatic field. When the hand approaches the metal grid area, the static electric field is disturbed, and the distance change between the hand and the metal grid in the vertical direction is reflected by the disturbance of the electric field. In this way, the hand approaching or departing from the metal grid can be recognized through the electric field disturbance condition, and the gesture control device can recognize the gesture change in the direction perpendicular to the metal grid, namely, the action of descending or ascending the hand can be recognized. Therefore, the device of the embodiment can recognize gesture actions in the horizontal direction and also can recognize gesture actions in the vertical direction, so that the accuracy of gesture recognition is improved, and a user can perform more control on the controlled device through the gesture actions due to the fact that more types of gesture actions can be recognized.
Fig. 10 is a block diagram of a gesture recognition apparatus according to an embodiment of the present application, which can be used to execute the above method embodiment. The apparatus may be implemented as part or all of an electronic device through software, hardware, or a combination of both. As shown in fig. 10, the apparatus includes:
an obtaining module 91, configured to obtain a signal sensed by the signal receiving component;
and the recognition module 92 is used for recognizing the gesture information according to the signal.
An embodiment of the present application further provides an electronic device, as shown in fig. 11, the electronic device may include: the system comprises a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502 and the memory 1503 complete communication with each other through the communication bus 1504.
A memory 1503 for storing a computer program;
the processor 1501, when executing the computer program stored in the memory 1503, implements the steps of the method embodiments described below.
The communication bus mentioned in the electronic device may be a peripheral component interconnect (pci) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method embodiments described below.
It should be noted that, for the above-mentioned apparatus, electronic device and computer-readable storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
It is further noted that, herein, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (15)

1. A gesture control apparatus, comprising: the signal receiving component is positioned on the top layer, the grounding component is positioned on the bottom layer, and the signal transmitting component is arranged on the middle layer between the top layer and the bottom layer;
the signal receiving assembly includes: the metal grid, connect with said metal grid and fix to the first receiving pole under said metal grid, and fix to the second receiving pole around said metal grid;
the signal transmitting assembly comprises an emitter positioned below the signal receiving assembly;
and insulating materials are arranged between the top layer and the middle layer and between the middle layer and the bottom layer.
2. The apparatus of claim 1, wherein the signal receiving component comprises: at least four second receiver electrodes disposed around the metal grid.
3. The apparatus of claim 2, wherein the signal transmitting component comprises: a first emitter located below the metal grid, four second emitters located below the four receivers, respectively.
4. The apparatus of claim 1, further comprising: the signal generating assembly is connected with the signal transmitting assembly;
the signal generating assembly is used for generating a pulse signal with a preset intensity range and outputting the pulse signal to the signal transmitting assembly.
5. The apparatus of claim 4, wherein a driving amplifying circuit is further disposed between the signal generating component and the signal transmitting component.
6. The apparatus of claim 1, further comprising: the signal processing assembly is connected with the signal receiving assembly;
the signal processing assembly is used for recognizing gesture information according to the signals sensed by the signal receiving assembly.
7. The apparatus of claim 6, wherein the signal processing component comprises: the device comprises a processor, a filtering and amplifying circuit and a digital-to-analog converter;
the input end of the filtering amplifying circuit is connected with the signal receiving assembly, the output end of the filtering amplifying circuit is connected with the input end of the digital-to-analog converter, and the output end of the digital-to-analog converter is connected with the processor.
8. The apparatus of claim 6, further comprising: an instruction generator connected with the signal processing component;
and the instruction generator is used for generating a control instruction for the controlled equipment according to the gesture information identified by the signal processing component.
9. A gesture control system, comprising: the gesture control device according to any one of claims 1-8 and a controlled device connected with the gesture control device.
10. A gesture recognition method, based on the gesture control apparatus of any one of claims 1-8, the method comprising:
acquiring a signal sensed by a signal receiving component;
and recognizing gesture information according to the signal.
11. The method of claim 10, wherein the signal receiving component comprises a first receiver pole connected to a metal grid;
the signal that obtains signal receiving element and sense includes:
acquiring a first voltage signal of the first receiving electrode;
the recognizing gesture information according to the signal comprises:
determining a first movement track between the hand and the metal grid in the vertical direction according to the first voltage signal;
and determining the gesture information according to the first movement track.
12. The method of claim 10, wherein the signal receiving assembly further comprises a second receiver pole positioned around the metal grid;
the signal that obtains signal receiving element and sense includes:
acquiring a second voltage signal sensed by the second receiver electrode;
the recognizing gesture information according to the signal comprises:
determining a second movement track of the hand in the horizontal direction according to the second voltage signal;
and determining the gesture information according to the second movement track.
13. A gesture recognition apparatus, comprising:
the acquisition module is used for acquiring signals sensed by the signal receiving assembly;
and the recognition module is used for recognizing the gesture information according to the signal.
14. An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the computer program, implementing the method steps of any of claims 10-12.
15. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 10 to 12.
CN201911413462.5A 2019-12-31 2019-12-31 Gesture control device and system, and gesture recognition method and device Pending CN111158488A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201911413462.5A CN111158488A (en) 2019-12-31 2019-12-31 Gesture control device and system, and gesture recognition method and device
PCT/CN2020/135202 WO2021135889A1 (en) 2019-12-31 2020-12-10 Gesture-controlled apparatus and system, and gesture recognition method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911413462.5A CN111158488A (en) 2019-12-31 2019-12-31 Gesture control device and system, and gesture recognition method and device

Publications (1)

Publication Number Publication Date
CN111158488A true CN111158488A (en) 2020-05-15

Family

ID=70560058

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911413462.5A Pending CN111158488A (en) 2019-12-31 2019-12-31 Gesture control device and system, and gesture recognition method and device

Country Status (2)

Country Link
CN (1) CN111158488A (en)
WO (1) WO2021135889A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021135889A1 (en) * 2019-12-31 2021-07-08 京东数科海益信息科技有限公司 Gesture-controlled apparatus and system, and gesture recognition method and apparatus

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106605193A (en) * 2014-08-20 2017-04-26 微晶片科技德国公司 Electrode arrangement for gesture detection and tracking
CN107743610A (en) * 2015-06-15 2018-02-27 密克罗奇普技术公司 The Sensor Design of touch and gesture decoding for reinforcement
CN108431750A (en) * 2016-04-07 2018-08-21 微晶片科技德国公司 The decoded Sensor Design of touch and gesture for reinforcement

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109388228A (en) * 2017-08-10 2019-02-26 智汇有初(广州)科技有限公司 Gestural control system and gestural control method
CN111158488A (en) * 2019-12-31 2020-05-15 北京海益同展信息科技有限公司 Gesture control device and system, and gesture recognition method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106605193A (en) * 2014-08-20 2017-04-26 微晶片科技德国公司 Electrode arrangement for gesture detection and tracking
CN107743610A (en) * 2015-06-15 2018-02-27 密克罗奇普技术公司 The Sensor Design of touch and gesture decoding for reinforcement
CN108431750A (en) * 2016-04-07 2018-08-21 微晶片科技德国公司 The decoded Sensor Design of touch and gesture for reinforcement

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MICROCHIP TECHNOLOGY INC: "GestIC® Design Guide", 《HTTPS://WWW.MICROCHIP.COM/DESIGN-CENTERS/CAPACITIVE-TOUCH-SENSING/GESTIC-TECHNOLOGY/GESTIC-TECHNOLOGY-BASICS》 *
MICROCHIP TECHNOLOGY INC: "MGC3030/3130 3D Tracking and Gesture Controller Data Sheet", 《HTTPS://WWW.MICROCHIP.COM/DESIGN-CENTERS/CAPACITIVE-TOUCH-SENSING/GESTIC-TECHNOLOGY/GESTIC-TECHNOLOGY-BASICS》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021135889A1 (en) * 2019-12-31 2021-07-08 京东数科海益信息科技有限公司 Gesture-controlled apparatus and system, and gesture recognition method and apparatus

Also Published As

Publication number Publication date
WO2021135889A1 (en) 2021-07-08

Similar Documents

Publication Publication Date Title
US20150103039A1 (en) Touch sensing system and display apparatus
CN108983979B (en) Gesture tracking recognition method and device and intelligent equipment
CN102055836A (en) Mobile terminal with action recognition function and action recognition method thereof
US20160370948A1 (en) Touch screen controller, touch sensing device, and touch sensing method
CN102279672A (en) Capacitive proximity sensing and touch detecting device and method
CN103702151A (en) Man-computer interaction remote control device and method for intelligent television and touch control screen
CN103616972A (en) Touch screen control method and terminal device
KR101476799B1 (en) System and method for detecting object using depth information
EP3358450A1 (en) Touch panel, terminal device, and method for use in detecting touched point
CN105718025A (en) Method and device for controlling infrared proximity sensor
US20160358005A1 (en) Terminal for recognizing fingerprint
CN103927065A (en) Touch screen and method for detecting same
CN111158488A (en) Gesture control device and system, and gesture recognition method and device
CN112214118A (en) Touch pen, control method thereof and electronic equipment
CN104400785B (en) Interactive intelligent household service robot
CN105446468A (en) Manipulation mode switching method and device
CN200944179Y (en) Photoelectric location and projector of infrared writing and projection system equipped with the same
KR101964192B1 (en) Smart table apparatus for simulation
CN105700749A (en) Touch control method and terminal equipment
CN107643753A (en) A kind of intelligent robot positions addressing method
CN104978171A (en) Output method and device of recognizable identifier
CN102842307A (en) Electronic device utilizing speech control and speech control method of electronic device
CN107122084B (en) Method and device for identifying touch operation on infrared touch screen and terminal equipment
CN112639393A (en) Pair thickness recognition device, bundle thickness recognition method and handwriting input device
CN110989870A (en) Display panel, driving method thereof and display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 601, 6 / F, building 2, No. 18, Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant after: Jingdong Technology Information Technology Co.,Ltd.

Address before: 601, 6 / F, building 2, No. 18, Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant before: Jingdong Shuke Haiyi Information Technology Co.,Ltd.

Address after: 601, 6 / F, building 2, No. 18, Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant after: Jingdong Shuke Haiyi Information Technology Co.,Ltd.

Address before: 601, 6 / F, building 2, No. 18, Kechuang 11th Street, Beijing Economic and Technological Development Zone, Beijing 100176

Applicant before: BEIJING HAIYI TONGZHAN INFORMATION TECHNOLOGY Co.,Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200515