CN106873779B - Gesture recognition device and gesture recognition method - Google Patents
Gesture recognition device and gesture recognition method Download PDFInfo
- Publication number
- CN106873779B CN106873779B CN201710104725.9A CN201710104725A CN106873779B CN 106873779 B CN106873779 B CN 106873779B CN 201710104725 A CN201710104725 A CN 201710104725A CN 106873779 B CN106873779 B CN 106873779B
- Authority
- CN
- China
- Prior art keywords
- gesture
- data
- module
- wire
- gesture recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a gesture recognition device and a gesture recognition method. The wire rod module comprises a detection unit, the detection unit is used for detecting the shape and the motion track of the wire rod module, and the wire rod module sends first data converted from shape data and motion track data; the gesture processing module is coupled with the wire module and receives first data which can be read by the gesture processing module, and prestores a gesture data lookup table; when the gesture recognition device judges that the wire rod module is wound on the hand of the user, the gesture recognition device enters a gesture recognition mode, and therefore the gesture processing module compares the first data with the gesture data lookup table to determine the gesture of the current user. The gesture recognition device can judge the gesture of the user according to the first data so as to carry out man-machine interface operation without using an input device such as a mouse, a keyboard and the like for input operation.
Description
Technical Field
The present disclosure relates to gesture recognition devices and gesture recognition methods, and particularly to a gesture recognition device and a gesture recognition method using a wire module.
Background
With the development of electronic technology, more and more applications (e.g., medical treatment, electronic contest, etc.) require more diversified and customized human-machine operation interfaces, and commonly used operation media such as a mouse, a keyboard, or a touch panel are not used, so companies such as microsoft have developed a human-machine operation technology that utilizes image recognition technology to analyze the body movements of a user, and various application systems have been gradually introduced.
However, the operation technique based on the image recognition technology requires that the hardware for capturing the image is placed at a specific position to continuously monitor the body movement of the user, and then analyze and convert the body movement into a specific input command, so that not only the space and angle limitations are present, but also the tactile feedback of the existing input devices such as a mouse or a keyboard is not available.
Disclosure of Invention
In order to solve the problems of limitation and no tactile feedback in use, the invention provides a gesture recognition device.
The gesture recognition device comprises:
the wire rod module comprises a detection unit, the detection unit is used for detecting the shape and the motion track of the wire rod module, and the wire rod module sends first data converted from the shape data and the motion track data; and
the gesture processing module is coupled with the wire module and receives the first data, the first data can be read by the gesture processing module, and the gesture processing module prestores a gesture data lookup table;
when the gesture recognition device judges that the wire rod module is wound on the hand of the user, the gesture recognition device enters a gesture recognition mode, and therefore the gesture processing module compares the first data with the gesture data lookup table to determine the current gesture of the user.
As an optional technical solution, the detecting unit includes a plurality of strain sub-detecting units and a plurality of inertia sub-detecting units, the plurality of strain sub-detecting units are used for detecting the shape of the wire module, and the plurality of inertia sub-detecting units are used for detecting the movement track of the wire module.
As an optional technical solution, the wire module further includes a signal conversion unit, and the signal conversion unit is configured to convert the data of the shape and the motion trajectory of the wire module detected by the detection unit into the first data.
As an optional technical solution, the wire module further includes an electrostatic film unit to provide the user tactile feedback.
As an optional technical solution, the gesture processing module is integrated with the wire module.
As an optional technical solution, the gesture processing module includes a processing unit and a storage unit, wherein the processing unit is configured to analyze the first data, and the storage unit is configured to store the first data.
As an optional technical solution, the wire module is a wire of an earphone, a wire of a stethoscope, or a wire having a usb interface.
The invention also provides a gesture recognition method for gesture recognition of the gesture recognition module,
this gesture recognition module includes:
a wire module; and
the gesture processing module prestores a gesture data lookup table;
the gesture recognition method comprises the following steps:
step S1: electrically connecting the wire module and the gesture processing module;
step S2: detecting the shape and the motion track of the wire module;
step S3: converting the shape data and the motion trajectory data into first data, and sending the first data to the gesture processing module, wherein the gesture processing module judges whether the wire module has wire winding according to the first data, and if so, the process goes to step S4; if not, go to step S2;
step S4: the gesture processing module compares the first data with the gesture data lookup table to determine the current gesture of the user.
As an optional technical solution, in the step S4, if the gesture processing module is used for the first time or the user needs to establish new gesture data, the process proceeds to step S5:
step S5: correcting the data in the gesture data lookup table, or adjusting and adding the new gesture data to the gesture data lookup table, and then continuing to step S4.
As an optional technical solution, in the step S4, the gesture processing module analyzes the wire winding information of the wire module from the first data, and after analyzing the position information of the wound section, compares the position information with the data in the gesture data lookup table to determine the gesture of the current user.
As an optional technical solution, the wire module includes a plurality of strain sub-detecting units and a plurality of inertia sub-detecting units, in the step S2, the plurality of strain sub-detecting units detect the shape of the wire module, and the plurality of inertia sub-detecting units detect the movement track of the wire module.
As an optional technical solution, the wire module further includes an electrostatic film unit, and if it is determined that the tactile feedback is required, a current is supplied to the electrostatic film unit to generate a feedback acting force.
Compared with the prior art, the gesture recognition device can judge the gesture of the user according to the first data so as to perform the operation of the human-computer interface, does not need to use an input device such as a mouse, a keyboard and the like for input operation, and is suitable for different use situations of application systems.
The invention is described in detail below with reference to the drawings and specific examples, but the invention is not limited thereto.
Drawings
FIG. 1 is a schematic diagram of a gesture recognition apparatus according to the present invention;
FIG. 2 is a cross-sectional view of the wire module of the present invention;
FIG. 3 is a schematic diagram of a gesture recognition apparatus according to the present invention;
FIG. 4 is a flowchart of a gesture recognition method according to the present invention.
Detailed Description
Fig. 1 is a schematic view of a gesture recognition device of the present invention, and fig. 2 is a cross-sectional view of a wire module of the present invention. Referring to fig. 1 and 2, the gesture recognition apparatus 100 is used for recognizing a gesture of a user, and includes a wire module 110 and a gesture processing module 120.
The wire module 110 includes a detecting unit 111 for detecting the shape and the motion track of the wire module 110, in this embodiment, the detecting unit 111 includes a plurality of strain sub-detecting units 1111 and a plurality of inertia sub-detecting units 1112, the plurality of strain sub-detecting units 1111 are used for detecting the shape of the wire module 110, the strain sub-detecting units 1111 may be a strain element of a resistance type, a capacitance type, a piezoelectric crystal, or a touch sensor, the detecting method is not limited, and the function of detecting the shape is satisfied; the inertia sub-detection units 1112 are configured to detect a movement track of the wire module 110, and the inertia sub-detection units 1112 may be an accelerometer, a gyroscope, or an electronic compass. In this embodiment, the wire module 110 further includes a signal conversion unit, and the signal conversion unit is configured to convert the data of the shape and the motion trajectory of the wire module 110 detected by the detection unit 111 into the first data.
The gesture processing module 120 is coupled to the wire module 110 and receives the first data, which can be read by the gesture processing module 120, and the gesture processing module 120 prestores a gesture data lookup table.
FIG. 3 is a schematic diagram of a gesture recognition apparatus according to the present invention. Referring to fig. 1 to 3, as shown in the left diagram of fig. 3, when the gesture recognition apparatus 100 determines that the wire module 110 is wound around the hand of the user, the gesture recognition apparatus 100 enters a gesture recognition mode, and the gesture processing module 120 compares the first data with the gesture data lookup table to determine the gesture of the current user. After receiving the first data, the gesture processing module 120 first analyzes the wire winding information of the wire module 110, and analyzes the position information of the wound section, i.e. analyzes which sections the wire module 110 is wound (as shown by the section 113 shown by the dashed frame part in fig. 3), and then compares the sections with the relevant data in the gesture data lookup table, for example, simulates the simulated gesture shown in the right diagram in fig. 3, thereby determining the gesture of the current user.
Thus, after the user winds the wire module 110 with the detection unit 111 on the hand, the gesture recognition device 100 can determine the gesture of the user according to the first data, so as to perform the operation of the human-computer interface, without using an input device such as a mouse, a keyboard and the like to perform the input operation, thereby satisfying the use requirements of various application systems and improving the convenience and efficiency of use. For example, a doctor can simultaneously perform other medical actions (such as operating oral medical equipment, surgical equipment or ultrasonic equipment) while winding wires of a stethoscope on hands for input operation; for another example, the gesture recognition apparatus 100 can be used as a user authentication application system, and can determine the identity of the user according to the action difference of the operation gesture of the user.
In the present embodiment, as shown in fig. 2 and 3, the wire module 110 further includes an electrostatic thin film unit 112 for providing a user with tactile feedback, the electrostatic thin film unit 112 is formed by stacking a first metal electrode, a vibrating thin film with charges, and a second metal electrode, and the feedback force is generated by the dipole molecules on the vibrating thin film after the driving current is provided to the electrostatic thin film unit 112. When some sections of the gesture touch the virtual object, such as the section 113 shown in the right diagram of fig. 3, the electrostatic film unit 112 vibrates to provide tactile feedback to the user, so as to provide the user with a feeling of touching the object.
In this embodiment, the gesture processing module 120 and the wire module 110 are independently configured, for example, the gesture processing module 120 is an intelligent device (e.g., a smart phone) and includes a processing unit and a storage unit, the processing unit is configured to analyze the first data, the storage unit is configured to store the first data, the wire module 110 is an earphone cable or a wire of a stethoscope, and of course, in other embodiments, the gesture processing module 120 may also be integrated into the wire module 110.
The transmission mode of the wire module 110 for the external signal may be various, and when the wire module 110 is an earphone wire, the connection transmission may be performed through a physical interface, such as a USB interface, a headphone interface, or a lightning interface; when the wire module 110 is a wire of a stethoscope, the wire module can be wirelessly transmitted, such as bluetooth transmission with low power consumption or Zigbee transmission; when the wire module 110 is a wire (e.g., a charging wire) having a Universal Serial Bus (USB) interface, the wire module 110 can also be physically (e.g., a USB interface) connected to a smart phone or a wearable electronic device, and then control a target system (e.g., a computer) by wireless transmission.
FIG. 4 is a flowchart of a gesture recognition method according to the present invention. Referring to fig. 1 to 4, the gesture recognition method 200 is used for gesture recognition of the gesture recognition module 100, the gesture recognition module 100 includes a wire module 110 and a gesture processing module 120, and a gesture data lookup table is pre-stored in the gesture processing module 120.
The gesture recognition method 200 includes:
step S1: electrically connecting the wire module 110 and the gesture processing module 120;
step S2: detecting the shape and the motion track of the wire module 110;
step S3: converting the shape data and the motion trajectory data into first data, and sending the first data to the gesture processing module 120, where the gesture processing module 120 determines whether the wire module 110 has a wire winding according to the first data, and if so, the process goes to step S4; if not, go to step S2;
step S4: the gesture processing module 120 compares the first data with the gesture data lookup table to determine the current gesture of the user.
In step S4, if the gesture processing module 120 is used for the first time or the user needs to create new gesture data, i.e. there is no data in the pre-stored gesture data lookup table or there is no gesture data that the user currently wants to recognize, then step S5 is performed:
step S5: the gesture recognition method 200 of the present invention has a learning function, and can automatically correct the gesture operation definition of the wire module 110 according to different users, different applications or operating environments, for example, if the data in the gesture data lookup table is right-handed data and the gesture of the user is left-handed, the left-handed gesture data of the user can be collected by the wire module 110 and then sent to the gesture processing module 120, and the gesture processing module 120 stores and defines the left-handed data of the user, so that the gesture data lookup table also has the left-handed gesture data of the user. And continues to step S4 after the correction or adjustment operation of the gesture data lookup table is completed.
In step S4, after the gesture processing module 120 receives the first data, it first analyzes the wire winding information of the wire module 110, and analyzes the position information of the wound sections, i.e. analyzes which sections the wire module 110 is wound (as shown by the dashed frame in fig. 3), and then compares the sections with the relevant data in the gesture data lookup table, for example, simulates the simulated gesture shown in the right diagram in fig. 3, so as to determine the gesture of the current user.
The wire module 110 includes a plurality of strain sub-detecting units 1111 and a plurality of inertia sub-detecting units 1112, in step S2, the plurality of strain sub-detecting units 1111 detect the shape of the wire module 110, and the plurality of inertia sub-detecting units 1112 detect the motion trajectory of the wire module 110. In the embodiment, the wire module 110 further includes an electrostatic film unit 112, and if it is determined that the tactile feedback is required, a current is provided to the electrostatic film unit 112 to generate a feedback force.
In summary, the gesture recognition apparatus of the present invention can determine the gesture of the user according to the first data, so as to perform the operation of the human-computer interface without using an input device such as a mouse or a keyboard for input operation, and is suitable for various application systems.
The present invention is capable of other embodiments, and various changes and modifications may be made by one skilled in the art without departing from the spirit and scope of the invention.
Claims (11)
1. A gesture recognition apparatus for recognizing a gesture of a user, the gesture recognition apparatus comprising:
the wire rod module comprises a detection unit, the detection unit is used for detecting the shape and the motion track of the wire rod module, and the wire rod module sends first data converted from the shape data and the motion track data; and
the gesture processing module is coupled with the wire module and receives the first data, the first data can be read by the gesture processing module, and the gesture processing module prestores a gesture data lookup table;
when the gesture recognition device judges that the wire module is wound on the hand of the user, the gesture recognition device enters a gesture recognition mode, and therefore the gesture processing module compares the first data with the gesture data lookup table to determine the current gesture of the user;
after receiving the first data, the gesture processing module firstly analyzes the wire winding information of the wire module, analyzes the position information of the wound section, and compares the position information with the related data in the gesture data lookup table, thereby judging the current gesture of the user.
2. The gesture recognition device of claim 1, wherein the detection unit comprises a plurality of strain sub-detection units and a plurality of inertia sub-detection units, the plurality of strain sub-detection units are used for detecting the shape of the wire module, and the plurality of inertia sub-detection units are used for detecting the motion track of the wire module.
3. The gesture recognition device of claim 1, wherein the wire module further comprises a signal conversion unit, and the signal conversion unit is configured to convert the data of the shape and the motion trajectory of the wire module detected by the detection unit into the first data.
4. The gesture recognition device of claim 1, wherein the wire module further comprises an electrostatic film unit to provide tactile feedback to the user.
5. The gesture recognition apparatus of claim 1, wherein the gesture processing module is integrated with the wire module.
6. The gesture recognition apparatus of claim 1, wherein the gesture processing module comprises a processing unit and a storage unit, the processing unit is configured to parse the first data, and the storage unit is configured to store the first data.
7. The gesture recognition apparatus of claim 1, wherein the wire module is a wire of an earphone, a wire of a stethoscope, or a wire with a usb interface.
8. A gesture recognition method for gesture recognition of a gesture recognition module is provided,
this gesture recognition module includes:
a wire module; and
the gesture processing module prestores a gesture data lookup table;
the gesture recognition method comprises the following steps:
step S1: electrically connecting the wire module and the gesture processing module;
step S2: detecting the shape and the motion track of the wire module;
step S3: converting the shape data and the motion trajectory data into first data, and sending the first data to the gesture processing module, wherein the gesture processing module judges whether the wire module has wire winding according to the first data, and if so, the process goes to step S4; if not, go to step S2; and
step S4: the gesture processing module compares the first data in the gesture data lookup table to determine the gesture of the current user;
after receiving the first data, the gesture processing module firstly analyzes the wire winding information of the wire module, analyzes the position information of the wound section, and compares the position information with the related data in the gesture data lookup table, thereby judging the current gesture of the user.
9. The method of claim 8, wherein in step S4, if the gesture processing module is used for the first time or the user needs to create new gesture data, then go to step S5:
step S5: correcting the data in the gesture data lookup table, or adjusting and adding the new gesture data to the gesture data lookup table, and then continuing to step S4.
10. The gesture recognition method of claim 8, wherein the wire module comprises a plurality of strain sub-detection units and a plurality of inertia sub-detection units, in the step S2, the plurality of strain sub-detection units detect the shape of the wire module, and the plurality of inertia sub-detection units detect the motion trajectory of the wire module.
11. The gesture recognition method of claim 8, wherein the wire module further comprises an electrostatic film unit, and if it is determined that haptic feedback is required, a current is provided to the electrostatic film unit to generate a feedback force.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710104725.9A CN106873779B (en) | 2017-02-24 | 2017-02-24 | Gesture recognition device and gesture recognition method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710104725.9A CN106873779B (en) | 2017-02-24 | 2017-02-24 | Gesture recognition device and gesture recognition method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106873779A CN106873779A (en) | 2017-06-20 |
| CN106873779B true CN106873779B (en) | 2020-05-08 |
Family
ID=59168492
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710104725.9A Active CN106873779B (en) | 2017-02-24 | 2017-02-24 | Gesture recognition device and gesture recognition method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106873779B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109753157B (en) * | 2019-01-11 | 2022-04-26 | 京东方科技集团股份有限公司 | Gesture control method and device of display screen |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339451A (en) * | 2007-07-02 | 2009-01-07 | 佛山市顺德区顺达电脑厂有限公司 | Non-contact type finger operation and control system and its method |
| CN102024151A (en) * | 2010-12-02 | 2011-04-20 | 中国科学院计算技术研究所 | Training method of gesture motion recognition model and gesture motion recognition method |
| CN204203932U (en) * | 2014-11-18 | 2015-03-11 | 华中科技大学 | A kind of human-computer interaction device based on radio-frequency (RF) identification |
| CN105677031A (en) * | 2016-01-04 | 2016-06-15 | 广州华欣电子科技有限公司 | Control method and device based on gesture track recognition |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9086875B2 (en) * | 2009-06-05 | 2015-07-21 | Qualcomm Incorporated | Controlling power consumption of a mobile device based on gesture recognition |
| US9529439B2 (en) * | 2012-11-27 | 2016-12-27 | Qualcomm Incorporated | Multi device pairing and sharing via gestures |
-
2017
- 2017-02-24 CN CN201710104725.9A patent/CN106873779B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339451A (en) * | 2007-07-02 | 2009-01-07 | 佛山市顺德区顺达电脑厂有限公司 | Non-contact type finger operation and control system and its method |
| CN102024151A (en) * | 2010-12-02 | 2011-04-20 | 中国科学院计算技术研究所 | Training method of gesture motion recognition model and gesture motion recognition method |
| CN204203932U (en) * | 2014-11-18 | 2015-03-11 | 华中科技大学 | A kind of human-computer interaction device based on radio-frequency (RF) identification |
| CN105677031A (en) * | 2016-01-04 | 2016-06-15 | 广州华欣电子科技有限公司 | Control method and device based on gesture track recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106873779A (en) | 2017-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2846219B1 (en) | Haptic conversion system using frequency shifting | |
| US10168775B2 (en) | Wearable motion sensing computing interface | |
| KR101345755B1 (en) | Apparatus and method for controlling operation in a mobile terminal | |
| JP6058866B2 (en) | Touch panel controller, stylus pen, touch panel system, and electronic device | |
| US9110505B2 (en) | Wearable motion sensing computing interface | |
| EP3211514A1 (en) | Touch signal-based mobile terminal operation method, system and mobile terminal | |
| JP6072989B2 (en) | Touch panel controller, touch panel system, and stylus pen | |
| KR20150104808A (en) | Electronic device and method for outputing feedback | |
| US20160239128A1 (en) | User interface method and apparatus | |
| US20140340336A1 (en) | Portable terminal and method for controlling touch screen and system thereof | |
| WO2015153690A1 (en) | Wearable motion sensing computing interface | |
| JP2016218857A (en) | Touch pen, touch panel system and electronic apparatus | |
| CN116027953A (en) | Finger joint touch operation identification method, electronic equipment and readable storage medium | |
| US20200192480A1 (en) | Systems and methods for providing haptic effects based on a user's motion or environment | |
| CN106873779B (en) | Gesture recognition device and gesture recognition method | |
| CN112256135B (en) | Equipment control method and device, equipment and storage medium | |
| Mulfari et al. | Using embedded systems to spread assistive technology on multiple devices in smart environments | |
| WO2016185838A1 (en) | Touch pen, touch panel system, and electronic apparatus | |
| CN109194793B (en) | Screen adjusting method and mobile terminal | |
| JPWO2020039479A1 (en) | Terminal device, program, method, and system | |
| CN207946726U (en) | A kind of all-in-one machine based on speech recognition | |
| KR20220051725A (en) | Electronic device for controlling operation of electronic pen device, operation method in the electronic device and non-transitory storage medium | |
| KR102353919B1 (en) | Electronic device and method for performing predefined operations in response to pressure of touch | |
| KR102569170B1 (en) | Electronic device and method for processing user input based on time of maintaining user input | |
| WO2019193601A1 (en) | Piezoelectric sensors integrated hand gesture recognition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |