CN108983955A - For sensing the wearable device and gesture recognition system of gesture - Google Patents

For sensing the wearable device and gesture recognition system of gesture Download PDF

Info

Publication number
CN108983955A
CN108983955A CN201710415353.1A CN201710415353A CN108983955A CN 108983955 A CN108983955 A CN 108983955A CN 201710415353 A CN201710415353 A CN 201710415353A CN 108983955 A CN108983955 A CN 108983955A
Authority
CN
China
Prior art keywords
wearable device
gesture
sensing
reflective sticker
hand
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710415353.1A
Other languages
Chinese (zh)
Inventor
何川丰
费越
何安莉
时驰
张鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Touch Technology Co Ltd
Original Assignee
Shenzhen Touch Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Touch Technology Co Ltd filed Critical Shenzhen Touch Technology Co Ltd
Priority to CN201710415353.1A priority Critical patent/CN108983955A/en
Publication of CN108983955A publication Critical patent/CN108983955A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Abstract

The present invention provides a kind of for sensing the wearable device of gesture, the reflective sticker that there is the light that the surface of the wearable device is provided with several pairs of specific wavelengths the material of strong reflection ability to make.The present invention also provides a kind of gesture recognition systems, including radiation source, photographic device, image processing apparatus and the wearable device for being used to sense gesture described at least one.Gesture recognition system of the invention uses low-cost reflective sticker to sense the operation of the different parts of hand, wears simply, low in cost.

Description

For sensing the wearable device and gesture recognition system of gesture
Technical field
The present invention relates to input equipment technical field, in particular to a kind of wearable device for sensing gesture and have The gesture recognition system of the wearable device.
Background technique
Gesture Recognition is a key technology of current field of human-computer interaction, is widely used in gesture interaction trip It plays, in VR equipment and mobile unit, has the tendency that becoming substitution conventional mouse, rocking bar or remote controler.It is relatively common at present Gesture Recognition is worn on hand using wearable various sensors, and by hand position information, shape information is transmitted to Analysis and operation are carried out on processing host, thus realize gesture identification and tracking, but such apparatus and process is complicated, it is with high costs, It wears complicated.
Summary of the invention
In view of the foregoing, it is necessary to provide it is a kind of low cost, wear be simply to sensing gesture wearable device And the gesture recognition system with the wearable device.
The embodiment of the present invention provides a kind of for sensing the wearable device of gesture, and the surface of the wearable device is set It is equipped with the reflective sticker that there is the light of several pairs of specific wavelengths the material of strong reflection ability to make.
As a preferred embodiment, the wearable device is ring, fingerstall, gloves, bracelet, watch or wrist guard.
As a preferred embodiment, the reflective sticker that the different parts setting of hand is corresponded on the wearable device has mark The figure of knowledge effect.
As a preferred embodiment, the reflective sticker that the different parts setting of hand is corresponded on the wearable device has not Same shape and/or size.
As a preferred embodiment, the light of the specific wavelength is infrared light.
As a preferred embodiment, it is straight for being worn on the reflective sticker of finger tip, articulations digitorum manus, the palm of the hand, the back of the hand and wrist The oval patch that the rectangle or short axle, long axis that circle, the side length of diameter 6mm-15mm is 6mm-15mm are 6mm-15mm.
As a preferred embodiment, the reflective sticker for being worn on the palm of the hand, the back of the hand and wrist front and back sides position is diameter > 20mm Circle, side length > 20mm rectangle or short axle, long axis be greater than 20mm oval patch.
As a preferred embodiment, the reflective sticker is mounted at the surface of the wearable device.
The embodiment of the present invention also provides a kind of gesture recognition system, including radiation source, photographic device, image procossing dress Set and at least one any one of as above described in for sensing the wearable device of gesture, the radiation source is used for described Wearable device issues the light wave of specific wavelength, and the photographic device is used to shoot the wearable device, and according to The photogenerated picture for the specific wavelength that reflective sticker on the wearable device is reflected back, described image processing unit is for dividing Analysis generates the bright spot formed on picture in picture by these reflective stickers and is identified and tracked the gesture to determine user.
As a preferred embodiment, the radiation source is the light source for emitting infrared light and/or the photographic device is red Outer photographic device.
Gesture recognition system of the invention senses the operation of the different parts of hand using low-cost reflective sticker, It wears simply, is not necessarily to power supply, and the different parts of hand have used the figure of different shapes and sizes to be distinguished, it can The characteristic portion for keeping recognizer simpler to be recognized the need for according to shape and size.Because selecting to specific wavelength Light have strong reflection ability material made of reflective sticker, then be used cooperatively appropriate power radiation source, can be more preferable Reduction gesture identification during background interference, simplify gesture identification tracing algorithm complexity, make embodiment of the present invention Gesture identifying device can be operated normally in cheaper hardware environment.
Detailed description of the invention
Fig. 1 is the functional-block diagram of the gesture recognition system of the embodiment of the present invention.
Fig. 2 is the schematic diagram of the first embodiment of the wearable device for sensing gesture of the embodiment of the present invention.
Fig. 3 is the schematic diagram of the second embodiment of the wearable device for sensing gesture of the embodiment of the present invention.
Fig. 4 is the schematic diagram of the 3rd embodiment of the wearable device for sensing gesture of the embodiment of the present invention.
Main element symbol description
The present invention that the following detailed description will be further explained with reference to the above drawings.
Specific embodiment
To better understand the objects, features and advantages of the present invention, with reference to the accompanying drawing and specific real Applying example, the present invention will be described in detail.It should be noted that in the absence of conflict, embodiments herein and embodiment In feature can be combined with each other.
In the following description, numerous specific details are set forth in order to facilitate a full understanding of the present invention, described embodiment is only It is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill Personnel's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Unless otherwise defined, all technical and scientific terms used herein and belong to technical field of the invention The normally understood meaning of technical staff is identical.Term as used herein in the specification of the present invention is intended merely to description tool The purpose of the embodiment of body, it is not intended that in the limitation present invention.
Fig. 1 shows the functional-block diagram of the gesture recognition system 100 of the embodiment of the present invention, the gesture recognition system 100 include several for sensing wearable device 10, radiation source 20, photographic device 30 and the image processing apparatus 40 of gesture. The wearable device 10 is worn on the positions such as the finger tip for needing to carry out gesture track identification, palm, wrist, joint, it is described can Carried device 10 is equipped with the reflective sticker 14 that there is the material of strong reflection ability to make the light of specific wavelength.The irradiation Light source 20 is used to issue the light of specific wavelength to the wearable device 10, and the photographic device 30 is used for the wearable dress 10 are set to be shot, according to the photogenerated picture for the specific wavelength that the reflective sticker 14 on the wearable device 10 is reflected back, Described image processing unit 40, which is used to analyze, to be generated the bright spot formed on picture in picture by these reflective stickers and is known The gesture of user is not determined with tracking.In certain embodiments of the present invention, the radiation source 20 can be luminous two Pole pipe, the photographic device 30 can be infrared eye.
The characteristic portion needed to keep Gesture Recognition Algorithm simpler according to size judgement, it is described reflective Patch 14 can all install according to demand or only installation section position.The bearing mode of the reflective sticker 14, that is, described wearable Device 10 can be suitable for wearing the device in hand for ring, fingerstall, gloves, bracelet or watch etc., and these devices are worn Band is simple, wears off conveniently.The reflective sticker 14 has strong reflection ability using the light to specific wavelength, such as infrared light Material production.The reflective sticker 14 can be made as the figure with mark action, such as circle, ellipse, rectangle, triangle, Diamond shape and star etc..Each reflective sticker 14 can choose different figures in position difference on hand according to wearing.It is described anti- The corresponding identical figure of light patch 14 can also have different sizes, and the reflective sticker 14 can be set in wearable device 10 different location identifies the operation of the different location of hand.It is, for example, possible to use the circle of diameter 6mm-15mm, The rectangle or short axle of side length 6mm-15mm, the oval reflective sticker 14 that long axis is 6mm-15mm are worn on finger tip, articulations digitorum manus, hand The positions such as the heart, the back of the hand and wrist according to demand can also wear the reflective sticker 14 in finger front or back or two sides Have or only installation section position, it is possible to use circle of the diameter greater than 20mm or side length are greater than the rectangle or short axle, length of 20mm The oval reflective sticker installation that axis is all larger than 20mm is worn on the positions such as the front and back sides of the palm of the hand, the back of the hand and wrist.This field Technical staff is appreciated that wearing in reflective sticker more than 14 on hand, and the shape and/or size of reflective sticker 14 are according to wearing The more refinement of the different instructions at position, will be more accurate for the identification of gesture motion.
Referring to FIG. 2, Fig. 2 is the schematic diagram of the first embodiment of wearable device 10 of the present invention for sensing gesture. In the present embodiment, the wearable device 10 is a finger ring 11, and the finger ring 11 includes a ring body 12 and an at least reflective sticker 14.The ring body 12 is for wearing in finger, such as the joint of finger.The reflective sticker 14 is set to the periphery of the ring body 12 Face.Reflective sticker 14 described in present embodiment is using the material production to infrared light with strong reflection ability.It is such as described reflective Patch 14 can have the metal powder of strong reflection ability to be made infrared light by coating on matrix.Certainly, other embodiments In, the reflective sticker 14 can also be infrared film.The reflective sticker 14 can also be embedded in installation to ring body 12.The finger Ring 11 can also be designed to the structure of adjustable size, be equipped with such as on finger ring and adjust notch 15, according to different wearer's fingers Thickness, adjustment adjust notch 15 size, to adapt to different user.
Referring to FIG. 3, Fig. 3 is the schematic diagram of the second embodiment of wearable device 10 of the present invention for sensing gesture. In the present embodiment, the wearable device 10 is a fingerstall 60, and the fingerstall 60 can cover the finger tip in finger, the fingerstall 60 In the shape that the finger with user matches, the fingerstall 60 can be designed to not according to different using the finger size of object Same internal diameter is designed as having elasticity.The fingerstall 60 is preferably made of elastic material, and such fingerstall 60 will not influence finger The flexibility of operation.Especially at least one reflective sticker 14 is arranged in pad of finger on the fingerstall 60, keeps reflective sticker 14 main Indicate the operation of user's finger tip.In other embodiments, the reflective sticker 14 can also be set to the tow sides of fingerstall 60.
Referring to FIG. 4, Fig. 4 is the schematic diagram of the 3rd embodiment of wearable device 10 of the present invention for sensing gesture. In the present embodiment, the wearable device 10 is a gloves 70, and the gloves 70 are including wrist 72, metacarpus 74 and refer to portion 76, root Wrist 72, metacarpus 74 are mountable to according to reflective sticker 14 described in demand and refers to that front, reverse side or the two sides in portion 76 have, or are only pacified Fill specific portion.In other embodiments, the gloves 70 can not also set finger portion, and gloves 70 extend from metacarpus 74 To finger root, the reflective sticker 14 only is set in the metacarpus 74 and wrist 72 of gloves.It, can if you need to know the movement on finger It wears finger ring on finger or fingerstall to cooperate and identifies.
It will be understood to those skilled in the art that the wearable device 10 is also to be made into watch, bracelet or wrist guard etc. Form, the reflective sticker 14 selects the different location for being set to watch, bracelet or wrist guard.It, can be with when specific design In the different location of gloves, watch, bracelet, finger ring and fingerstall etc., pin thread/female thread of velcro or hidden discount, the reflection plaster are set The fastener for being correspondingly provided with velcro on piece 14 or cooperating with pin thread/female thread can adjust anti-at any time according to different needs in this way Light patch 14 is in the position on wearable device 10.
User is carrying out various equipment such as household electrical appliance, Entertainment equipment, the vehicles, industrial machinery by gesture When manipulation, the combination only worn a kind of wearable device 10 or wear different number, wearable device 10 not of the same race can choose. Referring again to Fig. 1, in one embodiment of the invention, when being operated using gesture identifying device of the present invention, user is according to wanting The equipment selectivity of manipulation has the wearable devices such as finger ring, wrist guard and fingerstall in wearing on hand.The finger ring that each finger is worn On reflective sticker 14 have different shapes, if the reflective sticker 14 on thumb is the square patch that side length is 10mm, Reflective sticker 14 on his finger is rectangular patch.Fingerstall is sheathed on index finger, and it is 6mm that the reflective sticker 14 on fingerstall, which is side length, Triangle patch.Reflective sticker 14 on the wrist guard of Wrist-wearing is the oval patch that short axle is 6mm, long axis is 15mm. When carrying out gesture manipulation, the radiation source 20 issues the light of specific wavelength, the photographic device to the wearable device 10 30 to the wearable device for being shot and being generated picture, because these reflective stickers 14 are strong using having to infrared ray The material of albedo makes, and installation is worn on the positions such as the finger tip for needing to carry out gesture tracking, joint, in radiation source 20 Irradiation under can generate reflection point, these reflection points will be formed on the picture of generation strongly, apparent bright spot, the figure As processing unit 40 by algorithm identification, track these bright spots, can accurately obtain the information such as position, form, the track of hand.Tool When gymnastics is made, the radiation source 20 projects the direction of light and angle and can adjust, and photographic device 30, position of hand etc. can also be made Corresponding adjustment, so that photographic device 30 preferably obtains the reflected light of hand, more accurately to obtain the information of gesture.
Gesture recognition system of the invention senses the operation of the different parts of hand using low-cost reflective sticker, And the different parts of hand have used the figure of different shapes and sizes to be distinguished, the root that recognizer can be made simpler The characteristic portion recognized the need for according to shape and size.Because selecting the material that there is strong reflection ability to the light of specific wavelength Reflective sticker made of expecting, then it is used cooperatively the radiation source of appropriate power, during capable of preferably reducing gesture identification Background interference, the complexity for simplifying gesture identification tracing algorithm, enable the gesture identifying device of embodiment of the present invention more Add and is operated normally in cheap hardware environment, it, can by being acquired to the data for wearing the bright spot that reflective sticker is reflected back on hand More accurately identify hand-type, tracking gesture.And gesture recognition system of the invention is not by the colour of skin of user, hand size Influence.
It will also be understood by those skilled in the art that in other embodiments, for the acquisition not office of a certain position movement It is limited to only use a reflective sticker, the movement at the position can also be known using the combined form of multiple reflective stickers.
Gesture identifying device provided in an embodiment of the present invention can provide the identification picture of high contrast for Gesture Recognition Algorithm Face reduces the technical difficulty of Gesture Recognition Algorithm to improve the accuracy of gesture identification.With in the prior art use sensor The mode that the information such as hand position, posture are actively sent to processing system by type wearable device is different, the embodiment of the present invention By the way of passively feeding back, that is, reflectorized material is used to provide the image information for being easy to analyze identification for Gesture Recognition Algorithm, no Can information actively be sent to processing system.And using sensor type wearable device, structure is complicated in the prior art, and it is at high cost It is high, and gesture identifying device provided in an embodiment of the present invention is low in cost, structure is simple, reduces ordinary user and is known using gesture The threshold of other technology has stronger ease for use, maintainability, it helps the popularization and promotion of Gesture Recognition.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims Variation is included in the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.This Outside, it is clear that one word of " comprising " does not exclude other units or steps, and odd number is not excluded for plural number.
Finally it should be noted that the above examples are only used to illustrate the technical scheme of the present invention and are not limiting, although reference Preferred embodiment describes the invention in detail, those skilled in the art should understand that, it can be to of the invention Technical solution is modified or equivalent replacement, without departing from the spirit and scope of the technical solution of the present invention.

Claims (10)

1. a kind of for sensing the wearable device of gesture, which is characterized in that the surface of the wearable device is provided with several The reflective sticker that there is the material of strong reflection ability to make the light of specific wavelength.
2. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that the wearable device is to guard against Finger, fingerstall, gloves, bracelet, watch or wrist guard.
3. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that right on the wearable device The reflective sticker for answering the different parts of hand to be arranged is the figure with mark action.
4. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that right on the wearable device The reflective sticker for answering the different parts of hand to be arranged has different shape and/or size.
5. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that the light of the specific wavelength For infrared light.
6. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that be worn on finger tip, articulations digitorum manus, The reflective sticker of the palm of the hand, the back of the hand or wrist is the circle of diameter 6mm-15mm, side length is 6mm-15mm rectangle or short axle, Long axis is the oval patch of 6mm-15mm.
7. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that be worn on the palm of the hand, the back of the hand or The reflective sticker at wrist front and back sides position is diameter > 20mm circle, side length > 20mm rectangle or short axle, long axis greater than 20mm Oval patch.
8. as described in claim 1 for sensing the wearable device of gesture, which is characterized in that the reflective sticker is detachable The surface for being installed on the wearable device.
9. a kind of gesture recognition system, including radiation source, photographic device, image processing apparatus and at least one such as claim For sensing the wearable device of gesture described in any one of 1-8, the radiation source is used to send out to the wearable device The light wave of specific wavelength out, the photographic device are used to shoot the wearable device, and according to the wearable dress The photogenerated picture for the specific wavelength that the reflective sticker set is reflected back, described image processing unit generate in picture for analyzing The bright spot that is formed on picture by these reflective stickers is simultaneously identified and is tracked gesture to determine user.
10. gesture recognition system as claimed in claim 9, which is characterized in that the radiation source is the light for emitting infrared light Source and/or the photographic device are infrared eye.
CN201710415353.1A 2017-06-05 2017-06-05 For sensing the wearable device and gesture recognition system of gesture Pending CN108983955A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710415353.1A CN108983955A (en) 2017-06-05 2017-06-05 For sensing the wearable device and gesture recognition system of gesture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710415353.1A CN108983955A (en) 2017-06-05 2017-06-05 For sensing the wearable device and gesture recognition system of gesture

Publications (1)

Publication Number Publication Date
CN108983955A true CN108983955A (en) 2018-12-11

Family

ID=64502045

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710415353.1A Pending CN108983955A (en) 2017-06-05 2017-06-05 For sensing the wearable device and gesture recognition system of gesture

Country Status (1)

Country Link
CN (1) CN108983955A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111182381A (en) * 2019-10-10 2020-05-19 广东小天才科技有限公司 Camera control method of intelligent sound box, intelligent sound box and storage medium
CN113261726A (en) * 2021-03-24 2021-08-17 烟台南山学院 Gesture translation intelligent gloves based on multi-sensor data fusion
CN115022604A (en) * 2022-04-21 2022-09-06 新华智云科技有限公司 Projection book and use method and system thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111182381A (en) * 2019-10-10 2020-05-19 广东小天才科技有限公司 Camera control method of intelligent sound box, intelligent sound box and storage medium
CN111182381B (en) * 2019-10-10 2021-08-20 广东小天才科技有限公司 Camera control method of intelligent sound box, intelligent sound box and storage medium
CN113261726A (en) * 2021-03-24 2021-08-17 烟台南山学院 Gesture translation intelligent gloves based on multi-sensor data fusion
CN115022604A (en) * 2022-04-21 2022-09-06 新华智云科技有限公司 Projection book and use method and system thereof

Similar Documents

Publication Publication Date Title
EP3035164B1 (en) Wearable sensor for tracking articulated body-parts
JP6545258B2 (en) Smart ring
AU2013347935B2 (en) Computing interface system
Dementyev et al. WristFlex: low-power gesture input with wrist-worn pressure sensors
US8421448B1 (en) Hall-effect sensor system for gesture recognition, information coding, and processing
Hales et al. Interacting with objects in the environment by gaze and hand gestures
CN108983955A (en) For sensing the wearable device and gesture recognition system of gesture
EP3438790B1 (en) Input device and image display system
US10663729B2 (en) Peripheral device for head-mounted display
CN104113680A (en) Sight line tracking system and method
US20150077336A1 (en) Methods and Apparatus for Using the Human Body as an Input Device
Premaratne et al. Historical development of hand gesture recognition
JP2010108500A (en) User interface device for wearable computing environmental base, and method therefor
Sugiura et al. Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors
CN103677289A (en) Intelligent interactive glove and interactive method
Zhang et al. FinDroidHR: Smartwatch gesture input with optical heartrate monitor
CN103941864A (en) Somatosensory controller based on human eye binocular visual angle
US20190025931A1 (en) Techniques for Real Object and Hand Representation in Virtual Reality Content
CN110140166A (en) For providing the system for exempting to manually enter to computer
CN206162395U (en) A motion capture system for virtual reality environment
Shires et al. Enhancing the tracking capabilities of the Microsoft Kinect for stroke rehabilitation
US10229313B1 (en) System and method for identifying and tracking a human hand in an interactive space based on approximated center-lines of digits
Havalagi et al. The amazing digital gloves that give voice to the voiceless
US20180239439A1 (en) System and method for tracking a human hand in an augmented reality environment
US11353959B2 (en) Controller device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20181211

WD01 Invention patent application deemed withdrawn after publication