CN106249889A - Infrared gesture recognition system and control method thereof and wearable device, identification equipment - Google Patents

Infrared gesture recognition system and control method thereof and wearable device, identification equipment Download PDF

Info

Publication number
CN106249889A
CN106249889A CN201610614720.6A CN201610614720A CN106249889A CN 106249889 A CN106249889 A CN 106249889A CN 201610614720 A CN201610614720 A CN 201610614720A CN 106249889 A CN106249889 A CN 106249889A
Authority
CN
China
Prior art keywords
gesture
wearable device
equipment
identification
infrared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610614720.6A
Other languages
Chinese (zh)
Inventor
任毫亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd, Qizhi Software Beijing Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201610614720.6A priority Critical patent/CN106249889A/en
Publication of CN106249889A publication Critical patent/CN106249889A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/28Recognition of hand or arm movements, e.g. recognition of deaf sign language

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention discloses a kind of infrared gesture recognition system and control method thereof and wearable device, identification equipment, and wherein, the gesture identification auxiliary control method for wearable device comprises the steps:, based on Trusted channel, to receive the driving instruction of identification equipment;In response to described driving instruction, the infraluminescence assembly driving wearable device preset is launched infrared light, is caused described identification equipment to catch gesture based on infrared imaging, and generate corresponding gesture interaction event;Based on described Trusted channel, receive the out code of identification equipment;In response to described out code, control described infraluminescence assembly and stop launching infrared light.From outward, the present invention also provides for a kind of infrared gesture recognition system for performing described control method, the enforcement of the present invention, shorten the response time of gesture recognition system, improve operator background complicated or rather dark in the case of carry out efficiency and the accuracy of gesture identification, improve man-machine interaction experience.

Description

Infrared gesture recognition system and control method thereof and wearable device, identification equipment
Technical field
The present invention relates to technical field of hand gesture recognition, more particularly, to a kind of infrared gesture recognition system and control thereof Method and wearable device, identification equipment.
Background technology
Raising man-machine interaction experience required along with the universal of smart machine and people, gesture identification owing to it is convenient, Truly with characteristic intuitively, the deficiency of tradition interactive mode can be made up, play more and more important in man-machine interactive system Role, with the smart machines such as computer, mobile phone, unmanned plane mutual in, Gesture Recognition based on computer vision Application more and more extensive.Gesture identification is broadly divided into static gesture and dynamic gesture two kinds, and such as, the gesture of " pinching " can be used In " reducing ", " expansion " gesture can be used for " amplification ", and " sweepage " gesture can be used for rolling etc..Its essence is by hand shape State or action are identified, and sign language is converted into the process of machine language or natural language.
The process of the man-machine interaction of gesture identification typically specifically includes definition of gesture, Hand Gesture Segmentation, and gesture models, and gesture is divided Analysis and gesture identification etc..Wherein, Hand Gesture Segmentation is for demarcating the gesture area in image with other regions (background area) Come, be the part that intractability is higher during gesture identification based on computer vision.Hand Gesture Segmentation is by external environment shadow Ringing big, such as when ambient light is dim, background mixed and disorderly, be especially in moving process when identification equipment, background is the most changeable And time complicated, it is difficult to effectively carry out Hand Gesture Segmentation.
It is currently based in the Gesture Recognition of computer vision, in order to strengthen gesture area and the back of the body during Hand Gesture Segmentation The discrimination of scene area, is all based on greatly following two method:
One, carries out gesture identification under simple background condition.
Its two, operator puts on the glove of special color when carrying out gesture identification.
But, these methods not only limit the application scenarios of gesture identification, is difficult with as under scene out of doors, also drops Low man-machine interaction experience, and recognizer complexity is high, does not only take up substantial amounts of calculation resources, effect is the most undesirable.
Summary of the invention
Present invention aims to present at least one aspect not enough, it is provided that a kind of infrared gesture recognition system And control method and wearable device, identification equipment, to improve operator's gesture identification efficiency under complex background condition, carry Rise man-machine interaction experience.
To achieve these goals, the present invention takes the technical scheme of following some aspects:
First aspect, provides a kind of gesture identification auxiliary control method for wearable device in the embodiment of the present invention, Comprise the steps:
Based on Trusted channel, receive the driving instruction of identification equipment;
In response to described driving instruction, infrared light launched by the infraluminescence assembly driving wearable device preset;
Based on described Trusted channel, receive the out code of identification equipment;
In response to described out code, control described infraluminescence assembly and stop launching infrared light.
In conjunction with first aspect, the present invention in the first implementation of first aspect, infrared of described wearable device After optical assembly launches infrared light, cause described identification equipment to catch gesture based on infrared imaging, and generate corresponding gesture interaction Event.
In conjunction with first aspect, in the second implementation of first aspect, described wearable device is suitable to be arranged in arm Portion so that gesture implements region between wearable device and identification equipment.
In conjunction with first aspect, the present invention, in the third implementation of first aspect, also includes following concurrent step: count Calculate the operating time of described infraluminescence assembly, when this operating time exceedes predetermined value, control described infraluminescence assembly and stop Only luminescence.
In conjunction with first aspect, the present invention is in the 4th kind of implementation of first aspect, in response to the step of driving instruction In, only drive the one or more infrared spotlights preset in described infraluminescence assembly to launch infrared light.
In conjunction with first aspect, the present invention is in the 5th kind of implementation of first aspect, in response to the step of driving instruction In, the infraluminescence assembly driving wearable device preset is launched infrared light and is formed the infrared ring of light.
In conjunction with first aspect, the present invention is in the 6th kind of implementation of first aspect, and described Trusted channel is bluetooth letter Appoint connection, near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.
In conjunction with first aspect, the present invention is in the 7th kind of implementation of first aspect, and described infraluminescence assembly is controlled The wave-length coverage of the infrared light launched is: 0.76~2.5um.
In conjunction with first aspect, the present invention, in the 8th kind of implementation of first aspect, also comprises the steps:
Receive launch lock instruction based on described Trusted channel or detect the default control switch of wearable device for opening shape State, makes described infraluminescence assembly maintain the state launching infrared light.
In conjunction with the 8th kind of implementation of first aspect, the present invention, in the 9th kind of implementation of first aspect, receives After launch lock instruction, or the control switch preset of detection wearable device is for after opening, ignore described driving instruction and/ Or out code.
In conjunction with first aspect, the present invention, in the tenth kind of implementation of first aspect, also includes following previous step:
Described wearable device sends authentication request by communication connection to the equipment of identification;
When authentication success, described wearable device and described identification equipment set up Trusted channel.
Second aspect, provides a kind of gesture identification control method for identifying equipment in the embodiment of the present invention, including Following steps:
Based on Trusted channel, send for driving it to launch the driving instruction of infrared light to wearable device;
Obtain the infrared image formed under described infrared light effect, determine gesture instruction type according to infrared image;
Corresponding gesture interaction event is triggered according to described gesture instruction type.
In conjunction with second aspect, the present invention, in the first implementation of second aspect, also includes following subsequent step:
Based on described Trusted channel, send, to described wearable device, the closedown launching infrared light for controlling its stopping and referring to Order.
In conjunction with second aspect, the present invention is in the second implementation of second aspect, and described Trusted channel is bluetooth letter Appoint connection, near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.
In conjunction with second aspect, the present invention is in the third implementation of second aspect, and described foundation infrared image determines The process of gesture instruction type includes:
A frame or multiple image is obtained from the preview image that image unit obtains;
Determine the gesture area described in described multiple image by infrared light;
Extract gesture feature data based on described gesture area, it is carried out with the gesture instruction type specification data preset Coupling, determines corresponding gesture instruction type.
In conjunction with second aspect, the present invention, in the 4th kind of implementation of second aspect, is obtaining described infrared image Before step, or before send the step of described driving instruction to wearable device, including the step starting image unit.
In conjunction with the first implementation of second aspect or second aspect, the present invention is in the 5th kind of realization side of second aspect In formula, trigger described driving instruction by any one mode following:
Trigger when image unit is activated;
Trigger in response to Touch Screen event;
Trigger in response to vibration event;
Trigger in response to the near-field-communication signal sensing wearable device.
In conjunction with second aspect, the present invention is in the 6th kind of implementation of second aspect, and this method performs on backstage, described Gesture interaction event is passed to the present user interface of identification equipment.
In conjunction with the 6th kind of implementation of second aspect, the present invention in the 7th kind of implementation of second aspect, gesture Alternative events cause or at least one number of system setting relevant to identifying equipment present user interface owning application According to changing.
In conjunction with the 6th kind of implementation of second aspect, the present invention in the 8th kind of implementation of second aspect, gesture Alternative events cause being replaced with the present user interface of the equipment of identification or changing.
In conjunction with second aspect, the present invention, in the 9th kind of implementation of second aspect, also includes sending to wearable device Described infraluminescence assembly is made to maintain the launch lock instruction launching infrared light state.
In conjunction with second aspect, the present invention, in the tenth kind of implementation of second aspect, also includes following previous step:
Described identification equipment carries out authentication by communication connection to wearable device at least one described;
When authentication success, described identification equipment and corresponding described wearable device set up Trusted channel.
In conjunction with second aspect, the present invention is in the 11st kind of implementation of second aspect, and gesture feature data include: hands Gesture outline data and/or gesture depth data.
In conjunction with second aspect, the present invention is in the 12nd kind of implementation of second aspect, and image unit includes at least one Individual photographic head;Any by IR-CUT double filtering techniques, IR lens technology, infrared induction CCD technology of described image unit A kind of or any multiple acquisition infrared image.
The third aspect, provides a kind of wearable device in the embodiment of the present invention, this wearable device has and realizes above-mentioned first Aspect is used for the function of the gesture identification auxiliary control method of wearable device.Described function can be realized by hardware, it is possible to To perform the realization of corresponding software by hardware.Described hardware or software include one or more list corresponding with above-mentioned functions Unit.
In a possible design, the structure of wearable device includes:
First receives unit, is configured to, based on Trusted channel, receive the driving instruction of identification equipment;
Driver element, is configured to respond to described driving instruction, and the infraluminescence assembly driving wearable device preset is sent out Penetrate infrared light;
Second receives unit, is configured to, based on described Trusted channel, receive the out code of identification equipment;
Closing unit, in response to described out code, controls described infraluminescence assembly and stops launching infrared light.
In conjunction with the third aspect, the present invention in the first implementation of the third aspect, the infraluminescence group of wearable device Part is configured to: after launching infrared light, causes described identification equipment to catch gesture based on infrared imaging, and generates corresponding gesture Alternative events.
In conjunction with the first implementation of the third aspect, the present invention, in the second implementation of the third aspect, dresses Equipment is configured to be suitable to be arranged in arm part so that gesture implements region between wearable device and identification equipment.
In conjunction with the third aspect, the present invention is in the third implementation of the third aspect, and closing unit is also configured to
Calculate the operating time of described infraluminescence assembly, when this operating time exceedes predetermined value, control described infrared Luminescence component stops luminescence.
In conjunction with the third aspect, the present invention is in the 4th kind of implementation of the third aspect, and driver element is configured to only drive The one or more infrared spotlights preset in dynamic described infraluminescence assembly launch infrared light.
In conjunction with the third aspect, the present invention is in the 5th kind of implementation of the third aspect, and driver element is configured to drive The preset infraluminescence assembly of wearable device is launched infrared light and is formed the infrared ring of light.
In conjunction with the third aspect, the present invention is in the 6th kind of implementation of the third aspect, and Trusted channel is that bluetooth is trusted even Connect, near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.
In conjunction with the third aspect, the present invention in the 7th kind of implementation of the third aspect, infraluminescence assembly controlled emissions The wave-length coverage of infrared light be: 0.76~2.5um.
In conjunction with the third aspect, the present invention, in the 8th kind of implementation of the third aspect, also includes normal bright control unit:
Receive launch lock instruction based on described Trusted channel or detect the default control switch of wearable device for opening shape State, makes described infraluminescence assembly maintain the state launching infrared light.
In conjunction with the 8th kind of implementation of the third aspect, the present invention in the 9th kind of implementation of the third aspect, Chang Liang After control unit is configured to receive launch lock instruction, or the control switch preset of detection wearable device is for after opening, Ignore described driving instruction and/or out code.
In conjunction with the third aspect, the present invention, in the tenth kind of implementation of the third aspect, also includes the first communication unit, quilt It is configured that
Described wearable device sends authentication request by communication connection to the equipment of identification;
When authentication success, described wearable device and described identification equipment set up Trusted channel.
Fourth aspect, provides a kind of identification equipment in the embodiment of the present invention, this identification equipment has and realizes above-mentioned second For identifying the function of the gesture identification control method of equipment in aspect.Described function can be realized by hardware, it is also possible to logical Cross hardware and perform the realization of corresponding software.Described hardware or software include one or more unit corresponding with above-mentioned functions.
In a possible design, identify that the structure of equipment includes:
First transmitter unit, is configured to, based on Trusted channel, send to wearable device and be used for driving it to launch infrared light Driving instruction;
Recognition unit, for obtaining the infrared image formed under described infrared light effect, determines gesture according to infrared image Instruction type;
Response unit, is configured to trigger corresponding gesture interaction event according to described gesture instruction type.
In conjunction with fourth aspect, the present invention, in the first implementation of fourth aspect, also includes the second transmitter unit, quilt It is configured to described Trusted channel, sends for controlling its out code stopping launching infrared light to described wearable device.
In conjunction with fourth aspect, the present invention is in the second implementation of fourth aspect, and Trusted channel is that bluetooth is trusted even Connect, near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.
In conjunction with fourth aspect, the present invention is in the third implementation of fourth aspect, and response unit is configured to it and depends on Determine that according to infrared image the process of gesture instruction type includes:
A frame or multiple image is obtained from the preview image that image unit obtains;
Determine the gesture area described in described multiple image by infrared light;
Extract gesture feature data based on described gesture area, it is carried out with the gesture instruction type specification data preset Coupling, determines corresponding gesture instruction type.
In conjunction with fourth aspect, the present invention, in the 4th kind of implementation of fourth aspect, also includes camera control unit, quilt It was configured to before obtaining described infrared image, or before sending described driving instruction to wearable device, starts image unit.
In conjunction with the first implementation of fourth aspect or fourth aspect, the present invention is in the 5th kind of realization side of fourth aspect In formula, the first transmitter unit is configured to any one mode following and triggers described driving instruction:
Trigger when image unit is activated;
Trigger in response to Touch Screen event;
Trigger in response to vibration event;
Trigger in response to the near-field-communication signal sensing wearable device.
In conjunction with fourth aspect, the present invention is in the 6th kind of implementation of fourth aspect, and identification equipment is configured to: described Gesture interaction event is passed to the present user interface of identification equipment.
In conjunction with fourth aspect, the present invention is in the 7th kind of implementation of fourth aspect, and response unit is configured to: gesture Alternative events cause or at least one number of system setting relevant to identifying equipment present user interface owning application According to changing.
In conjunction with fourth aspect, the present invention is in the 8th kind of implementation of fourth aspect, and gesture interaction event causes and knows The present user interface of other equipment is replaced or changes.
In conjunction with fourth aspect, the present invention is in the 9th kind of implementation of fourth aspect, and the first transmitter unit is also configured Described infraluminescence assembly is made to maintain the launch lock launching infrared light state to instruct for sending to wearable device.
In conjunction with fourth aspect, the present invention, in the tenth kind of implementation of fourth aspect, also includes the second communication unit, quilt It is configured that
Described identification equipment carries out authentication by communication connection to wearable device at least one described;
When authentication success, described identification equipment and corresponding described wearable device set up Trusted channel.
In conjunction with fourth aspect, the present invention is in the 11st kind of implementation of fourth aspect, and gesture feature data include: hands Gesture outline data and/or gesture depth data.
In conjunction with fourth aspect, the present invention is in the 12nd kind of implementation of fourth aspect, and image unit includes at least one Individual photographic head;Any by IR-CUT double filtering techniques, IR lens technology, infrared induction CCD technology of described image unit A kind of or any multiple acquisition infrared image.
5th aspect, provides a kind of infrared gesture recognition system in the embodiment of the present invention, it includes the above-mentioned third aspect In wearable device and identification equipment in above-mentioned fourth aspect.
6th aspect, provides a kind of wearable device in the embodiment of the present invention, this wearable device has and realizes above-mentioned first Aspect is used for the function of the gesture identification auxiliary control method of wearable device.Described function can be realized by hardware, it is possible to To perform the realization of corresponding software by hardware.Described hardware or software include one or more list corresponding with above-mentioned functions Unit.
In a possible design, the structure of wearable device includes:
One or more processors;
One or more infrared light supplies;
Memorizer;
One or more application programs, wherein said one or more application programs are stored in described memorizer and quilt It is configured to be performed by the one or more processor;
The one or more program is used for driving the one or more processor to be configured to perform in first aspect Wearable device for the gesture identification auxiliary control method of wearable device.
7th aspect, provides a kind of identification equipment in the embodiment of the present invention, this identification equipment has and realizes above-mentioned second For identifying the function of the gesture identification control method of equipment in aspect.Described function can be realized by hardware, it is also possible to logical Cross hardware and perform the realization of corresponding software.Described hardware or software include one or more unit corresponding with above-mentioned functions.
In a possible design, identify that the structure of equipment includes:
Display, is used for showing user interface;
One or more processors;
One or more photographic head;
Memorizer;
One or more application programs, wherein said one or more application programs are stored in described memorizer and quilt It is configured to be performed by the one or more processor;
The one or more program is used for driving the one or more processor to be configured to perform in second aspect For identifying the identification equipment of the gesture identification control method of equipment.
Relative to prior art, the technical scheme that the present invention provides at least has the advantage that
First, the present invention, after the driving instruction receiving identification equipment, drives the infraluminescence assembly that wearable device is preset Launch infrared light, effectively strengthen the discrimination of gesture area and background area, and then enable identification equipment according to infrared imaging Catch gesture, generate corresponding gesture interaction event.Can reduce and calculate the taking of resource, shorten operator complicated in background or Carry out the response time needed for gesture identification in the case of rather dark, improve the discrimination of operator's man-machine interaction with in real time Property, especially when being in moving process as identification equipment or operator, its effect is especially pronounced.
Secondly, the wearable device of the present invention is suitable to be arranged in arm part so that gesture implement region be positioned at wearable device with Between identification equipment, it is possible in response to driving instruction, the infraluminescence assembly making wearable device preset is launched infrared light and formed The infrared ring of light.Without additional configuration infrared light supply on identification equipment, contribute to making identification equipment lighting, improve operation simultaneously Person's gesture identification efficiency and accuracy.
Additionally, the present invention can also make described infraluminescence when the control switch that wearable device is preset is for opening Assembly maintains the state launching infrared light so that wearable device keeps Chang Liang, it is simple to interact at any time.Or at luminescence component When operating time exceedes predetermined value, control infraluminescence assembly and stop luminescence, and only drive presetting in infraluminescence assembly One or more infrared spotlights launch infrared light, with saves energy, increase the service life.Lifting operation person utilizes gesture to know Do not carry out the experience of man-machine interaction.
I have much more to say than I can write in this letter, and aspect and advantage that the present invention adds will part be given in the following description, and these will be from following Description in become more straightforward, or recognized by the practice of the present invention.
Accompanying drawing explanation
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, in embodiment being described below required for make Accompanying drawing be briefly described, it should be apparent that, below describe in accompanying drawing be only some embodiments of the present invention, for From the point of view of those skilled in the art, on the premise of not paying creative work, it is also possible to obtain the attached of other according to these accompanying drawings Figure.
Fig. 1 be in the present invention for wearable device gesture identification auxiliary control method an embodiment flow process signal Figure;
Fig. 2 is for identifying the schematic flow sheet of an embodiment of the gesture identification control method of equipment in the present invention;
Fig. 3 is the schematic flow sheet of an embodiment of wearable device in the present invention;
Fig. 4 is the schematic flow sheet of the embodiment identifying equipment in the present invention;
Fig. 5 is the structure principle chart of an embodiment of wearable device in the present invention;
Fig. 6 is the structure principle chart of the embodiment identifying equipment in the present invention.
Detailed description of the invention
In order to make those skilled in the art be more fully understood that the present invention program, below in conjunction with in the embodiment of the present invention Accompanying drawing, is clearly and completely described the technical scheme in the embodiment of the present invention.
In some flow processs of description in description and claims of this specification and above-mentioned accompanying drawing, contain according to Particular order occur multiple operations, but it should be clearly understood that these operation can not according to its occur in this article suitable Sequence performs or executed in parallel, the sequence number of operation such as S10, S11 etc., is only used for distinguishing each different operation, sequence number Itself does not represent any execution sequence.It addition, these flow processs can include more or less of operation, and these operations can To perform in order or executed in parallel.It should be noted that " first ", " second " herein etc. describe, it is for distinguishing not Message together, equipment, module etc., do not represent sequencing, and not limiting " first " and " second " is different types.
It will appreciated by the skilled person that unless expressly stated, singulative used herein " ", " Individual ", " described " and " being somebody's turn to do " may also comprise plural form.It is to be further understood that use in the description of the present invention arranges Diction " including " refers to there is described feature, integer, step, operation, element and/or assembly, but it is not excluded that existence or adds Other features one or more, integer, step, operation, element, assembly and/or their group.It should be understood that when we claim unit Part is " connected " or during " coupled " to another element, and it can be directly connected or coupled to other elements, or can also exist Intermediary element.Additionally, " connection " used herein or " coupling " can include wireless connections or wireless couple.Used herein arrange Diction "and/or" includes that one or more list the whole of item or any cell being associated combines with whole.
It will appreciated by the skilled person that unless otherwise defined, all terms used herein (include technology art Language and scientific terminology), have with the those of ordinary skill in art of the present invention be commonly understood by identical meaning.Also should Be understood by, those terms defined in such as general dictionary, it should be understood that have with in the context of prior art The meaning that meaning is consistent, and unless by specific definitions as here, otherwise will not use idealization or the most formal implication Explain.
It will appreciated by the skilled person that " operator " used herein above refers to be disposed with wearable device, Wearable device and identification equipment is utilized to carry out gesture identification to implement the user of interactive controlling.
It will appreciated by the skilled person that " wearable device " used herein above had both included wireless signal receiver Equipment, it only possesses the equipment of wireless signal receiver of non-emissive ability, includes again the equipment receiving and launching hardware, its Have on bidirectional communication link, can carry out two-way communication reception and launch hardware equipment, also include accepting and Launch the equipment of signal of communication.This equipment can be disposed on the person, especially arm part, and it includes Intelligent bracelet, intelligence hands Table, or the bracelet/wrist-watch/bangle being provided with infrared light supply etc..
It will appreciated by the skilled person that " identification equipment " used herein above had both included wireless signal receiver Equipment, it only possesses the equipment of wireless signal receiver of non-emissive ability, includes again the equipment receiving and launching hardware, its There is the reception that on bidirectional communication link, can carry out two-way communication and the equipment launching hardware.This equipment may include that Honeycomb or other communication equipments, its have single line display or multi-line display or the honeycomb not having multi-line display or Other communication equipments;PCS (Personal Communications Service, PCS Personal Communications System), it can combine language Sound, data process, fax and/or its communication ability;(Personal Digital Assistant, individual digital helps PDA Reason), its can include the access of radio frequency receiver, pager, the Internet/intranet, web browser, notepad, calendar and/or GPS (Global Positioning System, global positioning system) receptor;Conventional laptop and/or palmtop computer Or other equipment, it has and/or includes the conventional laptop of radio frequency receiver and/or palmtop computer or other equipment. " identification equipment " used herein above can be portable, can transport, be arranged on the vehicles (aviation, sea-freight and/or land) In intelligent movable equipment, such as unmanned plane etc., or be suitable for and/or be configured to the smart machine at local runtime, and/or with Distribution form, any other position operating in the earth and/or space is run." identification equipment " used herein above can also is that Communication terminal, access terminals, music/video playback terminal, such as, can be that (Point of Sales sells eventually for PDA, POS End), MID (Mobile Internet Device, mobile internet device) and/or there is the shifting of music/video playing function Mobile phone, it is also possible to be the equipment such as intelligent television, Set Top Box.
It will appreciated by the skilled person that the implication of noun involved in the present invention at least includes:
Gesture identification: refer to various gestures to be identified by computer according to certain rule, instruction computer turns Turn to corresponding control command or semanteme, it is achieved control or the communication for information to computer.Gesture identification is broadly divided into static state Gesture and dynamic gesture two kinds, such as, the gesture of " pinching " may be used for " reducing ", and " expansion " gesture can be used for " amplification ", and " strokes Plunder " gesture can be used for rolling etc..Its essence is to be identified hand form or action by man-machine interaction, is turned by sign language Change the process of machine language or natural language into.Refer in particular to gesture identification based on computer vision.Its interactive process Typically specifically including definition of gesture, Hand Gesture Segmentation, gesture models, gesture analysis, gesture identification etc..
Wherein, Hand Gesture Segmentation comes for being divided with other regions (background area) by the gesture area in image, is base The part that intractability is higher during the gesture identification of computer vision.Hand Gesture Segmentation depends on algorithm, and by the external world Environment, such as the restriction of light intensity, background shape and color etc..
Infrared light: referring to that wavelength is the electromagnetic wave between 0.76um~1mm, its wavelength is longer than visible ray, it is however generally that no Can be seen by naked eyes, and infrared light can be observed by the infrared imaging device such as infrared camera or infrared thermoviewer.
Infrared gesture identification: refer to utilize the gesture identification of infrared light auxiliary interactive controlling.Infrared gesture identification mid-infrared Light can have a following configuration mode: one, by configuring infrared light supply on identification equipment;Its two, wearable device configures red Outer light source.The infrared gesture identification of the present invention refers in particular to, by configuring infrared light supply on wearable device, divide strengthening gesture Cut effect.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Describing, the most same or similar label represents same or similar element or has same or like function wholely Element.Obviously, described embodiment is only a part of embodiment of the present invention rather than whole embodiments.Based on this Embodiment in invention, the every other enforcement that those skilled in the art are obtained under not making creative work premise Example, broadly falls into the scope of protection of the invention.
Refer to Fig. 1, the present invention in the embodiment of the gesture identification auxiliary control method of wearable device, it includes Following steps:
Step S11, based on Trusted channel, receives the driving instruction of identification equipment.
Gesture recognition system in use, identifies that equipment and wearable device are the most separated, and it passes through communication link Connect to realize and the transmission of instruction.It is said that in general, use the connected mode of radio communication.Even, in some cases, such as wear Wear between equipment and identification equipment distant, or environment electromagnetics complicated condition etc., it is also possible to by signals such as signal repeaters Multiplying arrangement is attached.In one embodiment, in order to ensure accuracy and the safety of human-computer interactive control, it is also possible to adopt By the mode of Trusted channel so that only passed through gesture identification operator, wearable device and/or the knowledge that identity (ID) is verified Other equipment just can interact operation.
In a possible embodiment, identify the Trusted channel between equipment and wearable device can be bluetooth Trusted channel, Any one or a few in near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.Wear Equipment of wearing, based on above-mentioned connection, receives the driving instruction of identification equipment.
Step S12, in response to described driving instruction, infrared light launched by the infraluminescence assembly driving wearable device preset.
Wearable device includes infraluminescence assembly, in a kind of possible design, and infrared light two pole of infraluminescence assembly Pipe is along the side Sequential arrangement and lay out of wearable device.One or more infrared spotlight preset by infraluminescence assembly, such as infrared Optical diodes etc., are used for launching infrared light.Another embodiment is the improvement made on the basis of previous embodiment, in order to make to wear The infrared light that the equipment of wearing sends is conducive to gesture identification, wearable device to be suitable to be arranged in arm part so that gesture implements position, region Between wearable device and identification equipment.In a kind of possible design, wearable device, in response to the driving instruction of the equipment of identification, drives Move the preset infraluminescence assembly of wearable device to launch infrared light and form the infrared ring of light.
In a kind of embodiment, after infrared light launched by the infraluminescence assembly of wearable device, cause described identification equipment based on Infrared imaging catches gesture, and generates corresponding gesture interaction event.The infrared light that wearable device sends is in operator's the back of the hand portion There is diffuse-reflectance, " illuminating " hand profile so that operator's gesture area and background area in infrared imaging by infrared light institute Distinguish.Additionally, described infrared light is likely to be partially absorbed by hand, the infrared imaging of hand is made to become apparent from.Therefore, identify Equipment carries out Hand Gesture Segmentation based on infrared imaging, it is possible to reduce the amount of calculation of processor, shortens response time, improves gesture identification Efficiency and accuracy, especially when being in moving process as identification equipment or operator, its effect is especially pronounced.
In a kind of embodiment, wearable device in response to driving instruction, only drives presetting in described infraluminescence assembly One or more infrared spotlights launch infrared light.So that being adjusted according to practical service environment.Such as, relative in background When complexity or ambient light are the most dim, drive more infrared spotlight luminous;Otherwise, then less infrared spotlight is driven Luminous.Thus in the case of ensureing using effect, reduce the energy consumption of wearable device, extend the use time.
In another kind of embodiment, the wave-length coverage of the infrared light of infraluminescence assembly controlled emissions is: 0.76~2.5um. The infrared light that hand profile in the infrared image that identification equipment obtains mainly is reflected by hand is formed, to human body more Safety, and recognition effect is more preferably.
Step S13, based on described Trusted channel, receives the out code of identification equipment.
As it was previously stated, the equipment of identification and wearable device are by communicating to connect to realize and the transmission of instruction.It is said that in general, adopt By the connected mode of radio communication.Even, in some cases, such as distant between wearable device and identification equipment, or Environment electromagnetics complicated condition etc., it is also possible to be attached by signal amplifying apparatus such as signal repeaters.In order to ensure man-machine friendship The accuracy controlled mutually and safety, it is also possible to use the mode of Trusted channel so that only passed through identity (ID) checking Gesture identification operator, wearable device and/or identification equipment just can interact operation.
In a possible embodiment, identify the Trusted channel between equipment and wearable device can be bluetooth Trusted channel, Any one or a few in near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.Wear Equipment of wearing, based on above-mentioned connection, receives the out code of identification equipment.
Step S14, in response to described out code, controls described infraluminescence assembly and stops launching infrared light.
After the man-machine interaction terminating gesture identification, or man-machine interaction environment condition makes gesture identification set without dressing During standby infrared assist control, infraluminescence assembly can be closed.Wearable device, in response to out code, controls infraluminescence group Part stops launching infrared light.
In a kind of possible embodiment, in order to simplify control process, improve operation Discussing Convenience, can will dress further Equipment is configured that the operating time calculating described infraluminescence assembly, when this operating time exceedes predetermined value, controls described red Outer luminescence component stops luminescence.Make wearable device can be automatically switched off infrared group after the luminous scheduled duration of luminescence component Part.Thus effectively prevent from wasting electric energy due to reasons such as operator's carelessness, and operator can also arrange predetermined value voluntarily Control the luminous duration of infraluminescence assembly, improve work efficiency.
In certain embodiments of the present invention, infraluminescence assembly must be made to keep Chang Liang, to meet the demand of man-machine interaction. Thus identification equipment can be made to instruct to wearable device launch lock based on Trusted channel, or in default control on wearable device Switch.Wearable device receives launch lock instruction based on described Trusted channel or detects the default control switch of wearable device for opening Open state, make described infraluminescence assembly maintain the state launching infrared light.Thus when shortening the preparation of infrared gesture identification Between, make operator that the control of gesture identification as required, can be carried out much sooner, promote man-machine interaction experience.
Another embodiment corresponds to the improvement that previous embodiment is made, after wearable device receives launch lock instruction, or After the control switch that detection wearable device is preset is for opening, ignore described driving instruction and/or out code.Make to wear Wear equipment keep normal bright time, do not limited by aforementioned driving instruction or out code, utilize and priority is set avoids finger Order conflict.
As it was previously stated, in certain embodiments of the present invention, in order to improve accuracy and the peace that infrared gesture identification controls Quan Xing, the gesture identification auxiliary control method for wearable device of the present invention also includes following previous step:
Described wearable device sends authentication request by communication connection to the equipment of identification;
When authentication success, described wearable device and described identification equipment set up Trusted channel.
By this previous step so that only having passed through the wearable device that identity (ID) verifies could build with identification equipment Vertical Trusted channel, and then interactive operation could be realized, prevent the erroneous judgement of identification equipment or other people malicious interference, improve system accuracy And safety.
By the announcement for the gesture identification auxiliary control method of wearable device of the present invention be could be aware that, the present invention Enforcement, be greatly improved discrimination and the real-time of operator's man-machine interaction during carrying out gesture identification, improve user Experience.
Additionally, the gesture identification control method for identifying equipment of the present invention is primarily adapted for use in smart mobile phone, calculate Machine, the smart machine such as Intelligent flat or unmanned plane, be not restricted to the type of its operating system, can be Android, IOS, The operating system such as WP, Saipan.
Referring to Fig. 2, in the embodiment of gesture identification control method being used for the equipment that identifies of the present invention, it includes as follows Step:
Step S21, based on Trusted channel, sends for driving it to launch the driving instruction of infrared light to wearable device.
Gesture recognition system in use, identifies that equipment and wearable device are the most separated, and it passes through communication link Connect to realize and the transmission of instruction.It is said that in general, use the connected mode of radio communication.Even, in some cases, such as wear Wear between equipment and identification equipment distant, or environment electromagnetics complicated condition etc., it is also possible to by signals such as signal repeaters Multiplying arrangement is attached.In one embodiment, in order to ensure accuracy and the safety of human-computer interactive control, it is also possible to adopt By the mode of Trusted channel so that only passed through gesture identification operator, wearable device and/or the knowledge that identity (ID) is verified Other equipment just can interact operation.
In a possible embodiment, identify the Trusted channel between equipment and wearable device can be bluetooth Trusted channel, Any one or a few in near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.If Other equipment, based on above-mentioned connection, sends for driving it to launch the driving instruction of infrared light to wearable device.
In a kind of embodiment, identification equipment triggers described driving instruction by any one mode following:
Trigger when image unit is activated;
Trigger in response to Touch Screen event;
Trigger in response to vibration event;
Trigger in response to the near-field-communication signal sensing wearable device.
Operator as required, can flexibly set the triggering mode of driving instruction, or uses the acquiescence of identification equipment Set, improve interactive efficiency and experience.
Step S22, obtains the infrared image formed under described infrared light effect, determines gesture instruction class according to infrared image Type.
Identification equipment generally includes image unit, processor, bin etc., carries out gesture identification based on computer vision. In a kind of embodiment, identification equipment includes that at least one has the photographic head of infrared imaging function, identifies that equipment obtains above-mentioned red The infrared image formed under outer light action, has separated Hand Gesture Segmentation by gesture area with background area according to infrared image, Then by obtaining gesture feature estimate that gesture model parameter carries out gesture analysis, gesture carried out point further according to model parameter Class determines the gesture instruction type of correspondence, it is achieved infrared gesture identification.Recognition methods can be based on template matching, based on hidden horse Er Kefu model (HMM) or based on methods such as neutral nets.
Image unit includes at least one photographic head, and in a possible embodiment, image unit can be double by IR-CUT Any one or any multiple acquisition infrared image in filtering techniques, IR lens technology, infrared induction CCD technology.
In a kind of embodiment, according to infrared image, identification equipment determines that the process of gesture instruction type includes:
A frame or multiple image is obtained from the preview image that image unit obtains;
Determine the gesture area described in described multiple image by infrared light;
Extract gesture feature data based on described gesture area, it is carried out with the gesture instruction type specification data preset Coupling, determines corresponding gesture instruction type.
Identification equipment is considered as being made up of multiple image by the video that image unit obtains, in static gesture identification In, only the most a certain frame or a few frame need to be carried out gesture analysis to extract gesture feature data, gesture feature data can include Gesture outline data and/or gesture depth data.And in dynamic hand gesture recognition, then also need to obtain the space-time characteristic of gesture, The common method of dynamic gesture space-time trajectory analysis, mainly has two big classes: track template matching method (Trajectories And state space modeling method (State Space Modeling) Matching).So that multiple image is analyzed, with Obtain gesture produced space-time track at the volley.
Owing to utilizing infrared light effectively to enhance the discrimination of gesture area and background area, it is possible to make identification equipment according to Infrared imaging catches gesture, determines corresponding instruction type.Decrease and calculate taking of resource, shorten operator complicated in background Or in the case of rather dark, carry out the response time needed for gesture identification, improve the efficiency of operator's man-machine interaction with accurate Property, especially when being in moving process as identification equipment or operator, its effect is especially pronounced.
Step S23, triggers corresponding gesture interaction event according to described gesture instruction type.
Identification equipment, after determining the gesture instruction type that gesture is corresponding, triggers corresponding gesture interaction according to instruction type Event.Gesture interaction event and the corresponding relation with gesture instruction type thereof can be preset by operator, or use identification The default setting of equipment.
This method can perform on backstage, and gesture interaction event is passed to the present user interface of identification equipment.And hands The implementation result of gesture alternative events, then can select depending on being actually needed flexibly from below scheme:
One, gesture interaction event causes or system relevant to identifying equipment present user interface owning application At least one data arranged change.Realize gesture to identifying the application program of equipment or the control of system data.
Its two, gesture interaction event cause with identify equipment present user interface be replaced or change.Realize gesture pair Identify that the visualization of device user interface controls.
Such as, the gesture interaction event that the gesture of " singly refer to right draw " is corresponding may be used for increasing and identifies device voice volume;" palm On lift " gesture interaction event corresponding to gesture may be used to identification equipment, such as unmanned plane, promote flying height;" pinch " Gesture interaction event corresponding to gesture may be used to the picture on present user interface or video " reduces ";" launch " gesture pair Picture or video that the gesture interaction event answered may be used on present user interface " amplify ";And " sweepage " gesture is corresponding Gesture interaction event may be used to the picture on present user interface or video realizes rolling effect etc..
It is of course also possible to select above two scheme simultaneously, gesture interaction event is made both to have caused data for identification equipment Change, cause again replacement or the change at interface.Additionally, gesture interaction event also may act on and the communication connection of identification equipment Other equipment, it is achieved the gesture identification control to other equipment.
In certain embodiments of the present invention, infraluminescence assembly must be made to keep Chang Liang.Being used for of the present invention identifies equipment Gesture identification control method in, also include to wearable device send make described infraluminescence assembly maintain launch infrared light state Launch lock instruction.Control described infraluminescence assembly and maintain the state launching infrared light.Thus shorten infrared gesture and know Other time, make operator that the control of gesture identification as required, can be carried out much sooner, promote man-machine interaction body Test.
In certain embodiments of the present invention, infraluminescence assembly can be closed, the hands for identifying equipment of the present invention Gesture identification control method also includes following subsequent step: based on described Trusted channel, sends to described wearable device and is used for controlling Its out code stopping launching infrared light.
After the man-machine interaction terminating gesture identification, or man-machine interaction environment condition makes gesture identification set without dressing When standby infrared assist control, infraluminescence assembly can be controlled and stop luminescence.Identification equipment is trusted even based on described Connect, send out code to described wearable device so that the infraluminescence assembly of wearable device stops luminescence.
In certain embodiments of the present invention, in order to optimize interaction, obtain described infrared image at the equipment of identification Before step, or before send the step of described driving instruction to wearable device, also include the step starting image unit.From And make before identification equipment needs to obtain image, or the infraluminescence assembly luminescence of wearable device, it is possible to open shooting in time Unit, it is to avoid idle work.And at identification equipment without obtaining infrared image, or do not send described driving instruction to wearable device Time, image unit can be closed, reduce electric energy loss.
As it was previously stated, in certain embodiments of the present invention, in order to improve accuracy and the peace that infrared gesture identification controls Quan Xing, the present invention for identifying that the gesture identification control method of equipment also includes following previous step:
Described identification equipment carries out authentication by communication connection to wearable device at least one described;
When authentication success, described identification equipment and corresponding described wearable device set up Trusted channel.
By this previous step so that only having passed through the wearable device that identity (ID) verifies could build with identification equipment Vertical Trusted channel, and then interactive operation could be realized, prevent the erroneous judgement of identification equipment or other people malicious interference, improve system accuracy And safety.
Could be aware that by the present invention being used for the announcement of the gesture identification control method of the equipment that identifies, the reality of the present invention Execute, be greatly improved discrimination and the real-time of operator's man-machine interaction during carrying out gesture identification, improve Consumer's Experience.
According to modularized design thinking, the present invention is at the base of the above-mentioned gesture identification auxiliary control method for wearable device On plinth, it is further proposed that a kind of wearable device.
Referring to Fig. 3, in the embodiment of the wearable device of the present invention, it includes the first reception unit 11, driver element 12, Second receives unit 13, closing unit 14, and the function that each unit is realized specifically is explained below:
The first described reception unit 11, is configured to, based on Trusted channel, receive the driving instruction of identification equipment.
Gesture recognition system in use, identifies that equipment and wearable device are the most separated, and it passes through communication link Connect to realize and the transmission of instruction.It is said that in general, use the connected mode of radio communication.Even, in some cases, such as wear Wear between equipment and identification equipment distant, or environment electromagnetics complicated condition etc., it is also possible to by signals such as signal repeaters Multiplying arrangement is attached.In one embodiment, in order to ensure accuracy and the safety of human-computer interactive control, it is also possible to adopt By the mode of Trusted channel so that only passed through gesture identification operator, wearable device and/or the knowledge that identity (ID) is verified Other equipment just can interact operation.
In a possible embodiment, identify the Trusted channel between equipment and wearable device can be bluetooth Trusted channel, Any one or a few in near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.Wear Equipment of wearing, based on above-mentioned connection, receives the driving instruction of identification equipment.
Described driver element 12, is configured to respond to described driving instruction, drive that wearable device is preset infrared Optical assembly launches infrared light.
Wearable device includes infraluminescence assembly, in a kind of possible design, and infrared light two pole of infraluminescence assembly Pipe is along the side Sequential arrangement and lay out of wearable device.One or more infrared spotlight preset by infraluminescence assembly, such as infrared Optical diodes etc., are used for launching infrared light.Another embodiment is the improvement made on the basis of previous embodiment, in order to make to wear The infrared light that the equipment of wearing sends is conducive to gesture identification, wearable device to be suitable to be arranged in arm part so that gesture implements position, region Between wearable device and identification equipment.In a kind of possible design, wearable device, in response to the driving instruction of the equipment of identification, drives Move the preset infraluminescence assembly of wearable device to launch infrared light and form the infrared ring of light.
In a kind of embodiment, after infrared light launched by the infraluminescence assembly of wearable device, cause described identification equipment based on Infrared imaging catches gesture, and generates corresponding gesture interaction event.The infrared light that wearable device sends is in operator's the back of the hand portion There is diffuse-reflectance, " illuminating " hand profile so that operator's gesture area and background area in infrared imaging by infrared light institute Distinguish.Additionally, described infrared light is likely to be partially absorbed by hand, the infrared imaging of hand is made to become apparent from.Therefore, identify Equipment carries out Hand Gesture Segmentation based on infrared imaging, it is possible to reduce the amount of calculation of processor, shortens response time, improves gesture identification Efficiency and accuracy, especially when being in moving process as identification equipment or operator, its effect is especially pronounced.
In a kind of embodiment, wearable device in response to driving instruction, only drives presetting in described infraluminescence assembly One or more infrared spotlights launch infrared light.So that being adjusted according to practical service environment.Such as, relative in background When complexity or ambient light are the most dim, drive more infrared spotlight luminous;Otherwise, then less infrared spotlight is driven Luminous.Thus in the case of ensureing using effect, reduce the energy consumption of wearable device, extend the use time.
In another kind of embodiment, the wave-length coverage of the infrared light of infraluminescence assembly controlled emissions is: 0.76~2.5um. The infrared light that hand profile in the infrared image that identification equipment obtains mainly is reflected by hand is formed, to human body more Safety, and recognition effect is more preferably.
The second described reception unit 13, is configured to, based on described Trusted channel, receive the out code of identification equipment.
As it was previously stated, the equipment of identification and wearable device are by communicating to connect to realize and the transmission of instruction.It is said that in general, adopt By the connected mode of radio communication.Even, in some cases, such as distant between wearable device and identification equipment, or Environment electromagnetics complicated condition etc., it is also possible to be attached by signal amplifying apparatus such as signal repeaters.In order to ensure man-machine friendship The accuracy controlled mutually and safety, it is also possible to use the mode of Trusted channel so that only passed through identity (ID) checking Gesture identification operator, wearable device and/or identification equipment just can interact operation.
In a possible embodiment, identify the Trusted channel between equipment and wearable device can be bluetooth Trusted channel, Any one or a few in near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.Wear Equipment of wearing, based on above-mentioned connection, receives the out code of identification equipment.
Described closing unit 14, in response to described out code, controls the stopping of described infraluminescence assembly and launches infrared Light.
After the man-machine interaction terminating gesture identification, or man-machine interaction environment condition makes gesture identification set without dressing During standby infrared assist control, infraluminescence assembly can be closed.Wearable device, in response to out code, controls infraluminescence group Part stops launching infrared light.
In a kind of possible embodiment, in order to simplify control process, improve operation Discussing Convenience, can will dress further Equipment is configured that the operating time calculating described infraluminescence assembly, when this operating time exceedes predetermined value, controls described red Outer luminescence component stops luminescence.Make wearable device can be automatically switched off infrared group after the luminous scheduled duration of luminescence component Part.Thus effectively prevent from wasting electric energy due to reasons such as operator's carelessness, and operator can also arrange predetermined value voluntarily Control the luminous duration of infraluminescence assembly, improve work efficiency.
In certain embodiments of the present invention, infraluminescence assembly must be made to keep Chang Liang, to meet the demand of man-machine interaction. Thus identification equipment can be made to instruct to wearable device launch lock based on Trusted channel, or in default control on wearable device Switch.Wearable device also includes normal bright control unit, its be configured to based on described Trusted channel receive launch lock instruction or The control switch that detection wearable device is preset is opening, makes described infraluminescence assembly maintain the state launching infrared light. Thus shorten the time of infrared gesture identification, make operator can carry out gesture identification much sooner as required Control, promote man-machine interaction experience.
Another embodiment corresponds to the improvement that previous embodiment is made, and normal bright control unit is configured to, and sets at wearing After receiving launch lock instruction, or the control that detection wearable device is preset switchs as, after opening, ignoring described driving Instruction and/or out code.Make wearable device keep normal bright time, do not limited by aforementioned driving instruction or out code System, utilization arranges priority and avoids instruction conflict.
As it was previously stated, in certain embodiments of the present invention, in order to improve accuracy and the peace that infrared gesture identification controls Quan Xing, the wearable device of the present invention also includes the first communication unit, and it is configured to:
Described wearable device sends authentication request by communication connection to the equipment of identification;
When authentication success, described wearable device and described identification equipment set up Trusted channel.
By the first communication unit so that only having passed through wearable device that identity (ID) verifies could be with identification equipment Set up Trusted channel, and then interactive operation could be realized, prevent the erroneous judgement of identification equipment or other people malicious interference, improve system accurate Property and safety.
By the announcement of the wearable device of the present invention be could be aware that, the enforcement of the present invention, it is greatly improved operator and is entering During row gesture identification, the discrimination of man-machine interaction and real-time, improve Consumer's Experience.
According to modularized design thinking, the present invention is on the basis of the above-mentioned gesture identification control method for identifying equipment On, it is further proposed that a kind of identification equipment.
Referring to Fig. 4, in the embodiment identifying equipment of the present invention, it includes the first transmitter unit 21, recognition unit 22, Response unit 23, the function that each unit is realized specifically is explained below:
The first described transmitter unit 21, is configured to, based on Trusted channel, send to wearable device and be used for driving it Penetrate the driving instruction of infrared light.
Gesture recognition system in use, identifies that equipment and wearable device are the most separated, and it passes through communication link Connect to realize and the transmission of instruction.It is said that in general, use the connected mode of radio communication.Even, in some cases, such as wear Wear between equipment and identification equipment distant, or environment electromagnetics complicated condition etc., it is also possible to by signals such as signal repeaters Multiplying arrangement is attached.In one embodiment, in order to ensure accuracy and the safety of human-computer interactive control, it is also possible to adopt By the mode of Trusted channel so that only passed through gesture identification operator, wearable device and/or the knowledge that identity (ID) is verified Other equipment just can interact operation.
In a possible embodiment, identify the Trusted channel between equipment and wearable device can be bluetooth Trusted channel, Any one or a few in near-field communication connection, UBW Trusted channel, ZigBee Trusted channel or the Internet Trusted channel.If Other equipment, based on above-mentioned connection, sends for driving it to launch the driving instruction of infrared light to wearable device.
In a kind of embodiment, identify that the first transmitter unit of equipment is configured to any one mode following and triggers institute The driving instruction stated:
Trigger when image unit is activated;
Trigger in response to Touch Screen event;
Trigger in response to vibration event;
Trigger in response to the near-field-communication signal sensing wearable device.
Operator as required, can flexibly set the triggering mode of driving instruction, or uses the acquiescence of identification equipment Set, improve interactive efficiency and experience.
Described recognition unit 22, for obtaining the infrared image formed under described infrared light effect, according to infrared image Determine gesture instruction type.
Identification equipment generally includes image unit, processor, bin etc., carries out gesture identification based on computer vision. In a kind of embodiment, identification equipment includes that at least one has the photographic head of infrared imaging function, identifies that equipment obtains above-mentioned red The infrared image formed under outer light action, has separated Hand Gesture Segmentation by gesture area with background area according to infrared image, Then by obtaining gesture feature estimate that gesture model parameter carries out gesture analysis, gesture carried out point further according to model parameter Class determines the gesture instruction type of correspondence, it is achieved infrared gesture identification.Recognition methods can be based on template matching, based on hidden horse Er Kefu model (HMM) or based on methods such as neutral nets.
Image unit includes at least one photographic head, and in a possible embodiment, image unit can be double by IR-CUT Any one or any multiple acquisition infrared image in filtering techniques, IR lens technology, infrared induction CCD technology.
In a kind of embodiment, in identification equipment, response unit is configured to it and determines gesture instruction type according to infrared image Process include:
A frame or multiple image is obtained from the preview image that image unit obtains;
Determine the gesture area described in described multiple image by infrared light;
Extract gesture feature data based on described gesture area, it is carried out with the gesture instruction type specification data preset Coupling, determines corresponding gesture instruction type.
Identification equipment is considered as being made up of multiple image by the video that image unit obtains, in static gesture identification In, only the most a certain frame or a few frame need to be carried out gesture analysis to extract gesture feature data, gesture feature data can include Gesture outline data and/or gesture depth data.And in dynamic hand gesture recognition, then also need to obtain the space-time characteristic of gesture, The common method of dynamic gesture space-time trajectory analysis, mainly has two big classes: track template matching method (Trajectories And state space modeling method (State Space Modeling) Matching).So that multiple image is analyzed, with Obtain gesture produced space-time track at the volley.
Owing to utilizing infrared light effectively to enhance the discrimination of gesture area and background area, it is possible to make identification equipment according to Infrared imaging catches gesture, determines corresponding instruction type.Decrease and calculate taking of resource, shorten operator complicated in background Or in the case of rather dark, carry out the response time needed for gesture identification, improve the efficiency of operator's man-machine interaction with accurate Property, especially when being in moving process as identification equipment or operator, its effect is especially pronounced.
Described response unit 23, is configured to trigger corresponding gesture interaction event according to described gesture instruction type.
Identification equipment, after determining the gesture instruction type that gesture is corresponding, triggers corresponding gesture interaction according to instruction type Event.Gesture interaction event and the corresponding relation with gesture instruction type thereof can be preset by operator, or use identification The default setting of equipment.
In a kind of embodiment, gesture interaction event is passed to the present user interface of identification equipment.And gesture interaction thing The implementation result of part, then can select depending on being actually needed flexibly from below scheme:
One, gesture interaction event causes or system relevant to identifying equipment present user interface owning application At least one data arranged change.Realize gesture to identifying the application program of equipment or the control of system data.
Its two, gesture interaction event cause with identify equipment present user interface be replaced or change.Realize gesture pair Identify that the visualization of device user interface controls.
Such as, the gesture interaction event that the gesture of " singly refer to right draw " is corresponding may be used for increasing and identifies device voice volume;" palm On lift " gesture interaction event corresponding to gesture may be used to identification equipment, such as unmanned plane, promote flying height;" pinch " Gesture interaction event corresponding to gesture may be used to the picture on present user interface or video " reduces ";" launch " gesture pair Picture or video that the gesture interaction event answered may be used on present user interface " amplify ";And " sweepage " gesture is corresponding Gesture interaction event may be used to the picture on present user interface or video realizes rolling effect etc..
It is of course also possible to select above two scheme simultaneously, gesture interaction event is made both to have caused data for identification equipment Change, cause again replacement or the change at interface.Additionally, gesture interaction event also may act on and the communication connection of identification equipment Other equipment, it is achieved the gesture identification control to other equipment.
In certain embodiments of the present invention, infraluminescence assembly must be made to keep Chang Liang.First transmitter unit is also configured Described infraluminescence assembly is made to maintain the launch lock launching infrared light state to instruct for sending to wearable device.Control described red Outer luminescence component maintains the state launching infrared light.Thus shorten the time of infrared gesture identification, make operator permissible As required, carry out the control of gesture identification much sooner, promote man-machine interaction experience.
In certain embodiments of the present invention, can close infraluminescence assembly, the identification equipment of the present invention also includes Two transmitter units, it is configured to, based on described Trusted channel, be used for controlling its stopping to the transmission of described wearable device and launch red The out code of outer light.
After the man-machine interaction terminating gesture identification, or man-machine interaction environment condition makes gesture identification set without dressing When standby infrared assist control, infraluminescence assembly can be controlled and stop luminescence.Identification equipment is trusted even based on described Connect, send out code to described wearable device so that the infraluminescence assembly of wearable device stops luminescence.
In certain embodiments of the present invention, in order to optimize interaction, the identification equipment of the present invention also includes shooting control Unit processed, it was configured to before identification equipment obtains described infrared image, or refers to sending described driving to wearable device Before order, start image unit.So that need to obtain image at identification equipment, or the infraluminescence assembly of wearable device is sent out Before light, it is possible to open image unit in time, it is to avoid idle work.And at identification equipment without obtaining infrared image, or not to wearing When equipment sends described driving instruction, image unit can be closed, reduce electric energy loss.
As it was previously stated, in certain embodiments of the present invention, in order to improve accuracy and the peace that infrared gesture identification controls Quan Xing, the identification equipment of the present invention also includes the second communication unit, and it is configured to:
Described identification equipment carries out authentication by communication connection to wearable device at least one described;
When authentication success, described identification equipment and corresponding described wearable device set up Trusted channel.
By the second communication unit so that only having passed through wearable device that identity (ID) verifies could be with identification equipment Set up Trusted channel, and then interactive operation could be realized, prevent the erroneous judgement of identification equipment or other people malicious interference, improve system accurate Property and safety.
By the present invention being identified the announcement of equipment could be aware that, the enforcement of the present invention, it is greatly improved operator and is entering During row gesture identification, the discrimination of man-machine interaction and real-time, improve Consumer's Experience.
Additionally providing a kind of infrared gesture recognition system in the embodiment of the present invention, it includes the wearing of any of the above-described embodiment The identification equipment of equipment and any of the above-described embodiment.
Refer to Fig. 5, another embodiment of the present invention further provides a kind of wearable device, including:
One or more processors 704;
One or more infrared light supplies 708;
Memorizer 702, is used for storing application program 705;
One or more application programs 705, wherein said one or more application programs 705 are stored in described memorizer In and be configured to be performed by the one or more processor, the one or more program is used for driving one or many Individual processor is configured to perform the wearable device of the described gesture identification auxiliary control method for wearable device.
Wherein, memorizer 702 can be used for storing software program and module, and processor 704 is stored in storage by operation The software program of device 702 and module, thus perform the application of various functions and the data process of wearable device.Memorizer 702 Can mainly include storing program area and storage data field, wherein, storage program area can store operating system, at least one function institute The application program 705 (such as sound-playing function, image player function etc.) etc. needed;Storage data field can store and set according to wearing The data (such as voice data, phone directory etc.) etc. that standby use is created.Additionally, memorizer 702 can include the most random Access memory block 702, it is also possible to include nonvolatile storage 702, for example, at least one disk memory, flush memory device, Or other volatile solid-state parts.
Communication interface 703, in above-mentioned interaction wearable device with identify equipment and other equipment or communication network Communication.Communication interface 703 is the interface that processor 704 communicates with extraneous subsystem, for processor 704 and ambient systems Between the transmission of information, to reach to control the purpose of subsystem.
Processor 704 is the control centre of wearable device, utilizes various communication interface 703 and the whole wearing of connection to set Standby various piece, is stored in the software program in memory block 702 and/or module by running or performing, and calls storage Data in memory block 702, perform the various functions of wearable device and process data, thus wearable device carries out overall prison Control.Optionally, processor 704 can include one or more processing unit;Preferably, processor 704 can integrated application processor And modem processor, wherein, application processor mainly processes operating system, user interface and application program 705 etc., modulation Demodulation processor mainly processes radio communication.It is understood that above-mentioned modem processor can not also be integrated into process In device 704.
One or more application programs 705, it is preferable that these application programs 705 are stored in described memory block 702 And be configured to be performed by the one or more processor 704, the one or more program is configurable for performing use In the function that any embodiment of the gesture identification auxiliary control method of wearable device is realized.
One or more infrared light supplies 708, it can be infrarede emitting diode, is controlled by processor 704, is used for launching Infrared light.
In embodiments of the present invention, the processor 704 included by this wearable device also has a following functions:
Based on Trusted channel, receive the driving instruction of identification equipment;
In response to described driving instruction, infrared light launched by the infraluminescence assembly driving wearable device preset;
Based on described Trusted channel, receive the out code of identification equipment;
In response to described out code, control described infraluminescence assembly and stop launching infrared light.
Refer to Fig. 6, another embodiment of the present invention further provides a kind of identification equipment, including:
Display 701, is used for showing user interface;
One or more processors 704;
One or more photographic head 707;
Memorizer 702;
One or more application programs 705, wherein said one or more application programs 705 are stored in described memorizer In 702 and be configured to be performed by the one or more processor 704, the one or more program 705 is used for driving institute State one or more processor 704 and be configured to perform the identification equipment of the gesture identification control method for identifying equipment.
Fig. 6 is illustrated that provide with the embodiment of the present invention identifies device-dependent mobile phone, computer or the portion of unmanned plane The block diagram of separation structure.As a example by mobile phone, mobile phone includes: touch-sensitive display 701, memorizer 702, communication interface 703, or many The parts such as individual processor 704, one or more application program 705, one or more photographic head 707 and power supply 706.Ability Field technique personnel are appreciated that the handset structure shown in Fig. 3 is not intended that the restriction to mobile phone, can include more more than diagram Or less parts, or combine some parts, or different parts are arranged.
Below in conjunction with Fig. 6 each component parts of mobile phone carried out concrete introduction:
Display 701, including display screen, can be used for information that display inputs by user or the information being supplied to user and The various menus of mobile phone.Display unit can include display floater, optionally, can use liquid crystal display (Liquid Crystal Display, LCD), the form such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) Configure display floater.Further, contact panel can cover display floater, when contact panel detects thereon or neighbouring After touch operation, send processor 704 to determine the type of touch event, with preprocessor 704 according to the class of touch event Type provides corresponding visual output on a display panel.Although in figure 6, contact panel and display floater are as two independences Parts realize input and the input function of mobile phone, but in some embodiments it is possible to by contact panel and display floater Integrated and realize input and the output function of mobile phone.
Memorizer 702 can be used for storing software program and module, and processor 704 is stored in memorizer 702 by operation Software program and module, thus perform mobile phone various functions application and data process.Memorizer 702 can mainly include Storage program area and storage data field, wherein, storage program area can store the application journey needed for operating system, at least one function Sequence 705 (such as sound-playing function, image player function etc.) etc.;The use that storage data field can store according to mobile phone is created Data (such as voice data, phone directory etc.) etc..Additionally, memorizer 702 can include high random access memory block 702, Can also include nonvolatile storage 702, for example, at least one disk memory, flush memory device or other volatibility are solid State memory device.
Communication interface 703, wearable device and mobile phone and other equipment or communication in above-mentioned interaction. Communication interface 703 is the interface that processor 704 communicates with extraneous subsystem, between processor 704 and ambient systems The transmission of information, to reach to control the purpose of subsystem.
Processor 704 is the control centre of mobile phone, utilizes various communication interface 703 and the whole mobile phone of connection each Part, is stored in the software program in memory block 702 and/or module by running or performing, and calls and be stored in memory block Data in 702, perform the various functions of mobile phone and process data, thus mobile phone is carried out integral monitoring.Optionally, processor 704 can include one or more processing unit;Preferably, processor 704 can integrated application processor and modem processor, Wherein, application processor mainly processes operating system, user interface and application program 705 etc., and modem processor is mainly located Reason radio communication.It is understood that above-mentioned modem processor can not also be integrated in processor 704.
One or more application programs 705, it is preferable that these application programs 705 are stored in described memory block 702 And be configured to be performed by the one or more processor 704, the one or more program is configurable for identification and sets The function that any embodiment of standby gesture identification control method is realized.
One or more photographic head 707, at least one of which has infrared imaging function, these photographic head 707 and process Device 704 connects and is controlled by processor 704, and the image that photographic head 707 obtains can be stored in memorizer 702.
Mobile phone also includes the power supply 706 (such as battery) powered to all parts, it is preferred that power supply 706 can be by electricity Management system is logically contiguous with processor 704, thus manages system by power supply 706 and realize management charging, electric discharge, Yi Jigong The functions such as consumption management.
Although not shown, mobile phone can also include bluetooth module etc., does not repeats them here.
In embodiments of the present invention, this processor 704 included by identification equipment also has a following functions:
Based on Trusted channel, send for driving it to launch the driving instruction of infrared light to wearable device;
Obtain the infrared image formed under described infrared light effect, determine gesture instruction type according to infrared image;
Corresponding gesture interaction event is triggered according to described gesture instruction type.
The embodiment of the present invention additionally provides a kind of computer-readable storage medium, for saving as used by above-mentioned identification equipment Computer software instructions, it comprises for performing above-mentioned program designed by described identification equipment.
Those skilled in the art is it can be understood that arrive, for convenience and simplicity of description, and the system of foregoing description, The specific works process of device and unit, is referred to the corresponding process in preceding method embodiment, does not repeats them here.
In several embodiments provided herein, those skilled in that art are appreciated that disclosed system, dress Put and method, can realize by another way.Such as, device embodiment described above is only schematically, example Such as, the division of described unit, being only a kind of logic function and divide, actual can have other dividing mode, such as when realizing Multiple unit or assembly can in conjunction with or be desirably integrated into another system, or some features can be ignored, or does not performs.Separately A bit, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, device Or the INDIRECT COUPLING of unit or communication connection, can be electrical, machinery or other form.
The described unit illustrated as separating component can be or may not be physically separate, shows as unit The parts shown can be or may not be physical location, i.e. may be located at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of the present embodiment scheme 's.
It addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to two or more unit are integrated in a unit.Above-mentioned integrated list Unit both can realize to use the form of hardware, it would however also be possible to employ the form of SFU software functional unit realizes.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can Completing with the hardware controlling to be correlated with by programmed instruction, this program can be stored in a computer-readable recording medium, Storage medium may include that read only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc..
Above dialing keyboard input control method and device in a kind of communication process provided by the present invention are carried out in detail Thin introduction, for one of ordinary skill in the art, according to the thought of the embodiment of the present invention, at detailed description of the invention and application model Placing and all will change, in sum, this specification content should not be construed as limitation of the present invention.

Claims (10)

1. the gesture identification auxiliary control method for wearable device, it is characterised in that comprise the steps:
Based on Trusted channel, receive the driving instruction of identification equipment;
In response to described driving instruction, infrared light launched by the infraluminescence assembly driving wearable device preset;
Based on described Trusted channel, receive the out code of identification equipment;
In response to described out code, control described infraluminescence assembly and stop launching infrared light.
Gesture identification auxiliary control method for wearable device the most according to claim 1, it is characterised in that:
After infrared light launched by the infraluminescence assembly of described wearable device, described identification equipment is caused to catch hands based on infrared imaging Gesture, and generate corresponding gesture interaction event.
Gesture identification auxiliary control method for wearable device the most according to claim 1, it is characterised in that described in wear The equipment of wearing is suitable to be arranged in arm part so that gesture implements region between wearable device and identification equipment.
4. the gesture identification control method being used for the equipment that identifies, it is characterised in that comprise the steps:
Based on Trusted channel, send for driving it to launch the driving instruction of infrared light to wearable device;
Obtain the infrared image formed under described infrared light effect, determine gesture instruction type according to infrared image;
Corresponding gesture interaction event is triggered according to described gesture instruction type.
Gesture identification control method for identifying equipment the most according to claim 4, it is characterised in that described according to red Outer image determines that the process of gesture instruction type includes:
A frame or multiple image is obtained from the preview image that image unit obtains;
Determine the gesture area described in described multiple image by infrared light;
Extract gesture feature data based on described gesture area, it is carried out with the gesture instruction type specification data preset Join, determine corresponding gesture instruction type.
6. a wearable device, it is characterised in that including:
First receives unit, is configured to, based on Trusted channel, receive the driving instruction of identification equipment;
Driver element, is configured to respond to described driving instruction, and the infraluminescence assembly driving wearable device preset is launched red Outer light;
Second receives unit, is configured to, based on described Trusted channel, receive the out code of identification equipment;
Closing unit, in response to described out code, controls described infraluminescence assembly and stops launching infrared light.
7. one kind identifies equipment, it is characterised in that including:
First transmitter unit, is configured to, based on Trusted channel, send for driving it to launch driving of infrared light to wearable device Dynamic instruction;
Recognition unit, for obtaining the infrared image formed under described infrared light effect, determines gesture instruction according to infrared image Type;
Response unit, is configured to trigger corresponding gesture interaction event according to described gesture instruction type.
8. an infrared gesture recognition system, it is characterised in that include the wearable device described in claim 6 and claim 7 Described identification equipment.
9. a wearable device, it is characterised in that including:
One or more processors;
One or more infrared light supplies;
Memorizer;
One or more application programs, wherein said one or more application programs are stored in described memorizer and are configured For being performed by the one or more processor;
The one or more program is used for driving the one or more processor to be configured to perform in claim 1 to 3 The unit of the method described in any one.
10. one kind identifies equipment, it is characterised in that including:
Display, is used for showing user interface;
One or more processors;
One or more photographic head;
Memorizer;
One or more application programs, wherein said one or more application programs are stored in described memorizer and are configured For being performed by the one or more processor;
The one or more program is used for driving the one or more processor to be configured to perform in claim 4 to 5 The unit of the method described in any one.
CN201610614720.6A 2016-07-28 2016-07-28 Infrared gesture recognition system and control method thereof and wearable device, identification equipment Pending CN106249889A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610614720.6A CN106249889A (en) 2016-07-28 2016-07-28 Infrared gesture recognition system and control method thereof and wearable device, identification equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610614720.6A CN106249889A (en) 2016-07-28 2016-07-28 Infrared gesture recognition system and control method thereof and wearable device, identification equipment

Publications (1)

Publication Number Publication Date
CN106249889A true CN106249889A (en) 2016-12-21

Family

ID=57606191

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610614720.6A Pending CN106249889A (en) 2016-07-28 2016-07-28 Infrared gesture recognition system and control method thereof and wearable device, identification equipment

Country Status (1)

Country Link
CN (1) CN106249889A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109857251A (en) * 2019-01-16 2019-06-07 珠海格力电器股份有限公司 Gesture identification control method, device, storage medium and the equipment of intelligent appliance
CN110825217A (en) * 2018-08-13 2020-02-21 珠海格力电器股份有限公司 Household appliance control method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105361370A (en) * 2015-12-07 2016-03-02 上海科世达-华阳汽车电器有限公司 Intelligent bracelet
US20160212317A1 (en) * 2015-01-15 2016-07-21 Motorola Mobility Llc 3d ir illumination for iris authentication
CN104298348B (en) * 2014-09-23 2018-03-27 广东欧珀移动通信有限公司 A kind of infrared gesture recognition, image capture method, device and video camera

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104298348B (en) * 2014-09-23 2018-03-27 广东欧珀移动通信有限公司 A kind of infrared gesture recognition, image capture method, device and video camera
US20160212317A1 (en) * 2015-01-15 2016-07-21 Motorola Mobility Llc 3d ir illumination for iris authentication
CN105361370A (en) * 2015-12-07 2016-03-02 上海科世达-华阳汽车电器有限公司 Intelligent bracelet

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825217A (en) * 2018-08-13 2020-02-21 珠海格力电器股份有限公司 Household appliance control method and device
CN110825217B (en) * 2018-08-13 2023-07-11 珠海格力电器股份有限公司 Household appliance control method and device
CN109857251A (en) * 2019-01-16 2019-06-07 珠海格力电器股份有限公司 Gesture identification control method, device, storage medium and the equipment of intelligent appliance

Similar Documents

Publication Publication Date Title
CN106293081A (en) Wearable device
CN104503691A (en) Equipment control method and device
CN105278745B (en) Mobile terminal and its control method
CN104023434B (en) A kind of methods, devices and systems for opening intelligent lamp
US11971646B2 (en) Camera module, mobile terminal, and control method
CN106406892A (en) A shortcut function display method and device for applications and a terminal apparatus
CN109190592B (en) LCD display device and electronic equipment
CN109151180A (en) A kind of object identifying method and mobile terminal
CN106170931A (en) At electronic equipment and renovate and launch electronic equipment and the method for data between protection set
CN107085380A (en) A kind of intelligent domestic system customer location determination methods and electronic equipment
CN105979070A (en) Mobile terminal with infrared sensing and control method thereof
CN104347051A (en) Method and system for adjusting screen brightness
CN106201491A (en) Mobile terminal and mobile terminal remote assist course control method for use, device
CN104200249A (en) Automatic clothes matching method, device and system
CN110049185A (en) Image processing method and terminal device
CN106250014A (en) The recommendation method and device of application program
CN107193439A (en) Illumination control method and device
CN110349396A (en) Intelligent interactive system, interactive terminal and control platform
CN104583899A (en) Adaptive keyboard lighting
CN106332351A (en) Wireless LED illumination control system, control panel, and wireless pairing method
CN106096367A (en) A kind of mobile terminal wakes up processing method, device and equipment up
CN106249889A (en) Infrared gesture recognition system and control method thereof and wearable device, identification equipment
US11412555B2 (en) Mobile terminal
CN108628511A (en) A kind of program starts method and mobile terminal
CN110489678A (en) For picking monitoring method, system, device and the storage medium of object

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161221

RJ01 Rejection of invention patent application after publication