CN109240490A - Intelligent wearable device and the interaction control method based on it, system - Google Patents
Intelligent wearable device and the interaction control method based on it, system Download PDFInfo
- Publication number
- CN109240490A CN109240490A CN201810920959.5A CN201810920959A CN109240490A CN 109240490 A CN109240490 A CN 109240490A CN 201810920959 A CN201810920959 A CN 201810920959A CN 109240490 A CN109240490 A CN 109240490A
- Authority
- CN
- China
- Prior art keywords
- wearable device
- intelligent wearable
- wearer
- processor
- virtual reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of intelligent wearable device and the interaction control method based on it, system.Intelligent wearable device includes: processor, connect the photoelectricity mould group of processor, after intelligent wearable device is triggered into remote controler mode, photoelectricity mould group lights luminescence unit under the control of a processor, and incude change in location of wearer's hand above luminescence unit and obtain light intensity data, obtained light intensity data is sent to processor；Processor carries out the gesture motion that processing identifies wearer to light intensity data using Gesture Recognition Algorithm, and the interactive controlling of the virtual reality device of user and intelligent wearable device pairing is realized according to the gesture motion identified.The embodiment of the present invention realizes the function of existing VR remote controler or handle using intelligent wearable device, solves the problems, such as that current remote controler or handle are not easy to put in order, and widened the application range of intelligent wearable device.
Description
Technical field
The present invention relates to human-computer interaction technique fields, and in particular to a kind of intelligent wearable device and the interactive controlling based on it
Method, system.
Background technique
Currently, most of is all to realize that interface is selected by dedicated remote control or handle in virtual reality device product
Select the function of interaction control such as the identification with user action, remote controler and handle is not readily portable and storage when not in use
It is a problem.
Summary of the invention
The present invention provides a kind of intelligent wearable device and the interaction control method based on it, system, to solve or at least
Part solves the technical issues of prior art.
According to the one aspect of the application, a kind of intelligent wearable device is provided, comprising: processor connects processor
Photoelectricity mould group；
After the intelligent wearable device is triggered into remote controler mode, control of the photoelectricity mould group in the processor
Under light luminescence unit, and incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, will
To light intensity data be sent to the processor；
The processor carries out processing to the light intensity data using Gesture Recognition Algorithm and identifies that the gesture of wearer is dynamic
Make, the interactive controlling of user and the virtual reality device are realized according to the gesture motion identified；The virtual reality device
Pairing connection is established between the intelligent wearable device.
According to further aspect of the application, a kind of interaction control method based on intelligent wearable device is provided, comprising:
Triggering intelligent wearable device enters remote controler mode, and drives the luminous list lighted in the intelligent wearable device
Member；
Incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, is calculated using gesture identification
Method carries out the gesture motion that processing identifies wearer to the light intensity data；
The interactive controlling of user and intelligent wearable device are realized according to the gesture motion identified.
According to the another aspect of the application, a kind of interaction control method based on intelligent wearable device is provided, comprising:
Triggering intelligent wearable device enters remote controler mode, and drives the luminous list lighted in the intelligent wearable device
Member；
Incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, is calculated using gesture identification
Method carries out the gesture motion that processing identifies wearer to the light intensity data；
Realize the interactive controlling of user's virtual reality device according to the gesture motion that identifies, the virtual reality device with
Pairing connection is established between the intelligent wearable device.
According to another aspect of the application, a kind of intersection control routine based on intelligent wearable device is provided, comprising:
Intelligent wearable device and the virtual reality device that pairing connection is established between the intelligent wearable device；
The intelligent wearable device, for driving the hair lighted in the intelligent wearable device after entering remote controler mode
Light unit is incuded change in location of wearer's hand above the luminescence unit and obtains light intensity data, calculated using gesture identification
Method carries out the gesture motion that processing identifies wearer to the light intensity data, and it is dynamic to search gesture according to the gesture motion identified
Make and virtual reality device control instruction presets corresponding relationship, determines corresponding control instruction, the control instruction that will be determined
It is sent to the virtual reality device；
The virtual reality device realizes user's virtual reality for receiving the control instruction, and according to control instruction
The corresponding interactive controlling of equipment.
The utility model has the advantages that the embodiment of the present invention is increased in existing intelligent wearable device by improving existing intelligent wearable device
Add remote-controller function mode, enrich the function of existing intelligent wearable device, has widened application range and it is made to be used as interaction work
The user interaction tool of tool especially virtual reality device, to substitute the existing dedicated remote control of virtual reality device and hand
Handle.Firstly, intelligent wearable device is usually worn on user, this solves dedicated remote control and handle not Portable belt and storage
The problem of.Secondly, intelligent wearable device to be used as to the interactive tool of virtual reality device, grasping for intelligent wearable device is improved
The property made and man-machine interaction, should not extra purchase remote controler or handle, save user spending.Finally, intelligent wearable device is logical
The light intensity data for crossing acquisition wearer identifies the gesture motion of wearer, enriches gesture motion identification method, not only according to
Gesture motion is identified by motion sensor data, is improved the accuracy of gesture motion identification, is optimized user experience.
Detailed description of the invention
Fig. 1 is the circuit block diagram of the intelligent wearable device of one embodiment of the invention；
Fig. 2 is the positive schematic diagram of the intelligent wearable device of one embodiment of the invention；
Fig. 3 is the signal of the optical path track of the virtual reality device acquisition intelligent wearable device of one embodiment of the invention
Figure；
Fig. 4 is the flow chart based on intelligent wearable device interaction control method of one embodiment of the invention；
Fig. 5 is the block diagram based on intelligent wearable device intersection control routine of one embodiment of the invention.
Specific embodiment
Design concept of the invention is: setting for virtual reality (Virtual Reality, abbreviation VR) in the prior art
It is standby to interact control using dedicated remote control or handle mostly, caused by dedicated remote control and handle not Portable belt, store
Problem is proposed a kind of intelligent wearable device and is interacted the scheme of control based on it.Gesture is provided in intelligent wearable device
Identification function can identify the gesture motion of user, identify after gesture motion according to the gesture motion identified into
Intelligent wearable device or the interaction of VR and user are realized in row control.Since intelligent wearable device is usually worn on the person, solve
The problems such as remote controler or handle are lost, forget, is inconvenient to carry.Moreover, the gesture identification of intelligent wearable device is to acquisition
Light intensity data in user's hand motion process is handled and is identified, compared with the movement of existing remote controler and handle identification,
Identification function is richer, precision is higher.
Fig. 1 is the circuit block diagram of the intelligent wearable device of one embodiment of the invention, referring to Fig. 1, intelligent wearable device packet
Processor is included, the photoelectricity mould group of processor is connected.Photoelectricity mould group specifically includes analog front circuit, connect with analog front circuit
Luminescence unit and photodetector；Analog front circuit is connect with processor.
After intelligent wearable device is triggered into remote controler mode, photoelectricity mould group lights the list that shines under the control of a processor
Member, and incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, the light intensity data that will be obtained
It is sent to processor.Specifically, referring to Fig. 1, analog front circuit receives the control instruction of processor and is driven according to control instruction
It is dynamic to light luminescence unit；Photodetector incudes change in location of wearer's hand above luminescence unit and obtains light intensity data,
Obtained light intensity data is sent to processor by analog front circuit；
Processor carries out the gesture motion that processing identifies wearer to light intensity data using Gesture Recognition Algorithm, according to
The gesture motion identified realizes the interactive controlling of user and virtual reality device.Virtual reality device and intelligent wearable device it
Between establish have pairing connect.
From the foregoing, it will be observed that the intelligent wearable device of the present embodiment has remote controler mode, enter remote controler when being triggered by user
After mode, luminescence unit is lighted in the processor control analog front circuit driving of intelligent wearable device, and passes through photodetection
Incude user's hand light intensity data obtained from the change in location above luminescence unit, processor carries out hand according to light intensity data
Gesture action recognition is realized and the virtual reality device of intelligent wearable device pairing after identifying gesture motion based on gesture motion
Human-computer interaction function.
The present embodiment realizes the knowledge of user's routine gesture motion by the photoelectricity gesture identification device in intelligent wearable device
Not, and dedicated remote controler in current VR product is replaced to realize that the control of VR and user are interactive, remote-controller function and intelligence is worn
Equipment combination is worn, the application scenarios of intelligent wearable device have been widened, solving current remote controler or handle, Portable belt, storage are not asked
Topic.And intelligent wearable device, it realizes the human-computer interaction function of intelligent wearable device based on gesture motion or realizes and worn with intelligence
Wear the human-computer interaction function of the virtual reality device of device pairing.
That is, the intelligent wearable device of the present embodiment can control the interaction of itself based on gesture motion, for example, beating
The application on intelligent wearable device display screen is opened, the display interface etc. of display screen is switched.Gesture motion can also be used to control
The interaction of user and virtual reality device.For example, the opening of page turning up and down, the application of control virtual reality device display picture,
Pause shows that target object in picture waves, jump etc. to interact.When specific implementation, it can match in intelligent wearable device
It sets the corresponding control object of gesture motion (i.e. intelligent wearable device or virtual reality device), and establishes default gesture motion and intelligence
It is stored in intelligent wearable device after the default corresponding relationship of the interactive controlling of energy wearable device or virtual reality device instruction.
Processor shown in Fig. 1 is critical component, and processor chips are mainly used for intelligent wearable device and the information of VR
Interaction, and the change in optical signal that optical analog front-end circuit (that is, AFE) is detected pass through the Gesture Recognition Algorithm in chip
Be converted to user gesture movement.By the existing VR remote controler of above-mentioned function replacement, remote controler and intelligent wearable device are realized
In conjunction with.
Referring to Fig. 1 and Fig. 2, the front (as shown in Figure 2) of the intelligent wearable device of the present embodiment be provided with display screen (that is,
OLED Display in Fig. 2), it is less than the position of pre-determined distance threshold value on the front of intelligent wearable device with the distance between display screen
It installs and is equipped with the first windowing and the second windowing；Here pre-determined distance threshold value such as 5cm.Luminescence unit (is i.e. illustrated in Fig. 2
LED it) is mounted in the first windowing, photodetector (i.e. the PD illustrated in Fig. 2) is mounted in the second windowing.Design windowing be for
Light transmission.
It should be noted that the luminescence unit in the present embodiment in intelligent wearable device is LED (Light Emitting
Diode, light emitting diode) lamp, when practical application, multiple luminescence units can be set to form LED light in intelligent wearable device
Group.Here photoelectric detector PD (Photoelectric Detector) is a kind of sensitive chip, for incuding user's hand
The different light intensity data obtained from the change in location above luminescence unit.
A kind of way of realization of the intelligent wearable device of the present embodiment is Intelligent bracelet, is illustrated by taking Intelligent bracelet as an example below
The function of intelligent wearable device.
The Intelligent bracelet of the present embodiment includes the basic function of prior art bracelet, for example, display function, communication function,
Clocking capability, step function etc..It is appreciated that intelligent wearable device (such as Intelligent bracelet) shown in FIG. 1 is in addition to the portion that shows
It can also include realizing the component of bracelet basic function, such as RF (radio frequency) filter, flash memory, battery, power management except part
Chip, charging interface, USB interface.
The Intelligent bracelet of the embodiment of the present invention and Intelligent bracelet in the prior art the difference is that, the intelligence of the application
Energy bracelet also has remote-controller function.Remote controler mode is increased in Intelligent bracelet, correspondingly, in the display interface of Intelligent bracelet
On can show the trigger switch of remote controler mode, enter remote control when receiving user and opening trigger switch triggering Intelligent bracelet
After device mode, the processor control acquisition light intensity data of the Intelligent bracelet of the present embodiment simultaneously carries out photoelectricity gesture identification and friendship
Mutually.
The Intelligent bracelet of one embodiment of the invention provides three kinds of modes of hand relevant action identification, carries out weight below
Point explanation.The first is the identification of photoelectricity gesture motion, and the component used is mainly AFE(analog front end) processing circuit, processor, hair
Light unit and photodetector.Referring to fig. 2, LED light and photoelectric detector PD (or sensitive chip) are reserved in Intelligent bracelet front
Windowing position, when Intelligent bracelet is switched to gesture identification function, optical analog front-end circuit driving LED component light, when
Wearer is by (position of LED and PD guarantee to sense light intensity data at a distance of more closely) above the windowing for being manually placed at LED and PD
When, the variation of reflective light intensity caused by the position of light sensors sense user's palm, analog front circuit (Analog Front
End, abbreviation AFE) by sensor devices acquire simulation light intensity signal be converted to digital quantity after be uploaded to processor (such as BT or MCU
Chip), by loading Gesture Recognition Algorithm in the processor, processor effectively identifies the gesture motion of wearer, for example,
Shorten the close gesture motion (such as display screen close to Intelligent bracelet) vertical range between intelligent wearable device, increase and intelligence
The separate gesture motion (such as display screen far from Intelligent bracelet) of vertical range, solid above luminescence unit between energy wearable device
The click gesture motion or cunning of set a distance (for example arm keeps height constant, but finger is slided or clicked in the horizontal direction)
Dynamic gesture motion etc..The specific gesture motion meaning for cooperating Intelligent bracelet predetermined or virtual reality device again, for example, hand
The application hitting the corresponding application opened in Intelligent bracelet or opening on virtual reality device is given directions, to realize bracelet and the friendship of VR
Mutual control function.Function of interaction control is for example, may be implemented the functions such as the switching of bracelet and the interface VR, selection or confirmation.Here
AFE AFE(analog front end) be be located at process chain foremost, i.e., input terminal and carry out analog signal processing circuit, before simulation
The object of terminal circuit processing is the analog signal that signal source provides.
Second is arm motion state recognition.In-built motion sensor in the Intelligent bracelet of the present embodiment；Motion-sensing
The sensing data collected for acquiring the data during wearer's arm motion, and is uploaded to processor, institute by device
Processor is stated, processing is carried out to sensing data using moving state identification algorithm and identifies user's arm motion state, will be known
Not Chu user's arm motion state data wireless (such as bluetooth) be transferred to the virtual reality device.
Here motion state such as worn Intelligent bracelet arm setting in motion, movement quickly, at a slow speed, stop fortune
The motion states such as move, remain stationary, by acceleration transducer data, processor can determine whether out that Intelligent bracelet is moved,
For example shaken, fallen, other than acceleration information, processor can also obtain gyro data, gyro data table
Show that equipment surrounds the rotation of each reference axis, sometimes the movement of object does not change significantly on acceleration and has in gyroscope
Obvious performance is so pass through the combination of acceleration and gyro data, with user's arm motion shape of accurate judgement wearing bracelet
State.
It should be noted that the main components that this moving state identification is used be processor and motion sensor such as
A+G sensor, i.e. 3-axis acceleration add six axle sensors of three-axis gyroscope composition.Specific Intelligent bracelet is by being placed on
Acceleration and angular speed during internal six axis (i.e. A+G sensor) sensor acquisition user's arms swing, and will acquisition
Acceleration and angular speed data be uploaded to processor, processor identifies acceleration by the motion algorithm in loading processing device
With user's arm motion state of angular speed instruction, arm motion status data is obtained.
Note: this data according to the acquisition of the inertial sensors such as acceleration transducer, gyroscope are by feature extraction and divide
The means such as class speculate that the scheme of user's arm motion state is the prior art, and therefore, the content not described in the present embodiment can be with
Referring to the introduction of the prior art, details are not described herein.
The third is hand exercise optical path track identification.In one embodiment, the processor of Intelligent bracelet is also used to control
Analog front circuit processed lights any luminescence unit in multiple luminescence units or lights the office of display screen for controlling display screen
Portion display area, so that the camera on virtual reality device captures the luminescence unit lighted or partial display area with wearing
The motion profile of the arm motion of person obtains optical path track.Referring to Fig. 3, the main component that this mode is used is: processor, mould
Camera on quasi- front-end circuit, luminescence unit and virtual reality device.
Specifically, operating intelligent hand after user wears in Intelligent bracelet (appended drawing reference 3 in Fig. 3) to an arm
Ring enters remote controler mode, and it is (attached in Fig. 3 that a LED is lighted in the processor control analog front circuit AFE driving of Intelligent bracelet
Icon note is 2) or processor control display screen lights the fixed area (appended drawing reference 1 in Fig. 3) on display screen for virtual reality
The camera of equipment is taken pictures, and virtual reality device camera captures the light of LED (2 in Fig. 3) or screen bright block (1 in Fig. 3)
After rail mark, optical path track is converted to user's arm track and is based on using by the recognizer carried by virtual reality device
The interaction of family arm path implementation user and virtual reality device.
The mode of this optical path track capture meets the interaction of certain applications such as game application in virtual reality device
Demand.Part game application needs to capture the optical path tracks of the interactive tools such as remote controler, and base in virtual reality device at present
The movement of the target objects such as personage in optical path TRAJECTORY CONTROL game, for example, making one based on optical path TRAJECTORY CONTROL game charater
What is caused waves to act.
It can be seen from the above, the Intelligent bracelet of one embodiment of the invention, the acceleration and top that motion sensor senses are arrived
Spiral shell instrument data are identified as user's arm action state by the motion recognition algorithms of load in the processor, by optical analog front end
The change in optical signal that circuit (AFE) detects is identified as specific user gesture by the Gesture Recognition Algorithm in processor and moves
Make.Alternatively, the movement of Intelligent bracelet cooperation VR identifies camera, (at least lighted using the LEDs that Intelligent bracelet is lighted in AFE driving
One LED) or Intelligent bracelet processor chips control Intelligent bracelet display screen light specified region and show bright block (that is,
Specified region is part on display screen, fixed region) so that LED or screen that the camera detection Intelligent bracelet of VR is lighted
Bright block region recycles the image processing algorithm of VR that the bracelet motion state that camera acquires is converted to continuous optical path track
And then be converted to user's arm track.
By the existing VR remote controler of above-mentioned function replacement or handle, solve the interactive tools such as dedicated remote control or handle not
Just the problem of putting in order also enriches the gesture identification of Intelligent bracelet.
It should be noted that the display screen in the Intelligent bracelet of the present embodiment can be capacitive touch screen, or have
Machine light emitting diode (Organic Light-Emitting Diode, OLED) display screen, when display screen is OLED display screen,
Display screen, which does not have, touches interactive function, and therefore, by wearer's palm, in luminescence unit, (i.e. LED light, setting exist the present embodiment
Near display screen) above action recognition go out specific movement content and realize interaction.Here movement include: palm shorten with
The close gesture motion of vertical range between Intelligent bracelet, palm increase the separate gesture motion of the vertical range between Intelligent bracelet,
Finger with luminescence unit above click action or sliding action at fixed range.
The processor of Intelligent bracelet specifically for the gesture motion that basis identifies, for example close to gesture motion, searches hand
Gesture movement determines that current display circle is such as opened in corresponding interactive controlling instruction with the corresponding relationship that default interactive controlling instructs
An application on face instructs control to realize user's interactive controlling of intelligent wearable device or realize virtual existing according to interactive controlling
User's interactive controlling of real equipment.
So far, illustrate that Intelligent bracelet carries out the identification of hand relevant action, and based on the hand motion pair identified
Intelligent bracelet or VR interact the function of control.
One embodiment of the invention provides a kind of interactive controlling based on above-mentioned intelligent wearable device such as Intelligent bracelet
Method.
Triggering intelligent wearable device enters remote controler mode, and drives the luminous list lighted in the intelligent wearable device
Member；
Incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, is calculated using gesture identification
Method carries out the gesture motion that processing identifies wearer to the light intensity data；
The interactive controlling of user and intelligent wearable device are realized according to the gesture motion identified.
By above-mentioned interaction control method, intelligent wearable device such as Intelligent bracelet is realized based on built-in luminescence unit
With the gesture identification and interactive controlling of photoelectricity mould group, the user experience and the market competitiveness of Intelligent bracelet are improved.
In addition, being additionally provided in one embodiment of the invention a kind of based on above-mentioned intelligent wearable device such as Intelligent bracelet
Interaction control method, referring to fig. 4, the interaction control method based on intelligent wearable device of the present embodiment includes:
Step S401, triggering intelligent wearable device enters remote controler mode, and drives and light in the intelligent wearable device
Luminescence unit；
Step S402 incudes change in location of wearer's hand above the luminescence unit and obtains light intensity data, utilizes
Gesture Recognition Algorithm carries out the gesture motion that processing identifies wearer to the light intensity data；
Step S403 realizes the interactive controlling of user and virtual reality device according to the gesture motion identified.The void
Pairing connection is established between quasi- real world devices and intelligent wearable device.
In one embodiment of the invention, method shown in Fig. 4 further include: pass through the movement in the intelligent wearable device
Sensor acquires the data during wearer's arm motion；Sensing data is handled using moving state identification algorithm
Identify user's arm motion state, the user's arm motion state data that will identify that radios to the virtual reality and sets
It is standby, so that the virtual reality device executes corresponding control operation according to user's arm motion state data.
In one embodiment of the invention, the luminescence unit packet in the intelligent wearable device is lighted in driving shown in Fig. 4
It includes:
Any luminescence unit in the intelligent wearable device in multiple luminescence units is lighted in driving, so that described
Camera on virtual reality device captures the optical path track that the luminescence unit lighted is obtained with the arm motion of wearer.
In one embodiment of the invention, method shown in Fig. 4 further include: the display screen of intelligent wearable device is lighted in control
Upper specified region is transported so that the camera on the virtual reality device captures the specified region lighted with the arm of wearer
Dynamic obtained optical path track.
In one embodiment of the invention, step S402 shown in Fig. 4 is using Gesture Recognition Algorithm to the light intensity data
Carry out processing identify that the gesture motion of wearer includes: to identify following any gesture motion of wearer, shorten palm with
The close movement of vertical range between the intelligent wearable device, vertical range is remote between increase palm and the intelligent wearable device
From movement, finger with luminescence unit above click action or sliding action at fixed range.
It should be noted that the illustration of each step of the interaction control method shown in Fig. 4 illustrates, with aforementioned intelligent
The explanation of the function of wearable device is consistent, no longer repeats one by one here.
Fig. 5 is the block diagram based on intelligent wearable device intersection control routine of one embodiment of the invention, referring to Fig. 5, originally
Embodiment includes: intelligent wearable device 501 and and intelligent wearable device based on intelligent wearable device intersection control routine 500
The virtual reality device 502 of pairing connection is established between 501；
Intelligent wearable device 501, for driving the luminous list lighted in intelligent wearable device after entering remote controler mode
Member incudes change in location of wearer's hand above the luminescence unit and obtains light intensity data, utilizes Gesture Recognition Algorithm pair
The light intensity data carries out processing and identifies the gesture motion of wearer, according to the gesture motion identified search gesture motion and
Virtual reality device control instruction presets corresponding relationship, determines corresponding control instruction, and the control instruction determined is sent
To the virtual reality device 502；
Virtual reality device 502 realizes user and void for receiving the control instruction, and according to corresponding control instruction
The quasi- corresponding interactive controlling of real world devices 502.
It should be noted that shown in Fig. 5 based on intelligent wearable device in intelligent wearable device intersection control routine with
And the illustration explanation of the function of virtual reality device, it is consistent with the explanation in aforementioned intelligent wearable device embodiment,
Here it no longer repeats one by one.
In conclusion the intelligent wearable device of the present embodiment such as Intelligent bracelet, utilizes six axis in intelligent wearable device
(A+G sensor) sensor and photoelectricity gesture identification mould group, realize user movement state recognition and gesture identification, and cooperation VR is produced
The Flying Camera head of product, and can realize the recognition detection of user's arm track, realize that Intelligent bracelet substitutes VR based on these functions
Remote controler solves the problems, such as that current VR remote controler or handle are not easy to put in order, and has widened the application scenarios of bracelet.In addition,
Bracelet utilizes photoelectricity gesture identification mould group, cooperates the algorithm of gesture identification, passes through reflective light intensity caused by detection palm position
The function control of Intelligent bracelet and the switching of such as section, menu selection and the confirmation of VR is realized in variation, identification user gesture movement
System substitutes the touch key-press of current VR remote controler using photoelectricity gesture identification, realizes bracelet and the integration of user interaction functionality of VR, movement
More smooth, user experience is more preferably.
Another embodiment of the invention additionally provides a kind of computer readable storage medium, computer readable storage medium
Computer instruction is stored, computer instruction makes the computer execute the above-mentioned interactive controlling side based on intelligent wearable device
Method.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The dress for the function of being specified in one box or multiple boxes of one process or multiple processes and/or block diagrams of present flow chart
It sets.
It should be noted that the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability
Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including
Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device.
In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element
Process, method, article or equipment in there is also other identical elements.
In specification of the invention, numerous specific details are set forth.Although it is understood that the embodiment of the present invention can
To practice without these specific details.In some instances, well known method, structure and skill is not been shown in detail
Art, so as not to obscure the understanding of this specification.Similarly, it should be understood that disclose in order to simplify the present invention and helps to understand respectively
One or more of a inventive aspect, in the above description of the exemplary embodiment of the present invention, each spy of the invention
Sign is grouped together into a single embodiment, figure, or description thereof sometimes.However, should not be by the method solution of the disclosure
Release is in reflect an intention that i.e. the claimed invention requires more than feature expressly recited in each claim
More features.More precisely, as the following claims reflect, inventive aspect is less than single reality disclosed above
Apply all features of example.Therefore, it then follows thus claims of specific embodiment are expressly incorporated in the specific embodiment,
It is wherein each that the claims themselves are regarded as separate embodiments of the invention.
The above description is merely a specific embodiment, under above-mentioned introduction of the invention, those skilled in the art
Other improvement or deformation can be carried out on the basis of the above embodiments.It will be understood by those skilled in the art that above-mentioned tool
Body description only preferably explains that the purpose of the present invention, protection scope of the present invention are subject to the protection scope in claims.
Claims (15)
1. a kind of intelligent wearable device characterized by comprising processor connects the photoelectricity mould group of processor；
After the intelligent wearable device is triggered into remote controler mode, photoelectricity mould group point under the control of the processor
Brighten the hair light unit, and incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, by what is obtained
Light intensity data is sent to the processor；
The processor carries out the gesture motion that processing identifies wearer to the light intensity data using Gesture Recognition Algorithm,
The interactive controlling of user and virtual reality device, the virtual reality device and the intelligence are realized according to the gesture motion identified
Pairing connection can be established between wearable device.
2. intelligent wearable device according to claim 1, which is characterized in that the processor is identified for basis
Gesture motion after the corresponding relationship of interactive controlling instruction for searching preset gesture motion and intelligent wearable device, is determined pair
The interactive controlling instruction answered, and the interactive controlling for realizing user and intelligent wearable device is instructed based on interactive controlling.
3. intelligent wearable device according to claim 1, which is characterized in that the photoelectricity mould group includes: AFE(analog front end) electricity
Road, luminescence unit and photodetector；
The analog front circuit is connected to the processor,
The luminescence unit connects the analog front circuit, for lighting under the driving of the analog front circuit；
The photodetector connects the analog front circuit, for incuding wearer's hand above the luminescence unit
Change in location obtains light intensity data, and obtained light intensity data is sent to the processor by the analog front circuit.
4. intelligent wearable device according to claim 3, which is characterized in that the front of the intelligent wearable device is provided with
Display screen,
The position for being less than pre-determined distance threshold value on the front of the intelligent wearable device with the distance between the display screen is arranged
There are the first windowing and the second windowing；
The luminescence unit is mounted in first windowing, and the photodetector is mounted in second windowing.
5. intelligent wearable device according to claim 1, which is characterized in that the intelligent wearable device further include: movement
Sensor；
The motion sensor, for acquiring the data during wearer's arm motion, and the sensor number that will be collected
According to being uploaded to processor,
The processor carries out processing to sensing data using moving state identification algorithm and identifies user's arm motion shape
State, the user's arm motion state data that will identify that radio to the virtual reality device.
6. intelligent wearable device according to claim 3, which is characterized in that
The processor is also used to control the analog front circuit and lights any luminous list in multiple luminescence units
Member, so that the camera on the virtual reality device captures what the luminescence unit lighted was obtained with the arm motion of wearer
Optical path track.
7. intelligent wearable device according to claim 4, which is characterized in that the processor is also used to control described aobvious
Display screen, which is lighted, specifies region on the display screen, so that the camera on the virtual reality device captures the finger lighted
Determine the optical path track that region is obtained with the arm motion of wearer.
8. intelligent wearable device according to claim 1-7, which is characterized in that the intelligent wearable device is intelligence
It can bracelet；
The gesture motion for the wearer that the processor identifies include: shorten palm it is vertical between the intelligent wearable device away from
From close gesture motion, increase the separate gesture motion of vertical range between palm and the intelligent wearable device, finger with
Click action or sliding action above luminescence unit at fixed range.
9. a kind of interaction control method based on intelligent wearable device characterized by comprising
Triggering intelligent wearable device enters remote controler mode, and drives the luminescence unit lighted in the intelligent wearable device；
Incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, utilizes Gesture Recognition Algorithm pair
The light intensity data carries out the gesture motion that processing identifies wearer；
The interactive controlling of user and intelligent wearable device are realized according to the gesture motion identified.
10. a kind of interaction control method based on intelligent wearable device characterized by comprising
Triggering intelligent wearable device enters remote controler mode, and drives the luminescence unit lighted in the intelligent wearable device；
Incude change in location of wearer's hand above the luminescence unit and obtain light intensity data, utilizes Gesture Recognition Algorithm pair
The light intensity data carries out the gesture motion that processing identifies wearer；
The interactive controlling of user and virtual reality device, the virtual reality device and institute are realized according to the gesture motion identified
It states and establishes pairing connection between intelligent wearable device.
11. according to the method described in claim 10, it is characterized by further comprising:
The data during wearer's arm motion are acquired by the motion sensor in the intelligent wearable device；
Processing is carried out to sensing data using moving state identification algorithm and identifies user's arm motion state, will identify that
User's arm motion state data radios to the virtual reality device, so that the virtual reality device is according to
User's arm motion state data executes corresponding control operation.
12. according to the method described in claim 10, it is characterized in that, the luminous list in the intelligent wearable device is lighted in driving
Member includes:
Any luminescence unit in the intelligent wearable device in multiple luminescence units is lighted in driving, so that described virtual
Camera in real world devices captures the luminescence unit lighted and obtains optical path track with the arm motion of wearer.
13. according to the method described in claim 10, it is characterized by further comprising:
Control, which is lighted, specifies region on the display screen of intelligent wearable device, so that the camera on the virtual reality device is caught
The specified region lighted is caught with the obtained optical path track of the arm motion of wearer.
14. the described in any item methods of 0-13 according to claim 1, which is characterized in that using Gesture Recognition Algorithm to the light
Strong data carry out processing and identify that the gesture motion of wearer includes: to identify following any gesture motion of wearer,
Shorten the close movement of vertical range between palm and the intelligent wearable device, increases palm and the intelligent wearable device
Between vertical range separate movement, finger with luminescence unit above click action or sliding action at fixed range.
15. a kind of intersection control routine based on intelligent wearable device characterized by comprising intelligent wearable device and with
The intelligent wearable device establishes the virtual reality device of pairing connection；
The intelligent wearable device, for driving the luminous list lighted in the intelligent wearable device after entering remote controler mode
Member incudes change in location of wearer's hand above the luminescence unit and obtains light intensity data, utilizes Gesture Recognition Algorithm pair
The light intensity data carries out processing and identifies the gesture motion of wearer, according to the gesture motion identified search gesture motion and
Virtual reality device control instruction presets corresponding relationship, determines corresponding control instruction, and the control instruction determined is sent
To the virtual reality device；
The virtual reality device realizes that user sets with virtual reality for receiving the control instruction, and according to control instruction
Standby corresponding interactive controlling.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810920959.5A CN109240490A (en) | 2018-08-14 | 2018-08-14 | Intelligent wearable device and the interaction control method based on it, system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810920959.5A CN109240490A (en) | 2018-08-14 | 2018-08-14 | Intelligent wearable device and the interaction control method based on it, system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109240490A true CN109240490A (en) | 2019-01-18 |
Family
ID=65071511
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810920959.5A Pending CN109240490A (en) | 2018-08-14 | 2018-08-14 | Intelligent wearable device and the interaction control method based on it, system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109240490A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110102044A (en) * | 2019-03-15 | 2019-08-09 | 歌尔科技有限公司 | Game control method, Intelligent bracelet and storage medium based on Intelligent bracelet |
| CN110136706A (en) * | 2019-04-11 | 2019-08-16 | 北京宙心科技有限公司 | A kind of wearable smart machine and its working method |
| CN112202957A (en) * | 2020-09-28 | 2021-01-08 | 歌尔科技有限公司 | Terminal control method and control device |
| CN112214108A (en) * | 2020-09-21 | 2021-01-12 | 深圳光启空间技术有限公司 | Control method of head-mounted device, and storage medium |
| CN112686166A (en) * | 2020-12-31 | 2021-04-20 | 遵义师范学院 | Lost article detection and prompt method based on limited source data |
| CN113672093A (en) * | 2021-08-27 | 2021-11-19 | 歌尔科技有限公司 | Gesture recognition method and device, wearable device main body and wearable device |
| CN113672091A (en) * | 2021-08-26 | 2021-11-19 | 歌尔科技有限公司 | Intelligent wearable device control method and device, intelligent wearable device and medium |
| CN114637545A (en) * | 2020-11-30 | 2022-06-17 | 华为终端有限公司 | VR interaction method and device |
| US11630556B2 (en) * | 2020-09-16 | 2023-04-18 | Kyndryl, Inc. | Finger control of wearable devices |
| CN113672091B (en) * | 2021-08-26 | 2024-06-04 | 歌尔科技有限公司 | Intelligent wearable device control method and device, intelligent wearable device and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150205128A1 (en) * | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
| KR20160050419A (en) * | 2014-10-29 | 2016-05-11 | 엘지전자 주식회사 | Watch type control device |
| CN106055085A (en) * | 2015-04-08 | 2016-10-26 | 联发科技股份有限公司 | Wearable device interactive method and interactive wearable device |
| CN106062666A (en) * | 2014-02-10 | 2016-10-26 | 苹果公司 | Motion gesture input detected using optical sensors |
| CN106354253A (en) * | 2016-08-19 | 2017-01-25 | 上海理湃光晶技术有限公司 | Cursor control method and AR glasses and intelligent ring based on same |
| CN108181990A (en) * | 2018-01-19 | 2018-06-19 | 昆山国显光电有限公司 | Control method and smartwatch based on infrared gesture identification |
-
2018
- 2018-08-14 CN CN201810920959.5A patent/CN109240490A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150205128A1 (en) * | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
| CN106062666A (en) * | 2014-02-10 | 2016-10-26 | 苹果公司 | Motion gesture input detected using optical sensors |
| KR20160050419A (en) * | 2014-10-29 | 2016-05-11 | 엘지전자 주식회사 | Watch type control device |
| CN106055085A (en) * | 2015-04-08 | 2016-10-26 | 联发科技股份有限公司 | Wearable device interactive method and interactive wearable device |
| CN106354253A (en) * | 2016-08-19 | 2017-01-25 | 上海理湃光晶技术有限公司 | Cursor control method and AR glasses and intelligent ring based on same |
| CN108181990A (en) * | 2018-01-19 | 2018-06-19 | 昆山国显光电有限公司 | Control method and smartwatch based on infrared gesture identification |
Non-Patent Citations (1)
| Title |
|---|
| 胡小强编著: "《虚拟现实技术基础与应用》", 28 February 2009 * |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110102044A (en) * | 2019-03-15 | 2019-08-09 | 歌尔科技有限公司 | Game control method, Intelligent bracelet and storage medium based on Intelligent bracelet |
| CN110136706A (en) * | 2019-04-11 | 2019-08-16 | 北京宙心科技有限公司 | A kind of wearable smart machine and its working method |
| US11630556B2 (en) * | 2020-09-16 | 2023-04-18 | Kyndryl, Inc. | Finger control of wearable devices |
| CN112214108A (en) * | 2020-09-21 | 2021-01-12 | 深圳光启空间技术有限公司 | Control method of head-mounted device, and storage medium |
| CN112202957B (en) * | 2020-09-28 | 2022-07-22 | 歌尔科技有限公司 | Terminal control method and control device |
| CN112202957A (en) * | 2020-09-28 | 2021-01-08 | 歌尔科技有限公司 | Terminal control method and control device |
| CN114637545B (en) * | 2020-11-30 | 2024-04-09 | 华为终端有限公司 | VR interaction method and device |
| CN114637545A (en) * | 2020-11-30 | 2022-06-17 | 华为终端有限公司 | VR interaction method and device |
| CN112686166B (en) * | 2020-12-31 | 2023-04-18 | 遵义师范学院 | Lost article detection and prompt method based on limited source data |
| CN112686166A (en) * | 2020-12-31 | 2021-04-20 | 遵义师范学院 | Lost article detection and prompt method based on limited source data |
| CN113672091A (en) * | 2021-08-26 | 2021-11-19 | 歌尔科技有限公司 | Intelligent wearable device control method and device, intelligent wearable device and medium |
| CN113672091B (en) * | 2021-08-26 | 2024-06-04 | 歌尔科技有限公司 | Intelligent wearable device control method and device, intelligent wearable device and medium |
| CN113672093A (en) * | 2021-08-27 | 2021-11-19 | 歌尔科技有限公司 | Gesture recognition method and device, wearable device main body and wearable device |
| CN113672093B (en) * | 2021-08-27 | 2024-02-02 | 歌尔科技有限公司 | Gesture recognition method and device, wearing equipment main body and wearing equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109240490A (en) | Intelligent wearable device and the interaction control method based on it, system | |
| US10241573B2 (en) | Signal generation and detector systems and methods for determining positions of fingers of a user | |
| AU2018204039B2 (en) | Motion gesture input detected using optical sensors | |
| US9218058B2 (en) | Wearable digital input device for multipoint free space data collection and analysis | |
| US20170277282A1 (en) | Input device for transmitting user input | |
| JP6393996B2 (en) | Information reading system, reading control method, and reading control program | |
| EP2959362B1 (en) | System and method for tracking a passive wand and actuating an effect based on a detected wand path | |
| JP6043891B1 (en) | Footwear, audio output system and output control method | |
| CN104714644B (en) | Electronic equipment and information processing method | |
| US9389751B2 (en) | Storage medium storing subject selecting program and subject selecting apparatus | |
| US20160267894A1 (en) | Computerized percussion instrument | |
| WO2016189372A2 (en) | Methods and apparatus for human centric "hyper ui for devices"architecture that could serve as an integration point with multiple target/endpoints (devices) and related methods/system with dynamic context aware gesture input towards a "modular" universal controller platform and input device virtualization | |
| CN105117016A (en) | Interaction handle used in interaction control of virtual reality and augmented reality | |
| JP2015121979A (en) | Wearable information input device, information input system and information input method | |
| KR20150060945A (en) | Remote control with 3d pointing and gesture recognition capabilities | |
| JP5745247B2 (en) | GAME PROGRAM, GAME DEVICE, GAME SYSTEM, AND GAME CONTROL METHOD | |
| US20180376561A1 (en) | Wearable light-emitting apparatus and control method | |
| JP6534011B2 (en) | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING PROGRAM, INFORMATION PROCESSING SYSTEM, AND INFORMATION PROCESSING METHOD | |
| CN109324693A (en) | AR searcher, the articles search system and method based on AR searcher | |
| JP5259965B2 (en) | Information processing program and information processing apparatus | |
| KR101169583B1 (en) | Virture mouse driving method | |
| US11353958B2 (en) | Interactive attraction system and method for object and user association | |
| CN105302451A (en) | Gesture input device | |
| KR101211808B1 (en) | Gesture cognitive device and method for recognizing gesture thereof | |
| CN203982351U (en) | Gesture input device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190118 |