CN103713737A - Virtual keyboard system used for Google glasses - Google Patents

Virtual keyboard system used for Google glasses Download PDF

Info

Publication number
CN103713737A
CN103713737A CN201310684110.XA CN201310684110A CN103713737A CN 103713737 A CN103713737 A CN 103713737A CN 201310684110 A CN201310684110 A CN 201310684110A CN 103713737 A CN103713737 A CN 103713737A
Authority
CN
China
Prior art keywords
intelligent glasses
staff
main body
virtual keyboard
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310684110.XA
Other languages
Chinese (zh)
Other versions
CN103713737B (en
Inventor
王建军
樊建平
朱青松
岳冰心
谢耀钦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Priority to CN201310684110.XA priority Critical patent/CN103713737B/en
Publication of CN103713737A publication Critical patent/CN103713737A/en
Application granted granted Critical
Publication of CN103713737B publication Critical patent/CN103713737B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses virtual keyboard system used for Google glasses. The virtual keyboard system is characterized in that a hand tracking system and a self-positioning system are integrated in a Google glasses body; the hand tracking system is used for detecting three-dimensional positioning information and spatial position and angle of the hand; the self-positioning system is fixedly connected onto the Google glasses body and used for acquiring real-time natural movement data of the head and calculating spatial direction, displacement and speed of real-time movement of the head; the Google glasses body collects the information of the hand tracking system and the positioning system and calculating real-time relative movement data. Error responses of an interactive system can be effectively avoided through dependence mapping of a physical plane and a screen; feeling of fatigue resulted in dangling arm operation can be effectively relieved through hand operation on the physical plane; similar to a traditional one, an interactive operating interface is satisfactory to operation habit of an operator and convenient to use; by the introduction of the self-positioning system, the operation displacement problem caused by head movement of a wearer can be effectively removed.

Description

Virtual keyboard system for intelligent glasses
Technical field
The present invention relates to artificial intelligence field, be specifically related to a kind of virtual keyboard system for intelligent glasses.
Background technology
In recent years, the exploitation of intelligent wearable device was more and more hotter, and intelligent wearable device comprises the products such as intelligent watch, intelligent glasses, intelligent bracelet.Wherein, intelligent glasses is that similar smart mobile phone is the same, there is independently operating system, the program that can be provided by software houses such as user installation software, game, by voice or action controlled adding schedule, digital map navigation, interactive with good friend, take pictures and video, launch the functions such as video calling with friend, and can realize by mobile communication network the general name of class glasses of wireless network access.
Google Glass, Shi You Google is in a " augmented reality " glasses of in April, 2012 issue, there is the function the same with smart mobile phone, by Sound control, take pictures, video calling and distinguish direction and surf the web, process Word message and Email etc.It is mainly motion-captured by interactive voice or people's eye that but current and intelligent glasses carries out the mode of man-machine interaction, and other better interactive modes can not allow intelligent glasses respond people's command signal.
Interactive voice technology is due to the limitation of its input signal, as of prior art, supplements, and can not solve people completely and computing machine carries out mutual problem.And the transmission to computing machine that can only be interrupted by people's voice command single is ordered, and can not allow rapid as mouse, accurately people and computing machine carry out command interaction, cannot meet control signal input requirements fast and accurately.
The motion-captured control of people's eye is intelligent glasses to be responded accordingly by catching the actions such as the rotation of people's eyeball and nictation, and control model is comparatively limited, and exists that operation is not accurate enough, the easy shortcoming such as generation sense of fatigue while using.
Traditional man-machine interaction mode is more to adopt people's body language to send command signal to computing machine, such as being sent a signal to computing machine, controlled the click transmitted signal of game, touch screen employing finger etc. by health by mouse with finger.Its development is comparatively ripe, and the most classical configuration is exactly the scheme of the keyboard of notebook computer, touch pad combination, can realize the input of convenient and efficient.
For the intelligent glasses that can have an X-rayed, need to provide a kind of accurately efficient and be difficult for making people to produce the interaction schemes of sense of fatigue, to can make intelligent glasses can be used as a kind of independently working cell, carry out work, can greatly expand the range of application of intelligent glasses like this, even can be used as a PC of carrying and use.
Employing is similar to the keyboard layout of traditional notebook computer, builds a kind of virtual keyboard system of emulation around intelligent glasses, not only can adapt to people's use habit, and is conducive to realize accurately interactive operation efficiently.As for the unsettled operation of staff, easily produce the problem of sense of fatigue, can be by the ubiquitous object with plane in life (as desk, books wall etc. even) as supporting body, staff moves accordingly in the plane of this type objects, thereby and staff action is mapped to and on dummy keyboard, forms corresponding simulation interactive environment.
At number of patent application 201310263439.9, in " a kind of intelligent glasses system and exchange method of man-machine interaction ", a kind of input method is proposed: thus utilize binocular infrared facility to carry out three-dimensional tracing and positioning acquisition gesture motion as input to the staff being suspended on before eye, be suitable for carrying out button operation for the unsettled screen simulating in intelligent glasses.
Said method has following deficiency: 1, human body has swing naturally to a certain degree, such as people's head is not absolute rest under natural posture, but real-time there are some to rock, this amplitude of rocking and direction are unpredictable, when staff carries out unsettled operation, if now people's head has produced rocking of specific direction, and staff is not moving, may occur that binocular infrared facility tracks palmistry for " click " action of head, what binocular device was identified is the click action of the relative motion of glasses projection screen and hand, and the motion that cannot determine hand causes or naturally swinging of head part caused, thereby easily cause false triggering impact to control quality, and if people keeps high concentration, head is tried one's best and is staticly guaranteed that accurately input easily causes sense of fatigue and absent-minded.
2, because hand needs the unsettled three-dimensional manipulating that carries out, cannot avoid long-time operation easily to produce the problem of sense of fatigue, in individual product's real experiences, adopt the similar three-dimension gesture mode of operation of Leap Motion equipment, after common 10 minutes, arm can produce the sense of obviously aching.
3, do not provide pervasive accurate operation-interface, can not meet diversified interactive requirements, complementary operation input only can be provided.
From above analysis, the scheme proposing in number of patent application 201310263439.9 is applicable to operational scenario provisional or that do not have sensitive natur, and is not suitable for and has frequent interaction demand and require mutual efficient accurate intelligent glasses environment for use.
On market, existing intelligent glasses, conventionally by interactive voice or people's eye is motion-captured responds, has following shortcoming: 1, interactive voice has limitation, can only intermittently carry out input operation, can not carry out fast accurately input; 2, interactive voice easily produces sense of fatigue, cannot adapt to long interactive requirements; 3, interactive voice is applicable to the interactive mode of property as a supplement, is difficult to carry out independently pure interactive voice; 4, the motion-captured easy generation maloperation of people's eye, human eye has the not action of independence to produce, and easily causes false triggering; 5, the motion capture of people's eye easily makes people produce sense of fatigue, is unfavorable for carrying out long-time mutual; 6, the pattern of people's eye motion capture is less, is unfavorable for complicated controlling.
Summary of the invention
The invention reside in and solve the above-mentioned technical matters that prior art exists, a kind of virtual keyboard system for intelligent glasses is provided.
Technical scheme of the present invention comprises a kind of virtual keyboard system for intelligent glasses, comprises intelligent glasses main body, staff tracing system and self aligning system, and described staff tracing system and self aligning system are integrated in described intelligent glasses main body; Described staff tracing system is used for surveying staff three-dimensional localization information and locus, angle, and sends described intelligent glasses main body to; Described self aligning system is fixedly connected in described intelligent glasses main body, for obtaining head part's real-time proper motion data, calculates direction in space, displacement, the speed of head part's real-time proper motion, and sends described intelligent glasses main body to; Described intelligent glasses main body gathers the information of described staff tracing system and positioning system, calculates real-time relative motion data.
Preferably, described intelligent glasses main body comprises intelligent glasses framework, display module, computing module; Described intelligent glasses framework, for staff tracing system and self aligning system, provides the carrier of all modules of system; Described display module is used for providing projection to show, and the demonstration of simulating keyboard and touch pad is provided; Described computing module gathers the information of described staff tracing system and positioning system, calculates real-time relative motion data, obtains valid function information.
Preferably, described projection demonstration comprises main viewing area, dummy keyboard viewing area and touch pad viewing area.
Preferably, described staff tracing system comprises binocular camera shooting module and plane detecting module, and described binocular camera shooting module, for surveying the depth of field image of staff, obtains the three-dimensional localization information of staff, and sends described intelligent glasses main body to; Described plane detecting module is used for surveying locus and the angle of staff plane of living in, and sends described intelligent glasses main body to.
Preferably, described binocular camera shooting module comprises two cameras and binocular camera shooting processing unit, and described binocular camera shooting processing unit gathers the image of described camera, adopts stereo algorithm to calculate the position of finger fingertip.
Preferably, described plane detecting module is fixed and is formed towards different stadimeters by least 3.
Preferably, described stadimeter adopts laser range finder or infrared range-measurement system.
Preferably, described self aligning system comprises alignment sensor and positioning unit, and described alignment sensor is fixedly connected in described intelligent glasses main body, for obtaining head part's real-time proper motion data; Described locating module obtains the data of described alignment sensor, calculates direction in space, displacement, the speed of head part's real-time proper motion, and sends described intelligent glasses main body to.
Preferably, described alignment sensor adopts gyroscope or accelerometer.
Beneficial effect of the present invention comprises: by the relationship maps of physical plane and screen, can effectively avoid the response of interactive system mistake; Staff operates on physical plane, can effectively alleviate because the sense of fatigue that the operation of unsettled arm causes; Provide and be similar to traditional interactive operation interface, can adapt to operator's operating habit, easy to use; By the introducing of self aligning system, can effectively eliminate the operation offset problem that the head movement due to people causes.
Accompanying drawing explanation
Fig. 1 is the workflow diagram of the virtual keyboard system of the embodiment of the present invention.
Fig. 2 is the three-dimensional location of the binocular camera schematic diagram of the virtual keyboard system of the embodiment of the present invention.
Fig. 3 is the three-dimensional planar location schematic diagram of the virtual keyboard system of the embodiment of the present invention.
Fig. 4 is the demonstration output area schematic diagram of the virtual keyboard system of the embodiment of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
The present invention be take intelligent glasses as main body, and the function of carrying out intelligent glasses virtual keyboard system by integrated staff tracing system, self aligning system realizes.
The embodiment of the present invention provides a kind of virtual keyboard system for intelligent glasses, as shown in Figure 1, comprise intelligent glasses main body 1, staff tracing system 2 and self aligning system 3, this virtual keyboard system operating environment can be selected the physical plane of conventional object in life, requirement is nontransparent, can be the plane of desk, smooth books, wall, windowsill, stool and similar nontransparent object.
Staff tracing system 2 and self aligning system 3 are integrated in intelligent glasses main body 1; Staff tracing system 2 is for surveying staff three-dimensional localization information and locus, angle, and sends intelligent glasses main body 1 to; Self aligning system 3 is fixedly connected in intelligent glasses main body 1, for obtaining head part's real-time proper motion data, calculates direction in space, displacement, the speed of head part's real-time proper motion, and sends intelligent glasses main body 1 to; Intelligent glasses main body 1 gathers the information of staff tracing system 2 and positioning system, calculates real-time relative motion data.
This virtual keyboard system needs first to carry out pre-determined bit before using, and in the dummy keyboard that in use operation map of staff on selected physical plane goes out to projection, produces corresponding mutual effect.
The embodiment of the present invention, can effectively avoid the response of interactive system mistake by the relationship maps of physical plane and screen; Staff operates on physical plane, can effectively alleviate because the sense of fatigue that the operation of unsettled arm causes; Provide and be similar to traditional interactive operation interface, can adapt to operator's operating habit, easy to use; By the introducing of self aligning system 3, can effectively eliminate the operation offset problem that the head movement due to people causes.
Intelligent glasses main body 1 comprises intelligent glasses framework, display module, computing module; Intelligent glasses framework is used the basic framework of intelligent glasses, for staff tracing system 2 and self aligning system 3, provides the carrier of all modules of system;
Intelligent glasses framework comprises the Physical architecture main body of conventional intelligent glasses, microprocessor, independent current source, wireless connection device and projection display equipment.
Display module is used for providing projection to show, and the demonstration of simulating keyboard and touch pad is provided; Computing module gathers the information of staff tracing system 2 and positioning system, calculates real-time relative motion data, obtains valid function information.
Projection demonstration comprises main viewing area, dummy keyboard viewing area and touch pad viewing area.Its by virtual staff according to the position display of actual staff above interactive areas.
Preferably, staff tracing system 2 comprises provides binocular camera shooting module and the plane detecting module of staff with respect to the 3D locating information of intelligent glasses, binocular camera shooting module, for surveying the depth of field image of staff, obtains the three-dimensional localization information of staff, and sends intelligent glasses main body 1 to; Plane detecting module is used for surveying locus and the angle of staff plane of living in, and sends intelligent glasses main body 1 to.
Binocular camera shooting module, during for virtual keyboard system work, operator's both hands finger tip is carried out to space orientation and tracking, comprise two cameras and binocular camera shooting processing unit, the image of binocular camera shooting processing unit acquisition camera, adopts stereo algorithm to calculate the position of finger fingertip.
According to the needs of virtual keyboard system, this binocular camera shooting module realizes carries out real-time location tracking to the quality inspection of the finger of people's both hands, two cameras of module adopt stereo algorithm to calculate the real time position of finger fingertip according to two detected images, ultimate principle as shown in Figure 2, when follow the trail of to judge finger tip in certain position when used physical plane contacts, the effect of virtual keyboard system is finger and presses at corresponding virtual location place, produces corresponding input response.
Parallax d=x l-x r=fb/z,
Wherein, f is focal length, and b is baseline, and z is fore-and-aft distance.
Because system can be followed the trail of ten fingers simultaneously, therefore can support 10 fingers to press and input simultaneously.When judging that staff moves to after touchpad position, same, the staff operations such as touch, slip and double-click on the table, are equivalent to do on the virtual touch plate under dummy keyboard lower identical operation.
Plane detecting module provides the 3D locating information of used physical plane with respect to intelligent glasses, by least 3, fixes and forms towards different stadimeters, and three points that above-mentioned stadimeter is oriented come the locus of the physical plane of positioning action environment use.
Preferably, stadimeter adopts laser range finder or infrared range-measurement system.
Plane detecting module provides the posture information of used physical plane with respect to intelligent glasses, the light that each stadimeter sends can produce an intersection point with physical plane, three will produce three intersection points, and can in space, orient these three intersection points range data of relative stadimeter group respectively according to the data of stadimeter, the direction of each point and distance can be determined some the locus with respect to stadimeter group after determining, according to the data of three points, can determine this physical plane with respect to the relative tertiary location of stadimeter group, as shown in Figure 3, can obtain physical plane with respect to the 3D locating information of intelligent glasses.
Self aligning system 3 is that real-time detection goes out the disturbance due to head part's the binocular camera that swing produces naturally when virtual keyboard system is worked, and avoids, because head part's motion causes the skew of system location, comprising alignment sensor and positioning unit.
Alignment sensor is fixedly connected in intelligent glasses main body 1, for obtaining head part's real-time proper motion data; Locating module obtains the data of alignment sensor, calculates direction in space, displacement, the speed of head part's real-time proper motion, and sends intelligent glasses main body 1 to.
Preferably, alignment sensor adopts gyroscope or accelerometer.
The embodiment of the present invention course of work:
1, virtual keyboard system enters before work, first chooses the smooth nontransparent physical entity plane in a place, avoids anaclasis to cause the disorder of tracing system, and both hands are positioned in this plane naturally with the posture of operation with traditional keyboard;
2, start after virtual keyboard system, this default pre-determined bit, so that provide hand, plane and corresponding initial alignment.The completing of this process comprise staff with respect to the location of intelligent glasses and the physical plane of use the location with respect to intelligent glasses.
3, after initial alignment completes, this system can normally be worked, artificial hand in virtual keyboard system will strictly move accordingly and move according to the position of staff, if finger execution hammer action artificial hand is carried out corresponding hammer action in simulating keyboard, equally also hand can be moved to touch operation region, can carry out the control of simulated touch plate, as shown in Figure 4.Strictly according to staff, move that to make response be that the swing of people's head when interactive operation is by the action of artificial hand in not affecting analog image for naturally the swinging of head part.Computing module obtains the information of head movement in real time according to self aligning system 3, deduct the real time kinematics data of head according to the real-time relative motion data of head and hand, can obtain the valid function information of hand, thereby realize accurately interactive operation.
The embodiment of the present invention has following effect:
1., by the relationship maps of physical plane and screen, can effectively avoid the response of interactive system mistake;
2., staff operates on physical plane, can effectively alleviate because the sense of fatigue that the operation of unsettled arm causes;
3., provide and be similar to traditional interactive operation interface, can adapt to operator's operating habit, easy to use;
4., by glasses, position oneself the introducing of system, can effectively eliminate the operation offset problem that the head movement due to people causes;
5., can, whenever and wherever possible easily using intelligent glasses as the stand-alone terminal use that possesses complete input function, be conducive to applying of intelligent glasses.
The above the specific embodiment of the present invention, does not form limiting the scope of the present invention.Various other corresponding changes and distortion that any technical conceive according to the present invention has been done, all should be included in the protection domain of the claims in the present invention.

Claims (9)

1. for a virtual keyboard system for intelligent glasses, it is characterized in that, comprise intelligent glasses main body, staff tracing system and self aligning system, described staff tracing system and self aligning system are integrated in described intelligent glasses main body; Described staff tracing system is used for surveying staff three-dimensional localization information and locus, angle, and sends described intelligent glasses main body to; Described self aligning system is fixedly connected in described intelligent glasses main body, for obtaining head part's real-time proper motion data, calculates direction in space, displacement, the speed of head part's real-time proper motion, and sends described intelligent glasses main body to; Described intelligent glasses main body gathers the information of described staff tracing system and positioning system, calculates real-time relative motion data.
2. the virtual keyboard system for intelligent glasses as claimed in claim 1, is characterized in that, described intelligent glasses main body comprises intelligent glasses framework, display module, computing module; Described intelligent glasses framework, for staff tracing system and self aligning system, provides the carrier of all modules of system; Described display module is used for providing projection to show, and the demonstration of simulating keyboard and touch pad is provided; Described computing module gathers the information of described staff tracing system and positioning system, calculates real-time relative motion data, obtains valid function information.
3. the virtual keyboard system for intelligent glasses as claimed in claim 2, is characterized in that, described projection demonstration comprises main viewing area, dummy keyboard viewing area and touch pad viewing area.
4. the virtual keyboard system for intelligent glasses as claimed in claim 1, it is characterized in that, described staff tracing system comprises binocular camera shooting module and plane detecting module, described binocular camera shooting module is for surveying the depth of field image of staff, obtain the three-dimensional localization information of staff, and send described intelligent glasses main body to; Described plane detecting module is used for surveying locus and the angle of staff plane of living in, and sends described intelligent glasses main body to.
5. the virtual keyboard system for intelligent glasses as claimed in claim 4, it is characterized in that, described binocular camera shooting module comprises two cameras and binocular camera shooting processing unit, and described binocular camera shooting processing unit gathers the image of described camera, adopts stereo algorithm to calculate the position of finger fingertip.
6. the virtual keyboard system for intelligent glasses as claimed in claim 4, is characterized in that, described plane detecting module is fixed and formed towards different stadimeters by least 3.
7. the virtual keyboard system for intelligent glasses as claimed in claim 6, is characterized in that, described stadimeter adopts laser range finder or infrared range-measurement system.
8. the virtual keyboard system for intelligent glasses as claimed in claim 1, it is characterized in that, described self aligning system comprises alignment sensor and positioning unit, and described alignment sensor is fixedly connected in described intelligent glasses main body, for obtaining head part's real-time proper motion data; Described locating module obtains the data of described alignment sensor, calculates direction in space, displacement, the speed of head part's real-time proper motion, and sends described intelligent glasses main body to.
9. the virtual keyboard system for intelligent glasses as claimed in claim 8, is characterized in that, described alignment sensor adopts gyroscope or accelerometer.
CN201310684110.XA 2013-12-12 2013-12-12 Virtual keyboard system used for Google glasses Active CN103713737B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310684110.XA CN103713737B (en) 2013-12-12 2013-12-12 Virtual keyboard system used for Google glasses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310684110.XA CN103713737B (en) 2013-12-12 2013-12-12 Virtual keyboard system used for Google glasses

Publications (2)

Publication Number Publication Date
CN103713737A true CN103713737A (en) 2014-04-09
CN103713737B CN103713737B (en) 2017-01-11

Family

ID=50406776

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310684110.XA Active CN103713737B (en) 2013-12-12 2013-12-12 Virtual keyboard system used for Google glasses

Country Status (1)

Country Link
CN (1) CN103713737B (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104216517A (en) * 2014-08-25 2014-12-17 联想(北京)有限公司 Information processing method and electronic equipment
CN104345632A (en) * 2014-11-06 2015-02-11 湖州高鼎智能科技有限公司 Intelligent watch capable of making call
CN104597971A (en) * 2014-12-06 2015-05-06 许昌学院 Wearable computer
CN105094675A (en) * 2015-07-28 2015-11-25 中国联合网络通信集团有限公司 Man-machine interaction method and touch screen wearable device
CN105159539A (en) * 2015-09-10 2015-12-16 京东方科技集团股份有限公司 Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment
CN105320452A (en) * 2014-07-18 2016-02-10 马克西姆综合产品公司 Wearable device for using human body as input mechanism
CN105718038A (en) * 2014-12-05 2016-06-29 北京蚁视科技有限公司 Gesture posture recognition device for near eye display device
CN106781841A (en) * 2017-01-20 2017-05-31 东莞市触梦网络科技有限公司 A kind of AR religion picture devices and its religion picture system
CN108064372A (en) * 2016-12-24 2018-05-22 深圳市柔宇科技有限公司 Head-mounted display apparatus and its content input method
CN108376029A (en) * 2017-01-30 2018-08-07 精工爱普生株式会社 Display system
CN109496331A (en) * 2016-05-20 2019-03-19 奇跃公司 The context aware of user interface
CN109872519A (en) * 2019-01-13 2019-06-11 上海萃钛智能科技有限公司 A kind of wear-type remote control installation and its remote control method
CN109976636A (en) * 2019-03-19 2019-07-05 北京华捷艾米科技有限公司 AR touch control method, device, system and AR equipment
USD899493S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899500S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899495S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899496S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899497S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899494S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899499S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899498S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD900205S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900204S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900203S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900206S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900920S1 (en) 2019-03-22 2020-11-03 Lucyd Ltd. Smart glasses
US10908419B2 (en) 2018-06-28 2021-02-02 Lucyd Ltd. Smartglasses and methods and systems for using artificial intelligence to control mobile devices used for displaying and presenting tasks and applications and enhancing presentation and display of augmented reality information
CN114020156A (en) * 2015-09-24 2022-02-08 托比股份公司 Wearable device capable of eye tracking
US11282523B2 (en) 2020-03-25 2022-03-22 Lucyd Ltd Voice assistant management
USD954137S1 (en) 2019-12-19 2022-06-07 Lucyd Ltd. Flat connector hinges for smartglasses temples
USD954136S1 (en) 2019-12-12 2022-06-07 Lucyd Ltd. Smartglasses having pivot connector hinges
USD954135S1 (en) 2019-12-12 2022-06-07 Lucyd Ltd. Round smartglasses having flat connector hinges
USD955467S1 (en) 2019-12-12 2022-06-21 Lucyd Ltd. Sport smartglasses having flat connector hinges
WO2022141192A1 (en) * 2020-12-30 2022-07-07 广东视场科技有限公司 Intelligent control glasses
USD958234S1 (en) 2019-12-12 2022-07-19 Lucyd Ltd. Round smartglasses having pivot connector hinges
USD974456S1 (en) 2019-12-19 2023-01-03 Lucyd Ltd. Pivot hinges and smartglasses temples

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101673161A (en) * 2009-10-15 2010-03-17 复旦大学 Visual, operable and non-solid touch screen system
CN102799318A (en) * 2012-08-13 2012-11-28 深圳先进技术研究院 Human-machine interaction method and system based on binocular stereoscopic vision
US20130016070A1 (en) * 2011-07-12 2013-01-17 Google Inc. Methods and Systems for a Virtual Input Device
CN102906623A (en) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 Local advertising content on an interactive head-mounted eyepiece
US20130027572A1 (en) * 2011-07-27 2013-01-31 Google Inc. Head-Mounted Display That Displays A Visual Representation Of Physical Interaction With An Input Interface Located Outside Of The Field Of View

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101673161A (en) * 2009-10-15 2010-03-17 复旦大学 Visual, operable and non-solid touch screen system
CN102906623A (en) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 Local advertising content on an interactive head-mounted eyepiece
US20130016070A1 (en) * 2011-07-12 2013-01-17 Google Inc. Methods and Systems for a Virtual Input Device
US20130027572A1 (en) * 2011-07-27 2013-01-31 Google Inc. Head-Mounted Display That Displays A Visual Representation Of Physical Interaction With An Input Interface Located Outside Of The Field Of View
CN102799318A (en) * 2012-08-13 2012-11-28 深圳先进技术研究院 Human-machine interaction method and system based on binocular stereoscopic vision

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105320452B (en) * 2014-07-18 2020-07-10 马克西姆综合产品公司 Wearable device using human body as input mechanism
CN105320452A (en) * 2014-07-18 2016-02-10 马克西姆综合产品公司 Wearable device for using human body as input mechanism
CN104216517A (en) * 2014-08-25 2014-12-17 联想(北京)有限公司 Information processing method and electronic equipment
CN104345632A (en) * 2014-11-06 2015-02-11 湖州高鼎智能科技有限公司 Intelligent watch capable of making call
CN105718038A (en) * 2014-12-05 2016-06-29 北京蚁视科技有限公司 Gesture posture recognition device for near eye display device
CN105718038B (en) * 2014-12-05 2018-10-19 北京蚁视科技有限公司 A kind of gesture gesture recognition equipment for near-eye display device
CN104597971B (en) * 2014-12-06 2018-04-03 许昌学院 A kind of wearable computer
CN104597971A (en) * 2014-12-06 2015-05-06 许昌学院 Wearable computer
CN105094675A (en) * 2015-07-28 2015-11-25 中国联合网络通信集团有限公司 Man-machine interaction method and touch screen wearable device
CN105094675B (en) * 2015-07-28 2019-04-02 中国联合网络通信集团有限公司 A kind of man-machine interaction method and touch screen wearable device
WO2017041433A1 (en) * 2015-09-10 2017-03-16 京东方科技集团股份有限公司 Touch control response method and apparatus for wearable device, and wearable device
CN105159539A (en) * 2015-09-10 2015-12-16 京东方科技集团股份有限公司 Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment
CN105159539B (en) * 2015-09-10 2018-06-01 京东方科技集团股份有限公司 Touch-control response method, device and the wearable device of wearable device
US10185433B2 (en) 2015-09-10 2019-01-22 Boe Technology Group Co., Ltd. Method and apparatus for touch responding of wearable device as well as wearable device
CN114020156A (en) * 2015-09-24 2022-02-08 托比股份公司 Wearable device capable of eye tracking
CN109496331A (en) * 2016-05-20 2019-03-19 奇跃公司 The context aware of user interface
CN109496331B (en) * 2016-05-20 2022-06-21 奇跃公司 Context awareness for user interface menus
CN108064372A (en) * 2016-12-24 2018-05-22 深圳市柔宇科技有限公司 Head-mounted display apparatus and its content input method
CN106781841A (en) * 2017-01-20 2017-05-31 东莞市触梦网络科技有限公司 A kind of AR religion picture devices and its religion picture system
CN108376029A (en) * 2017-01-30 2018-08-07 精工爱普生株式会社 Display system
CN108376029B (en) * 2017-01-30 2023-04-18 精工爱普生株式会社 Display system
US10908419B2 (en) 2018-06-28 2021-02-02 Lucyd Ltd. Smartglasses and methods and systems for using artificial intelligence to control mobile devices used for displaying and presenting tasks and applications and enhancing presentation and display of augmented reality information
CN109872519A (en) * 2019-01-13 2019-06-11 上海萃钛智能科技有限公司 A kind of wear-type remote control installation and its remote control method
CN109976636A (en) * 2019-03-19 2019-07-05 北京华捷艾米科技有限公司 AR touch control method, device, system and AR equipment
USD900920S1 (en) 2019-03-22 2020-11-03 Lucyd Ltd. Smart glasses
USD899497S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899499S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899498S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD900205S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900204S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900203S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD900206S1 (en) 2019-03-22 2020-10-27 Lucyd Ltd. Smart glasses
USD899495S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899500S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899493S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899496S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD899494S1 (en) 2019-03-22 2020-10-20 Lucyd Ltd. Smart glasses
USD954136S1 (en) 2019-12-12 2022-06-07 Lucyd Ltd. Smartglasses having pivot connector hinges
USD954135S1 (en) 2019-12-12 2022-06-07 Lucyd Ltd. Round smartglasses having flat connector hinges
USD955467S1 (en) 2019-12-12 2022-06-21 Lucyd Ltd. Sport smartglasses having flat connector hinges
USD958234S1 (en) 2019-12-12 2022-07-19 Lucyd Ltd. Round smartglasses having pivot connector hinges
USD954137S1 (en) 2019-12-19 2022-06-07 Lucyd Ltd. Flat connector hinges for smartglasses temples
USD974456S1 (en) 2019-12-19 2023-01-03 Lucyd Ltd. Pivot hinges and smartglasses temples
US11282523B2 (en) 2020-03-25 2022-03-22 Lucyd Ltd Voice assistant management
WO2022141192A1 (en) * 2020-12-30 2022-07-07 广东视场科技有限公司 Intelligent control glasses

Also Published As

Publication number Publication date
CN103713737B (en) 2017-01-11

Similar Documents

Publication Publication Date Title
CN103713737B (en) Virtual keyboard system used for Google glasses
US20220326781A1 (en) Bimanual interactions between mapped hand regions for controlling virtual and graphical elements
WO2022146678A1 (en) Micro hand gestures for controlling virtual and graphical elements
JP7095602B2 (en) Information processing equipment, information processing method and recording medium
CN103443742B (en) For staring the system and method with gesture interface
CN108815804B (en) VR upper limb rehabilitation training platform and method based on MYO arm ring and mobile terminal
CN102426486B (en) Stereo interaction method and operated apparatus
CN103838378A (en) Head wearing type eye control system based on pupil recognition positioning
CN103064514A (en) Method for achieving space menu in immersive virtual reality system
CN106125921A (en) Gaze detection in 3D map environment
WO2007013833A1 (en) Method and system for visualising virtual three-dimensional objects
CN103793060A (en) User interaction system and method
CN103955295A (en) Real-time grabbing method of virtual hand based on data glove and physical engine
CN101579238A (en) Human motion capture three dimensional playback system and method thereof
CN103699219B (en) A kind of intelligent glasses interactive system and intelligent interactive method
CN104007844A (en) Electronic instrument and wearable type input device for same
CN103529944A (en) Human body movement identification method based on Kinect
US20210117078A1 (en) Gesture Input Method for Wearable Device and Wearable Device
CN102508562B (en) Three-dimensional interaction system
US20190227693A1 (en) Virtual space positioning method and apparatus
Sherstyuk et al. Mixed reality manikins for medical education
CN205039917U (en) Sea floor world analog system based on CAVE system
CN102508561B (en) Operating rod
Mihaľov et al. Potential of low cost motion sensors compared to programming environments
CN107632702B (en) Holographic projection system adopting light-sensing data gloves and working method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant