CN103336575A - Man-machine interaction intelligent glasses system and interaction method - Google Patents
Man-machine interaction intelligent glasses system and interaction method Download PDFInfo
- Publication number
- CN103336575A CN103336575A CN2013102634399A CN201310263439A CN103336575A CN 103336575 A CN103336575 A CN 103336575A CN 2013102634399 A CN2013102634399 A CN 2013102634399A CN 201310263439 A CN201310263439 A CN 201310263439A CN 103336575 A CN103336575 A CN 103336575A
- Authority
- CN
- China
- Prior art keywords
- intelligent glasses
- coordinate
- finger
- man
- image frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a man-machine interaction intelligent glasses system. The system comprises a pair of perspective intelligent glasses which can enable the visible light to penetrate through the intelligent glass lenses and overlap image information on the true sight of people; two cameras and an infrared LED (light emitting diode) are arranged on the intelligent glasses; the two cameras are symmetrically arranged at left and right ends of the intelligent glasses in parallel, and the infrared LED is arranged at the central position of the intelligent glasses; and the cameras and the infrared LED of the intelligent glasses form a three-dimensional movement capturing system for capturing movement tracks and coordinates of objects in a certain three-dimensional space range. According to the system, the finger movement information of people is captured and judged, and the man-machine interaction with the intelligent glasses is realized.
Description
Technical field
The present invention relates to artificial intelligence field, especially a kind of intelligent glasses system and exchange method of man-machine interaction.
Background technology
At present, man-machine interaction always is one of key problem that various electronic equipments need solve, and has only to allow electronic equipment better response people's control signal, and electronic equipment just can better meet people's user demand.
Intelligent glasses refers to as smart mobile phone, has independently operating system, the program that can be provided by software houses such as user installation software, recreation, can control by voice or action and finish adding schedule, digital map navigation, with good friend's interaction, take pictures and video, launch functions such as video calling with friend, and can realize the general name of such class glasses that wireless network inserts by mobile communication network.
Google Glass, be by Google's a " augmented reality " glasses in April, 2012 issue, it has the function the same with smart mobile phone, can take pictures video calling and distinguish direction and surf the web, handle Word message and Email etc. by sound control.But at present with carry out interactive means with intelligent glasses and mainly rest on the interactive voice scope, other better interactive modes can not allow intelligent glasses response people's command signal.
Though adopt speech recognition technology and intelligent glasses to carry out the problem that man-machine interaction can solve intelligent glasses response people's control signal within the specific limits, also there is the problem that can not solve in it:
Man-machine interaction at present more is to adopt people's body language to send command signal to computing machine, such as sending a signal to computing machine, adopt the click of finger to send signal etc. by health control recreation, touch screen by mouse with finger.The interactive voice technology is because the limitation of its input signal, and just as prior art replenishes, and can not solve the people fully and computing machine carries out mutual problem.
Speech recognition technology can only be ordered by interrupted the sending to computing machine of people's voice command single, can not allow people and computing machine carry out command interaction rapid as mouse, accurately, namely can't solve control signal and import requirement fast and accurately.
In existing electronic equipment, speech recognition technology still can not become the major technique that realizes man-machine interaction, and is replenishing as prior art.Based on same present situation, speech recognition technology can not satisfy the man-machine interaction demand of intelligent glasses, and can only be as an additional technology of carrying out man-machine interaction with intelligent glasses.
Speech recognition technology exists long-time use to make the people produce tired problem easily, because for long signal input, if rely on the people to go in a minute to finish always, so after using for a long time, anyone can feel tired, therefore speech recognition technology can't also be the same for intelligent glasses as main man-machine interaction forwarding method.
But for the Clairvoyant type intelligent glasses, when intelligent glasses comprises a plurality of order button options with one screen is presented in people's the visual field, adopt the button that interactive voice can not be clicked fast and accurately to be needed, because interactive voice needs the people to say order, under such occasion, adopt the mode that is similar to mouse click or finger click just can better meet the man-machine interaction demand.
Based on this, be necessary to change existing design proposal, provide a kind of and can carry out man-machine interaction method fast and accurately with intelligent glasses, purpose of the present invention that Here it is.
Summary of the invention
At the existing deficiency that adopts speech recognition technology and intelligent glasses to carry out man-machine interaction, the embodiment of the invention provides a kind of intelligent glasses system of man-machine interaction, allows intelligent glasses can respond people's control signal, realizes special operation.
For achieving the above object, the technical solution adopted for the present invention to solve the technical problems is that the described intelligent glasses system that carries out man-machine interaction comprises:
Intelligent glasses: but described intelligent glasses is the Clairvoyant type intelligent glasses, can make the described intelligent glasses eyeglass of visible light transmissive, simultaneously image information is superimposed upon on people's the true visual field;
Camera and infrared LED: two cameras and an infrared LED are installed on the described intelligent glasses, described two parallel symmetries of camera are installed on the two ends, the left and right sides of intelligent glasses, be respectively left camera and right camera, described infrared LED is installed in the center of described intelligent glasses;
Two cameras of described intelligent glasses and described infrared LED have been formed a three-dimensional motion capture system that is used for catching the interior movement locus of object of certain three dimensions scope and coordinate.
Preferably, described intelligent glasses system comprises that three-dimensional motion catches coordinate system and image frame coordinate system, wherein, described three-dimensional motion catches coordinate system and is used for analyzing finger motion, and described image frame coordinate system is used for analyzing the shown image frame of described intelligent glasses.
Preferably, described three-dimensional motion catches coordinate system and described image frame coordinate system, be true origin O with described infrared LED center all, to be parallel to described image frame and to be the OXY plane through the plane of true origin O, set up right-handed coordinate system OXYZ, as the coordinate system of described three-dimensional motion capture system and described image frame.
Another object of the present invention is to provide the exchange method of described intelligent glasses system.
For achieving the above object, the technical solution adopted for the present invention to solve the technical problems is that the exchange method of the intelligent glasses system of described a kind of man-machine interaction may further comprise the steps:
(1) allow finger to enter the catching range of the three-dimensional motion capture system of being formed by two cameras installing on the described intelligent glasses and infrared LED;
(2) described infrared LED emission infrared ray, described infrared ray touches the finger back by the finger scattering;
(3) after described two cameras detect the infrared ray of described scattering, generate two width of cloth dispersion images relevant with the movement locus of described finger;
(4) described two width of cloth dispersion images are adopted the stereoscopic vision algorithm, calculate the three dimensional space coordinate of described finger;
(5) three dimensional space coordinate according to described finger judges whether to have selected button;
(6) described intelligent glasses is realized the image frame that described intelligent glasses shows is pointed clicking operation according to selection.
Concrete, described step (4) may further comprise the steps: read the coordinate range of described finger fingertip X, Y-direction in image frame from described two width of cloth dispersion images, adopt the binocular stereo vision algorithm to calculate the Z coordinate of described finger fingertip then.
Concrete, the process of Z coordinate that described employing binocular stereo vision algorithm calculates described finger fingertip is as follows: l
1, l
2Represent described two cameras respectively, B represents the distance between described two camera photocentres, and f is the focal length of described camera, and (x, y z) are the residing spatial point of described finger fingertip to be asked to P, and (x, y z) are its three dimensional space coordinate, P
1(x
1, y
1), P
2(x
2, y
2) be respectively P o'clock at two cameras as the picpointed coordinate on the plane, wherein the P parallax of ordering is d=x
1-x
2, calculate the degree of depth that P orders by geometric relationship and be:
Concrete, described step (5) may further comprise the steps: if the X of three dimensional space coordinate scope any button in X, Y-direction and described image frame of described finger fingertip, Y coordinate range are approaching, then represent the top that described finger fingertip has been positioned at described button;
Concrete, if the Z coordinate of the three dimensional space coordinate scope of described finger fingertip surpasses the Z coordinate time of described image frame, then described button has been selected in representative.
Concrete, described step (5) is further comprising the steps of: when described finger fingertip correspondence be more than one volume coordinate point the time, ask for the Z coordinate of described more than one volume coordinate point and be weighted, ask for average coordinates
When
Greater than the Z coordinate time of described image frame in coordinate system, judge that described finger fingertip has touched the described image frame that described intelligent glasses shows, in the X of described finger fingertip, Y-direction coordinate range and described image frame the X of any button, when the Y-direction coordinate range overlaps, can judge that described finger clicked described button.
Concrete, described identification to finger fingertip is not limited only to a finger, can identify any or a plurality of finger tip, makes the man-machine interaction of carrying out with described intelligent glasses can realize multi-point touch.
Compare with existing intelligent glasses, the embodiment of the invention has following advantage:
1, carry out the speech recognition technology that man-machine interaction is adopted with respect to existing with intelligent glasses, the embodiment of the invention is very similar to present touch screen use-pattern, meets popular use habit.
2, the embodiment of the invention provides a kind of multi-point touch interactive mode that is similar to touch screen; can allow the people once import a plurality of control signals fast; thereby can provide rapid and precise man-machine interaction mode; and present speech recognition technology all is to import a signal slowly at every turn; very slow, poor efficiency.
3, the interactive mode that provides of the embodiment of the invention is stereoscopic three-dimensional, so just has more interactive mode than present speech recognition technology, can import the more control signal.
4, the interactive mode that provides of the embodiment of the invention does not exist serious long-time use can produce tired problem, because the people is when carrying out man-machine interaction with intelligent glasses, need moving just finger, and speech recognition technology needs at every moment all opening one's mouth;
5, the man-machine interaction mode that provides of the embodiment of the invention is based on people's limbs voice, and such mode can be better, the demand for control with the people informs computing machine faster, realizes man-machine interaction more efficiently.
Description of drawings
Fig. 1 is the outside drawing of the intelligent glasses that provides of the embodiment of the invention;
Fig. 2 is the intelligent glasses front view (FV) that the embodiment of the invention provides;
Fig. 3 is the interaction concept synoptic diagram that the embodiment of the invention provides;
Fig. 4 is the binocular stereo vision ultimate principle figure that the embodiment of the invention provides;
Fig. 5 is that the two dimensional image picture with having the three-dimensional depth of field that the embodiment of the invention provides carries out mutual synoptic diagram.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with embodiment, the present invention is further elaborated.Should be appreciated that described herein only is a part of embodiment of the present invention, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills obtain under the prerequisite of not making creative work belongs to the scope of protection of the invention.
One of purpose of the embodiment of the invention provides a kind of intelligent glasses system of man-machine interaction, allows intelligent glasses can respond people's control signal, realizes special operation.For achieving the above object, the embodiment of the invention provides a kind of intelligent glasses system of man-machine interaction, as shown in Figure 1, comprising:
Intelligent glasses: but described intelligent glasses is the Clairvoyant type intelligent glasses, can make the described intelligent glasses eyeglass of visible light transmissive, image information is superimposed upon on people's the true visual field simultaneously.After the people puts on this intelligent glasses, except the environment around seeing, also can see the image information that is shown by intelligent glasses, viewing effect is equivalent to watching a screen that size is certain in the space of human eye.
Camera and infrared LED: as shown in Figure 2, two cameras and an infrared LED 1 are installed on the described intelligent glasses, described two parallel symmetries of camera are installed on the two ends, the left and right sides of intelligent glasses, be respectively left camera 2 and right camera 3, described infrared LED 1 is installed in the center of described intelligent glasses.
Two cameras 2 of described intelligent glasses, 3 and described infrared LED 1 form a three-dimensional motion capture system that is used for catching movement locus of object and coordinate in the three dimensions scope.When the people brandishes finger, the range of movement of finger will be positioned at the capture space inside of this three-dimensional motion capture system.In use, infrared LED will be launched infrared ray, when the finger of meeting the people when infrared ray is scattered, can be detected by two cameras, thereby obtain two width of cloth dispersion image relevant with the movement locus of finger, two width of cloth dispersion images like this can calculate the three dimensional space coordinate of finger behind employing and stereoscopic vision algorithm.
Basic ideas of the present invention are that the finger motion information to the people catches and judges, finally reach with intelligent glasses and carry out man-machine interaction.Interactive mode is similar at touch-screen uses finger to click screen.At present, the process of certain clicking operation of touch screen device responds user was divided into for two steps:
User's finger fingertip moves to above the button that needs to click;
The user presses the button.
Realize that the problem that these two process natures need solve is, calculate people's finger fingertip with respect to the three-dimensional coordinate of touch screen, comprise the coordinate of X, Y-direction and Z direction.In the embodiment of the invention, realize that the interactive mode that people and intelligent glasses carry out clicking based on finger also is to be dependent on such process.Concrete implementation procedure as shown in Figure 3, described intelligent glasses system comprises two coordinate systems: three-dimensional motion catches coordinate system and image frame coordinate system, wherein, described three-dimensional motion catches coordinate system and is used for analyzing finger motion, and described image frame coordinate system is used for analyzing the shown image frame of described intelligent glasses.
Concrete, true origin and coordinate axis that described three-dimensional motion catches coordinate system and described image frame coordinate system overlap, be true origin with described infrared LED center all, that is, described three-dimensional motion catches finger X, the Y-direction coordinate that coordinate system captures and just directly is mapped as the coordinate of finger in the image frame coordinate system.
Concrete, as shown in Figure 3, be true origin O with described infrared LED center, to be parallel to described image frame and to be the OXY plane through the plane of true origin O, set up right-handed coordinate system OXYZ, as the coordinate system of described three-dimensional motion capture system, simultaneously also as the coordinate system of described image frame.In Fig. 3, plane ABCD is image frame, and the positive rectangular pyramid that dotted line is represented represents the catching range of three-dimensional motion capture system.
When various button clicks appear in image frame, need people's finger to click when finishing man-machine interaction, people's finger can enter the catching range of three-dimensional motion capture system, at this moment, infrared LED sends infrared ray, infrared ray can be by the finger scattering after running into people's finger, and the part infrared ray of scattering can enter the camera at intelligent glasses two ends, camera can be exported two width of cloth dispersion images, this two width of cloth dispersion image is after adopting corresponding stereoscopic vision algorithm, can calculate the three-dimensional coordinate scope of finger fingertip in coordinate system OXYZ, if the three-dimensional coordinate scope of finger fingertip is at X, the X of some buttons in Y-direction and the image frame, the Y coordinate range approaches, and then represents the top that finger fingertip has been positioned at this button; If the Z coordinate of the three-dimensional coordinate scope of finger fingertip surpasses the Z coordinate time of image frame, then this button has been selected in representative.By such mode, just can realize that the people directly clicks the image frame that intelligent glasses shows, allow the people can be as the mode of using touch screen, the words picture that intelligent glasses shows is pointed clicking operation, thereby realize people and intelligent glasses carry out based on the human body language man-machine interaction, allow intelligent glasses respond people's control signal rapidly, accurately.
Another object of the present invention is to provide the exchange method of described intelligent glasses system.
For achieving the above object, the technical solution adopted for the present invention to solve the technical problems is that the exchange method of the intelligent glasses system of described a kind of man-machine interaction may further comprise the steps:
(1) button click appears in the image frame that shows of described intelligent glasses, needs to click when finishing man-machine interaction, allows finger to enter the catching range of the three-dimensional motion capture system of being made up of two cameras installing on the described intelligent glasses and infrared LED;
(2) described infrared LED emission infrared ray, described infrared ray touches the finger back by the finger scattering;
(3) after described two cameras detect the infrared ray of described scattering, generate two width of cloth dispersion images relevant with the movement locus of described finger;
(4) described two width of cloth dispersion images are adopted the stereoscopic vision algorithm, calculate the three dimensional space coordinate of described finger;
(5) three dimensional space coordinate according to described finger judges whether to have selected button;
(6) described intelligent glasses is according to selection, and response people's control signal realizes the image frame that described intelligent glasses shows is pointed clicking operation.
Because the coordinate system of three-dimensional motion capture system is identical with the coordinate system of image frame, therefore, can directly from two width of cloth dispersion images that video camera obtains, read the coordinate range of finger fingertip X, Y-direction in image frame, and the Z coordinate of finger fingertip can calculate by the binocular stereo vision algorithm.That is, described step (4) may further comprise the steps: read the coordinate range of described finger fingertip X, Y-direction in image frame from described two width of cloth dispersion images, adopt the binocular stereo vision algorithm to calculate the Z coordinate of described finger fingertip then.
The process that the three-dimensional motion capture system carries out analytical calculation to the Z coordinate of people's finger fingertip three-dimensional coordinate: as shown in Figure 4, be the binocular stereo vision algorithm basic principle among the figure.Technique of binocular stereoscopic vision is based on principle of parallax, in the drawings, and l
1, l
2Be respectively the camera of two parallel placements, in the present invention, l
1, l
2Represent left camera, right camera respectively.B represents two distances between the camera photocentre, and f is the focal length of camera.(x, y z) are spatial point to be asked to P, and (x, y z) are its three-dimensional coordinate, P
1(x
1, y
1), P
2(x
2, y
2) be respectively P o'clock at two cameras as the picpointed coordinate on the plane, wherein the P parallax of ordering is
D=x
1-x
2, can calculate the degree of depth that P orders by geometric relationship and be:
Therefore, described step (4) may further comprise the steps: the process of Z coordinate that described employing binocular stereo vision algorithm calculates described finger fingertip is as follows: l
1, l
2Represent described two cameras respectively, B represents the distance between described two camera photocentres, and f is the focal length of described camera, and (x, y z) are the residing spatial point of described finger fingertip to be asked to P, and (x, y z) are its three dimensional space coordinate, P
1(x
1, y
1), P
2(x
2, y
2) be respectively P o'clock at two cameras as the picpointed coordinate on the plane, wherein the P parallax of ordering is, calculates the degree of depth that P orders by geometric relationship to be:
Described step (5) may further comprise the steps: if the X of three dimensional space coordinate scope any button in X, Y-direction and described image frame of described finger fingertip, Y coordinate range are approaching, then represent the top that described finger fingertip has been positioned at described button; If the Z coordinate of the three dimensional space coordinate scope of described finger fingertip surpasses the Z coordinate time of described image frame, then described button has been selected in representative.
And described step (5) is further comprising the steps of: when described finger fingertip correspondence be more than one volume coordinate point the time, ask for the Z coordinate of described more than one volume coordinate point and be weighted, ask for average coordinates
When
Greater than the Z coordinate time of described image frame in coordinate system, judge that described finger fingertip has touched the described image frame that described intelligent glasses shows, simultaneously, if X, the Y-direction coordinate range of described finger fingertip overlap with X, the Y-direction coordinate range of any button in the described image frame, can judge that described finger clicked described button.
In embodiments of the present invention, the identification of finger finger tip is not limited only to a finger, can refers to that finger tips identify to ten, thereby make the man-machine interaction of carrying out with intelligent glasses can realize multi-point touch.
Simultaneously, though the just image frame of a two dimension that shows in the intelligent glasses at present, but this two-dimentional image frame but can reflect three-dimensional image effect (viewing effect is equivalent to present bore hole 3D) when using under the specific occasion, this moment, then the finger fingertip that will ask for help can touch the image of different distance if need carry out with the different parts of this 3-D view alternately.As shown in Figure 5, the plane that the several two dimensional surfaces representative that increases newly need be clicked with finger fingertip, though in fact these two dimensional surfaces appear in this image frame of ABCD, the viewing effect of human eye is equivalent to these two dimensional surfaces from the different plane of distance human eye.Because the three-dimensional motion capture system can be that the distance of initial point is measured to the finger fingertip range coordinate, so the signal that finger fingertip is clicked Different Plane can be responded.
Increase is mutual to two-dimensional picture with three-dimensional depth of field, just make exchange method provided by the invention not merely be confined on the two dimensional surface, just with respect to similar present touch screen two dimensional surface interactive mode, exchange method provided by the invention is stereoscopic three-dimensional, so just can provide more interactive signal.
Through the above description of the embodiments, those skilled in the art can be well understood to dimension disclosed by the invention and value and not be intended to be used to strictly be limited to described exact value.On the contrary, except as otherwise noted, each such dimension and value are intended to explain described value and center on the scope that is equal on this value function.
The above only is preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be looked protection scope of the present invention.
Claims (10)
1. the intelligent glasses system of a man-machine interaction is characterized in that, comprises with the lower part:
Intelligent glasses: but described intelligent glasses is the Clairvoyant type intelligent glasses, can make the described intelligent glasses eyeglass of visible light transmissive, simultaneously image information is superimposed upon on people's the true visual field;
Camera and infrared LED: two cameras and an infrared LED have been installed on the described intelligent glasses, described two parallel symmetries of camera are installed on the two ends, the left and right sides of intelligent glasses, be respectively left camera and right camera, described infrared LED is installed in the center of described intelligent glasses;
Two cameras of described intelligent glasses and described infrared LED are formed a three-dimensional motion capture system that is used for catching the interior movement locus of object of certain three dimensions scope and coordinate.
2. the intelligent glasses system of a kind of man-machine interaction as claimed in claim 1, it is characterized in that, described intelligent glasses system comprises that three-dimensional motion catches coordinate system and image frame coordinate system, wherein, described three-dimensional motion catches coordinate system and is used for analyzing finger motion, and described image frame coordinate system is used for analyzing the shown image frame of described intelligent glasses.
3. the intelligent glasses system of a kind of man-machine interaction as claimed in claim 2, it is characterized in that, described three-dimensional motion catches coordinate system and described image frame coordinate system, be true origin O with described infrared LED center all, to be parallel to described image frame and to be the OXY plane through the plane of true origin O, set up right-handed coordinate system OXYZ, catch coordinate system and described image frame coordinate system as described three-dimensional motion.
4. the exchange method of the intelligent glasses system of a man-machine interaction is characterized in that, may further comprise the steps:
(1) finger enters the catching range of the three-dimensional motion capture system of being made up of two cameras installing on the described intelligent glasses and infrared LED;
(2) described infrared LED emission infrared ray, described infrared ray touches the finger back by the finger scattering;
(3) after described two cameras detect the infrared ray of described scattering, generate two width of cloth dispersion images relevant with the movement locus of described finger;
(4) described two width of cloth dispersion images are adopted the stereoscopic vision algorithm, calculate the three dimensional space coordinate of described finger;
(5) three dimensional space coordinate according to described finger judges whether to have selected button;
(6) described intelligent glasses is realized the image frame that described intelligent glasses shows is pointed clicking operation according to selection.
5. the exchange method of the intelligent glasses system of a kind of man-machine interaction as claimed in claim 4, it is characterized in that, described step (4) may further comprise the steps: read the coordinate range of described finger fingertip X, Y-direction in image frame from described two width of cloth dispersion images, adopt the binocular stereo vision algorithm to calculate the Z coordinate of described finger fingertip then.
6. the exchange method of the intelligent glasses system of a kind of man-machine interaction as claimed in claim 5 is characterized in that, the process of Z coordinate that described employing binocular stereo vision algorithm calculates described finger fingertip is as follows: l
1, l
2Represent described two cameras respectively, B represents the distance between described two camera photocentres, and f is the focal length of described camera, and (x, y z) are the residing spatial point of described finger fingertip to be asked to P, and (x, y z) are its three dimensional space coordinate, P
1(x
1, y
1), P
2(x
2, y
2) be respectively P o'clock at two cameras as the picpointed coordinate on the plane, wherein the P parallax of ordering is d=x
1-x
2, calculate the degree of depth that P orders by geometric relationship and be:
7. as the exchange method of the intelligent glasses system of claim 5 or 6 described a kind of man-machine interactions, it is characterized in that, described step (5) may further comprise the steps: the X of the three dimensional space coordinate scope of described finger fingertip any button in X, Y-direction and described image frame, Y coordinate range approach, and then represent the top that described finger fingertip has been positioned at described button.
8. the exchange method of the intelligent glasses system of a kind of man-machine interaction as claimed in claim 7, it is characterized in that, described step (5) may further comprise the steps: the Z coordinate of the three dimensional space coordinate scope of described finger fingertip surpasses the Z coordinate time of described image frame, and then described button has been selected in representative.
9. the exchange method of the intelligent glasses system of a kind of man-machine interaction as claimed in claim 8, it is characterized in that, described step (5) is further comprising the steps of: when described finger fingertip correspondence be more than one volume coordinate point the time, ask for the Z coordinate of described more than one volume coordinate point and be weighted, ask for average coordinates
When
Greater than the Z coordinate time of described image frame in coordinate system, judge that described finger fingertip has touched the described image frame that described intelligent glasses shows, in the X of described finger fingertip, Y-direction coordinate range and described image frame the X of any button, when the Y-direction coordinate range overlaps, can judge that described finger clicked described button.
10. the exchange method of the intelligent glasses system of a kind of man-machine interaction as claimed in claim 5 is characterized in that, can identify any or a plurality of finger tip, makes the man-machine interaction of carrying out with described intelligent glasses can realize multi-point touch.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310263439.9A CN103336575B (en) | 2013-06-27 | 2013-06-27 | The intelligent glasses system of a kind of man-machine interaction and exchange method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310263439.9A CN103336575B (en) | 2013-06-27 | 2013-06-27 | The intelligent glasses system of a kind of man-machine interaction and exchange method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103336575A true CN103336575A (en) | 2013-10-02 |
| CN103336575B CN103336575B (en) | 2016-06-29 |
Family
ID=49244763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310263439.9A Active CN103336575B (en) | 2013-06-27 | 2013-06-27 | The intelligent glasses system of a kind of man-machine interaction and exchange method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103336575B (en) |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513771A (en) * | 2013-10-09 | 2014-01-15 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN103591958A (en) * | 2013-11-12 | 2014-02-19 | 中国科学院深圳先进技术研究院 | Intelligent spectacle based worker navigation system and method |
| CN103676154A (en) * | 2013-12-09 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Electronic zoom glasses |
| CN103699219A (en) * | 2013-12-06 | 2014-04-02 | 中国科学院深圳先进技术研究院 | Intelligent glasses interaction system and intelligent interaction method |
| CN103763431A (en) * | 2013-12-31 | 2014-04-30 | 上海闻泰电子科技有限公司 | Mobile terminal with wearable device and wearable device thereof |
| CN103957383A (en) * | 2014-04-22 | 2014-07-30 | 中国科学院深圳先进技术研究院 | Back vision system based on smart glasses |
| CN104298345A (en) * | 2014-07-28 | 2015-01-21 | 浙江工业大学 | Control method for man-machine interaction system |
| CN104598015A (en) * | 2013-10-31 | 2015-05-06 | 深圳先进技术研究院 | Information sharing system and method based on smart glasses |
| CN104597971A (en) * | 2014-12-06 | 2015-05-06 | 许昌学院 | Wearable computer |
| CN104656880A (en) * | 2013-11-21 | 2015-05-27 | 深圳先进技术研究院 | Writing system and method based on smart glasses |
| CN104657568A (en) * | 2013-11-21 | 2015-05-27 | 深圳先进技术研究院 | Multiplayer mobile game system and multiplayer mobile game method based on intelligent glasses |
| CN104679222A (en) * | 2013-11-26 | 2015-06-03 | 深圳先进技术研究院 | Medical office system based on human-computer interaction, medical information sharing system and method |
| CN105094675A (en) * | 2015-07-28 | 2015-11-25 | 中国联合网络通信集团有限公司 | Man-machine interaction method and touch screen wearable device |
| CN105159539A (en) * | 2015-09-10 | 2015-12-16 | 京东方科技集团股份有限公司 | Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment |
| CN105224069A (en) * | 2014-07-03 | 2016-01-06 | 王登高 | The device of a kind of augmented reality dummy keyboard input method and use the method |
| CN105867640A (en) * | 2016-05-12 | 2016-08-17 | 上海擎感智能科技有限公司 | Smart glasses and control method and control system of smart glasses |
| CN105929544A (en) * | 2016-06-16 | 2016-09-07 | 腾讯科技（深圳）有限公司 | Virtual reality glasses |
| CN105988562A (en) * | 2015-02-06 | 2016-10-05 | 刘小洋 | Intelligent wearing equipment and method for realizing gesture entry based on same |
| CN106199964A (en) * | 2015-01-21 | 2016-12-07 | 成都理想境界科技有限公司 | Binocular AR helmet and the depth of field control method of the depth of field can be automatically adjusted |
| CN106502376A (en) * | 2015-09-08 | 2017-03-15 | 天津三星电子有限公司 | A kind of 3D touch operation methods, electronic equipment and 3D glasses |
| WO2017049776A1 (en) * | 2015-09-21 | 2017-03-30 | 中国科学院深圳先进技术研究院 | Smart glasses capable of viewing interior and interior-viewing method |
| CN107015655A (en) * | 2017-04-11 | 2017-08-04 | 苏州和云观博数字科技有限公司 | Museum virtual scene AR experiences eyeglass device and its implementation |
| CN107430479A (en) * | 2015-03-31 | 2017-12-01 | 索尼公司 | Information processor, information processing method and program |
| CN107801413A (en) * | 2016-06-28 | 2018-03-13 | 华为技术有限公司 | The terminal and its processing method being controlled to electronic equipment |
| CN107807738A (en) * | 2017-12-04 | 2018-03-16 | 成都思悟革科技有限公司 | It is a kind of to show that the headwork of glasses catches system and method for VR |
| CN108509173A (en) * | 2018-06-07 | 2018-09-07 | 北京德火科技有限责任公司 | Image shows system and method, storage medium, processor |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | telematics method and device |
| CN111443813A (en) * | 2020-04-08 | 2020-07-24 | 维沃移动通信有限公司 | Application program management operation method and device, electronic equipment and storage medium |
| CN111651034A (en) * | 2019-12-05 | 2020-09-11 | 武汉美讯半导体有限公司 | Intelligent glasses and control method and control chip of intelligent glasses |
| CN114140531A (en) * | 2021-12-07 | 2022-03-04 | 河北工程大学 | Novel hand augmented reality technology based on deep learning |
| CN114564100A (en) * | 2021-11-05 | 2022-05-31 | 南京大学 | Free stereoscopic display hand-eye interaction method based on infrared guidance |
| CN118170259A (en) * | 2024-05-13 | 2024-06-11 | 中国科学院苏州生物医学工程技术研究所 | Screen interaction method and device based on gesture control, electronic equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102006017509A1 (en) * | 2006-04-13 | 2007-10-18 | Maxie Pantel | Sign language translating device, has computer accomodated in case that is supported around neck for determining predetermined words orders from signals of multiple cameras under evaluation of determined paths of movement of arms |
| CN101673161A (en) * | 2009-10-15 | 2010-03-17 | 复旦大学 | Visual, operable and non-solid touch screen system |
| CN102799318A (en) * | 2012-08-13 | 2012-11-28 | 深圳先进技术研究院 | Human-machine interaction method and system based on binocular stereoscopic vision |
| CN103019377A (en) * | 2012-12-04 | 2013-04-03 | 天津大学 | Head-mounted visual display equipment-based input method and device |
| JP2013061848A (en) * | 2011-09-14 | 2013-04-04 | Panasonic Corp | Noncontact input device |
-
2013
- 2013-06-27 CN CN201310263439.9A patent/CN103336575B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102006017509A1 (en) * | 2006-04-13 | 2007-10-18 | Maxie Pantel | Sign language translating device, has computer accomodated in case that is supported around neck for determining predetermined words orders from signals of multiple cameras under evaluation of determined paths of movement of arms |
| CN101673161A (en) * | 2009-10-15 | 2010-03-17 | 复旦大学 | Visual, operable and non-solid touch screen system |
| JP2013061848A (en) * | 2011-09-14 | 2013-04-04 | Panasonic Corp | Noncontact input device |
| CN102799318A (en) * | 2012-08-13 | 2012-11-28 | 深圳先进技术研究院 | Human-machine interaction method and system based on binocular stereoscopic vision |
| CN103019377A (en) * | 2012-12-04 | 2013-04-03 | 天津大学 | Head-mounted visual display equipment-based input method and device |
Cited By (51)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513771A (en) * | 2013-10-09 | 2014-01-15 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN103513771B (en) * | 2013-10-09 | 2017-02-08 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN104598015B (en) * | 2013-10-31 | 2017-07-18 | 深圳先进技术研究院 | A kind of information sharing system and method based on intelligent glasses |
| CN104598015A (en) * | 2013-10-31 | 2015-05-06 | 深圳先进技术研究院 | Information sharing system and method based on smart glasses |
| CN103591958A (en) * | 2013-11-12 | 2014-02-19 | 中国科学院深圳先进技术研究院 | Intelligent spectacle based worker navigation system and method |
| CN103591958B (en) * | 2013-11-12 | 2017-01-04 | 中国科学院深圳先进技术研究院 | A kind of worker navigation system based on intelligent glasses and method |
| CN104656880A (en) * | 2013-11-21 | 2015-05-27 | 深圳先进技术研究院 | Writing system and method based on smart glasses |
| CN104657568B (en) * | 2013-11-21 | 2017-10-03 | 深圳先进技术研究院 | Many people's moving game system and methods based on intelligent glasses |
| CN104657568A (en) * | 2013-11-21 | 2015-05-27 | 深圳先进技术研究院 | Multiplayer mobile game system and multiplayer mobile game method based on intelligent glasses |
| CN104656880B (en) * | 2013-11-21 | 2018-02-06 | 深圳先进技术研究院 | A kind of writing system and method based on intelligent glasses |
| CN104679222A (en) * | 2013-11-26 | 2015-06-03 | 深圳先进技术研究院 | Medical office system based on human-computer interaction, medical information sharing system and method |
| CN104679222B (en) * | 2013-11-26 | 2018-02-06 | 深圳先进技术研究院 | Medical office system, medical information sharing system and method based on man-machine interaction |
| CN103699219A (en) * | 2013-12-06 | 2014-04-02 | 中国科学院深圳先进技术研究院 | Intelligent glasses interaction system and intelligent interaction method |
| CN103676154A (en) * | 2013-12-09 | 2014-03-26 | 苏州市峰之火数码科技有限公司 | Electronic zoom glasses |
| CN103763431A (en) * | 2013-12-31 | 2014-04-30 | 上海闻泰电子科技有限公司 | Mobile terminal with wearable device and wearable device thereof |
| CN103957383A (en) * | 2014-04-22 | 2014-07-30 | 中国科学院深圳先进技术研究院 | Back vision system based on smart glasses |
| CN105224069A (en) * | 2014-07-03 | 2016-01-06 | 王登高 | The device of a kind of augmented reality dummy keyboard input method and use the method |
| CN105224069B (en) * | 2014-07-03 | 2019-03-19 | 王登高 | A kind of augmented reality dummy keyboard input method and the device using this method |
| CN104298345A (en) * | 2014-07-28 | 2015-01-21 | 浙江工业大学 | Control method for man-machine interaction system |
| CN104298345B (en) * | 2014-07-28 | 2017-05-17 | 浙江工业大学 | Control method for man-machine interaction system |
| CN104597971B (en) * | 2014-12-06 | 2018-04-03 | 许昌学院 | A kind of wearable computer |
| CN104597971A (en) * | 2014-12-06 | 2015-05-06 | 许昌学院 | Wearable computer |
| CN106199964A (en) * | 2015-01-21 | 2016-12-07 | 成都理想境界科技有限公司 | Binocular AR helmet and the depth of field control method of the depth of field can be automatically adjusted |
| CN106199964B (en) * | 2015-01-21 | 2019-06-21 | 成都理想境界科技有限公司 | The binocular AR helmet and depth of field adjusting method of the depth of field can be automatically adjusted |
| CN105988562A (en) * | 2015-02-06 | 2016-10-05 | 刘小洋 | Intelligent wearing equipment and method for realizing gesture entry based on same |
| CN107430479A (en) * | 2015-03-31 | 2017-12-01 | 索尼公司 | Information processor, information processing method and program |
| CN105094675A (en) * | 2015-07-28 | 2015-11-25 | 中国联合网络通信集团有限公司 | Man-machine interaction method and touch screen wearable device |
| CN105094675B (en) * | 2015-07-28 | 2019-04-02 | 中国联合网络通信集团有限公司 | A kind of man-machine interaction method and touch screen wearable device |
| CN106502376A (en) * | 2015-09-08 | 2017-03-15 | 天津三星电子有限公司 | A kind of 3D touch operation methods, electronic equipment and 3D glasses |
| US10185433B2 (en) | 2015-09-10 | 2019-01-22 | Boe Technology Group Co., Ltd. | Method and apparatus for touch responding of wearable device as well as wearable device |
| WO2017041433A1 (en) * | 2015-09-10 | 2017-03-16 | 京东方科技集团股份有限公司 | Touch control response method and apparatus for wearable device, and wearable device |
| CN105159539A (en) * | 2015-09-10 | 2015-12-16 | 京东方科技集团股份有限公司 | Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment |
| CN105159539B (en) * | 2015-09-10 | 2018-06-01 | 京东方科技集团股份有限公司 | Touch-control response method, device and the wearable device of wearable device |
| WO2017049776A1 (en) * | 2015-09-21 | 2017-03-30 | 中国科学院深圳先进技术研究院 | Smart glasses capable of viewing interior and interior-viewing method |
| CN105867640A (en) * | 2016-05-12 | 2016-08-17 | 上海擎感智能科技有限公司 | Smart glasses and control method and control system of smart glasses |
| CN105929544A (en) * | 2016-06-16 | 2016-09-07 | 腾讯科技（深圳）有限公司 | Virtual reality glasses |
| CN107801413A (en) * | 2016-06-28 | 2018-03-13 | 华为技术有限公司 | The terminal and its processing method being controlled to electronic equipment |
| CN107801413B (en) * | 2016-06-28 | 2020-01-31 | 华为技术有限公司 | Terminal for controlling electronic equipment and processing method thereof |
| CN107015655A (en) * | 2017-04-11 | 2017-08-04 | 苏州和云观博数字科技有限公司 | Museum virtual scene AR experiences eyeglass device and its implementation |
| CN107807738B (en) * | 2017-12-04 | 2023-08-15 | 成都思悟革科技有限公司 | Head motion capturing system and method for VR display glasses |
| CN107807738A (en) * | 2017-12-04 | 2018-03-16 | 成都思悟革科技有限公司 | It is a kind of to show that the headwork of glasses catches system and method for VR |
| CN108509173A (en) * | 2018-06-07 | 2018-09-07 | 北京德火科技有限责任公司 | Image shows system and method, storage medium, processor |
| CN110740285A (en) * | 2019-10-30 | 2020-01-31 | 中车青岛四方机车车辆股份有限公司 | telematics method and device |
| CN111651034A (en) * | 2019-12-05 | 2020-09-11 | 武汉美讯半导体有限公司 | Intelligent glasses and control method and control chip of intelligent glasses |
| CN111651034B (en) * | 2019-12-05 | 2023-12-26 | 寰采星科技(宁波)有限公司 | Intelligent glasses, control method and control chip of intelligent glasses |
| CN111443813A (en) * | 2020-04-08 | 2020-07-24 | 维沃移动通信有限公司 | Application program management operation method and device, electronic equipment and storage medium |
| CN114564100A (en) * | 2021-11-05 | 2022-05-31 | 南京大学 | Free stereoscopic display hand-eye interaction method based on infrared guidance |
| CN114564100B (en) * | 2021-11-05 | 2023-12-12 | 南京大学 | Infrared guiding-based hand-eye interaction method for auto-stereoscopic display |
| CN114140531A (en) * | 2021-12-07 | 2022-03-04 | 河北工程大学 | Novel hand augmented reality technology based on deep learning |
| CN118170259A (en) * | 2024-05-13 | 2024-06-11 | 中国科学院苏州生物医学工程技术研究所 | Screen interaction method and device based on gesture control, electronic equipment and medium |
| CN118170259B (en) * | 2024-05-13 | 2024-08-13 | 中国科学院苏州生物医学工程技术研究所 | Screen interaction method and device based on gesture control, electronic equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103336575B (en) | 2016-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103336575B (en) | The intelligent glasses system of a kind of man-machine interaction and exchange method | |
| US9104239B2 (en) | Display device and method for controlling gesture functions using different depth ranges | |
| CN110647239A (en) | Gesture-based projection and manipulation of virtual content in an artificial reality environment | |
| CN114127669A (en) | Trackability enhancement for passive stylus | |
| US20160004908A1 (en) | Shape recognition device, shape recognition program, and shape recognition method | |
| WO2012111998A2 (en) | Virtual touch device without pointer | |
| KR102147430B1 (en) | virtual multi-touch interaction apparatus and method | |
| CN103176605A (en) | Control device of gesture recognition and control method of gesture recognition | |
| CN110018736A (en) | The object via near-eye display interface in artificial reality enhances | |
| CN114402589A (en) | Smart stylus beam and secondary probability input for element mapping in 2D and 3D graphical user interfaces | |
| CN103793060A (en) | User interaction system and method | |
| CN103339591A (en) | Apparatus and method for user input for controlling displayed information | |
| US20160021353A1 (en) | I/o device, i/o program, and i/o method | |
| CN104246664B (en) | The transparent display virtual touch device of pointer is not shown | |
| KR101441882B1 (en) | method for controlling electronic devices by using virtural surface adjacent to display in virtual touch apparatus without pointer | |
| EP2788839A1 (en) | Method and system for responding to user's selection gesture of object displayed in three dimensions | |
| CN104298340A (en) | Control method and electronic equipment | |
| KR20120126508A (en) | method for recognizing touch input in virtual touch apparatus without pointer | |
| CN104637080A (en) | Three-dimensional drawing system and three-dimensional drawing method based on human-computer interaction | |
| CN102508548A (en) | Operation method and system for electronic information equipment | |
| US10171800B2 (en) | Input/output device, input/output program, and input/output method that provide visual recognition of object to add a sense of distance | |
| CN103513771B (en) | System and method for using intelligent glasses in cooperation with interactive pen | |
| CN103033145B (en) | For identifying the method and system of the shape of multiple object | |
| CN106909219B (en) | Interaction control method and device based on three-dimensional space and intelligent terminal | |
| KR101321274B1 (en) | Virtual touch apparatus without pointer on the screen using two cameras and light source |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170914 Address after: 215028, room 20, 523, Northwest District, nano City, 99 Jinji Lake Road, Suzhou Industrial Park, Jiangsu, China Patentee after: SUZHOU ZHONGKE ADVANCED TECHNOLOGY RESEARCH INSTITUTE Co.,Ltd. Address before: Room office building No. 1068 Shenzhen Institute of advanced technology A-301 518000 in Guangdong city of Shenzhen province Nanshan District Shenzhen University city academy Avenue Patentee before: Shenzhen shen-tech advanced Cci Capital Ltd. Effective date of registration: 20170914 Address after: Room office building No. 1068 Shenzhen Institute of advanced technology A-301 518000 in Guangdong city of Shenzhen province Nanshan District Shenzhen University city academy Avenue Patentee after: Shenzhen shen-tech advanced Cci Capital Ltd. Address before: 1068 No. 518055 Guangdong city in Shenzhen Province, Nanshan District City Xili University School Avenue Patentee before: SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY |
|
| TR01 | Transfer of patent right |