CN101449265A - Mobile global virtual browser with heads-up display for browsing and interacting with the World Wide Web - Google Patents
Mobile global virtual browser with heads-up display for browsing and interacting with the World Wide Web Download PDFInfo
- Publication number
- CN101449265A CN101449265A CNA2007800180055A CN200780018005A CN101449265A CN 101449265 A CN101449265 A CN 101449265A CN A2007800180055 A CNA2007800180055 A CN A2007800180055A CN 200780018005 A CN200780018005 A CN 200780018005A CN 101449265 A CN101449265 A CN 101449265A
- Authority
- CN
- China
- Prior art keywords
- data input
- gesture
- mobile communication
- input device
- communication equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
This disclosure describes a new method to browse and interact with the World Wide Web and other users while mobile comprising the following components: 1) a mobile communications device including but not limited to Blackberries, personal data assistants, or smartphones; 2) special glasses or viewing surface including but not limited to LCD (liquid crystal display) glasses, 3 -dimensional goggles, or Organic LED (light emitting diode) panels; 3) a data input device including but not limited to a data glove, finger sensor, data input pen, or gesturing device; 4) a mobile communications device headset; and 5) a third generation or more powerful wireless carrier, Voice over IP provider, or a wireless LAN technology such as WiFi or, Wi-Max, or Bluetooth.
Description
Technical field
The demand that provides complete mutual network browsing to experience to the mobile subscriber is provided in the present invention.Particularly, the disclosure has been described a kind of interactive system and method, and it allows network (web) user who moves to browse, participate in game on line, common new user interface and WWW and other user interactions via the mobile device that utilizes big virtual colorful display screen.
Background technology
At present, the mobile subscriber will see Web content, just must stare the little lcd screen on the mobile cellular equipment.System and method of the present disclosure has enlarged the perception screen, and can make the abundant aural/visual network-impacting of user experience.The disclosure system is to use a kind of mobile, the global service of smart phone of future generation, is used to play game on line and carries out alternately with world wide web (www).This system can be counted as online all the time, always readily available WWW service, and it provides the ability that overcomes the visual restriction of current smart phone by using LCD (LCD) glasses as the user of smart phone.At present, cellular user must stare a little LCD screen, visits and check the webpage that has been dwindled greatly with respect to abundant web content.On these preliminary webpages, has only basic text.The small size of smart phone lcd screen is that current techniques is subjected to this to weaken the main cause of restriction.In a foreseeable future, this will can not change, because manufacturer is reducing rather than increasing their hardware space area.Disclosure system will allow the user to see size and the same virtual screen of large scale TV machine screen in their front.The true district (real estate) that increases the perception screen has greatly considered many possibilities, comprise: the WWW that wonderful recreation authenticity, the degree of depth are immersed is mutual, streaming film, motion and video, video conference, visual virtual digit technology, and many other possibilities.System needs smart phone of future generation, the LCD glasses that have boombox, finger pointing equipment, data input pen or data glove, honeycomb headphone and the third generation (3G) (or 4G) cellular carrier (wireless carrier), ip voice (VoIP) if provider or can't use or when not needing cellular signal, then game on line just need be such as WLAN (wireless local area network) (LAN) technology WiFi (it is interior to be in same building) or the Wi-MaX (being in the same city).
Related art comprises: the patent WO2 of World Intellectual Property Organization 005/054782 Al:Mobile Geographic Information Display System; The open 20020015008:Computer System and Headset-Mounted Display Device of the U.S.; The open 20030092384:Piconetwork Radiotelephone Interfaces for VehiclesIncluding Wireless Pointing and Display Devices of the U.S.; The open 20030160736:Portable Heads-up Display for Vehicle of the U.S.; The open 20050096096:WirelessCommunications Systems for Masks or Helmets of the U.S.; United States Patent (USP) 4,636,866:Personal Liquid Crystal Image Display; United States Patent (USP) 5,509,048-RadioTransceiver with Interface Apparatus Which Visually Displays Informationand Method Therefor; United States Patent (USP) 5,556,224:Radio FrequencyCommunication Device Including Mirrored Surface; United States Patent (USP) 5,969,698:Manually Controllable Cursor and Control Panel in a VirtualImage; United States Patent (USP) 5,977,950:Manually Controllable Cursor in a VirtualImage; United States Patent (USP) 6,073,033:Portable Telephone with Integrated Heads-up Display and DataTerminal Functions; United States Patent (USP) 6,091,376:Mobile Telephone Equipmentwith Head-up Display; United States Patent (USP) 6,091,546:Eyeglass Interface System; United States Patent (USP) 6,697,721:Safety Devices for Use in Motor Vehicles; United States Patent (USP) 6,747,611:Compact Optical System and Packaging for Head MountedDisplay; And, United States Patent (USP) 6,941,248:System for Operating and ObservingMaking Use of Mobile Equipment.In these prior aries, neither one discloses the unique combination that allows the mobile subscriber to enjoy this system of full web experience.
Summary of the invention
The present invention be a kind of when mobile, browse and with the new system and method for WWW and other user interactions, comprise following assembly: the mobile communication equipment that 1) includes but not limited to blackberry, blueberry, personal digital assistant, dull and stereotyped PC or smart phone; 2) include but not limited to the special glasses of LCD (LCD) glasses, three-dimensional safety goggles, organic LED (light emitting diode) panel and/or watch the surface; 3) include but not limited to the data input device of data glove, data input pen, finger sensor or the equipment that postures (gesturing device); 4) mobile communication equipment headphone; And 5) third generation or more powerful cellular carrier or ip voice provider, if and/or cellular signal can't use or not need, then play required WLAN (wireless local area network) (LAN) technology of game on line such as WiFi (in same building) or Wi-Max (in same city).
At present, the mobile subscriber will see Web content, just must stare the little LCD screen on the mobile cellular equipment.System and method of the present invention has enlarged the screen of perception, and can make the abundant aural/visual network-impacting of user experience.In addition, the user must use uncomfortable little keypad to dial, send short message, navigation menu and input data gropingly at present.System and method of the present invention provides brand-new interface to the user.
One object of the present invention is, provide a kind of when mobile the system and method for visit WWW, its via big virtual color/graphics and stereo watch and with network or other user interactions.
Another purpose of the present invention is, allows the user not to be subjected to the restriction of little mobile device lcd screen and to enjoy abundant WWW audiovisual.
A further object of the present invention is, a kind of sign language order of the hand signal language such as American sign language (American SignLanguage) or the design of other conventions is provided, and is used for and this system interaction and control system.
Another object of the present invention is to, a kind of voice-operated command language is provided, be used for and this system interaction and control system.
Another object of the present invention is to, a kind of input, the transmission of the little keypad of current hand-held set and method that receives text message or SMS message of getting around is provided, it is by following realization: allow to use gesture command and verbal order to carry out dialing, and call accepted, refusal call out, change circuit, meeting, when warning receives voice mail or text or SMS message and who sends out, comprise the predetermined message that proposes via gesture command or voice easily.
A further object of the present invention is, a kind of screen soverlay technique that is activated by voice or gesture is provided, and these voice or gesture accord with each possible virtual screen option of mark (hyperlink, cursor move, select, input etc.) and make the user select described option immediately by voice, posture or eye focus with alphanumeric, symbol or color sign.
An also purpose of the present invention is, provides a kind of and having the system and method for watching streaming film, motion and video on the stereosonic virtual color/graphics greatly when mobile.
Another purpose of the present invention is, provides a kind of and having the system and method for playing online, real-time multiplayer on the stereosonic virtual color/graphics greatly when mobile.
Another purpose of the present invention is, provide a kind of when mobile at the system and method that has holding video conference on the stereosonic big virtual color/graphics, this system and method can also promote mobile working person's throughput rate by providing the ability of establishment and editing files and spreadsheet to need not computing machine to the mobile subscriber when mobile.
A further object of the present invention is, provide a kind of and go up with geographical and go up the many people that separate and experience the audiovisual system and method for virtual vacation simultaneously having stereosonic big virtual color/graphics (being three-dimensional figure as far as possible) when mobile, this system and method is by watching map, sensing map on the screen and select and subscribing complete content (package) and subscribe virtual vacation.
Another purpose of the present invention is, provides a kind of and watch and listen to the system and method for the digital art product in museum via having stereosonic big virtual color/graphics when mobile.
Another purpose of the present invention is, provide a kind of when mobile via big virtual color/graphics with stereoly make up and carry out mutual system and method with the tridimensional virtual world and the socialization world.
A further object of the present invention is, provide a kind of when mobile via big virtual color/graphics and stereo permission user combination (assemble) with organize the system and method for their virtual digit life, wherein, people's contact can improve (pull up) and focuses on or the gesture command activation via voice, eyes on virtual screen.
A further object of the present invention is, provide a kind of via big virtual color/graphics and the stereo system and method for checking gps data, it allows user to check and listens to the accurate detailed data of the restaurant of expectation destination, traffic returns, current location, navigation direction etc.
A further object of the present invention is, provide a kind of via having the system and method that stereosonic virtual color/graphics participation greatly is not subjected to public organization's network of geographic constraint, this system and method is by concrete statement or digital preference and artificial voice (voice artifact) are real-time and virtual net China Association for Promoting Democracy row is mutual.
In order fully to understand purpose of the present invention and characteristic, should be in conjunction with the accompanying drawings with reference to following detailed description.
Description of drawings
In order fully to understand purpose of the present invention and characteristic, should be with reference to accompanying drawing, wherein:
Fig. 1 shows total figure of the conventional system with assembly and input and output thereof;
Fig. 2 shows the typical user under the first generation system, and this first generation system has used the controller that is just having on;
Fig. 3 shows the typical user under the more excellent second-generation system, this second-generation system replace controller with software and run directly in smart phone or mobile phone on.
Referenced drawings numeral shown in the figure is as follows:
10-smart phone or mobile device
12-controller (based on microprocessor)
14-phone/control unit interface
16-has the head mounted display of boombox
18-head mounted display/control unit interface
The 20-headphone
22-headphone/control unit interface
24-data glove or pointing apparatus
26-data glove/control unit interface
Embodiment
The importance of system is that it moves, and does not need computing machine to come work (for example, need not pocket computer).In addition, for the out-of-date keypad of little lcd screen and current mobile device interface, this mobile device interface is brand-new user interface, and be similar to the disc operating system (DOS) (DOS) of Microsoft, this be with its graphic user interface that is called Windows Comparatively speaking.And though this system makes up round the existing assembly of current existence, the hardware and software interface that can be realized by those skilled in the art comes integrated.The mobile subscriber needs that minimum relatively extras---visual required equipment is smooth LCD glasses.For with this system interaction, data glove, virtual mouse or data input pen can be used for (in theair) use input equipment formation character, numeral etc. by aloft, finish the text of arbitrary form, wherein, systematic analysis is also translated into text on screen/file, to allow browse network.Little headphone such as the headphone that has PlayGear Stealth (earbud), is used for stereo.Can realize having the game on line undertaken by the player who separates on the geography real-time feedback, and need not huge game machine (gaming console), for example PS3 or Xbox360.Best mobile device (especially smart phone) is equipped with airborne (onboard) RAM, bluetooth, 8GB HDD, USB port and integrated GPS ability.All component need have their power supply, perhaps by usb bus (or other) power supply, so that keep movability.Be used for the WLAN ability update internet of searching system etc.If Internet connection is unavailable, then WiFi will allow the player mutual in buildings or same room.The Wi-Max ability will allow the player to play game on line in same city under the situation that does not have honeycomb to connect.
Shown in Fig. 3 preferred embodiment, for using this system, the user has used following assembly: 1) mobile communication equipment, include but not limited to blackberry, blueberry, personal digital assistant, dull and stereotyped PC or smart phone (10), this equipment and the third generation or more powerful cellular carrier or ip voice provider link to each other, and are used for wireless network and insert.Particularly, in the case, Samsung (Samsung) SGH-i310 smart phone is attached to this individual, to allow carrying out " hands-free " operation by one or more data glove (24), but as known to those skilled in the art, can use other mobile communication equipment; 2) combine special glasses or the various display apparatus (16) of watching the surface known to those skilled in the art, include but not limited to LCD (LCD) glasses, three-dimensional safety goggles or organic LED (light emitting diode) panel.In the case, i-glasses (i-glasses) (16) are positioned on the head, and wherein, lcd screen places the front of eyes of user; 3) data input device (24) includes but not limited to data glove known in those skilled in the art, finger sensor, data input pen or other gesture equipment.In the preferred embodiment that illustrates, put on (one or more) 5DT data glove (24); And 4) the mobile communication equipment headphone (20) compatible with SGH-i310 smart phone (10) is placed on the ear.
In the operation, i-glasses video display (16) is by the TV-OUT jack and Samsung SGH-i310 smart phone (10) interface of smart phone (10).Smart phone (10) equipment support by with the NTSC and the PAL output signal of the cable of output cable termination.These cables connect i-glasses (16), and may need adapter so that the S-video that goes on the video eyeglasses (16) from composite video imports, as known to those skilled in the art.
Headphone (20) carries out wireless connections by blueteeth network technology (22).Similarly, (one or more) data glove (24) connects smart phone (10) via Bluetooth technology by data glove " hub ".
In the operation shown in Fig. 1 alternative embodiment, SGH-i310 smart phone (10) is used for connecting the internet via the service supplier, and is as good as usually.Yet the image that the user watches is virtual colored panel, and it " floats " in people's front and is revealed as the giant-screen of considerable size.For example, locate the user at 13 feet and perceive 70 ＂ screens.This reconstruction of image is on the lcd screen of display (16), and by the parallax known in those skilled in the art that moves on controller or mobile device and the effect of switching software, image is revealed as big colored panel.Can also use particular mirror (for example, half-silvered), it can provide the eyes trace ability, and this eyes trace ability is selected the user who allows to watch attentively the specified point of virtual screen.Cursor or arrow are apparent on the screen, resemble normal computer screen and look the same.The TV OUT port driver display device (16) and the audio-frequency assembly of SGH-i310 smart phone (10).As known to those skilled in the art, current video standard is used to drive display device (16), and current audio format standard is used to drive audio-frequency assembly.
Have motion and location (the posture tracking) of the finger or the hand of data input device (24), help the motion in the browser.Motion and location are changed by system, so that go up mobile virtual cursor or indicator (pointer) at virtual screen (16).Software driver is used for moving cursor, resembles very much the computer mouse of location personal computer.Space orientation is relative, and can adopt body sensor.At first, data input device (24) uses relative positioning, thereby hand can be positioned in solid space, and system will be converted to the true district that is positioned at virtual screen to the virtual screen cursor position.In case position stability a short-term, then on virtual screen, directly follow the trail of the follow-up motion of hand.This has given the user places data input device (24) Anywhere and begins to navigate in three dimensions dirigibility.Some examples that gesture is followed the trail of hardware are: be positioned on the magnetic circle (tracked by its magnetic field) on the finger; Be positioned on the transceiver on finger, hand or the arm, it sends the known signal of being located and being moved by controller (12) or mobile device (10) being used to of catching; Perhaps send the data glove equipment (24) of its position and gesture (gesturing) data to controller (12) or mobile device (10).In addition, body sensor can strategic location and be used to posture (gesturing).By using magnetic circle or data glove (24), it is more convenient that finger-joint can also become.
Screen covers and helps feature to activate by sign language order or voice command.At first, the subclass of American sign language is used in the sign language order, but as known to those skilled in the art, other sign language order can make up from ground-up.System's digital alphabet, color or symbol data of visual cues all available options of user or selection, tagging scheme intuitively superposes.The user visually checks screen (16) and wants the option that activates or select so that determine them.The user can point to this symbol to carry out this action, perhaps can say their selection, and it will work by speech recognition subsystem.By using the eyes tracer technique, for example utilize mirror or laser, can also make a choice by user's visual focus.
As known to those skilled in the art, need very large bandwidth to carry all videos and the data component of wireless signal.This system is designed to be used in any bandwidth and carries out work, and increases their bandwidth capacity or led to for the 4th generation during network at third generation wireless network, will move (migrate in power) on power.Voice, video and data need wirelessly be carried.
The mobile device computing power will depend primarily on CPU (central processing unit) (CPU) and storage restriction.ARM of future generation or mobile Pentium (Pentium) processor with RAM of 2 GB can be used for driving in mobile device (10) and calculate.Special operation (figure, speech recognition, space orientation, encoding and decoding of video, gesture recognition) is by coding and fire EPROM (EPROM), can unload from mobile device.This hardware solution is faster than its equivalent software.
Alternative embodiment comprises as follows: 1) as Fig. 1 and 2 hardware control equipment (12) as central control point, so that by hard-wired cable rather than move special software on one's body at smart phone (10) and come the interface armamentarium; 2) head mounted display (16) can be three-dimensional safety goggles, rather than the LCD glasses; 3) display (16) can be Organic Light Emitting Diode (OLED) surface; 4) display (16) can be advanced optics contact lenses; 5) display (16) can be holographic or based on the image of interfering; 6) display (16) can be a human retina, and its utilization nanometer technology or other advanced biotechnologys are sent to optic nerve with digital video signal; 7) data input device (24) can be virtual Genius mouse, pointing apparatus or body sensor, rather than data glove (24); 8) system interconnection can be wired, rather than wireless; 9) sign language order input can replace with or add speech recognition technology; 10) smart phone (10) equipment can be substituted by tablet personal computer; 11) mobile cellular equipment (10) can substitute with satellite-based communication facilities; And 12) posture is followed the trail of and can be used laser to detect eye movement and position.
In the operation of alternative embodiment shown in Fig. 1 and 2, interface cable (14) connects mobile communication equipment (10) and controller equiment (12).Controller (12) is carried out all operations and is controlled at interface between mobile communication equipment (10), display device (16), equipment headphone (20) and the data input device (24).Second cable (audio/video) (18) connects display device (16) and controller (12).The 3rd cable (data) (26) connects data input device (24) and controller (12).In this alternative embodiment of system, wireless technology (22) is used to connect headphone (20) and controller equiment (12).Every other connection will be used wired connection.The preferred embodiments of the present invention have adopted protocol of wireless local area network, for example as mentioned above and at bluetooth shown in Figure 3, WiFi or Wi-Max.
The system component of the preferred embodiment (SC) comprising: 1) i-glasses video heads head mounted displays (16) (LCD glasses); 2) Samsung SGH-i310 smart phone (10) or similar equipment (N95 of Nokia, Samsung SCH-A990); 3) the standard bluetooth headphone (20) of compatible SGH-i310; 4) the super series of 5DT data glove (if will use virtual keypad then need two); And 5) the wireless external member of the 5DT of data glove (Kit), but those skilled in the art can easily predict the similar assembly that is implemented in this disclosed system and method.
Be the specification of above preferred embodiment system component below, but those skilled in the art can easily predict other specifications that are implemented in this disclosed system and method:
SC1-i-glasses video heads head mounted displays (16) (LCD glasses)
The I-O display system, Menlo Park, CA
A) 1,000,000 pixels of each display 1.44
B) locate the virtual image and be of a size of 70 ＂ for 13 feet
C) 24 color depth
D) PAL/NTSC combination or S-video (S-video) input: be scaled to 800 * 600
E) audio frequency: stereo entirely
F) weight: 7 ounces
G) power supply: battery/with the charger-4 of lithium polymer battery packing hour
SC2-Samsung SGH-i310 smart phone (10) or similar devices
A) Windows Mobile 5 operating systems
B) Intel Xscate PXA272 processor moves at 416Mhz
C) the accessible 128MB ROM of user
d)64MB?RAM
E) hard-disk capacity of 8GB
F) interface:
Expand: SDIO, microSD, TransFlash
Serial: RS-232,115200 bps
USB：USB?2.0
Bluetooth: bluetooth 2.0
G) TV OUT video output plughole
H) battery-lithium-ion
The super series of SC4-5DT data glove (24) (if use virtual keypad then need two)
5DT?Irvine，CA
A) 8 deflection resolution
B) USB1.1 interface
C) airborne processor
D) reach 20 meters blue teeth wireless connectivity
E) left hand and right hand version
F) tie up based on light
G) power by USB interface
H) sampling rate is minimum 75 hertz
The wireless external member of the 5DT of SC5-data glove
5DT?Irvine，CA
A) utilization 2.4Ghz bluetooth spread spectrum
B) have lace-tied type (belt-worn) external member of electric battery
C) data of two data gloves of a unit transmission
D) little form factor (small form factor), 1.65 inches of 4.33 x, 3.27 x
E) light, 10.6 ounces
This system can dispose as described in following scene.Ralph on business comes Tokyo.Cindy also has last weekend apart from operation, then want to loosen and see Ralph or with his talk.In the time of agreement, Cindy puts on her LCD glasses, puts on sign language order gloves, connects smart phone then.She enters within the universe of her personal virtual in login.Virtual menu floats in her front on the virtual screen of 36 ＂.A selection is " The Magic of Italy (gondola glamour) ".The finger that she explains by gloves moves selects this option, and the photo of Ralph manifests then.So greet because he has logined him---he is to being virtual vacation so exciting, to such an extent as to champ at the bit.When Cindy logined, he just saw her photo.They talk about their even in everyday situations of a few minutes, determine that then carrying out their virtual spends a holiday.Remember, Ralph physically in Tokyo and Cindy in the U.S..
Unsteady menu demonstrates in their possible destination-Milan, Venice, Florence, Rome, Assinie, Su Peng holder (Sorrento), Pompeii or Kapp.They select Venice and take advantage of firm to draw (gondola) travelling when dusk.When they went sight-seeing the canal, two people saw the video cinestrip of the identical true specialty on the journey.Because the connection of honeycomb, certainly, they are live talk each other, and they can discuss them each other what has been seen.In fact, thousands of miles even they physically are separated by, but they feel together.
Afterwards, Cindy wanted the Vatican, and Sistine Chapel is passed in walking.Ralph agrees.By several sign language orders, on virtual screen, manifest virtual options menu, and Cindy has selected the Vatican tourism.Present two personal virtuals are strolled about in the Vatican, and enter Sistine Chapel.They have seen mural painting " Creation of Adam (Adam's birth) " on ceiling.Ralph suspend this view in case they open to discussion it.Praising it after five minutes, they have changed angle via sign language order repeatedly.They in addition increased magnification.The next stop is Rome and big arenas!
Though physically separate, two people have enjoyed Italian travelling by disclosed technology in this application form, experience travel companion's happiness, talk animatedly each other simultaneously, this application book has been erected broad bridge between them, allows them together and share unique experience.
Owing to do not breaking away under the prerequisite of this related scope of the invention, can carry out certain change to mutual web page browsing and online game system and method, so all are included in instructions or content illustrated in the accompanying drawings will be an example explanation, and do not have limiting meaning.
Claims (12)
1. system, be used for that the user browses when mobile, game on line and generally speaking with WWW and other user interactions, this system comprises:
Mobile communication equipment;
The head mounted display that communicates with described mobile communication equipment;
Data input device, using gesture produces the input that communicates with described mobile communication equipment;
The headphone that communicates with described mobile communication equipment;
Cellular carrier, ip voice provider or the wireless lan technology that described mobile communication equipment is connected with other users in WWW or the LAN such as WiFi, Wi-Max or bluetooth.
2. the system of claim 1, wherein, described mobile communication equipment is blackberry, blueberry, personal digital assistant, dull and stereotyped PC or smart phone.
3. the system of claim 1, wherein, described head mounted display is cover LCD (LCD) glasses, three-dimensional safety goggles, or organic LED (light emitting diode) panel.
4. the system of claim 1, wherein, described data input device is one or more data glove, finger sensor, data input pen or the equipment that postures.
5. the system of claim 1, wherein, described data input device uses eye movement to follow gesture or uses eye movement to replace gesture.
6. the system of claim 1, wherein, described data input device uses voice command to follow gesture or uses voice command to replace gesture.
7. system, be used for that the user browses when mobile, game on line and generally speaking with WWW and other user interactions, this system comprises:
Hardware control equipment;
The mobile communication equipment that communicates with described hardware control equipment;
The head mounted display that communicates with described hardware control equipment;
Data input device, using gesture produces the input that communicates with described hardware control equipment;
The headphone that communicates with described hardware control equipment; And
Cellular carrier, ip voice provider or the wireless lan technology that described mobile communication equipment is connected with other users in WWW or the LAN such as WiFi, Wi-Max or bluetooth.
8. the system of claim 7, wherein, described mobile communication equipment is blackberry, blueberry, personal digital assistant, dull and stereotyped PC or smart phone.
9. the system of claim 7, wherein, described head mounted display is cover LCD (LCD) glasses, three-dimensional safety goggles, or organic LED (light emitting diode) panel.
10. the system of claim 7, wherein, described data input device is one or more data glove, finger sensor, data input pen or the equipment that postures.
11. the system of claim 7, wherein, described data input device uses eye movement to follow gesture or uses eye movement to replace gesture.
12. the system of claim 7, wherein, described data input device uses voice command to follow gesture or uses voice command to replace gesture.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US78298706P | 2006-03-15 | 2006-03-15 | |
| US60/782,987 | 2006-03-15 | ||
| US11/716,280 | 2007-03-09 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101449265A true CN101449265A (en) | 2009-06-03 |
Family
ID=40743806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007800180055A Pending CN101449265A (en) | 2006-03-15 | 2007-03-13 | Mobile global virtual browser with heads-up display for browsing and interacting with the World Wide Web |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101449265A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102306059A (en) * | 2011-08-10 | 2012-01-04 | 电子科技大学 | Universal remote controller based on touch control input for handheld digital television |
| CN102681651A (en) * | 2011-03-07 | 2012-09-19 | 刘广松 | User interaction system and method |
| CN103095927A (en) * | 2013-02-06 | 2013-05-08 | 吴玉胜 | Displaying and voice outputting method and system based on mobile communication terminal and glasses |
| CN103226443A (en) * | 2013-04-02 | 2013-07-31 | 百度在线网络技术（北京）有限公司 | Method and device for controlling intelligent glasses and intelligent glasses |
| CN103281181A (en) * | 2013-04-27 | 2013-09-04 | 天地融科技股份有限公司 | Conversion device and display system |
| CN103309226A (en) * | 2013-06-09 | 2013-09-18 | 深圳先进技术研究院 | Smart watch assorted with smart glasses |
| CN103631503A (en) * | 2013-11-15 | 2014-03-12 | 北京智谷睿拓技术服务有限公司 | Information interaction method and information interaction device |
| CN103777746A (en) * | 2012-10-23 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Human-machine interactive method, terminal and system |
| CN103998970A (en) * | 2011-12-16 | 2014-08-20 | 索尼公司 | Head-mounted display and information display apparatus |
| CN105183175A (en) * | 2015-10-23 | 2015-12-23 | 周维 | Wearable communication equipment |
| CN105874785A (en) * | 2013-11-04 | 2016-08-17 | At&T知识产权部有限合伙公司 | System and method for enabling mirror video chat using wearable display device |
| CN106415510A (en) * | 2014-05-30 | 2017-02-15 | 三星电子株式会社 | Data processing method and electronic device thereof |
| CN107193381A (en) * | 2017-05-31 | 2017-09-22 | 湖南工业大学 | A kind of intelligent glasses and its display methods based on eyeball tracking sensing technology |
| CN110060537A (en) * | 2019-03-22 | 2019-07-26 | 珠海超凡视界科技有限公司 | A kind of virtual reality drives training device and its man-machine interaction method |
-
2007
- 2007-03-13 CN CNA2007800180055A patent/CN101449265A/en active Pending
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102681651A (en) * | 2011-03-07 | 2012-09-19 | 刘广松 | User interaction system and method |
| CN102681651B (en) * | 2011-03-07 | 2016-03-23 | 刘广松 | A kind of user interactive system and method |
| CN102306059A (en) * | 2011-08-10 | 2012-01-04 | 电子科技大学 | Universal remote controller based on touch control input for handheld digital television |
| CN103998970A (en) * | 2011-12-16 | 2014-08-20 | 索尼公司 | Head-mounted display and information display apparatus |
| CN103777746B (en) * | 2012-10-23 | 2018-03-13 | 腾讯科技（深圳）有限公司 | A kind of man-machine interaction method, terminal and system |
| CN103777746A (en) * | 2012-10-23 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Human-machine interactive method, terminal and system |
| CN103095927A (en) * | 2013-02-06 | 2013-05-08 | 吴玉胜 | Displaying and voice outputting method and system based on mobile communication terminal and glasses |
| CN103226443A (en) * | 2013-04-02 | 2013-07-31 | 百度在线网络技术（北京）有限公司 | Method and device for controlling intelligent glasses and intelligent glasses |
| CN103281181A (en) * | 2013-04-27 | 2013-09-04 | 天地融科技股份有限公司 | Conversion device and display system |
| WO2014173216A1 (en) * | 2013-04-27 | 2014-10-30 | 天地融科技股份有限公司 | Conversion device and display system |
| CN103281181B (en) * | 2013-04-27 | 2016-09-14 | 天地融科技股份有限公司 | Conversion equipment and display system |
| CN103309226A (en) * | 2013-06-09 | 2013-09-18 | 深圳先进技术研究院 | Smart watch assorted with smart glasses |
| CN103309226B (en) * | 2013-06-09 | 2016-05-11 | 深圳先进技术研究院 | The intelligent watch that coordinates intelligent glasses to use |
| CN105874785A (en) * | 2013-11-04 | 2016-08-17 | At&T知识产权部有限合伙公司 | System and method for enabling mirror video chat using wearable display device |
| CN103631503A (en) * | 2013-11-15 | 2014-03-12 | 北京智谷睿拓技术服务有限公司 | Information interaction method and information interaction device |
| CN103631503B (en) * | 2013-11-15 | 2017-12-22 | 北京智谷睿拓技术服务有限公司 | Information interacting method and information interactive device |
| CN106415510A (en) * | 2014-05-30 | 2017-02-15 | 三星电子株式会社 | Data processing method and electronic device thereof |
| US10365882B2 (en) | 2014-05-30 | 2019-07-30 | Samsung Electronics Co., Ltd. | Data processing method and electronic device thereof |
| CN106415510B (en) * | 2014-05-30 | 2020-03-13 | 三星电子株式会社 | Data processing method and electronic equipment thereof |
| CN105183175A (en) * | 2015-10-23 | 2015-12-23 | 周维 | Wearable communication equipment |
| CN105183175B (en) * | 2015-10-23 | 2018-03-23 | 周维 | Wearable communication apparatus |
| CN107193381A (en) * | 2017-05-31 | 2017-09-22 | 湖南工业大学 | A kind of intelligent glasses and its display methods based on eyeball tracking sensing technology |
| CN110060537A (en) * | 2019-03-22 | 2019-07-26 | 珠海超凡视界科技有限公司 | A kind of virtual reality drives training device and its man-machine interaction method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101449265A (en) | Mobile global virtual browser with heads-up display for browsing and interacting with the World Wide Web | |
| US20070220108A1 (en) | Mobile global virtual browser with heads-up display for browsing and interacting with the World Wide Web | |
| TWI581178B (en) | User controlled real object disappearance in a mixed reality display | |
| Höllerer et al. | Mobile augmented reality | |
| US9390561B2 (en) | Personal holographic billboard | |
| CN102812417B (en) | The wireless hands-free with the detachable accessory that can be controlled by motion, body gesture and/or verbal order calculates headset | |
| KR100836481B1 (en) | System and method for advertising position and behavior information of the avatar object of the user in 3D virtual reality map to real world | |
| Litvak et al. | Enhancing cultural heritage outdoor experience with augmented-reality smart glasses | |
| US8860787B1 (en) | Method and apparatus for telepresence sharing | |
| KR20120000418A (en) | Mobile terminal and operation method thereof | |
| CN107329268A (en) | A kind of utilization AR glasses realize the shared method in sight spot | |
| CN105898694A (en) | Method used for positioning and information interaction, head-mounted visual device and server | |
| CN107277450A (en) | A kind of utilization AR realizes the method and apparatus of the live disaster relief of remote command | |
| CN111131904B (en) | Video playing method and head-mounted electronic equipment | |
| JP2016200884A (en) | Sightseeing customer invitation system, sightseeing customer invitation method, database for sightseeing customer invitation, information processor, communication terminal device and control method and control program therefor | |
| KR20110028902A (en) | Method for providing inforamtion related to navigation in mobile terminal and mobile terminal thereof | |
| US11074034B2 (en) | Information processing apparatus, information processing method, and program | |
| JP6828235B2 (en) | Head-mounted display device, how to share the display of the head-mounted display device, computer program | |
| Nack | Add to the Real [Media Beat] | |
| Tankeu et al. | Augmented Reality Navigation | |
| JP6619539B2 (en) | Information management system and information management method | |
| da Silva et al. | M-Traveling: Experiences using mobile applications in tourism | |
| KR102294362B1 (en) | The method for providing realistication contents in xtended reality space and system thereof | |
| JP6698240B2 (en) | Information management system, information management server, information management method, and program | |
| JP2017208070A (en) | Information sharing system, information sharing method, terminal device, and information processing program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20090603 |