CN105892627A - Virtual augmented reality method and apparatus, and eyeglass or helmet using same - Google Patents
Virtual augmented reality method and apparatus, and eyeglass or helmet using same Download PDFInfo
- Publication number
- CN105892627A CN105892627A CN201510146099.0A CN201510146099A CN105892627A CN 105892627 A CN105892627 A CN 105892627A CN 201510146099 A CN201510146099 A CN 201510146099A CN 105892627 A CN105892627 A CN 105892627A
- Authority
- CN
- China
- Prior art keywords
- virtual
- main frame
- virtual world
- brain wave
- brain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention discloses a virtual augmented reality method. The method comprises the steps that monitored human brain waves are transmitted to a host 1 by using a brain wave monitoring module, and an encoding/decoding module and an analysis module in the host 1 process the human brain waves, and execute a corresponding instruction, so as to operate a virtual computer or mobile phone or control a person or object in a virtual world. The present invention further discloses a virtual augmented reality apparatus. The apparatus comprises: a pair of eyeglasses or a helmet, a host (a mobile phone system, a CPU, a GPU, an ROM, an RAM, a hard disk, an external memory, Bluetooth, a wireless connection, a gyroscope, a sensor, a battery), a microphone, a loudspeaker, a brain wave monitor, a camera, and a projector. By means of a sensory game, virtual reality and a brain computer interface technology, the computer or mobile phone can be operated by thoughts, characters can be input by thoughts, the person or object in the virtual world can be controlled by thoughts and the like.
Description
Technical field
The present invention relates to mobile device technology, electronic technology and field of computer technology, particularly relate to the method and apparatus of a kind of virtual exceeding reality and use its glasses or the helmet.
Technical background
Along with mobile technology, electronic technology, the development of computer technology, only it is used for glasses and the helmet worn in the past, now function gets more and more, as being connected with internet by smart mobile phone or home network, can realize search, note, take pictures, image, the function such as social activity is shared, virtual reality
There is a lot of problem in intelligent glasses and the helmet at present in operation convenience, agility, such as utilizes intelligent glasses or the helmet cannot realize by brain or idea and operates.
Summary of the invention
In view of this, the present invention proposes the method and apparatus of a kind of virtual exceeding reality and uses its glasses or the helmet, to solve the problems referred to above.
For reaching above-mentioned purpose, the technical scheme of embodiments of the invention is achieved in that
A kind of method of virtual exceeding reality, it is characterized in that, utilize brain wave monitoring modular 3 that human body electroencephalogram's ripple of monitoring is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform command adapted thereto, operate virtual computer and mobile phone, or control the people in virtual world or thing, including:
A1, main frame 1 start corresponding software, show virtual world, pass to projecting apparatus or display screen 5, projecting apparatus or display screen 5 and project or show all visual angles covering human eye.
A2, want to generate or cancel the eeg signal of virtual computer and mobile phone when brain wave monitoring modular 3 receives human brain, it is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform to generate or cancel the instruction of virtual computer and mobile phone；Corresponding can also move or scaling computer and mobile phone.
A3, want to operate the eeg signal of virtual computer and mobile phone when brain wave monitoring modular 3 receives human brain, be transferred to main frame 1, by coding/decoding module in main frame 1, analyze module and process, and perform command adapted thereto；As wanted to open certain software or website；Or carry out page turning, certain character etc. on certain button or dummy keyboard is clicked in hand-written, slip, screen sliding, selection.
A4, want to input the eeg signal of certain character or passage when brain wave monitoring modular 3 receives human brain, be transferred to main frame 1, by coding/decoding module in main frame 1, analyze module and process, and perform respective symbols or the instruction of passage input；Such as brain wave monitoring modular receives eeg signal, consistent with thinking the brain wave codec signal that input " I " or " I Love You " sends after carrying out encoding and decoding and analyzing, main frame directly perform input " I " or the instruction of " I Love You ".
A5, want to enter into the eeg signal of virtual world when brain wave monitoring modular 3 receives human brain, it is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform command adapted thereto virtual world call in selection virtual portrait role or by human body three-dimensional scanning generate its virtual portrait role, controlled the limb action of virtual world character role by human body electroencephalogram's ripple, projecting apparatus or display screen 5 show that picture is the first person.
A6, when brain wave monitoring modular 3 receives human brain because the eeg signal that produces of body kinematics, be transferred to main frame 1, by coding/decoding module in main frame 1, analyze module and process, and perform command adapted thereto, make virtual portrait role make corresponding action；Such as brain wave monitoring modular receives eeg signal, stretch the bent right hand after carrying out encoding and decoding and analyzing with human body or brain wave codec signal that percussion right hand forefinger human brain sends is consistent, performed to allow virtual portrait role make by main frame 1 stretch the bent right hand or tap the action of right hand forefinger, the corresponding eeg signal that can also select to be produced by idea controls virtual portrait role, the eeg signal that the eeg signal priority that body kinematics produces produces higher than idea
A7, brain wave monitoring modular 3 receive human brain and want to control the computer in virtual world physical manipulation virtual world or the eeg signal of mobile phone, it is transferred to main frame 1, by main frame 1 coding/decoding module, analyze resume module, control the computer in the physical manipulation virtual world of virtual world or mobile phone, processed by computer or mobile phone operation software, dummy keyboard software and other corresponding software, transmit a signal to the cell phone system in main frame 1 or main frame 1 again process, it is achieved brain wave controls the computer in virtual world physical manipulation virtual world or mobile phone.
A8, received by brain wave monitoring modular 3 human brain eeg signal control virtual world character role, this character is the virtual portrait role by human body carries out 3D anthropometric scanning technology generation, two people or many people can occur in same virtual world by network, the people of reality and different location carries out face-to-face exchange living with real world.
A9, want to control the eeg signal that the idea how to move of certain object of virtual world produces when brain wave monitoring modular 3 receives human brain, it is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform command adapted thereto, make the corresponding object of virtual world make the motion of correspondence；Such as aloft flown by the idea of oneself or mobile by the object in idea virtual world to be allowed, brain wave monitoring modular 3 receives the brain wave of such idea, it is transferred to coding/decoding module in main frame 1, analyzes resume module, main frame performs its instruction, allows the object in virtual world aloft by corresponding track flight or mobile.
The embodiment of the invention also discloses the device of a kind of virtual exceeding reality, it is characterized in that, human body eeg signal is received by brain wave monitoring modular 3, it is transferred to coding/decoding module in main frame 1 process, signal after being processed by coding/decoding module is transferred to analyze resume module, then the signal analyzing resume module is transferred to main frame 1 and is performed.Can realize by brain wave operating computer and mobile phone, and by the people of brain wave operation virtual world or thing, carry out character input by brain wave.
Described device has a phone, search, note, take pictures, image, the function such as social activity is shared, the operation of virtual reality, somatic sensation television game, brain wave, idea input.
Accompanying drawing explanation
The present invention will be further described in detail below in conjunction with the accompanying drawings.
Fig. 1 is the structural representation of the present invention；
In figure: 1 is main frame (cell phone system, CPU, GPU, ROM, RAM, hard disk, external memory storage, bluetooth, wireless connection, gyroscope, sensor, battery etc.), 2 is loudspeaker, 3 brain wave monitoring modulars, and 4 is laser and camera, 5 is projecting apparatus or display screen, and 6 is Mike.
Specific embodiments
As shown in Figure 1, described device includes: glasses or the helmet, main frame 1 (cell phone system, CPU, GPU, ROM, RAM, hard disk, external memory storage, bluetooth, wireless connection, gyroscope, sensor, battery etc.), loudspeaker 2, brain wave monitoring modular 3, laser and camera 4, projecting apparatus or display screen 5, Mike 6.
A1, described device holding state, brain wave monitoring modular 3, laser and camera 4, projecting apparatus or display screen 5 be closed, and main frame is in holding state, and which function holding state opens can be arranged；Described device is at holding state, if any incoming call, will start voice or brain wave monitoring modular 3 function；Receive: answer instruction, connect phone；Receive: hang up instruction, hang up the telephone；Receiving: start-up command, open projecting apparatus or display screen 5, virtual world screen can show cell phone incoming call information, and the health controlled in virtual world by eeg signal is operated, it is also possible to carry out button or touch operation.
Two projecting apparatus or display screen 5 on a2, glasses or the helmet connect main frame 1, are projected by virtual world or are shown on eyes；
A3, brain wave monitoring modular 3 obtain human body electroencephalogram's ripple signal, send to the coding/decoding module in main body, analyze module process, control people and the thing of virtual world.
The method of virtual exceeding reality, it is characterized in that, utilize brain wave monitoring modular 3 that human body electroencephalogram's ripple of monitoring is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform command adapted thereto, operate virtual computer and mobile phone, or control the people in virtual world or thing, including:
A1, main frame 1 start corresponding software, show virtual world, pass to projecting apparatus or display screen 5, projecting apparatus or display screen 5 and project or the aobvious all visual angles regarding covering human eye.
A2, want to generate or cancel the eeg signal of virtual computer and mobile phone when brain wave monitoring modular 3 receives human brain, it is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform to generate or cancel the instruction of virtual computer and mobile phone；Corresponding can also move or scaling computer and mobile phone.
A3, want to operate the eeg signal of virtual computer and mobile phone when brain wave monitoring modular 3 receives human brain, be transferred to main frame 1, by coding/decoding module in main frame 1, analyze module and process, and perform command adapted thereto；As wanted to open certain software or website；Or carry out page turning, certain character etc. on certain button or dummy keyboard is clicked in hand-written, slip, screen sliding, selection.
A4, want to input the eeg signal of certain character or passage when brain wave monitoring modular 3 receives human brain, be transferred to main frame 1, by coding/decoding module in main frame 1, analyze module and process, and perform respective symbols or the instruction of passage input；Such as brain wave monitoring modular 3 receives eeg signal, consistent with thinking the brain wave codec signal that input " I " or " I Love You " sends after carrying out encoding and decoding and analyzing, main frame directly perform input " I " or the instruction of " I Love You ".
A5, want to enter into the eeg signal of virtual world when brain wave monitoring modular 3 receives human brain, it is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform command adapted thereto virtual world call in selection virtual portrait role or by human body three-dimensional scanning generate its virtual portrait role, controlled the limb action of virtual world character role by human body electroencephalogram's ripple, projecting apparatus or display screen 5 show that picture is the first person.
A6, when brain wave monitoring modular 3 receives human brain because the eeg signal that produces of body kinematics, be transferred to main frame 1, by coding/decoding module in main frame 1, analyze module and process, and perform command adapted thereto, make virtual portrait role make corresponding action；Such as brain wave monitoring modular 3 receives eeg signal, stretch the bent right hand after carrying out encoding and decoding and analyzing with human body or brain wave codec signal that percussion right hand forefinger human brain sends is consistent, performed to allow virtual portrait role make by main frame 1 stretch the bent right hand or tap the action of right hand forefinger, the corresponding eeg signal that can also select to be produced by idea controls virtual portrait role, the eeg signal that the eeg signal priority that body kinematics produces produces higher than idea
A7, brain wave monitoring modular 3 receive human brain and want to control the computer in virtual world physical manipulation virtual world or the eeg signal of mobile phone, it is transferred to main frame 1, by main frame 1 coding/decoding module, analyze resume module, control the computer in the physical manipulation virtual world of virtual world or mobile phone, processed by computer or mobile phone operation software, dummy keyboard software and other corresponding software, transmit a signal to the cell phone system in main frame 1 or main frame 1 again process, it is achieved brain wave controls the computer in virtual world physical manipulation virtual world or mobile phone.
A8, received by brain wave monitoring modular 3 human brain eeg signal control virtual world character role, this character is the virtual portrait role by human body carries out 3D anthropometric scanning technology generation, two people or many people can occur in same virtual world by network, the people of reality and different location carries out face-to-face exchange living with real world.
A9, brain wave monitoring modular 3 receive human brain and want to control the eeg signal of the idea generation how certain object of virtual world moves, it is transferred to main frame 1, processed by coding/decoding module, analysis module in main frame 1, and perform command adapted thereto, make the corresponding object of virtual world make the motion of correspondence；Such as aloft flown by the idea of oneself or mobile by the object in idea virtual world to be allowed, brain wave monitoring modular 3 receives the brain wave of such idea, it is transferred to coding/decoding module in main frame 1, analyzes resume module, main frame performs its instruction, allows the object in virtual world aloft by corresponding track flight or mobile.
Claims (8)
1. the method for a virtual exceeding reality, it is characterised in that utilize brain wave monitoring modular 3 by human body electroencephalogram's ripple of monitoring
It is transferred to main frame, coding/decoding module, analysis module in main frame processes, the signal of process is transferred to main frame 1 and by leading
Machine 1 performs corresponding instruction, operates virtual computer and mobile phone, or controls the people in virtual world or thing.
The method of virtual exceeding reality the most according to claim 1, it is characterised in that brain wave monitoring modular 3 receives
Human brain wants to operate the eeg signal of virtual computer and mobile phone, is transferred to main frame 1, by coding/decoding module in main frame 1,
Analyze module to process, and perform command adapted thereto, as wanted to open certain software or website；Or carry out page turning, hand-written, slide,
Certain character etc. on screen sliding, selection certain button of click or dummy keyboard.
The method of virtual exceeding reality the most according to claim 1, it is characterised in that brain wave monitoring modular 3 receives
Human brain wants to input the eeg signal of certain character or passage, is transferred to main frame 1, by encoding and decoding mould in main frame 1
Block, analysis module process, and perform respective symbols or the instruction of passage input.
The method of virtual exceeding reality the most according to claim 1, it is characterised in that when brain wave monitoring modular 3 receives
To human brain because the eeg signal that produces of the idea how body kinematics or want moves, it is transferred to main frame 1, by main frame 1
Middle coding/decoding module, analysis module process, and perform command adapted thereto, make virtual portrait role make corresponding action.
The method of virtual exceeding reality the most according to claim 1, it is characterised in that connect by brain wave monitoring modular 3
Receiving human brain eeg signal and control virtual world character role, this character is by human body is carried out 3D anthropometric scanning
The virtual portrait role that technology generates, two people or many people can occur in same virtual world by network, real and different
The people in place carries out face-to-face exchange living with real world.
The method of virtual exceeding reality the most according to claim 1, it is characterised in that brain wave monitoring modular 3 receives
Human brain wants to control the eeg signal of the idea generation how certain object of virtual world moves, and is transferred to main frame 1, by
In main frame 1, coding/decoding module, analysis module process, and perform command adapted thereto, make the corresponding object of virtual world make right
The motion answered.
The method of virtual exceeding reality the most according to claim 1, it is characterised in that brain wave monitoring modular 3 receives
Human brain is wanted to control the computer in virtual world physical manipulation virtual world or the eeg signal of mobile phone, is transferred to main frame 1,
By main frame 1 coding/decoding module, analyze resume module, control the computer in the physical manipulation virtual world of virtual world or mobile phone,
Processed by computer or mobile phone operation software, dummy keyboard software and other corresponding software, then transmit a signal to main frame 1
Or the cell phone system in main frame 1 processes, it is achieved brain wave controls the computer in virtual world physical manipulation virtual world or mobile phone.
8. the device of a virtual exceeding reality, it is characterised in that described device includes: glasses or the helmet, main frame 1 (mobile phone
System, CPU, GPU, ROM, RAM, hard disk, external memory storage, bluetooth, wireless connection, gyroscope, sensor, battery
Deng), loudspeaker 2, brain wave monitoring modular 3, laser and camera 4, projecting apparatus or display screen 5, Mike 6；By brain electricity
Ripple monitoring modular 3 receives human body eeg signal, is transferred to coding/decoding module in main frame 1 and processes, after being processed by coding/decoding module
Signal be transferred to analyze resume module, then the signal analyzing resume module is transferred to main frame 1 performs.Can realize passing through brain
Electric wave operating computer and mobile phone, and people or the thing of virtual world is operated by brain wave, carry out character input by idea.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510146099.0A CN105892627A (en) | 2015-03-28 | 2015-03-28 | Virtual augmented reality method and apparatus, and eyeglass or helmet using same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510146099.0A CN105892627A (en) | 2015-03-28 | 2015-03-28 | Virtual augmented reality method and apparatus, and eyeglass or helmet using same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105892627A true CN105892627A (en) | 2016-08-24 |
Family
ID=57002629
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510146099.0A Pending CN105892627A (en) | 2015-03-28 | 2015-03-28 | Virtual augmented reality method and apparatus, and eyeglass or helmet using same |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105892627A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107357416A (en) * | 2016-12-30 | 2017-11-17 | 长春市睿鑫博冠科技发展有限公司 | A kind of human-computer interaction device and exchange method |
| CN108509034A (en) * | 2018-03-16 | 2018-09-07 | 广东欧珀移动通信有限公司 | Electronic device, information processing method and related product |
| CN108498094A (en) * | 2018-03-29 | 2018-09-07 | 广东欧珀移动通信有限公司 | Brain wave information transmission and control method and Related product |
| CN108970109A (en) * | 2018-06-21 | 2018-12-11 | 珠海金山网络游戏科技有限公司 | A kind of methods, devices and systems based on idiodynamic reality-virtualizing game |
| CN109567992A (en) * | 2018-12-10 | 2019-04-05 | 长春理工大学 | Body's consciousness controls books automatic page turning system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130288761A1 (en) * | 2011-01-04 | 2013-10-31 | Marta Isabel Santos Paiva Ferraz Conceicao | Interactive wearable videogame through the use of wireless electronic sensors and physical objects |
| CN103777636A (en) * | 2014-01-24 | 2014-05-07 | 浙江大学 | Idiodynamic video trolley system based on wifi communication |
| CN103955269A (en) * | 2014-04-09 | 2014-07-30 | 天津大学 | Intelligent glass brain-computer interface method based on virtual real environment |
| CN104281260A (en) * | 2014-06-08 | 2015-01-14 | 朱金彪 | Method and device for operating computer and mobile phone in virtual world and glasses adopting method and device |
-
2015
- 2015-03-28 CN CN201510146099.0A patent/CN105892627A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130288761A1 (en) * | 2011-01-04 | 2013-10-31 | Marta Isabel Santos Paiva Ferraz Conceicao | Interactive wearable videogame through the use of wireless electronic sensors and physical objects |
| CN103777636A (en) * | 2014-01-24 | 2014-05-07 | 浙江大学 | Idiodynamic video trolley system based on wifi communication |
| CN103955269A (en) * | 2014-04-09 | 2014-07-30 | 天津大学 | Intelligent glass brain-computer interface method based on virtual real environment |
| CN104281260A (en) * | 2014-06-08 | 2015-01-14 | 朱金彪 | Method and device for operating computer and mobile phone in virtual world and glasses adopting method and device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107357416A (en) * | 2016-12-30 | 2017-11-17 | 长春市睿鑫博冠科技发展有限公司 | A kind of human-computer interaction device and exchange method |
| CN108509034A (en) * | 2018-03-16 | 2018-09-07 | 广东欧珀移动通信有限公司 | Electronic device, information processing method and related product |
| CN108509034B (en) * | 2018-03-16 | 2021-05-11 | Oppo广东移动通信有限公司 | Electronic device, information processing method and related product |
| CN108498094A (en) * | 2018-03-29 | 2018-09-07 | 广东欧珀移动通信有限公司 | Brain wave information transmission and control method and Related product |
| CN108498094B (en) * | 2018-03-29 | 2021-06-01 | Oppo广东移动通信有限公司 | Brain wave information transmission control method and related product |
| CN108970109A (en) * | 2018-06-21 | 2018-12-11 | 珠海金山网络游戏科技有限公司 | A kind of methods, devices and systems based on idiodynamic reality-virtualizing game |
| CN109567992A (en) * | 2018-12-10 | 2019-04-05 | 长春理工大学 | Body's consciousness controls books automatic page turning system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020203999A1 (en) | Communication assistance system, communication assistance method, and image control program | |
| CN105320262A (en) | Method and apparatus for operating computer and mobile phone in virtual world and glasses thereof | |
| CN102789313B (en) | User interaction system and method | |
| CN102779000B (en) | User interaction system and method | |
| US10162594B2 (en) | Information processing device, method of information processing, and program | |
| CN102681651B (en) | A kind of user interactive system and method | |
| CN105892627A (en) | Virtual augmented reality method and apparatus, and eyeglass or helmet using same | |
| CN103019377A (en) | Head-mounted visual display equipment-based input method and device | |
| CN106527678B (en) | A kind of social interactive device, system and the head-mounted display apparatus of mixed reality | |
| CN110688910B (en) | Method for realizing wearable human body basic gesture recognition | |
| CN105451090B (en) | Image processing method and image processing apparatus | |
| CN108898058A (en) | The recognition methods of psychological activity, intelligent necktie and storage medium | |
| Nijholt | Capturing obstructed nonverbal cues in augmented reality interactions: a short survey | |
| CN109144176A (en) | Display screen interactive display method, terminal and storage medium in virtual reality | |
| Powell et al. | Towards thought control of next-generation wearable computing devices | |
| KR20190123245A (en) | Eye training apparatus using focus enlargement and reduction | |
| CN110199244B (en) | Information processing apparatus, information processing method, and program | |
| CN109032350A (en) | Spinning sensation mitigates method, virtual reality device and computer readable storage medium | |
| CN210109744U (en) | Head-mounted alternating current device and head-mounted alternating current system | |
| US11328187B2 (en) | Information processing apparatus and information processing method | |
| Hussein | Wearable computing: Challenges of implementation and its future | |
| CN107783639A (en) | Virtual reality leisure learning system | |
| KR20210070119A (en) | Meditation guide system using smartphone front camera and ai posture analysis | |
| CN214097971U (en) | AR glasses system based on wireless Bluetooth transmission protocol | |
| CN112437226B (en) | Image processing method, apparatus and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160824 |
|
| RJ01 | Rejection of invention patent application after publication |