CN107272891A - A kind of the intelligent display helmet and its display methods including display system - Google Patents
A kind of the intelligent display helmet and its display methods including display system Download PDFInfo
- Publication number
- CN107272891A CN107272891A CN201710397387.2A CN201710397387A CN107272891A CN 107272891 A CN107272891 A CN 107272891A CN 201710397387 A CN201710397387 A CN 201710397387A CN 107272891 A CN107272891 A CN 107272891A
- Authority
- CN
- China
- Prior art keywords
- module
- display
- helmet
- mobile terminal
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of intelligent display helmet, the inner helmet includes the cavity for place system module, the system module includes processing module, wireless transport module for connecting mobile terminal device, display module, movement sensing module and eye recognition module, the display module includes symmetrical left eye display screen and right eye display screen, the left eye display screen and right eye display screen are optical glasses, the eye recognition module is electrically connected with processing module, the processing module respectively with movement sensing module, display module and wireless transport module electrical connection, the present invention receives control command message by the intelligent display helmet, by control command message transmission to mobile terminal device, mobile terminal device receives control message and performs order, control of the experiencer for virtual reality system can be realized, simplify some complicated interaction flows.
Description
Technical field
The invention belongs to technical field of virtual reality, more particularly, to a kind of intelligent display head including display system
Helmet and its display methods.
Background technology
As big screen intelligent mobile phone, intelligent television, HDTV etc. are progressively popularized, computer graphics techniques, human-machine interface
It has been shown that, algorithm, the development of interaction technique of the virtual reality such as mouth, Radio Transmission Technology core technology and VR equipment.Give VR skills
The lifting of art brings significant impact.Virtual reality is also known as virtual reality.It is to produce a three dimensions using computer simulation
Virtual world, and vision, the sense of hearing, the tactile of analog subscriber etc. make user produce sensation on the spot in person.Should in virtual reality
In scene, usual user tracks the various motions on head using various sensors by wearing virtual implementing helmet, warp
Cross behavior interpreter and produce behavioral data, be then input in virtual environment, interacted with user.
Current virtual reality display device is needed to access additional video input apparatus mostly, and the mode of connection is used mostly
Wired connection, the method for this connection has fettered the scope of activities of people so that experiencer can not arbitrarily walk about, and greatly affected
The comfort level of experiencer and real virtual experience, therefore take one kind can be for instruments such as mobile phone, flat boards, by its network signal
It is transferred to intelligent display device to be watched, such consumer, which can take glasses and directly carry out mobile phone, platform information, to be browsed, from
And realize the great target of " overturning race of bowing ".
The content of the invention
In order to overcome the defect nuclear issue of prior art, the present invention devises a kind of intelligent display head including display system
Helmet and its display methods.
Technical scheme is as follows:
A kind of intelligent display helmet, the inner helmet includes the cavity for place system module, and the system module includes
Processing module, for connecting mobile terminal device communication module, display module, movement sensing module, eye recognition module and nothing
Line transport module, the display module includes symmetrical left eye display screen and right eye display screen, the left eye display screen and right eye
Display screen is optical glasses, and the eye recognition module is electrically connected with processing module, the processing module respectively with motion-sensing
Module, display module and communication module electrical connection, the wireless transport module are electrically connected with communication module.
Further, the intelligent display helmet also includes power module and opened for the power supply for controlling the helmet to start or close
Close.
Further, the intelligent display helmet also includes memory modules, and the memory modules are DDR double-speed internal memories.
Further, the processor includes GPU and cpu chip.
Further, the wireless transport module includes WiFi module and/or bluetooth module.
Further, the movement sensing module be nine axle sensors, including gyro sensor, geomagnetic sensor and add
The one or more of velocity sensor;Angle of rotation when gyroscope in movement sensing module can detect user's deflection, tilt
The change of speed, as a kind of judgment mode of control instruction, the changes of magnetic field of geomagnetic sensors detection user can be to accelerating
Degree sensor or angular-rate sensor enter line displacement correction, to cause the result of sensing more accurate, so that when user's rotary head
Amplitude and speed can do some simple command informations.
Further, the mobile terminal device includes mobile phone or tablet personal computer.
Include the display system of the intelligent display helmet, in addition to mobile terminal device and use the invention provides a kind of
It is responsible for rendering virtual reality scenario and the execution method of various control commands in the configuration processor of write-in and the cloud of discrimination method is put down
Platform service module, the mobile terminal device and cloud platform service module are connected with the helmet by wireless transport module.
Present invention also offers a kind of intelligent display method based on the display system, by based on the virtual reality
The helmet receives the control command message generated from control device, by the control command message transmission to mobile terminal, mobile
End receives control message and performs order, can realize control of the experiencer for virtual reality system, simplifies some complicated
Interaction flow, and abandoned conventional various cable control systems.
Specifically include following steps:
The first step, local area network platform is built by Wi-Fi, is set the intelligent display helmet and mobile terminal by wireless transport module
It is standby to set up connection;In the case where selecting a kind of communication protocol, start mobile phone mobile terminal and virtual implementing helmet, in Wi-Fi LAN
Under pattern, mobile phone mobile terminal and virtual implementing helmet is set infinitely to be connected, now cloud platform service module will be written into advance
Various execution operational order programs, are to receive the control instruction information from virtual implementing helmet below as identification operation to make
Supported for data.
Second step, user wears the intelligent display helmet, passes through eye recognition module or movement sensing module acquisition control number
According to, and control data is converted into by control command signal by processing module, the control data is adopted including eyeball identification module
The optical data and/or motion-sensing mould for collecting user gather user's head action data soon;External control devices can also be passed through
Control command is obtained, external equipment can be that user is worn by data suit and data glove, and doing some can be programmed in advance
Action command, now the sensor of virtual reality spread over experiencer's whole body, the amount of calculation of computer, current calculating can be increased
Level can't all meet requirement, but some simple action recognitions can typically accomplish.
3rd step, control command signal is transmitted to cloud platform service module recognize by wireless transport module, and will be known
Control command signal after not is transferred to mobile terminal device;Be under control command information, will be collected into by processing module
Data message is compared in cloud platform service module, is instructed accordingly, it is achieved thereby that change of the action command to data command
Change, the program that developer is previously written in mobile terminal device, cloud platform service module is passed to by wireless transport module.
4th step, mobile terminal device performs control signal, and the result after execution is transmitted to the intelligent display helmet, intelligence
It can show that helmet processing module is transmitted after control signal is handled to display module, display module transmits display picture to left eye
Display screen and right eye display screen.
5th step, step one to four moves in circles work.
Wherein, optical data includes following several:
1. the data splitting of user's number of winks, frequency of wink and Rotation of eyeball frequency;
2. user's number of winks and frequency of wink data splitting;
3. the data splitting of frequency of wink and Rotation of eyeball frequency;
4. the data splitting of user's number of winks and Rotation of eyeball frequency;
5. user's number of winks;
6. frequency of wink;
7. Rotation of eyeball frequency;
Head movement data include following several:
1. user's head tilt angle and head rotation rate combinations data;
2. user's head tilt angle;
3. head rotation speed;
Further, the optical data is the one or more of user's number of winks, frequency of wink and Rotation of eyeball frequency, institute
It is user's head tilt angle and the one or more of head rotation speed to state head movement data;Obtained using eye recognition module
Control command message is taken, the number of times and frequency blinked in the range of the regular hour to user are acquired, pass through different times
Number and frequency discrimination go out different control instructions, can also gather user eyeball number of revolutions to obtain different control instructions.
The present invention has the beneficial effect that:
1. connected mode uses wireless connection, constraint of the cable to user is reduced, the scope of activities of people is effectively increased, side
User activity, solve the communication issue of virtual implementing helmet and wireless terminal;
2. the equipment ensures experience diversification of forms, the applied field of virtual reality products is enriched by cloud platform service module
Build and contact between scape, convenient and existing mobile device;
3. in the system, experiencer does not interact directly with mobile terminal, the great target of " overturning race of bowing " is realized, letter
Control flow is changed;
4 solve the unnatural shortcoming of man-machine interaction in virtual reality at present, greatly improve the experience effect of user.
Brief description of the drawings
Fig. 1 is intelligent display helmet schematic diagram;
Fig. 2 is intelligent display headgear system module diagram;
Fig. 3 is intelligent display system schematic diagram;
Fig. 4 is intelligent display method flow chart.
Embodiment
With reference to embodiment, the present invention is further illustrated.Wherein, being given for example only property of accompanying drawing illustrates,
What is represented is only schematic diagram, rather than pictorial diagram, it is impossible to be interpreted as limitation of the present invention;In order to which the reality of the present invention is better described
Example is applied, some parts of accompanying drawing have omission, zoomed in or out, and do not represent the size of actual product;To those skilled in the art
For, some known features and its explanation may be omitted and will be understood by accompanying drawing.
Embodiment
As shown in figure 1, a kind of intelligent display helmet 1, inner helmet includes the cavity 2 and system for place system module
Module 3;
As shown in Fig. 2 system module 3 includes processing module 31, wireless transport module 32, display module 33, movement sensing module
34 and eye recognition module 35, display module 33 includes symmetrical left eye display screen 33-1 and right eye display screen 33-2, and left eye shows
Display screen 33-1 and right eye display screen 33-2 is optical glasses, and eye recognition module 35 is electrically connected with processing module 31, processing module
31 electrically connect with movement sensing module 34, display module 33 and wireless transport module 32 respectively.
Movement sensing module is nine axle sensors, including gyro sensor, geomagnetic sensor and acceleration transducer;
The change of rotational angular velocity when gyroscope in movement sensing module can detect user's deflection, tilt, is used as control instruction
A kind of judgment mode, the changes of magnetic field of geomagnetic sensors detection user can be to acceleration transducer or angular-rate sensor
Enter line displacement correction, to cause the result of sensing more accurate, so that when the amplitude and speed of user's rotary head can do some letters
Single command information.
Mobile terminal device is mobile phone.
System module also includes power module 36 and the power switch for controlling the helmet to start or close.
System module also includes memory modules 37, and memory modules 37 are DDR double-speed internal memories.
As shown in figure 3, a kind of include the display system of the intelligent display helmet 1, in addition to mobile terminal device 4 and use
It is responsible for rendering virtual reality scenario and the execution method of various control commands in the configuration processor of write-in and the cloud of discrimination method is put down
Platform service module 5, mobile terminal device 4 and cloud platform service module 5 are connected with the intelligent display helmet 1 by wireless transport module 32
Connect, wireless transport module 32 is that WiFi module and bluetooth module are used cooperatively, and the intelligent display helmet 1 and mobile terminal device 4 are adopted
Data are transmitted with bluetooth module, data are transmitted using WiFi module between the intelligent display helmet 1 and cloud platform service module 5, adopted
The mode used cooperatively with WiFi module and bluetooth module, can avoid data transmission fault.
As shown in figure 4, a kind of intelligent display method based on the display system, by being received based on the intelligent display helmet
To the control command message generated from control device, by control command message transmission to mobile terminal, mobile terminal receives control and disappeared
Cease and perform order, control of the experiencer for virtual reality system can be realized, simplify some complicated interaction flows, and
And abandoned conventional various limited control systems.
Specifically include following steps:
The first step, local area network platform is built by Wi-Fi, is set the intelligent display helmet and mobile terminal by wireless transport module
It is standby to set up connection;In the case where selecting a kind of communication protocol, start mobile phone mobile terminal and virtual implementing helmet, in Wi-Fi LAN
Under pattern, mobile phone mobile terminal and virtual implementing helmet is set infinitely to be connected, now cloud platform service module will be written into advance
Various execution operational order programs, are to receive the control instruction information from virtual implementing helmet below as identification operation to make
Supported for data.
Second step, user wears the intelligent display helmet, passes through eye recognition module or movement sensing module acquisition control number
According to, and control data is converted into by control command signal by processing module, control data includes eyeball identification module and gathers use
The optical data and/or motion-sensing mould at family gather user's head action data soon;It can also be obtained by external control devices
Control command, external equipment can be that user is worn by data suit and data glove, and doing some can programmed action in advance
Instruction, now the sensor of virtual reality spreads over experiencer's whole body, can increase the amount of calculation of computer, current calculated level
Requirement can't be all met, but some simple action recognitions can typically accomplish.
3rd step, control command signal is transmitted to cloud platform service module recognize by wireless transport module, and will be known
Control command signal after not is transferred to mobile terminal device;Be under control command information, will be collected into by processing module
Data message is compared in cloud platform service module, is instructed accordingly, it is achieved thereby that change of the action command to data command
Change, the program that developer is previously written in mobile terminal device, cloud platform service module is passed to by wireless transport module.
4th step, mobile terminal device performs control signal, and the result after execution is transmitted to the intelligent display helmet, intelligence
Energy real helmet processing module is transmitted to display module after control signal is handled, and display module transmits display picture to left eye
Display screen and right eye display screen.
5th step, step one to four moves in circles work.
Wherein optical data is user's number of winks, and head movement data are user's head tilt angle;Known using eye
Other module obtains control command message, the number of times that user blinks is acquired in the range of the regular hour, by different
Number of times tells different control instructions.
Obviously, above-described embodiment is only intended to clearly illustrate technical scheme example, and is not
Restriction to embodiments of the present invention.For those of ordinary skill in the field, on the basis of the above description also
It can make other changes in different forms.Any modification for being made within the spirit and principles of the invention, etc.
With replacement and improvement etc., it should be included within the protection of the claims in the present invention.
Claims (9)
1. a kind of intelligent display helmet, it is characterised in that the inner helmet includes the cavity for place system module, described
System module includes processing module, the wireless transport module for connecting mobile terminal device, display module, movement sensing module
With the eye recognition module for obtaining user's optical data, the display module includes symmetrical left eye display screen and right eye is aobvious
Display screen, the left eye display screen and right eye display screen are optical glasses, and the eye recognition module is electrically connected with processing module, institute
Processing module is stated to electrically connect with movement sensing module, display module and wireless transport module respectively;The movement sensing module is
Nine axle sensors, include the one or more of gyro sensor, geomagnetic sensor and acceleration transducer;The optical data
For the one or more of user's number of winks, frequency of wink and Rotation of eyeball frequency, the head movement data are user's head
The one or more of tilt angle and head rotation speed.
2. the intelligent display helmet according to claim 1, it is characterised in that also including power module and for controlling the helmet
The power switch for starting or closing.
3. the intelligent display helmet according to claim 1, it is characterised in that also including memory modules, the memory modules
For DDR double-speed internal memories.
4. the intelligent display helmet according to claim 1, it is characterised in that the processor includes GPU and cpu chip.
5. the intelligent display helmet according to claim 1, it is characterised in that the wireless transport module includes WiFi module
And/or bluetooth module.
6. the intelligent display helmet according to claim 1, it is characterised in that the mobile terminal device includes mobile phone or flat
Plate computer.
7. one kind includes the display system of the intelligent display helmet described in claim 1 ~ 6, it is characterised in that also including mobile terminal
Equipment and configuration processor for write-in are responsible for rendering execution method and the identification side of virtual reality scenario and various control commands
The cloud platform service module of method, the mobile terminal device and cloud platform service module are connected with the helmet by wireless transport module
Connect.
8. it is a kind of based on the intelligent display method that system is shown described in claim 7, it is characterised in that to comprise the following steps:
S1. local area network platform is built by wireless transport module, it is by wireless transport module that the intelligent display helmet is whole with movement
End equipment sets up connection;
S2. user wears the intelligent display helmet, by eye recognition module or movement sensing module acquisition control data, and passes through
Control data is converted into control command signal by processing module, and the control data includes the eye that eyeball identification module gathers user
Portion's data and/or motion-sensing mould gather user's head action data soon;
S3. control command signal is transmitted to cloud platform service module by wireless transport module and recognized, and by the control after identification
Command signal processed is transferred to mobile terminal device;
S4. mobile terminal device performs control signal, and the result after execution is transmitted to the intelligent display helmet, intelligence reality head
Helmet processing module is transmitted after control signal is handled to display module, display module display picture is transmitted to left eye display screen and
Right eye display screen;
S5. step S1 ~ S4 circulation work.
9. intelligent display method according to claim 8, it is characterised in that the optical data be user's number of winks,
The one or more of frequency of wink and Rotation of eyeball frequency, the head movement data are that user's head tilt angle and head turn
The one or more of dynamic speed.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710397387.2A CN107272891A (en) | 2017-05-31 | 2017-05-31 | A kind of the intelligent display helmet and its display methods including display system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710397387.2A CN107272891A (en) | 2017-05-31 | 2017-05-31 | A kind of the intelligent display helmet and its display methods including display system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107272891A true CN107272891A (en) | 2017-10-20 |
Family
ID=60064386
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710397387.2A Pending CN107272891A (en) | 2017-05-31 | 2017-05-31 | A kind of the intelligent display helmet and its display methods including display system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107272891A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019128748A1 (en) * | 2017-12-31 | 2019-07-04 | 深圳市虚拟现实科技有限公司 | Virtual reality display device and method therefor |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104281266A (en) * | 2014-10-17 | 2015-01-14 | 栾林林 | Head-mounted display equipment |
CN205007551U (en) * | 2015-08-19 | 2016-02-03 | 深圳游视虚拟现实技术有限公司 | Human -computer interaction system based on virtual reality technology |
CN205485929U (en) * | 2016-03-28 | 2016-08-17 | 胡证翕 | Distributed virtual reality display device and system based on radio communication |
-
2017
- 2017-05-31 CN CN201710397387.2A patent/CN107272891A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104281266A (en) * | 2014-10-17 | 2015-01-14 | 栾林林 | Head-mounted display equipment |
CN205007551U (en) * | 2015-08-19 | 2016-02-03 | 深圳游视虚拟现实技术有限公司 | Human -computer interaction system based on virtual reality technology |
CN205485929U (en) * | 2016-03-28 | 2016-08-17 | 胡证翕 | Distributed virtual reality display device and system based on radio communication |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019128748A1 (en) * | 2017-12-31 | 2019-07-04 | 深圳市虚拟现实科技有限公司 | Virtual reality display device and method therefor |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105915990B (en) | Virtual reality helmet and using method thereof | |
US6685566B2 (en) | Compound reality presentation apparatus, method therefor, and storage medium | |
CN109218648B (en) | Display control method and terminal equipment | |
CN103310186A (en) | Method for correcting user's gaze direction in image, machine-readable storage medium and communication terminal | |
CN104428732A (en) | Multimodal interaction with near-to-eye display | |
CN103197757A (en) | Immersion type virtual reality system and implementation method thereof | |
CN103458184A (en) | Method for carrying out long-range control on pan-tilt with cell phone | |
CN105739703A (en) | Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment | |
CN107193381A (en) | A kind of intelligent glasses and its display methods based on eyeball tracking sensing technology | |
CN110637274B (en) | Information processing apparatus, information processing method, and program | |
CN103179278A (en) | Method and device for controlling screen to rotate | |
CN110825333A (en) | Display method, display device, terminal equipment and storage medium | |
CN108108018A (en) | Commanding and training method, equipment and system based on virtual reality | |
CN106937143A (en) | The control method for playing back and device and equipment of a kind of virtual reality video | |
WO2017061890A1 (en) | Wireless full body motion control sensor | |
CN105892627A (en) | Virtual augmented reality method and apparatus, and eyeglass or helmet using same | |
CN107272891A (en) | A kind of the intelligent display helmet and its display methods including display system | |
CN207037598U (en) | A kind of intelligent display helmet and its display system | |
KR20200075773A (en) | Systems and methods for providing haptic effects based on a user's motion or environment | |
CN106200911A (en) | A kind of motion sensing control method based on dual camera, mobile terminal and system | |
CN107844197A (en) | Virtual reality scenario display methods and equipment | |
Park et al. | Low-latency interactive sensing for machine vision | |
CN106200923A (en) | The control method of a kind of virtual reality system and device | |
CN207037599U (en) | A kind of intelligent glasses based on eyeball tracking sensing technology | |
CN105630169A (en) | Motion input method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |