CN107272891A - A kind of the intelligent display helmet and its display methods including display system - Google Patents

A kind of the intelligent display helmet and its display methods including display system Download PDF

Info

Publication number
CN107272891A
CN107272891A CN201710397387.2A CN201710397387A CN107272891A CN 107272891 A CN107272891 A CN 107272891A CN 201710397387 A CN201710397387 A CN 201710397387A CN 107272891 A CN107272891 A CN 107272891A
Authority
CN
China
Prior art keywords
module
display
helmet
mobile terminal
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710397387.2A
Other languages
Chinese (zh)
Inventor
何静
程涛
黄良辉
张昌凡
康组超
钟云飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Nanhai Eagle View Technology Co Ltd
Hunan University of Technology
Original Assignee
Guangdong Nanhai Eagle View Technology Co Ltd
Hunan University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Nanhai Eagle View Technology Co Ltd, Hunan University of Technology filed Critical Guangdong Nanhai Eagle View Technology Co Ltd
Priority to CN201710397387.2A priority Critical patent/CN107272891A/en
Publication of CN107272891A publication Critical patent/CN107272891A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a kind of intelligent display helmet, the inner helmet includes the cavity for place system module, the system module includes processing module, wireless transport module for connecting mobile terminal device, display module, movement sensing module and eye recognition module, the display module includes symmetrical left eye display screen and right eye display screen, the left eye display screen and right eye display screen are optical glasses, the eye recognition module is electrically connected with processing module, the processing module respectively with movement sensing module, display module and wireless transport module electrical connection, the present invention receives control command message by the intelligent display helmet, by control command message transmission to mobile terminal device, mobile terminal device receives control message and performs order, control of the experiencer for virtual reality system can be realized, simplify some complicated interaction flows.

Description

A kind of the intelligent display helmet and its display methods including display system
Technical field
The invention belongs to technical field of virtual reality, more particularly, to a kind of intelligent display head including display system Helmet and its display methods.
Background technology
As big screen intelligent mobile phone, intelligent television, HDTV etc. are progressively popularized, computer graphics techniques, human-machine interface It has been shown that, algorithm, the development of interaction technique of the virtual reality such as mouth, Radio Transmission Technology core technology and VR equipment.Give VR skills The lifting of art brings significant impact.Virtual reality is also known as virtual reality.It is to produce a three dimensions using computer simulation Virtual world, and vision, the sense of hearing, the tactile of analog subscriber etc. make user produce sensation on the spot in person.Should in virtual reality In scene, usual user tracks the various motions on head using various sensors by wearing virtual implementing helmet, warp Cross behavior interpreter and produce behavioral data, be then input in virtual environment, interacted with user.
Current virtual reality display device is needed to access additional video input apparatus mostly, and the mode of connection is used mostly Wired connection, the method for this connection has fettered the scope of activities of people so that experiencer can not arbitrarily walk about, and greatly affected The comfort level of experiencer and real virtual experience, therefore take one kind can be for instruments such as mobile phone, flat boards, by its network signal It is transferred to intelligent display device to be watched, such consumer, which can take glasses and directly carry out mobile phone, platform information, to be browsed, from And realize the great target of " overturning race of bowing ".
The content of the invention
In order to overcome the defect nuclear issue of prior art, the present invention devises a kind of intelligent display head including display system Helmet and its display methods.
Technical scheme is as follows:
A kind of intelligent display helmet, the inner helmet includes the cavity for place system module, and the system module includes Processing module, for connecting mobile terminal device communication module, display module, movement sensing module, eye recognition module and nothing Line transport module, the display module includes symmetrical left eye display screen and right eye display screen, the left eye display screen and right eye Display screen is optical glasses, and the eye recognition module is electrically connected with processing module, the processing module respectively with motion-sensing Module, display module and communication module electrical connection, the wireless transport module are electrically connected with communication module.
Further, the intelligent display helmet also includes power module and opened for the power supply for controlling the helmet to start or close Close.
Further, the intelligent display helmet also includes memory modules, and the memory modules are DDR double-speed internal memories.
Further, the processor includes GPU and cpu chip.
Further, the wireless transport module includes WiFi module and/or bluetooth module.
Further, the movement sensing module be nine axle sensors, including gyro sensor, geomagnetic sensor and add The one or more of velocity sensor;Angle of rotation when gyroscope in movement sensing module can detect user's deflection, tilt The change of speed, as a kind of judgment mode of control instruction, the changes of magnetic field of geomagnetic sensors detection user can be to accelerating Degree sensor or angular-rate sensor enter line displacement correction, to cause the result of sensing more accurate, so that when user's rotary head Amplitude and speed can do some simple command informations.
Further, the mobile terminal device includes mobile phone or tablet personal computer.
Include the display system of the intelligent display helmet, in addition to mobile terminal device and use the invention provides a kind of It is responsible for rendering virtual reality scenario and the execution method of various control commands in the configuration processor of write-in and the cloud of discrimination method is put down Platform service module, the mobile terminal device and cloud platform service module are connected with the helmet by wireless transport module.
Present invention also offers a kind of intelligent display method based on the display system, by based on the virtual reality The helmet receives the control command message generated from control device, by the control command message transmission to mobile terminal, mobile End receives control message and performs order, can realize control of the experiencer for virtual reality system, simplifies some complicated Interaction flow, and abandoned conventional various cable control systems.
Specifically include following steps:
The first step, local area network platform is built by Wi-Fi, is set the intelligent display helmet and mobile terminal by wireless transport module It is standby to set up connection;In the case where selecting a kind of communication protocol, start mobile phone mobile terminal and virtual implementing helmet, in Wi-Fi LAN Under pattern, mobile phone mobile terminal and virtual implementing helmet is set infinitely to be connected, now cloud platform service module will be written into advance Various execution operational order programs, are to receive the control instruction information from virtual implementing helmet below as identification operation to make Supported for data.
Second step, user wears the intelligent display helmet, passes through eye recognition module or movement sensing module acquisition control number According to, and control data is converted into by control command signal by processing module, the control data is adopted including eyeball identification module The optical data and/or motion-sensing mould for collecting user gather user's head action data soon;External control devices can also be passed through Control command is obtained, external equipment can be that user is worn by data suit and data glove, and doing some can be programmed in advance Action command, now the sensor of virtual reality spread over experiencer's whole body, the amount of calculation of computer, current calculating can be increased Level can't all meet requirement, but some simple action recognitions can typically accomplish.
3rd step, control command signal is transmitted to cloud platform service module recognize by wireless transport module, and will be known Control command signal after not is transferred to mobile terminal device;Be under control command information, will be collected into by processing module Data message is compared in cloud platform service module, is instructed accordingly, it is achieved thereby that change of the action command to data command Change, the program that developer is previously written in mobile terminal device, cloud platform service module is passed to by wireless transport module.
4th step, mobile terminal device performs control signal, and the result after execution is transmitted to the intelligent display helmet, intelligence It can show that helmet processing module is transmitted after control signal is handled to display module, display module transmits display picture to left eye Display screen and right eye display screen.
5th step, step one to four moves in circles work.
Wherein, optical data includes following several:
1. the data splitting of user's number of winks, frequency of wink and Rotation of eyeball frequency;
2. user's number of winks and frequency of wink data splitting;
3. the data splitting of frequency of wink and Rotation of eyeball frequency;
4. the data splitting of user's number of winks and Rotation of eyeball frequency;
5. user's number of winks;
6. frequency of wink;
7. Rotation of eyeball frequency;
Head movement data include following several:
1. user's head tilt angle and head rotation rate combinations data;
2. user's head tilt angle;
3. head rotation speed;
Further, the optical data is the one or more of user's number of winks, frequency of wink and Rotation of eyeball frequency, institute It is user's head tilt angle and the one or more of head rotation speed to state head movement data;Obtained using eye recognition module Control command message is taken, the number of times and frequency blinked in the range of the regular hour to user are acquired, pass through different times Number and frequency discrimination go out different control instructions, can also gather user eyeball number of revolutions to obtain different control instructions.
The present invention has the beneficial effect that:
1. connected mode uses wireless connection, constraint of the cable to user is reduced, the scope of activities of people is effectively increased, side User activity, solve the communication issue of virtual implementing helmet and wireless terminal;
2. the equipment ensures experience diversification of forms, the applied field of virtual reality products is enriched by cloud platform service module Build and contact between scape, convenient and existing mobile device;
3. in the system, experiencer does not interact directly with mobile terminal, the great target of " overturning race of bowing " is realized, letter Control flow is changed;
4 solve the unnatural shortcoming of man-machine interaction in virtual reality at present, greatly improve the experience effect of user.
Brief description of the drawings
Fig. 1 is intelligent display helmet schematic diagram;
Fig. 2 is intelligent display headgear system module diagram;
Fig. 3 is intelligent display system schematic diagram;
Fig. 4 is intelligent display method flow chart.
Embodiment
With reference to embodiment, the present invention is further illustrated.Wherein, being given for example only property of accompanying drawing illustrates, What is represented is only schematic diagram, rather than pictorial diagram, it is impossible to be interpreted as limitation of the present invention;In order to which the reality of the present invention is better described Example is applied, some parts of accompanying drawing have omission, zoomed in or out, and do not represent the size of actual product;To those skilled in the art For, some known features and its explanation may be omitted and will be understood by accompanying drawing.
Embodiment
As shown in figure 1, a kind of intelligent display helmet 1, inner helmet includes the cavity 2 and system for place system module Module 3;
As shown in Fig. 2 system module 3 includes processing module 31, wireless transport module 32, display module 33, movement sensing module 34 and eye recognition module 35, display module 33 includes symmetrical left eye display screen 33-1 and right eye display screen 33-2, and left eye shows Display screen 33-1 and right eye display screen 33-2 is optical glasses, and eye recognition module 35 is electrically connected with processing module 31, processing module 31 electrically connect with movement sensing module 34, display module 33 and wireless transport module 32 respectively.
Movement sensing module is nine axle sensors, including gyro sensor, geomagnetic sensor and acceleration transducer; The change of rotational angular velocity when gyroscope in movement sensing module can detect user's deflection, tilt, is used as control instruction A kind of judgment mode, the changes of magnetic field of geomagnetic sensors detection user can be to acceleration transducer or angular-rate sensor Enter line displacement correction, to cause the result of sensing more accurate, so that when the amplitude and speed of user's rotary head can do some letters Single command information.
Mobile terminal device is mobile phone.
System module also includes power module 36 and the power switch for controlling the helmet to start or close.
System module also includes memory modules 37, and memory modules 37 are DDR double-speed internal memories.
As shown in figure 3, a kind of include the display system of the intelligent display helmet 1, in addition to mobile terminal device 4 and use It is responsible for rendering virtual reality scenario and the execution method of various control commands in the configuration processor of write-in and the cloud of discrimination method is put down Platform service module 5, mobile terminal device 4 and cloud platform service module 5 are connected with the intelligent display helmet 1 by wireless transport module 32 Connect, wireless transport module 32 is that WiFi module and bluetooth module are used cooperatively, and the intelligent display helmet 1 and mobile terminal device 4 are adopted Data are transmitted with bluetooth module, data are transmitted using WiFi module between the intelligent display helmet 1 and cloud platform service module 5, adopted The mode used cooperatively with WiFi module and bluetooth module, can avoid data transmission fault.
As shown in figure 4, a kind of intelligent display method based on the display system, by being received based on the intelligent display helmet To the control command message generated from control device, by control command message transmission to mobile terminal, mobile terminal receives control and disappeared Cease and perform order, control of the experiencer for virtual reality system can be realized, simplify some complicated interaction flows, and And abandoned conventional various limited control systems.
Specifically include following steps:
The first step, local area network platform is built by Wi-Fi, is set the intelligent display helmet and mobile terminal by wireless transport module It is standby to set up connection;In the case where selecting a kind of communication protocol, start mobile phone mobile terminal and virtual implementing helmet, in Wi-Fi LAN Under pattern, mobile phone mobile terminal and virtual implementing helmet is set infinitely to be connected, now cloud platform service module will be written into advance Various execution operational order programs, are to receive the control instruction information from virtual implementing helmet below as identification operation to make Supported for data.
Second step, user wears the intelligent display helmet, passes through eye recognition module or movement sensing module acquisition control number According to, and control data is converted into by control command signal by processing module, control data includes eyeball identification module and gathers use The optical data and/or motion-sensing mould at family gather user's head action data soon;It can also be obtained by external control devices Control command, external equipment can be that user is worn by data suit and data glove, and doing some can programmed action in advance Instruction, now the sensor of virtual reality spreads over experiencer's whole body, can increase the amount of calculation of computer, current calculated level Requirement can't be all met, but some simple action recognitions can typically accomplish.
3rd step, control command signal is transmitted to cloud platform service module recognize by wireless transport module, and will be known Control command signal after not is transferred to mobile terminal device;Be under control command information, will be collected into by processing module Data message is compared in cloud platform service module, is instructed accordingly, it is achieved thereby that change of the action command to data command Change, the program that developer is previously written in mobile terminal device, cloud platform service module is passed to by wireless transport module.
4th step, mobile terminal device performs control signal, and the result after execution is transmitted to the intelligent display helmet, intelligence Energy real helmet processing module is transmitted to display module after control signal is handled, and display module transmits display picture to left eye Display screen and right eye display screen.
5th step, step one to four moves in circles work.
Wherein optical data is user's number of winks, and head movement data are user's head tilt angle;Known using eye Other module obtains control command message, the number of times that user blinks is acquired in the range of the regular hour, by different Number of times tells different control instructions.
Obviously, above-described embodiment is only intended to clearly illustrate technical scheme example, and is not Restriction to embodiments of the present invention.For those of ordinary skill in the field, on the basis of the above description also It can make other changes in different forms.Any modification for being made within the spirit and principles of the invention, etc. With replacement and improvement etc., it should be included within the protection of the claims in the present invention.

Claims (9)

1. a kind of intelligent display helmet, it is characterised in that the inner helmet includes the cavity for place system module, described System module includes processing module, the wireless transport module for connecting mobile terminal device, display module, movement sensing module With the eye recognition module for obtaining user's optical data, the display module includes symmetrical left eye display screen and right eye is aobvious Display screen, the left eye display screen and right eye display screen are optical glasses, and the eye recognition module is electrically connected with processing module, institute Processing module is stated to electrically connect with movement sensing module, display module and wireless transport module respectively;The movement sensing module is Nine axle sensors, include the one or more of gyro sensor, geomagnetic sensor and acceleration transducer;The optical data For the one or more of user's number of winks, frequency of wink and Rotation of eyeball frequency, the head movement data are user's head The one or more of tilt angle and head rotation speed.
2. the intelligent display helmet according to claim 1, it is characterised in that also including power module and for controlling the helmet The power switch for starting or closing.
3. the intelligent display helmet according to claim 1, it is characterised in that also including memory modules, the memory modules For DDR double-speed internal memories.
4. the intelligent display helmet according to claim 1, it is characterised in that the processor includes GPU and cpu chip.
5. the intelligent display helmet according to claim 1, it is characterised in that the wireless transport module includes WiFi module And/or bluetooth module.
6. the intelligent display helmet according to claim 1, it is characterised in that the mobile terminal device includes mobile phone or flat Plate computer.
7. one kind includes the display system of the intelligent display helmet described in claim 1 ~ 6, it is characterised in that also including mobile terminal Equipment and configuration processor for write-in are responsible for rendering execution method and the identification side of virtual reality scenario and various control commands The cloud platform service module of method, the mobile terminal device and cloud platform service module are connected with the helmet by wireless transport module Connect.
8. it is a kind of based on the intelligent display method that system is shown described in claim 7, it is characterised in that to comprise the following steps:
S1. local area network platform is built by wireless transport module, it is by wireless transport module that the intelligent display helmet is whole with movement End equipment sets up connection;
S2. user wears the intelligent display helmet, by eye recognition module or movement sensing module acquisition control data, and passes through Control data is converted into control command signal by processing module, and the control data includes the eye that eyeball identification module gathers user Portion's data and/or motion-sensing mould gather user's head action data soon;
S3. control command signal is transmitted to cloud platform service module by wireless transport module and recognized, and by the control after identification Command signal processed is transferred to mobile terminal device;
S4. mobile terminal device performs control signal, and the result after execution is transmitted to the intelligent display helmet, intelligence reality head Helmet processing module is transmitted after control signal is handled to display module, display module display picture is transmitted to left eye display screen and Right eye display screen;
S5. step S1 ~ S4 circulation work.
9. intelligent display method according to claim 8, it is characterised in that the optical data be user's number of winks, The one or more of frequency of wink and Rotation of eyeball frequency, the head movement data are that user's head tilt angle and head turn The one or more of dynamic speed.
CN201710397387.2A 2017-05-31 2017-05-31 A kind of the intelligent display helmet and its display methods including display system Pending CN107272891A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710397387.2A CN107272891A (en) 2017-05-31 2017-05-31 A kind of the intelligent display helmet and its display methods including display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710397387.2A CN107272891A (en) 2017-05-31 2017-05-31 A kind of the intelligent display helmet and its display methods including display system

Publications (1)

Publication Number Publication Date
CN107272891A true CN107272891A (en) 2017-10-20

Family

ID=60064386

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710397387.2A Pending CN107272891A (en) 2017-05-31 2017-05-31 A kind of the intelligent display helmet and its display methods including display system

Country Status (1)

Country Link
CN (1) CN107272891A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019128748A1 (en) * 2017-12-31 2019-07-04 深圳市虚拟现实科技有限公司 Virtual reality display device and method therefor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104281266A (en) * 2014-10-17 2015-01-14 栾林林 Head-mounted display equipment
CN205007551U (en) * 2015-08-19 2016-02-03 深圳游视虚拟现实技术有限公司 Human -computer interaction system based on virtual reality technology
CN205485929U (en) * 2016-03-28 2016-08-17 胡证翕 Distributed virtual reality display device and system based on radio communication

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104281266A (en) * 2014-10-17 2015-01-14 栾林林 Head-mounted display equipment
CN205007551U (en) * 2015-08-19 2016-02-03 深圳游视虚拟现实技术有限公司 Human -computer interaction system based on virtual reality technology
CN205485929U (en) * 2016-03-28 2016-08-17 胡证翕 Distributed virtual reality display device and system based on radio communication

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019128748A1 (en) * 2017-12-31 2019-07-04 深圳市虚拟现实科技有限公司 Virtual reality display device and method therefor

Similar Documents

Publication Publication Date Title
CN105915990B (en) Virtual reality helmet and using method thereof
US6685566B2 (en) Compound reality presentation apparatus, method therefor, and storage medium
CN109218648B (en) Display control method and terminal equipment
CN103310186A (en) Method for correcting user's gaze direction in image, machine-readable storage medium and communication terminal
CN104428732A (en) Multimodal interaction with near-to-eye display
CN103197757A (en) Immersion type virtual reality system and implementation method thereof
CN103458184A (en) Method for carrying out long-range control on pan-tilt with cell phone
CN105739703A (en) Virtual reality somatosensory interaction system and method for wireless head-mounted display equipment
CN107193381A (en) A kind of intelligent glasses and its display methods based on eyeball tracking sensing technology
CN110637274B (en) Information processing apparatus, information processing method, and program
CN103179278A (en) Method and device for controlling screen to rotate
CN110825333A (en) Display method, display device, terminal equipment and storage medium
CN108108018A (en) Commanding and training method, equipment and system based on virtual reality
CN106937143A (en) The control method for playing back and device and equipment of a kind of virtual reality video
WO2017061890A1 (en) Wireless full body motion control sensor
CN105892627A (en) Virtual augmented reality method and apparatus, and eyeglass or helmet using same
CN107272891A (en) A kind of the intelligent display helmet and its display methods including display system
CN207037598U (en) A kind of intelligent display helmet and its display system
KR20200075773A (en) Systems and methods for providing haptic effects based on a user's motion or environment
CN106200911A (en) A kind of motion sensing control method based on dual camera, mobile terminal and system
CN107844197A (en) Virtual reality scenario display methods and equipment
Park et al. Low-latency interactive sensing for machine vision
CN106200923A (en) The control method of a kind of virtual reality system and device
CN207037599U (en) A kind of intelligent glasses based on eyeball tracking sensing technology
CN105630169A (en) Motion input method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination