CN105607743A - System based on double sets of sensors, hand-held terminal and head mount display - Google Patents
System based on double sets of sensors, hand-held terminal and head mount display Download PDFInfo
- Publication number
- CN105607743A CN105607743A CN201610102789.0A CN201610102789A CN105607743A CN 105607743 A CN105607743 A CN 105607743A CN 201610102789 A CN201610102789 A CN 201610102789A CN 105607743 A CN105607743 A CN 105607743A
- Authority
- CN
- China
- Prior art keywords
- data
- sensor
- handheld terminal
- display device
- management module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a system based on double sets of sensors, a hand-held terminal and a head mount display. The system comprises the two sets of sensors and a sensor management module; each set of sensors collect exercise data of a user and transmit the exercise data to the sensor management module; before receiving the data transmitted by each set of sensors, the sensor management module distributes local unique identification (ID) for each sensor of one set of sensors and distributes expansion unique identification (ID) for each sensor of one of the other set of sensors, so that the data transmitted by each set of sensors carry the corresponding unique identification (ID), and the data collected by each set of sensors are further managed in a unified mode. By means of the system based on the double sets of sensors, the hand-held terminal and the head mount display, the exercise data of the user can be collected by the two sets of sensors at the same time, thereby it is convenient to use the data of the two sets of sensors for conducting corresponding control respectively in a head mount display all-in-one machine, and user experience is greatly improved.
Description
Technical field
The present invention relates to virtual reality technology field, be specifically related to a kind of system based on two cover sensors,Handheld terminal with wear display device.
Background technology
Progressively ripe along with virtual reality technology, sensor wear in virtual reality system, play more nextMore important effect. Wear virtual reality system or wear augmented reality system and generally include a hand-held endEnd (or claim box) and be connected with handheld terminal wear display device (HeadMountDisplay,Be called for short HMD). At present, wearing virtual reality system or wearing augmented reality system and only prop up based on AndroidHold a set of sensor, causing wearing virtual reality system or wear augmented reality system can only be according to a set of biographyThe data of sensor collection are controlled, as, by wearing virtual reality system or wearing augmented reality systemWhile playing virtual reality racing game, a set of sensor can only be used for controlling the direction of racing car or observe roadRoad surrounding, utilizes the data of sensor collection control the direction of racing car simultaneously and observe road and cannot realizeThe effect of road surrounding.
Hence one can see that, the today developing rapidly, only has a set of sensor can not in virtual reality technologyMeet the user demand of user under some application scenarios, user experiences poor.
Summary of the invention
The invention provides a kind of system, handheld terminal based on two cover sensors and wear display device,Existingly wear virtual reality system or wear in augmented reality system and only have a set of sensor to cause to solveThe problem of poor user experience.
According to an aspect of the present invention, provide a kind of system based on two cover sensors, this system bagDraw together: two cover sensor and sensor management modules;
Every cover sensor, for gathering user's exercise data, and sends to sensor by this exercise dataAdministration module;
Sensor management module, for before receiving the data of every cover sensor transmission, for wherein a set ofThe local unique ID of each sensor assignment in sensor is the each sensor in other a set of sensorDistribute expansion unique ID, to carry corresponding unique identification in the data that every cover sensor is sentID, and then the data of the every cover sensor collection of unified management.
Alternatively, system is for wearing virtual reality system or wearing augmented reality system.
Alternatively, wear virtual reality system or wear augmented reality system and comprise: handheld terminal, withAnd be connected with handheld terminal wear display device;
First set sensor and sensor management module are arranged in handheld terminal; In handheld terminal, be provided withAndroid operating system;
The second cover sensor setting is wearing in display device;
First set sensor, for gathering user's hand exercise data, and sends out these hand exercise dataGive sensor management module;
The second cover sensor, for gathering user's head movement data, and sends head movement dataGive sensor management module.
Alternatively, handheld terminal and wear and set up general-purpose serial bus USB data between display device and connectOr wireless data connects;
When handheld terminal is when wearing display device and set up usb data and be connected, wear display device basisThe data packing of the second cover sensor collection is obtained usb data bag by USBHID agreement, and by this USBPacket connects and sends to handheld terminal through usb data;
The usb data of handheld terminal connects, and receives and wears display device transmission according to USBHID agreementUsb data bag, and usb data bag is resolved, the data after resolving are sent to sensorAdministration module.
Alternatively, wear virtual reality system or wear augmented reality system and comprise: handheld terminal, withAnd be connected with handheld terminal wear display device;
First set sensor setting is in handheld terminal;
The second cover sensor and sensor management module are arranged on to be worn in display device; Wear display deviceIn Android operating system is installed;
First set sensor, for gathering user's hand exercise data, and sends out these hand exercise dataGive sensor management module;
The second cover sensor, for gathering user's head movement data, and sends head movement dataGive sensor management module.
Alternatively, handheld terminal and wear and set up general-purpose serial bus USB data between display device and connectOr wireless data connects;
When handheld terminal is when wearing display device and set up usb data and be connected, handheld terminal is according to USBThe data packing of first set sensor collection is obtained usb data bag by HID agreement, and by this USB numberConnect to send to through usb data according to bag and wear display device;
The usb data of wearing display device connects, and receives handheld terminal send according to USBHID agreementUsb data bag, and usb data bag is resolved, the data after resolving are sent to sensorAdministration module.
According to another aspect of the present invention, provide a kind of handheld terminal, this handheld terminal with wear aobviousShow equipment connection, comprising: first set sensor, data link block and sensor management module; HandHold Android operating system is installed in terminal;
First set sensor, for gathering user's hand exercise data, and sends out these hand exercise dataGive sensor management module;
Data link block, for receiving the user's who wears display device transmission head movement data, andHead movement data are sent to sensor management module; Wherein, head movement data are established by wearing demonstrationThe second standby interior cover sensor collection obtains;
Sensor management module, for the number receiving first set sensor or the transmission of data link blockAccording to before, be the local unique ID of the each sensor assignment in first set sensor, and be the second coverEach sensor assignment expansion unique ID in sensor, will expand unique ID and connect by dataConnection module sends to wears display device, and then the hand exercise number of unified management first set sensor collectionAccording to second cover sensor gather head movement data.
Alternatively, data link block is that general-purpose serial bus USB data link block or wireless data connectConnection module;
In the time that data link block is usb data link block, handheld terminal connects by usb dataModule, receives and wears the usb data bag that display device sends according to USBHID agreement, and to USBPacket is resolved, and the data after resolving are sent to sensor management module.
According to a further aspect of the invention, provide one to wear display device, this wears display deviceBe connected with handheld terminal, comprise: the second cover sensor, data communication module and sensor management module;Wear Android operating system is installed in display device;
The second cover sensor, for gathering user's head movement data and head movement data being sent toSensor management module;
Data communication module, user's the hand exercise data that send for receiving handheld terminal, and shouldHand exercise data send to sensor management module, and wherein, hand exercise data are by being arranged on hand-held endFirst set sensor collection in end obtains;
Sensor management module, for the number receiving the second cover sensor or data communication module transmissionAccording to before, be the local unique ID of each sensor assignment in the second cover sensor, and be first setEach sensor assignment expansion unique ID in sensor, will expand unique ID and lead to by dataLetter module send to handheld terminal, and then unified management second overlap sensor gather head movement data andThe hand exercise data that first set sensor gathers.
Alternatively, data communication module is usb communication module or wireless communication module;
In the time that data communication module is usb communication module, wear display device by usb communication module,Receive according to USBHID agreement the usb data bag that handheld terminal sends, and usb data bag is carried outResolve, the data after resolving are sent to sensor management module.
The invention has the beneficial effects as follows: the invention provides a kind of system based on two cover sensors, this isSystem is owing to having comprised two cover sensors, and two cover sensors gather respectively user's exercise data, thereby canSolve existing virtual reality system and only support the problem of a set of sensor, and by sensor management moduleDistribute respectively different unique ID to distinguish and corresponding data processing to two cover sensors, makeThe data of two cover sensors can be all virtual reality system use, and then have realized according to two cover sensorsThe data that gather are controlled the beneficial effect of realizing corresponding function simultaneously, the user demand that met user,Promote user's experience.
Brief description of the drawings
Fig. 1 is the structural representation of a kind of system based on two cover sensors of one embodiment of the invention;
Fig. 2 is a kind of structure chart of wearing virtual reality system of one embodiment of the invention;
Fig. 3 is a kind of structure chart of wearing virtual reality system of another embodiment of the present invention;
Fig. 4 is a kind of principle schematic that realizes of wearing virtual reality system of one embodiment of the invention;
Fig. 5 is the structural representation of a kind of handheld terminal of one embodiment of the invention;
Fig. 6 is a kind of structural representation of wearing display device of one embodiment of the invention.
Detailed description of the invention
Embodiment mono-
Fig. 1 is the structural representation of a kind of system based on two cover sensors of one embodiment of the invention,Referring to Fig. 1, should the system 10 based on two cover sensors comprise: two cover sensor and sensor management mouldsPiece 103, two cover sensors are respectively first set sensor 101 and the second cover sensor 102;
First set sensor 101 and the second cover sensor 102, for gathering user's exercise data, andThis exercise data is sent to sensor management module 103;
Sensor management module 103, for receiving first set sensor 101 and the second cover sensor 102Before the data that send, it is the each sensor in a set of sensor (as first set sensor 101) whereinDistributing local unique ID, is the each biography in other a set of sensor (as the second cover sensor 102)Sensor distributes expansion unique ID, to carry the unique of correspondence in the data that every cover sensor is sentMark ID, and then the data of the every cover sensor collection of unified management.
System based on two cover sensors is known as shown in Figure 1, and the present embodiment is for virtual in prior artReality system is only supported the problem of a set of sensor, by two cover sensors and a sensor management are setModule is the different unique identification of each sensor assignment in two cover sensors by sensor management moduleID, and according to this ID, the data in two cover sensors are distinguished and alignment processing, two covers are passedThe data of sensor collection are virtual reality system and use, and realize and utilize the same time control of two cover sensing datasThe effect of corresponding function processed.
Embodiment bis-
Fig. 2 is a kind of structure chart of wearing virtual reality system of another embodiment of the present invention, in this realityExecute the system based on two cover sensors of Fig. 1 in example for wearing virtual reality system, it should be noted that,In the present embodiment, be that to wear virtual reality system be that example is carried out the structure of the system based on two cover sensorsExplanation, in other embodiments of the invention, the system based on two cover sensors shown in Fig. 1 also canTo be to wear augmented reality system, this is not restricted.
Referring to Fig. 2, this is worn virtual reality system 20 and comprises: handheld terminal 21, and and handheld terminal21 connect wear display device 22;
First set sensor 210 and sensor management module 211 are arranged in handheld terminal 21; Hand-held endIn end 21, Android operating system is installed;
The second cover sensor 220 is arranged on to be worn in display device 22;
First set sensor 210, for gathering user's hand exercise data, and by this hand exercise numberAccording to sending to sensor management module 211;
The second cover sensor 220, for gathering user's head movement data, and by head movement dataSend to sensor management module 211.
Wherein, handheld terminal 21 and wear and set up general-purpose serial bus USB data between display device 22Connect or wireless data connection; When handheld terminal 21 with wear display device 22 and set up usb data and be connectedTime, wear the data that display device 22 gathers the second cover sensor 220 according to USBHID agreement and beatBag obtains usb data bag, and this usb data bag is connected and sends to handheld terminal through usb data21；
The usb data of handheld terminal 21 connects, and receives and wears display device according to USBHID agreementThe 22 usb data bags that send, and usb data bag is resolved, the data after resolving are sent toSensor management module 211.
The USB here refers to USB (UniversalSerialBus is called for short USB), HIDRefer to man-machine interactive operation (HumanInterfaceDevice is called for short HID), can by the title of HIDTo find out that HID realizes equipment direct and that people is mutual, as equipment such as keyboard, mouse and joysticks. MakeBe by an advantage of HID, system carries the driver of HID, and without going again exploitation to driveProgram. In the present embodiment, the function of sensor management module is realized and being arranged in handheld terminal, concreteWhen enforcement, the function of sensor management module can be by the microprocessing unit in handheld terminal(MicrocontrollerUnit is called for short MCU) realizes. Wear on the sensor function in display deviceBe equivalent to a USB mouse.
In the present embodiment, when handheld terminal 21 and to wear between display device 22 what set up be usb dataWhen connection, as, in handheld terminal 21, be provided with usb data transport module, wear display device 22Correspondence arranges usb data transport module, connects, at this moment between two usb data transport modulesHandheld terminal 21 is equivalent to usb host, wears display device 22 and is equivalent to USB from equipment, right overheadWear the cover of second in display device 22 sensor 220 and collect after user's head movement data, according toUSBHID agreement, obtains usb data bag to this head movement data packing, then aobvious through wearingShow that usb data transport module in equipment 22 sends to the usb data transport module of handheld terminal 21,The usb data transport module of handheld terminal 21 is resolved the usb data bag receiving, and will resolveThe data that obtain send the sensor management module 211 in handheld terminal 21, by this sensor management module211 carry out corresponding processing.
In addition, in the present embodiment, handheld terminal 21 and wear between display device 22 and can also set up nothingLine data connect, as: blue teeth wireless data connect or Wi-Fi wireless data connects, and pass through bluetoothWireless data connects or Wi-Fi wireless data connects and will wear the cover of second in display device 22 sensorThe 220 head movement data that gather send to handheld terminal 21.
The first set sensor 210 for gathering user's hand exercise data of handheld terminal 21 can compriseOne or more in gravity sensor (or acceleration transducer), gyro sensor and geomagnetic sensor.The second cover sensor 220 for gathering user's head movement data of wearing display device 22 also can wrapDraw together a kind of or many in gravity sensor (or acceleration transducer), gyro sensor and geomagnetic sensorKind, the value volume and range of product of sensor is not limited, as long as can collect user's corresponding exercise data.
The concrete reality-virtualizing game of an application scenarios field of wearing virtual reality system 20 shown in Fig. 2Scape. In reality-virtualizing game, user's hand motion and headwork no less important, realize hand and passSensor and hot nose use simultaneously, will bring different experience to user. As, user wears headWhile wearing the racing game of display device object for appreciation virtual reality, watch road surrounding (by head by head movementWear the second cover sensor collection user's of display device head movement data, and through sensor management mouldPiece is applied for the reality-virtualizing game on upper strata after processing), (logical by hand exercise control racing car directionThe first set sensor of crossing handheld terminal gathers user's hand exercise data process sensor management moduleReality-virtualizing game for upper strata after processing is applied), can transport by perception hand again by perception head movementMoving, thus make game experiencing more true to nature, change single control while playing reality-virtualizing game in prior artThe uninteresting experience causing.
It is emphasized that in the present embodiment, sensor management module is arranged on wears virtual reality systemHandheld terminal in. But in another embodiment of the present invention, sensor management module also can be establishedPut wearing the wearing in display device of virtual reality system, be specifically described below in conjunction with embodiment tri-.
Embodiment tri-
The present embodiment is mainly the explanation that the structure to wearing virtual reality system is carried out, other guide referring toOther embodiment of the present invention. Fig. 3 is that the one of another embodiment of the present invention is worn virtual reality systemStructure chart, referring to Fig. 3, this is worn virtual reality system 30 and comprises: handheld terminal 31, and and handThat holds that terminal 31 connects wears display device 32;
First set sensor 310 is arranged in handheld terminal 31, the second cover sensor 320 and sensor tubeReason module 321 is arranged on to be worn in display device 32; Wear Android operation is installed in display device 32System;
First set sensor 310, for gathering user's hand exercise data, and by this hand exercise numberAccording to sending to sensor management module 321;
The second cover sensor 320, for gathering user's head movement data, and by head movement dataSend to sensor management module 321.
In the present embodiment, handheld terminal 31 and wear that can to set up general serial between display device 32 totalLine usb data connects or wireless data connects;
When handheld terminal 31 is when wearing display device 32 and set up usb data and be connected, handheld terminal 31Data packing first set sensor 310 being gathered according to USBHID agreement obtains usb data bag,And this usb data bag is sent to and wears display device 32 through usb data connection; Wear display device32 usb data connects, and receives according to USBHID agreement the usb data that handheld terminal 31 sendsBag, and usb data bag is resolved, the data after resolving are sent to sensor management module 321.
So, realize collection and the management of two cover sensing datas in virtual reality system, facilitated virtualApplication in reality system is used.
Embodiment tetra-
Fig. 4 is a kind of principle schematic that realizes of wearing virtual reality system of one embodiment of the invention,Referring to Fig. 4, the present embodiment this worn virtual reality system and comprised handheld terminal and wear display device,Handheld terminal has been installed Android Android operating system, Android be a kind of freedom based on Linux andThe operating system of open source code, is mainly used in mobile device.
Referring to Fig. 4, Android has adopted the framework of layering, from high level to low layer respectively: application programLayer, ccf layer, hardware abstraction layer (HardwareAbstractionLayer is called for short HAL) and drivingLayer (or claiming kernel-driven layer).
In the present embodiment, wear virtual reality system to realize principle as follows:
Step 4.1, before the data that send at receiving sensor, the sensor management module of Android ccf layer,For local sensor distributes local unique ID (being SensorID), that is, and each of handheld terminalGround sensor is assigned with a local unique ID, passes through Android data transmission mechanism for local sensorUpload gathered data. Here, be local sensor by the scales of installing in handheld terminal, phaseFor this locality, the scales of wearing in display device is extension sensor.
And sensor management module is that each extension sensor of wearing in display device distributes expansion onlyOne mark ID (being SensorIDNew), sends to the expansion unique ID of distribution to wear demonstrationEquipment, uploads sensing data for wearing display device.
Step 4.2, wears the extension sensor collection user's of display device head movement data, meanwhile,The local sensor that handheld terminal is installed is realized the collection of hand exercise data.
It should be noted that, Fig. 4 schematically shows that handheld terminal and wearing arranges in display deviceSensor is the situation of gravity sensor, gyro sensor and geomagnetic sensor, in other embodimentsHandheld terminal and wear and in display device, gravity sensor can be only set and gather corresponding data, rightThis is not restricted.
Step 4.3, wear display device extension sensor gather data by USBHID technology completeBecome packing, and by USB transmission channel, usb data bag is sent to the hardware abstraction layer of handheld terminal.Meanwhile, the local sensor encapsulation of the hardware abstraction layer of handheld terminal, completes the hand that local sensor gathersThe encapsulation of portion's exercise data, the hardware abstraction layer of handheld terminal merges the sensor number that extension sensor is uploadedAccording to this and the sensing data uploaded of local sensor.
In the present embodiment, handheld terminal and wear can appointment data transformat between display device. As,Every data of agreement transmission are 64 byte-sized, wherein, and the position corresponding to front predetermined bite of every dataThe data of put gravity sensor, gyro sensor collection is recorded in position corresponding to middle predetermined biteData, position corresponding to rear predetermined bite record geomagnetic sensor gather data. Every data also canThe data that gather only to send a sensor, as, while only sending the valid data of gravity sensor collection,The valid data of gravity sensor under the corresponding byte records of these data, and in the residue of these dataThe byte that records sensing data fill invalid data (as fill corresponding byte 0), like this when one 64The transfer of data of byte-sized is after the hardware abstraction layer of handheld terminal, and handheld terminal hardware abstraction layer carries outThe data that the data of resolving known current collection are gravity sensor, the ID that obtains carrying in data isThe ID of gravity sensor, it (is frame that the ID of the gravity sensor being resolved to and data are sent to upper strataRack-layer) sensor management module.
Step 4.4, (, unique identification is Android sensor management module unified management local sensorThe sensor of SensorID) and the extension sensor (sensing that, unique identification is SensorIDNewDevice) the data alignment processing of local sensor and extension sensor collection is become to game of application layer etc.Android is applied the data that can identify and use.
Step 4.5, the application of the Android such as the game of the application layer of handheld terminal, silent by with ccf layerRecognize unified local sensor data and the extension sensor data that use sensor management module management of interface.As, car race game application can preset the Data Control of utilizing the local sensor of handheld terminal to gatherThe travel direction of racing car, and set and utilize the data of expanding the extension sensor collection of wearing display device to seeExamine road surrounding situation. When this race car applications gets from ccf layer interface the hand that local sensor gathersWhen exercise data (as data of the hand that turns left), according to the direction of this exercise data control racing carTurn left, get head movement data (as the head that turns left that extension sensor gathers when simultaneouslyData) time, the condition of road surface in controlled observation left side. User, can in the time playing this car race game like thisPerception head movement again can perception hand exercise, and controls when having realized two cover sensors, makes gameExperience more true to naturely, met user's user demand.
As from the foregoing, the system based on two cover sensors of the present embodiment, this system comprises two cover sensingsDevice and a sensor management module are the each sensor in two cover sensors by sensor management moduleDistribute different unique ID, and according to this ID, the data in two cover sensors are distinguished and rightShould process, the data of two cover sensor collections can, simultaneously by virtual reality system is used, be realizedControl simultaneously, greatly promoted user's experience.
Embodiment five
Fig. 5 is the structural representation of a kind of handheld terminal of one embodiment of the invention, referring to Fig. 5, and shouldHandheld terminal 50 with wear display device and be connected, comprising: first set sensor 501, data link block502 and sensor management module 503; Android operating system is installed in handheld terminal 50;
First set sensor 501, for gathering user's hand exercise data, and by this hand exercise numberAccording to sending to sensor management module 503;
Data link block 502, for receiving the user's who wears display device transmission head movement data,And head movement data are sent to sensor management module 503; Wherein, head movement data are by wearingThe collection of in display device second cover sensor obtains;
Sensor management module 503, for receiving first set sensor 501 or data link blockBefore 502 data that send, it is the local unique identification of the each sensor assignment in first set sensor 501ID, and be the each sensor assignment expansion unique ID in the second cover sensor, unique mark will be expandedKnow ID and send to and wear display device by data link block 502, and then unified management first set passesThe head movement data that the hand exercise data that sensor 501 gathers and the second cover sensor gather.
In the present embodiment, data link block 501 is general-purpose serial bus USB data link block or nothingLine data link block;
In the time that data link block 501 is usb data link block, handheld terminal 50 is by USB numberAccording to link block 501, receive and wear the usb data bag that display device sends according to USBHID agreement,And usb data bag is resolved, the data after resolving are sent to sensor management module 503.
Embodiment six
Fig. 6 is a kind of structural representation of wearing display device of one embodiment of the invention, referring to Fig. 6,The present embodiment provides one to wear display device 60, and this is worn display device 60 and is connected with handheld terminal,Comprise: the second cover sensor 601, data communication module 602 and sensor management module 603; Wear aobviousShow Android operating system is installed in equipment 60;
The second cover sensor 601, for gathering user's head movement data and head movement data being sent outGive sensor management module 603;
Data communication module 602, user's the hand exercise data that send for receiving handheld terminal, andThese hand exercise data are sent to sensor management module 603, and wherein, hand exercise data are by arrangingFirst set sensor collection in handheld terminal obtains;
Sensor management module 603, for receiving the second cover sensor 601 or data communication moduleBefore 602 data that send, it is the local unique identification of each sensor assignment in the second cover sensor 601ID, and be the each sensor assignment expansion unique ID in first set sensor, unique mark will be expandedKnow ID and send to handheld terminal by data communication module 602, and then sensor is overlapped in unified management secondThe hand exercise data that the 601 head movement data that gather and first set sensor gather.
In the present embodiment, data communication module 602 is usb communication module or wireless communication module; WearDisplay device 60, by usb communication module 602, receives handheld terminal according to USBHID agreement and sendsUsb data bag, and usb data bag is resolved, the data after resolving are sent to sensorAdministration module 603.
In sum, only support a set of sensor to cause user's body for virtual reality system in prior artTest poor problem, the embodiment of the present invention proposes a kind of system based on two cover sensors, in this system, wrapsDrawing together two cover sensors and a sensor management module, is in two cover sensors by sensor management moduleThe different unique ID of each sensor assignment, and according to this ID, the data in two cover sensors are enteredRow is distinguished and alignment processing, and the data that two cover sensors are gathered can be virtual reality system institute simultaneouslyUse, and then realize simultaneously and controlling, met user's user demand, optimized user's experience.
In addition, the present invention also provides a kind of handheld terminal and one to wear display device, this handheld terminalOr wear the exercise data that display device this locality is provided with a set of sensor collection user and can receive outside expansionThe data that a set of sensor of exhibition gathers, and the data of two cover sensors are managed, thereby realizeThe beneficial effect that utilizes the data of two cover sensors simultaneously to control, compared with prior art user experiencesBetter, promoted the competitiveness of product.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection model of the present inventionEnclose. All any amendments of doing within the spirit and principles in the present invention, be equal to replacement, improvement etc., allBe included in protection scope of the present invention.
Claims (10)
1. two cover sensing systems, is characterized in that, this system comprises: two cover sensor and biographiesSensor administration module;
Every cover sensor, for gathering user's exercise data, and sends to described biography by this exercise dataSensor administration module;
Described sensor management module, for before receiving the data that every cover sensor sends, for whereinThe local unique ID of each sensor assignment in a set of sensor is the each biography in other a set of sensorSensor distributes expansion unique ID, to carry the unique of correspondence in the data that every cover sensor is sentMark ID, and then the data of the every cover sensor collection of unified management.
2. system according to claim 1, is characterized in that, described system is for wearing virtual realitySystem or wear augmented reality system.
3. system according to claim 2, is characterized in that,
Described wear virtual reality system or wear augmented reality system comprise: handheld terminal, Yi JiyuWhat described handheld terminal connected wears display device;
Described first set sensor and described sensor management module are arranged in described handheld terminal; DescribedAndroid operating system is installed in handheld terminal;
Described the second cover sensor setting is worn in display device described;
Described first set sensor, for gathering user's hand exercise data, and by this hand exercise numberAccording to sending to described sensor management module;
Described the second cover sensor, for gathering user's head movement data, and by described head movementData send to described sensor management module.
4. system according to claim 3, is characterized in that, described handheld terminal and described in wearBetween display device, setting up the connection of general-purpose serial bus USB data or wireless data connects;
When described handheld terminal with described in when wearing display device and setting up usb data and be connected, described in wear aobviousShow that equipment obtains usb data bag according to USBHID agreement by the data packing of the second cover sensor collection,And this usb data bag is connected and sends to described handheld terminal through usb data;
The usb data of described handheld terminal connects, and described in receiving, wears demonstration according to USBHID agreementThe usb data bag that equipment sends, and described usb data bag is resolved, by the data after resolvingSend to described sensor management module.
5. system according to claim 2, is characterized in that, described in wear virtual reality system orPerson wears augmented reality system and comprises: handheld terminal, and be connected with described handheld terminal wear demonstrationEquipment;
Described first set sensor setting is in described handheld terminal;
Described in being arranged on, described the second cover sensor and described sensor management module wear in display device;Described wearing is provided with Android operating system in display device;
Described first set sensor, for gathering user's hand exercise data, and by this hand exercise numberAccording to sending to described sensor management module;
Described the second cover sensor, for gathering user's head movement data, and by described head movementData send to described sensor management module.
6. system according to claim 5, is characterized in that, described handheld terminal and described in wearBetween display device, setting up the connection of general-purpose serial bus USB data or wireless data connects;
When described handheld terminal with described in when wearing display device and setting up usb data and be connected, described hand-held endEnd obtains usb data bag according to USBHID agreement by the data packing of first set sensor collection, andThis usb data bag is connected described in sending to and wears display device through usb data;
The described usb data of wearing display device connects, and receives described hand-held according to USBHID agreementThe usb data bag that terminal sends, and described usb data bag is resolved, by the data after resolvingSend to described sensor management module.
7. a handheld terminal, this handheld terminal with wear display device and be connected, it is characterized in that this handHolding terminal comprises: first set sensor, data link block and sensor management module;
Android operating system is installed in described handheld terminal;
Described first set sensor, for gathering user's hand exercise data, and by this hand exercise numberAccording to sending to described sensor management module;
Described data link block, for wearing the user's that display device sends head movement described in receivingData, and described head movement data are sent to described sensor management module; Wherein, described headExercise data is worn the collection of second in display device cover sensor and is obtained by described;
Described sensor management module, for receiving described first set sensor or data link blockBefore the data that send, be the local unique ID of the each sensor assignment in described first set sensor,And be the each sensor assignment expansion unique ID in described the second cover sensor, by described expansion onlyDescribed in sending to by described data link block, one mark ID wears display device, and then unified managementThe head movement data that the hand exercise data that first set sensor gathers and the second cover sensor gather.
8. handheld terminal according to claim 7, is characterized in that, described data link block isGeneral-purpose serial bus USB data link block or wireless data link block;
In the time that described data link block is usb data link block, described in described handheld terminal passes throughUsb data link block, wears USB that display device send described in receiving according to USBHID agreementPacket, and described usb data bag is resolved, the data after resolving are sent to described sensorAdministration module.
9. wear a display device, this is worn display device and is connected with handheld terminal, it is characterized in that,This is worn display device and comprises: the second cover sensor, data communication module and sensor management module;
Described wearing is provided with Android operating system in display device;
Described the second cover sensor, for gathering user's head movement data and by described head movement numberAccording to sending to described sensor management module;
Described data communication module, for receiving the user's that described handheld terminal sends hand exercise data,And these hand exercise data are sent to described sensor management module, and wherein, described hand exercise dataObtained by the first set sensor collection being arranged in described handheld terminal;
Described sensor management module, for receiving described the second cover sensor or data communication moduleBefore the data that send, be the local unique ID of each sensor assignment in described the second cover sensor,And be the each sensor assignment expansion unique ID in described first set sensor, by described expansion onlyOne mark ID sends to described handheld terminal by described data communication module, and then unified management secondThe hand exercise data that the head movement data that cover sensor gathers and first set sensor gather.
10. the display device of wearing according to claim 9, is characterized in that, described data communicationModule is usb communication module or wireless communication module;
In the time that described data communication module is usb communication module, described in wear described in display device passes throughUsb communication module, receives according to USBHID agreement the usb data bag that handheld terminal sends, and rightDescribed usb data bag is resolved, and the data after resolving are sent to described sensor management module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610102789.0A CN105607743A (en) | 2016-02-24 | 2016-02-24 | System based on double sets of sensors, hand-held terminal and head mount display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610102789.0A CN105607743A (en) | 2016-02-24 | 2016-02-24 | System based on double sets of sensors, hand-held terminal and head mount display |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105607743A true CN105607743A (en) | 2016-05-25 |
Family
ID=55987728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610102789.0A Pending CN105607743A (en) | 2016-02-24 | 2016-02-24 | System based on double sets of sensors, hand-held terminal and head mount display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105607743A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107272892A (en) * | 2017-05-31 | 2017-10-20 | 北京数科技有限公司 | A kind of virtual touch-control system, method and device |
| CN107977324A (en) * | 2017-12-22 | 2018-05-01 | 潍坊歌尔电子有限公司 | Identification wears the method for display device, wears display device and system |
| CN108664127A (en) * | 2018-05-21 | 2018-10-16 | 云谷（固安）科技有限公司 | A kind of data transmission method and its equipment based on gesture identification input equipment |
| CN108920187A (en) * | 2018-06-29 | 2018-11-30 | 歌尔股份有限公司 | sensor control method and device |
| CN109408128A (en) * | 2018-11-10 | 2019-03-01 | 歌尔科技有限公司 | Split type AR equipment communication means and AR equipment |
| CN110764610A (en) * | 2018-07-27 | 2020-02-07 | 博世汽车部件(苏州)有限公司 | Method and device for data acquisition and control device |
| CN110806798A (en) * | 2018-07-20 | 2020-02-18 | 北京君正集成电路股份有限公司 | Control method and device based on HID protocol |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317403A (en) * | 2014-10-27 | 2015-01-28 | 黄哲军 | Wearable equipment for sign language recognition |
| CN104615243A (en) * | 2015-01-15 | 2015-05-13 | 深圳市掌网立体时代视讯技术有限公司 | Head-wearable type multi-channel interaction system and multi-channel interaction method |
| CN204360325U (en) * | 2015-01-15 | 2015-05-27 | 深圳市掌网立体时代视讯技术有限公司 | A kind of wear-type multi-modal interaction system |
| CN104765456A (en) * | 2015-04-08 | 2015-07-08 | 成都爱瑞斯文化传播有限责任公司 | Virtual space system and building method thereof |
| CN104857704A (en) * | 2015-06-11 | 2015-08-26 | 苏州百源软件设计有限公司 | Wearable virtual reality motion helmet and wearable virtual action game system |
| CN205015835U (en) * | 2015-08-03 | 2016-02-03 | 众景视界（北京）科技有限公司 | Wear -type intelligence interaction system |
| CN105323380A (en) * | 2014-07-31 | 2016-02-10 | 三星电子株式会社 | Mobile terminal and method of operating same |
| CN105320820A (en) * | 2015-12-02 | 2016-02-10 | 上海航空电器有限公司 | Rapid cockpit design system and method based on immersive virtual reality platform |
-
2016
- 2016-02-24 CN CN201610102789.0A patent/CN105607743A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105323380A (en) * | 2014-07-31 | 2016-02-10 | 三星电子株式会社 | Mobile terminal and method of operating same |
| CN104317403A (en) * | 2014-10-27 | 2015-01-28 | 黄哲军 | Wearable equipment for sign language recognition |
| CN104615243A (en) * | 2015-01-15 | 2015-05-13 | 深圳市掌网立体时代视讯技术有限公司 | Head-wearable type multi-channel interaction system and multi-channel interaction method |
| CN204360325U (en) * | 2015-01-15 | 2015-05-27 | 深圳市掌网立体时代视讯技术有限公司 | A kind of wear-type multi-modal interaction system |
| CN104765456A (en) * | 2015-04-08 | 2015-07-08 | 成都爱瑞斯文化传播有限责任公司 | Virtual space system and building method thereof |
| CN104857704A (en) * | 2015-06-11 | 2015-08-26 | 苏州百源软件设计有限公司 | Wearable virtual reality motion helmet and wearable virtual action game system |
| CN205015835U (en) * | 2015-08-03 | 2016-02-03 | 众景视界（北京）科技有限公司 | Wear -type intelligence interaction system |
| CN105320820A (en) * | 2015-12-02 | 2016-02-10 | 上海航空电器有限公司 | Rapid cockpit design system and method based on immersive virtual reality platform |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107272892A (en) * | 2017-05-31 | 2017-10-20 | 北京数科技有限公司 | A kind of virtual touch-control system, method and device |
| CN107272892B (en) * | 2017-05-31 | 2019-12-20 | 北京一数科技有限公司 | Virtual touch system, method and device |
| CN107977324A (en) * | 2017-12-22 | 2018-05-01 | 潍坊歌尔电子有限公司 | Identification wears the method for display device, wears display device and system |
| CN107977324B (en) * | 2017-12-22 | 2021-12-24 | 潍坊歌尔电子有限公司 | Method for identifying head-mounted display device, head-mounted display device and system |
| CN108664127A (en) * | 2018-05-21 | 2018-10-16 | 云谷（固安）科技有限公司 | A kind of data transmission method and its equipment based on gesture identification input equipment |
| CN108920187A (en) * | 2018-06-29 | 2018-11-30 | 歌尔股份有限公司 | sensor control method and device |
| CN110806798A (en) * | 2018-07-20 | 2020-02-18 | 北京君正集成电路股份有限公司 | Control method and device based on HID protocol |
| CN110764610A (en) * | 2018-07-27 | 2020-02-07 | 博世汽车部件(苏州)有限公司 | Method and device for data acquisition and control device |
| CN110764610B (en) * | 2018-07-27 | 2024-05-14 | 博世汽车部件(苏州)有限公司 | Method and device for data acquisition and control equipment |
| CN109408128A (en) * | 2018-11-10 | 2019-03-01 | 歌尔科技有限公司 | Split type AR equipment communication means and AR equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105607743A (en) | System based on double sets of sensors, hand-held terminal and head mount display | |
| CN105915990B (en) | Virtual reality helmet and using method thereof | |
| CN103786061B (en) | Vehicular robot device and system | |
| CN104618712A (en) | Head wearing type virtual reality equipment and virtual reality system comprising equipment | |
| EP3229482B1 (en) | Master device, slave device, and control method therefor | |
| CN104615243A (en) | Head-wearable type multi-channel interaction system and multi-channel interaction method | |
| CN107943722A (en) | It is a kind of that the method and system for passing screen are realized based on USB device | |
| CN105915766B (en) | Control method based on virtual reality and device | |
| WO2017092396A1 (en) | Virtual reality interaction system and method | |
| CN106484982A (en) | Method for designing based on virtual reality and VR system during automobile product development | |
| CN105999696A (en) | Driving simulator | |
| CN106507092A (en) | Camera head and its image processing method, virtual reality device | |
| CN103414746A (en) | Realization method of cross-platform network interaction, reader and network server | |
| CN206584310U (en) | A kind of MR gloves being applied in virtual reality | |
| CN105094317A (en) | Motion sensing method and device | |
| CN106843504A (en) | VR environment realizes the true sense of touch gloves and exchange method for interacting with actual environment | |
| CN106843511A (en) | A kind of intelligent display device system of whole scene covering and application | |
| CN106327583A (en) | Virtual reality equipment for realizing panoramic image photographing and realization method thereof | |
| KR101675006B1 (en) | Transmitting an interrupt packet | |
| CN106774940A (en) | A kind of Intelligent worn device and smart motion interactive system | |
| CN109817232A (en) | A kind of transmission method, terminal device and apparatus for processing audio | |
| CN109905572A (en) | A kind of AR system of wireless transmission | |
| CN103083901A (en) | Holographic projection somatosensory interactive system and holographic projection somatosensory interactive method | |
| CN106657286A (en) | Data interaction method, virtual reality terminal and unmanned aerial vehicle | |
| US20170147274A1 (en) | Separation control video system in which mobile terminal and hmd device are independently separated and operating method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160525 |
|
| RJ01 | Rejection of invention patent application after publication |