CN112558773A - Dual-input VR device and virtual driving system - Google Patents
Dual-input VR device and virtual driving system Download PDFInfo
- Publication number
- CN112558773A CN112558773A CN202011453297.9A CN202011453297A CN112558773A CN 112558773 A CN112558773 A CN 112558773A CN 202011453297 A CN202011453297 A CN 202011453297A CN 112558773 A CN112558773 A CN 112558773A
- Authority
- CN
- China
- Prior art keywords
- glasses
- camera
- control
- input
- driving system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 claims abstract description 60
- 238000004891 communication Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005191 phase separation Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000003238 somatosensory effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Aviation & Aerospace Engineering (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a double-input VR device and a virtual driving system, comprising: VR glasses, a control handle and a camera; the control handle inputs the attitude information into the VR glasses in a wireless mode; the camera is used for catching VR glasses person of wearing's gesture input and gives VR glasses. The virtual driving system also comprises a real driver seat; displaying a driving virtual environment to a VR glasses wearer by VR glasses of the VR device; the orientation of the camera is in the horizontal plane and perpendicular to the front direction of the driver seat. The gesture information of the control handle is used as the first control input, the bare-handed gesture of the VR glasses wearer is used as the second control input, and the control flexibility is improved.
Description
Technical Field
The invention relates to the technical field of VR (virtual reality), in particular to a double-input VR device and a virtual driving system.
Background
Patent document CN208126674U discloses an architectural engineering teaching system based on VR virtual reality technology, which includes a teacher end, a student end, and a network channel connecting the teacher end and the student end, where the student end includes a VR handle, a locator, and a VR helmet worn by the student; the VR handle is used for interacting with an object in the virtual reality world, and a sensor which can be tracked by a locator is arranged in the VR handle: a laser generator and a photosensitive sensor are arranged in the positioner and used for determining the position of the VR handle; the VR helmet includes: the device comprises an input module, a processing module, a storage module, a display module and an output module. Building engineering teaching system based on VR virtual reality technique presents the building engineering general appearance with VR equipment directly perceivedly, by teacher's operation teaching student how correctly carry out actual building management, brings the real impression of student, improves the efficiency and the quality of teaching.
Patent document CN206379004U discloses an immersive teaching system based on VR technique, including desk and curtain, the top middle part on ground is placed to the desk, and display, computer, virtual helmet and mutual handle have been placed to the upper surface of desk, the front left corner and the right back corner on ground all are equipped with the bracing piece, and the laser locator is installed to the upper end of bracing piece, the curtain sets up on the rear side wall, and this immersive teaching system based on VR technique can utilize VR virtual reality technique to make the virtual environment of writing reality, highly makes according to real scene in the environment. The virtual helmet and the somatosensory controller are utilized to realize the switching and transformation operation of relevant information such as virtual images, models and the like in the virtual scene, and record and play the teaching process after the superposition effect in real time.
In general, a control handle of the related art forms a light spot by a laser and obtains a gesture captured by a camera, but in a virtual training system such as driving, the gesture has a large sensory distance from a realistic feeling and a realistic operation manner such as a steering wheel.
Disclosure of Invention
In view of the defects in the prior art, the invention aims to provide a double-input VR device and a virtual driving system.
According to the invention, the dual-input VR device comprises: VR glasses, a control handle and a camera;
the control handle inputs the attitude information into the VR glasses in a wireless mode;
the camera is used for catching the bare-handed gesture input of VR glasses wearer and giving VR glasses.
Preferably, the number of the control handles is two, and the control handles are respectively provided for the left hand and the right hand of a VR glasses wearer;
when the sensors on both control handles detect that the control handles are held, the recognition of gestures of captured images from the cameras is suspended.
Preferably, when the sensors on the two control handles detect that the control handles are held first and then detect that the control handles are not held, comparing the pictures captured by the cameras before and after the moment when the control handles are not held, finding a new hand object at a later moment, regarding the new hand object as the hand of the AR glasses wearer, and performing gesture recognition.
Preferably, the camera is separated from the VR glasses, and the camera is connected with the VR glasses through wireless signal communication;
the virtual driving system provided by the invention comprises the VR equipment;
the virtual driving system also comprises a real driver seat;
displaying a driving virtual environment to a VR glasses wearer by VR glasses of the VR device;
the orientation of the camera is in the horizontal plane and perpendicular to the front direction of the driver seat.
Preferably, when there is overlapping occlusion of two hands of the VR glasses wearer in the picture captured by the camera, the picture is captured by the camera which is installed on the VR glasses and is arranged coaxially or in parallel with the VR glasses in the direction.
Preferably, the VR glasses recognize that the two hands have overlapping occlusion as a gesture, and recognize that the control steering wheel rotates for one circle.
Preferably, the VR glasses recognize the left-hand shielding right hand as a gesture for controlling the steering wheel to rotate one circle rightwards, and the VR glasses recognize the right-hand shielding left hand as a gesture for controlling the steering wheel to rotate one circle leftwards.
Compared with the prior art, the invention has the following beneficial effects:
the gesture information of the control handle is used as the first control input, the bare-handed gesture of the VR glasses wearer is used as the second control input, and the control flexibility is improved.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
The virtual driving system provided by the invention comprises the VR equipment; the virtual driving system also comprises a real driver seat; displaying a driving virtual environment to a VR glasses wearer by VR glasses of the VR device; the orientation of the camera is in the horizontal plane and perpendicular to the front direction of the driver seat. Specifically, the traditional gesture is obtained by detecting the posture of the control handle and the laser beam emitted by the control handle, and the laser beam forms a light spot on a real object in a real environment, but there is a great difference between the training or entertainment for simulating driving a car and the operation gesture of the steering wheel in reality. Accordingly, the present invention provides a VR device, particularly one suitable for use in a virtual driving system.
The gesture information of the control handle is used as the first control input, the bare-handed gesture of the VR glasses wearer is used as the second control input, and the control flexibility is improved. The dual-input VR device comprising: VR glasses, a control handle and a camera; the control handle inputs the attitude information into the VR glasses in a wireless mode; the camera is used for catching the bare-handed gesture input of VR glasses wearer and giving VR glasses. The control handle has two, provides VR glasses wearer's left hand, right hand respectively and uses.
In a preferred example, when the two hands of the VR glasses wearer overlap and block in the picture captured by the camera, the picture is captured by the camera which is installed on the VR glasses and is coaxially or parallelly arranged with the VR glasses in the direction. This allows both hands to be fully observed at the same time at any time.
In another preferred example, the VR glasses recognize the overlapping occlusion of the two hands as a gesture, and recognize the gesture as controlling the steering wheel to rotate for one circle. VR glasses shelter from the right hand with the left hand and discern as the gesture of control steering wheel rotation one week right, VR glasses shelter from the left hand with the right hand and discern as the gesture of control steering wheel rotation one week left. Therefore, the two hands can be controlled by gestures respectively, new gestures can be generated between the two hands through matching, and the number and the flexibility of the gestures are greatly increased.
When the sensors on both control handles detect that the control handles are held, the recognition of gestures of captured images from the cameras is suspended. In this case, if there is a hand on the screen captured by the camera, the hand is not the hand of the VR glasses wearer, and therefore recognition is not necessary, and it is considered that the hand does not collide with the control command of the control handle after the gesture is recognized.
Further preferably, when the sensors on the two control handles detect that the control handles are held first and then detect that the control handles are not held, the images captured by the cameras before and after the time when the control handles are not held are compared, a new hand object is found at the later time, and the new hand object is considered as the hand of the AR glasses wearer and gesture recognition is performed. The camera passes through wireless signal communication connection VR glasses with VR glasses phase separation, camera. Thus, when the camera captures more than three hands in the picture, the hands of the VR glasses wearer can be known so as to be distinguished from the hands of other people. So that only two hands of the VR glasses wearer are gesture recognized.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.
Claims (8)
1. A dual-input VR device comprising: VR glasses, a control handle and a camera;
the control handle inputs the attitude information into the VR glasses in a wireless mode;
the camera is used for catching the bare-handed gesture input of VR glasses wearer and giving VR glasses.
2. The dual-input VR device of claim 1, wherein there are two control handles that are provided for left and right hand use by a VR glasses wearer;
when the sensors on both control handles detect that the control handles are held, the recognition of gestures of captured images from the cameras is suspended.
3. The dual-input VR device of claim 2 wherein when both sensors on both handles detect that the handle is held and then both detect that the handle is not held, then comparing the captured images from the camera before and after the moment when the handle is not held, finding a new hand object at a later moment, considering the new hand object as the hand of the AR glasses wearer, and performing gesture recognition.
4. The dual-input VR device of claim 1 wherein the camera is separate from VR glasses and the camera is coupled to the VR glasses via wireless signal communication.
5. A virtual driving system, comprising the VR device of any of claims 1-4;
the virtual driving system also comprises a real driver seat;
displaying a driving virtual environment to a VR glasses wearer by VR glasses of the VR device;
the orientation of the camera is in the horizontal plane and perpendicular to the front direction of the driver seat.
6. The virtual driving system according to claim 5, wherein when there is an overlapping occlusion of both hands of the VR glasses wearer in the camera-captured picture, the virtual driving system switches to a camera-captured picture mounted on the VR glasses and disposed coaxially or parallel to the VR glasses in an upward direction.
7. The virtual driving system of claim 6, wherein the VR glasses recognize the presence of overlapping occlusions of the two hands as gestures that control one turn of the steering wheel.
8. The virtual driving system of claim 7, wherein the VR glasses recognize a left-handed occluded right hand as a gesture to control one rotation of the steering wheel to the right and the VR glasses recognize a right-handed occluded left hand as a gesture to control one rotation of the steering wheel to the left.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011453297.9A CN112558773A (en) | 2020-12-11 | 2020-12-11 | Dual-input VR device and virtual driving system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011453297.9A CN112558773A (en) | 2020-12-11 | 2020-12-11 | Dual-input VR device and virtual driving system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112558773A true CN112558773A (en) | 2021-03-26 |
Family
ID=75061560
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011453297.9A Pending CN112558773A (en) | 2020-12-11 | 2020-12-11 | Dual-input VR device and virtual driving system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112558773A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116469279A (en) * | 2022-12-28 | 2023-07-21 | 润芯微科技(江苏)有限公司 | Automobile click-to-read teaching method and system |
-
2020
- 2020-12-11 CN CN202011453297.9A patent/CN112558773A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116469279A (en) * | 2022-12-28 | 2023-07-21 | 润芯微科技(江苏)有限公司 | Automobile click-to-read teaching method and system |
| CN116469279B (en) * | 2022-12-28 | 2023-09-15 | 润芯微科技(江苏)有限公司 | Automobile click-to-read teaching method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20230066626A (en) | Tracking of Hand Gestures for Interactive Game Control in Augmented Reality | |
| JP2022530012A (en) | Head-mounted display with pass-through image processing | |
| US20130063560A1 (en) | Combined stereo camera and stereo display interaction | |
| US10701344B2 (en) | Information processing device, information processing system, control method of an information processing device, and parameter setting method | |
| WO2015180497A1 (en) | Motion collection and feedback method and system based on stereoscopic vision | |
| US20140160162A1 (en) | Surface projection device for augmented reality | |
| CN105252532A (en) | Method of cooperative flexible attitude control for motion capture robot | |
| CN104536579A (en) | Interactive three-dimensional scenery and digital image high-speed fusing processing system and method | |
| US20120281092A1 (en) | Visual communication using a robotic device | |
| CN110610547A (en) | Cabin training method and system based on virtual reality and storage medium | |
| CN110045832B (en) | AR interaction-based immersive safety education training system and method | |
| WO2017065348A1 (en) | Collaboration method using head mounted display | |
| US11151804B2 (en) | Information processing device, information processing method, and program | |
| CN107918482A (en) | The method and system of overstimulation is avoided in immersion VR systems | |
| US11442685B2 (en) | Remote interaction via bi-directional mixed-reality telepresence | |
| CN112558773A (en) | Dual-input VR device and virtual driving system | |
| CN107463261A (en) | Three-dimensional interaction system and method | |
| JPH10198506A (en) | System for detecting coordinate | |
| KR101076263B1 (en) | Tangible Simulator Based Large-scale Interactive Game System And Method Thereof | |
| CN108553888A (en) | Augmented reality exchange method and device | |
| US20220351442A1 (en) | Animation production system | |
| JPH11211414A (en) | Position detecting system | |
| CN105759552B (en) | A kind of method for displaying image and electronic equipment | |
| Isham et al. | Vr welding kit: Accuracy comparison between smartphone vr and standalone vr using rmse | |
| JP6964302B2 (en) | Animation production method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |