CN208888763U - A kind of virtual reality fusion keyboard system for virtual reality - Google Patents
A kind of virtual reality fusion keyboard system for virtual reality Download PDFInfo
- Publication number
- CN208888763U CN208888763U CN201820524446.8U CN201820524446U CN208888763U CN 208888763 U CN208888763 U CN 208888763U CN 201820524446 U CN201820524446 U CN 201820524446U CN 208888763 U CN208888763 U CN 208888763U
- Authority
- CN
- China
- Prior art keywords
- hand
- keyboard
- actual
- virtual reality
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The utility model discloses a kind of virtual reality fusion keyboard systems for virtual reality, can give the true tactile force feedback of user, the input experience and the sense of reality of the input of lifting system keyboard, while promoting input efficiency by virtual reality fusion technology.The technical solution of the utility model are as follows: obtain equipment, actual keyboard, computer and head-mounted display HMD including position tracker, hand-type.Position tracker is set on actual keyboard, is obtained actual keyboard real-time position information and is sent to computer.Hand-type obtains equipment, and the hand shape and hand position data when for obtaining user's hand percussion keyboard are sent to computer.Computer controls HMD according to actual keyboard real-time position information and renders dummy keyboard in the corresponding position of virtual scene, and dummy keyboard is consistent with actual keyboard geometry.Computer renders hand shape in the corresponding position of virtual scene according to hand shape and hand position data control HMD.
Description
Technical field
The utility model relates to technical field of virtual reality, and in particular to a kind of virtual reality fusion keyboard for virtual reality
System.
Background technique
It is general there are two types of scheme when being related to the virtual reality system for keyboard at present in technical field of virtual reality,
The respectively patent of Holographic Keyboard-Microsoft and Publication No. CN106354412A, both based on virtual existing
The input method and device of real equipment.
Holographic Keyboard-Microsoft: the program captures the depth of the true hand of user using depth camera
Information is spent, using depth information, the posture of real-time tracing user hand, and shows holographic hand image in the helmet.User's activation
When virtual keyboard system, the fixed interaction angle for being shown in virtual hand following distance, and being kept fixed of dummy keyboard.When
When user carries out actuation of keys, occur shade below virtual hand, and as actuation of keys is to centre convergence, promotes interactive experience.
The program is also by virtual key animation, and when finger is stretched to some key, the key to be selected can extend outwardly, and press this
When key, virtual key is mobile to surface of keyboard, increases interactive authenticity.
However the Holographic Keyboard mixed reality system of Microsoft is defeated using dummy keyboard progress key
Enter, although there is key animation to promote interactive experience, compared with traditional actual keyboard input, lacks tactile force feedback, significantly
The sense of reality for reducing virtual reality system, influences input speed.The system needs to carry out image zooming-out to hand in real time, knows
Not, hand images are drawn out, increases the complexity of algorithm, increase the pressure for calculating equipment.It is identified to hand
When, when there is compound action (for example two fingers intersect) in the true hand of user, in fact it could happen that finger identification is chaotic, leads to virtual skeleton
Corresponding mistake, occurs deformity.
Input method and device (patent No.: CN106354412A) based on virtual reality device: this solution provides one
Virtual keyboard input system of the kind in virtual reality device.When there are input operating characteristics in default identification region in user,
Trigger the display of dummy keyboard, the preset relation that the dummy keyboard and virtual finger of display can be kept fixed.When camera shooting machine examination
When measuring the virtual hand image of user has mobile and digital flexion, the moving distance of opponent judges, determines the key of user
Information, and shown.It, can be to keyboard position again when the key information of output is not met with actual key in system
Calibration display, improves the accuracy rate of input.
Virtual keyboard input system in the virtual reality device needs the distance mobile to finger and curved in input
Qu Chengdu is measured in real time, and due to existing hand tracking system, there are calibrated error and ambient noise etc., causes to have certain
Location error, cause input information misjudgment.When using keyboard, user automatic may loosen in hand bending
Posture may cause system erroneous input, reduce the input efficiency of user.Also, the program uses dummy keyboard, with conventional keypad
It compares, lacks tactile force feedback, reduce the sense of reality of input experience and virtual reality system.
To sum up, both the above is that dummy keyboard is established in virtual scene for the virtual system of keyboard, and user is directed to
Dummy keyboard is operated, and tactile force feedback is lacked, and reduces the sense of reality of input experience and virtual reality system；Simultaneously because
Tracking in real time can not be carried out efficiently to user's hand, cause input efficiency slack-off.
Utility model content
In view of this, the present invention provides a kind of virtual reality fusion keyboard systems for virtual reality, can pass through
Virtual reality fusion technology, gives the true tactile force feedback of user, the input experience and the sense of reality of the input of lifting system keyboard, simultaneously
Promote input efficiency.
The technical solution of the utility model is
A kind of virtual reality fusion keyboard system for virtual reality, the system include: position tracker, hand-type acquisition set
Standby, actual keyboard, computer and head-mounted display HMD.
Position tracker is set on actual keyboard, is obtained actual keyboard real-time position information and is sent to computer.
Hand-type obtains equipment, is sent to computer for obtaining hand data when user taps keyboard with hand.
Computer controls HMD according to actual keyboard real-time position information and renders virtual key in the corresponding position of virtual scene
Disk, dummy keyboard are consistent with actual keyboard geometry.
Computer controls HMD according to hand data and renders hand shape in the corresponding position of virtual scene.
Further, position tracker includes the induction point of base station and setting quantity；The quantity of induction point is arbitrarily chosen；If
The induction point of fixed number amount is set on actual keyboard or around actual keyboard；Base station, for emitting signal, emitted signal is felt
It should put and receive；Base station is also used to obtain the inductive signal of induction point, obtains actual keyboard real time position letter according to inductive signal
Breath.
Preferably, it is data glove that hand-type, which obtains equipment,.
Preferably, it is depth camera that hand-type, which obtains equipment,；
Depth camera is irradiated using active infrared light, is covered on the desktop and actual keyboard in depth camera coverage
Infrared material is absorbed, depth camera acquisition obtains hand depth image as hand receipt；It include hand in hand depth image
Portion's shape and hand position data；Computer controls HMD according to depth image and sells in the corresponding position rendering that goes out of virtual scene
Portion's shape.
Further, depth camera refresh rate is in 30hz or more.
Preferably, it is color camera that hand-type, which obtains equipment,；Color camera acquires the hand color image of user as hand
Data；Computer controls HMD according to hand color image and renders hand shape in the corresponding position of virtual scene.
Preferably, it is depth camera and color camera that hand-type, which obtains equipment,.
Depth camera is irradiated using active infrared light, is covered on the desktop and actual keyboard in depth camera coverage
Infrared material is absorbed, depth camera acquisition obtains hand depth image.
It include hand shape and hand position data in hand depth image.
The hand color image of color camera acquisition user.
It is superimposed using hand depth image and hand color image as hand data.
Computer controls HMD according to hand data and renders hand shape in the corresponding position that goes out of virtual scene.
Further, computer obtains the input information of true keyboard, and according to input information control HMD in virtual field
Input information is rendered in scape.
The utility model has the advantages that
1, the utility model uses actual keyboard, tracks actual keyboard position using position tracker, is obtained using hand-type
Equipment scans the keyboards such as hand and taps object, and is rendered into HMD head-mounted display virtual environment, realizes the user in virtual environment
Actual keyboard is controlled by viewing dummy keyboard and phantom hand, realizes information input.It is capable of providing very compared to technology before
The real force feedback for tapping keyboard, improves the sense of reality, comfort level, accuracy.Secondly, the utility model be not limited to before technology void
Quasi- hand, can be used simpler three-dimensional hand shape and interacts.The utility model can be realized user in virtual scene
Keyboard is used as in true environment, realizes efficiently inputting for information.
2, the utility model proposes the scheme that the depth image using depth camera scanning carries out hand rendering, depth maps
The position for tapping object as can accurately provide hand etc., technology needs to carry out the complexity of image procossing, segmentation before simplifying
Process, so that the interaction technique is simple, cost is relatively low.Compared to the information collection of data glove or hand tracker, this reality
Go out to identify and tap the hand information of keyboard with novel, any object that can tap keyboard can identify.Same phase
More convenient, cheaper than use, the rendering of virtual hand in data glove, accuracy is also higher.
Detailed description of the invention
Fig. 1 is the virtual reality fusion keyboard system composite structural diagram provided by the embodiment of the utility model for virtual reality；
Fig. 2 (a) be the virtual reality fusion keyboard system provided by the embodiment of the utility model for virtual reality in position with
Track device and hand-type obtain device location relational graph；
Fig. 2 (b) be the virtual reality fusion keyboard system provided by the embodiment of the utility model for virtual reality in position with
Track device and hand-type obtain device location relational users visual angle figure；
Fig. 2 (c) be the virtual reality fusion keyboard system provided by the embodiment of the utility model for virtual reality in position with
Track device and hand-type obtain device location relationship side view.
Specific embodiment
With reference to the accompanying drawings and examples, the utility model is described in detail.
Referring to FIG. 1, the utility model provides a kind of virtual reality fusion keyboard system for virtual reality, feature exists
In the system includes: position tracker, hand-type acquisition equipment, actual keyboard, computer and head-mounted display HMD.
Position tracker is set on actual keyboard, is obtained actual keyboard real-time position information and is sent to computer.This reality
With in new embodiment, position tracker can be used HMD and carry handle or tracker as tracking device.Tracking device and
The position of keyboard keeps relatively fixed, and the real-time position information of actual keyboard can be calculated by tracking device position.
Hand-type obtains equipment, for obtaining hand data when user's hand percussion keyboard.In the utility model embodiment
Hand data can be hand shape image or other hand shape datas.Hand data are sent to computer.
Computer controls HMD according to actual keyboard real-time position information and renders virtual key in the corresponding position of virtual scene
Disk.Dummy keyboard is consistent with actual keyboard geometry in the utility model embodiment, single vision (such as color, texture in appearance
Deng) can be inconsistent.
Computer renders hand in the corresponding position of virtual scene according to hand shape and hand position data control HMD
Shape.
When rendering, can to hand etc. tap object tip, such as finger fingertip, carry out color, the reinforcement of details etc., so as to
The case where keyboard input can be more easily observed in user in virtual scene.A cloud, small side can be used in three-dimensional auxiliary hand shape
(but not limited to this) such as blocks is rendered (such as annex), can also be rendered to other any shapes, it is only necessary to guarantee that user can
Go out position of the virtual rendering object when dummy keyboard inputs by the shape recognition of the rendering, guarantees that user can be according to void
Quasi- rendering object realizes keypad information input.
In the utility model embodiment, computer can also obtain the input information of true keyboard, and according to input information
Control HMD renders input information in virtual scene.
System solves the problem traditional virtual keyboards not to have the shortcomings that force feedback, greatly improves interactive feeling of immersion and true
Sense, and then improve the comfort level and accuracy of input.
In virtual reality fusion keyboard system provided by the embodiment of the utility model for virtual reality position tracker and
Hand-type obtains shown in device location relationship such as Fig. 2 (a).
Position tracker includes the induction point of base station and setting quantity in the utility model embodiment；
The quantity of induction point is arbitrarily chosen；Such as in Fig. 2 (a), be chosen at actual keyboard upper surface quadrangle (but it is unlimited with
This), when practical operation, appearance, size, the quantity of induction point can freely be chosen.Guarantee incude base station issue signal and
It is fixed with actual keyboard relative position, to guarantee that the position of actual keyboard is accurately calculated from the position of induction point
It sets.
Fig. 2 (b) and Fig. 2 (c) gives position tracker and hand-type in the system and obtains device location relational users view
Angle figure and side view.
The induction point of setting quantity is set on actual keyboard or around actual keyboard；
Base station, for emitting signal, emitted signal is received by induction point；Base station is also used to obtain the induction of induction point
Signal obtains actual keyboard real-time position information according to inductive signal.The position of base station guarantee can with transmitting and receiving signal,
Base station number, model etc. are chosen according to different tracking systems.
In the utility model embodiment, it is data glove that hand-type, which obtains equipment, and depth camera also can be used, such as
Leapmotion, Realsense, Kinect etc., but not limited to this.
Depth camera is irradiated using active infrared light, is covered on the desktop and actual keyboard in depth camera coverage
Infrared material is absorbed, such as sprays the paint containing 850nm infrared Absorption material.
Depth camera acquisition obtains depth image.
It include hand shape and hand position data in depth image；
Computer controls HMD according to depth image and renders hand shape in the corresponding position that goes out of virtual scene.
The utility model embodiment in order to ensure that real-time, used depth camera refresh rate in 30hz or more, this
When user will not feel delay.
In the utility model embodiment, it can also be color camera that hand-type, which obtains equipment,.
Color camera acquires the hand color image of user as hand data.
Computer controls HMD according to hand color image and renders hand shape in the corresponding position of virtual scene.
In the utility model embodiment, hand-type obtains the combination that equipment can also be depth camera and color camera.
Depth camera is irradiated using active infrared light, is covered on the desktop and actual keyboard in depth camera coverage
Infrared material is absorbed, depth camera acquisition obtains hand depth image.
It include hand shape and hand position data in hand depth image.
The hand color image of color camera acquisition user.
It is superimposed using hand depth image and hand color image as hand data.
Computer controls HMD according to hand data and renders hand shape in the corresponding position that goes out of virtual scene.
To sum up, the above is only the preferred embodiments of the present utility model only, is not intended to limit the protection of the utility model
Range.Within the spirit and principle of the utility model, any modification, equivalent replacement, improvement and so on should be included in
Within the protection scope of the utility model.
Claims (8)
1. a kind of virtual reality fusion keyboard system for virtual reality, which is characterized in that the system includes: position tracker, hand
Type obtains equipment, actual keyboard, computer and head-mounted display HMD；
The position tracker is set on the actual keyboard, is obtained actual keyboard real-time position information and is sent to the meter
Calculation machine；
The hand-type obtains equipment, and hand data when tapping the keyboard for obtaining user with hand are sent to the calculating
Machine；
The computer controls the HMD according to the actual keyboard real-time position information and renders in the corresponding position of virtual scene
Dummy keyboard, the dummy keyboard are consistent with the actual keyboard geometry；
The computer controls the HMD according to the hand data and renders the hand shape in the corresponding position of virtual scene
Shape.
2. keyboard system as described in claim 1, which is characterized in that the position tracker includes base station and setting quantity
Induction point；
The quantity of the induction point is arbitrarily chosen；
The induction point of the setting quantity is set on the actual keyboard or around the actual keyboard；
The base station, for emitting signal, emitted signal is received by the induction point；The base station is also used to obtain described
The inductive signal of induction point obtains the actual keyboard real-time position information according to the inductive signal.
3. the system as claimed in claim 1, which is characterized in that it is data glove that the hand-type, which obtains equipment,.
4. the system as claimed in claim 1, which is characterized in that it is depth camera that the hand-type, which obtains equipment,；
The depth camera is irradiated using active infrared light, on the desktop and the actual keyboard in depth camera coverage
Covering absorbs infrared material, and the depth camera acquisition obtains hand depth image as hand receipt；
It include the hand shape and hand position data in the hand depth image；
The computer controls the HMD according to the depth image and renders the hand in the corresponding position that goes out of virtual scene
Shape.
5. system as claimed in claim 4, which is characterized in that the depth camera refresh rate is in 30hz or more.
6. the system as claimed in claim 1, which is characterized in that it is color camera that the hand-type, which obtains equipment,；
The hand color image of the color camera acquisition user is as hand data；
The computer controls the HMD according to the hand color image and renders the hand in the corresponding position of virtual scene
Portion's shape.
7. the system as claimed in claim 1, which is characterized in that it is depth camera and color camera that the hand-type, which obtains equipment,；
The depth camera is irradiated using active infrared light, on the desktop and the actual keyboard in depth camera coverage
Covering absorbs infrared material, and the depth camera acquisition obtains hand depth image；
It include the hand shape and hand position data in the hand depth image；
The hand color image of the color camera acquisition user；
It is superimposed using hand depth image and hand color image as hand data；
The computer controls the HMD according to the hand data and renders the hand in the corresponding position that goes out of virtual scene
Shape.
8. the system as described in claim 1~7 is any, which is characterized in that the computer obtains the true keyboard
Information is inputted, and controls the HMD according to the input information and renders the input information in virtual scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201820524446.8U CN208888763U (en) | 2018-04-13 | 2018-04-13 | A kind of virtual reality fusion keyboard system for virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201820524446.8U CN208888763U (en) | 2018-04-13 | 2018-04-13 | A kind of virtual reality fusion keyboard system for virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN208888763U true CN208888763U (en) | 2019-05-21 |
Family
ID=66492485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201820524446.8U Active CN208888763U (en) | 2018-04-13 | 2018-04-13 | A kind of virtual reality fusion keyboard system for virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN208888763U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108334203A (en) * | 2018-04-13 | 2018-07-27 | 北京理工大学 | A kind of virtual reality fusion keyboard system for virtual reality |
| CN114546125A (en) * | 2022-04-27 | 2022-05-27 | 北京影创信息科技有限公司 | Keyboard tracking method and tracking system |
-
2018
- 2018-04-13 CN CN201820524446.8U patent/CN208888763U/en active Active
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108334203A (en) * | 2018-04-13 | 2018-07-27 | 北京理工大学 | A kind of virtual reality fusion keyboard system for virtual reality |
| CN114546125A (en) * | 2022-04-27 | 2022-05-27 | 北京影创信息科技有限公司 | Keyboard tracking method and tracking system |
| CN114546125B (en) * | 2022-04-27 | 2022-08-09 | 北京影创信息科技有限公司 | Keyboard tracking method and tracking system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108334203A (en) | A kind of virtual reality fusion keyboard system for virtual reality | |
| US11112856B2 (en) | Transition between virtual and augmented reality | |
| CN103793060B (en) | A kind of user interactive system and method | |
| Leibe et al. | The perceptive workbench: Toward spontaneous and natural interaction in semi-immersive virtual environments | |
| US9430147B2 (en) | Method for user input from alternative touchpads of a computerized system | |
| CN107209582A (en) | The method and apparatus of high intuitive man-machine interface | |
| US9857868B2 (en) | Method and system for ergonomic touch-free interface | |
| CN107728792A (en) | A kind of augmented reality three-dimensional drawing system and drawing practice based on gesture identification | |
| Leibe et al. | Toward spontaneous interaction with the perceptive workbench | |
| CN201903986U (en) | Robot simulation training system | |
| CN107357434A (en) | Information input equipment, system and method under a kind of reality environment | |
| CN202150897U (en) | Body feeling control game television set | |
| Matulic et al. | Phonetroller: Visual representations of fingers for precise touch input with mobile phones in vr | |
| CN106873775A (en) | A kind of implementation method of virtual reality interaction, system and MR gloves | |
| CN208888763U (en) | A kind of virtual reality fusion keyboard system for virtual reality | |
| CN112068757B (en) | Target selection method and system for virtual reality | |
| CN106445118A (en) | Virtual reality interaction method and apparatus | |
| Lee et al. | Design and empirical evaluation of a novel near-field interaction metaphor on distant object manipulation in vr | |
| JP5458245B2 (en) | Operation control apparatus, method thereof, and program | |
| CN108363494A (en) | A kind of mouse input system based on virtual reality system | |
| CN103336583B (en) | Projected keyboard and projected keyboard character code determine method | |
| CN102430244A (en) | Method for generating visual man-machine interaction by touching with finger | |
| Cai et al. | Gesture recognition method based on wireless data glove with sensors | |
| CN113467625A (en) | Virtual reality control device, helmet and interaction method | |
| KR101525011B1 (en) | tangible virtual reality display control device based on NUI, and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |