CN107436749A - Character input method and system based on three-dimension virtual reality scene - Google Patents
Character input method and system based on three-dimension virtual reality scene Download PDFInfo
- Publication number
- CN107436749A CN107436749A CN201710656786.6A CN201710656786A CN107436749A CN 107436749 A CN107436749 A CN 107436749A CN 201710656786 A CN201710656786 A CN 201710656786A CN 107436749 A CN107436749 A CN 107436749A
- Authority
- CN
- China
- Prior art keywords
- word
- control unit
- virtual
- text
- character input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Abstract
The present invention provides a kind of character input method and system based on three-dimension virtual reality scene, character input system includes computer terminal, handheld control unit, speech capture unit, speech capture control unit, voice converting unit and text importing and edit cell, chooses the word input position under reality environment；The beginning of control voice capture and end time；The voice messaging of user is captured, and is transferred to computer terminal；Voice messaging is converted into text information in real time；The text information after conversion is shown in the word input position chosen, and the word of identification mistake is deleted and corrected.The position of the input of word as needed of the invention, directly by the converting voice message into text message of user, is shown in virtual reality scenario, word input efficiency is high, speed is fast, greatly improves the Experience Degree of virtual reality.
Description
Technical field
The present invention relates to technical field of virtual reality, and in particular to a kind of word input based on three-dimension virtual reality scene
Method and system.
Background technology
At present in the VR experience that teaching, training etc. can interact, more by the way of computer+head mounted display+handle.Adopting
During with this mode, the vision of user is closed by head mounted display, therefore user has no idea to carry out by the keyboard of computer
Words input operates.Current settling mode is that the dummy keyboard completion word operated by handle in reality environment is defeated
Enter, this mode word input efficiency is low, the covert time for adding experience, so as to aggravated head mounted display to it is artificial into
Dizziness, the sense of discomfort such as compressing.
The content of the invention
The present invention provides a kind of character input method based on three-dimension virtual reality scene, can be directly by the voice of user
Information is converted into text information, and is shown in virtual reality scenario.
In order to solve the above technical problems, the present invention adopts the following technical scheme that：
A kind of character input method based on three-dimension virtual reality scene, comprises the following steps：Choose under reality environment
Word input position；The beginning of control voice capture and end time；The voice messaging of user is captured, and is transferred to computer end
End；Voice messaging is converted into text information in real time；The text information after conversion is shown in the word input position chosen, and
The word of identification mistake is deleted and corrected.
The present invention also provides a kind of character input system based on three-dimension virtual reality, including：
Computer terminal；
Handheld control unit, for choosing and locking the word input position under reality environment；
Speech capture unit, for capturing the voice messaging of user, and it is real-time transmitted to computer terminal；
Speech capture control unit, beginning and end time for control voice capture；
Voice converting unit, it is placed in computer terminal, for converting speech information into text information；
Text importing and edit cell, it is placed in computer terminal, for showing the text information after changing, and can be by virtual
Keyboard enters edlin and amendment to the word of identification mistake.
From above technical scheme, the present invention position that word inputs as needed, directly by the voice messaging of user
Text information is converted into, is shown in virtual reality scenario, word input efficiency is high, speed is fast, greatly improves virtual existing
Real Experience Degree.
Brief description of the drawings
Fig. 1 is the system block diagram of character input system of the present invention.
Embodiment
A kind of preferred embodiment of the present invention is described in detail below in conjunction with the accompanying drawings.
As shown in figure 1, the character input system include computer terminal 1, handheld control unit 2, speech capture unit 3,
Speech capture control unit 4, voice converting unit 5 and text importing and edit cell 6.
The handheld control unit 2, for choosing and locking the word input position under reality environment；Speech capture
Unit, for capturing the voice messaging of user, and it is real-time transmitted to computer terminal；Speech capture control unit, for controlling language
The beginning of sound capture and end time.
The handheld control unit 2 positions virtual cursor or virtual ray in three-dimension virtual reality by optical positioning system
Position in scene.Optical positioning system is divided into a variety of targeting schemes such as active optical positioning and passive optical, here only
The principle of passive optical positioning is sketched：Two generating lasers are disposed in the space for needing to position, form a 4.5*
4.5 meters of square region, this region can be adjusted according to actual size of the space.Laser beam is by two rows inside transmitter
Fixed LED is sent, 6 times per second.Two scan modules are designed with each generating laser, respectively both horizontally and vertically
Launch located space the located space of vertical and horizontal laser scanning 4.5*4.5 rice in turn.It is covered with light on head mounted display and handle
Dependent sensor, while laser is inswept, head mounted display and handle start counting up, and after sensor receives laser, utilize biography
Sensor position and the relation for receiving Laser Time, calculate the accurate location relative to generating laser.Laser beam in the same time
The light sensor hit is enough, the model with regard to that can form a 3D.The position of handle and head mounted display can not only be detected
Put, the direction of handle and head mounted display can also be captured.Positioning flow includes laser scanning, inductor signal receives,
Effective receiving point judges, data operation and coordinate export.
In the present embodiment, handheld control unit uses equipment handle, and it chooses the concrete operations of word input position to be：If
The virtual ray of standby handle control hovers over the position for needing to input word and presses the confirming button of equipment handle, completes input
The selection and locking of position.Handheld control unit includes selection subelement and locking subelement, selects subelement control virtual optical
Position of the line in reality environment（Need by optical positioning system）, lock of the locking subelement for completing input position
Fixed and unblock, the present embodiment are realized by the confirming button on handle.When the virtual ray controlled by selection subelement is moved to
When on the text box of text importing and edit cell, the determination button of lower handle is pressed, completes the selection and locking of input position.When
When the virtual ray controlled by selection subelement is moved to outside the text box of text importing and edit cell, by lower handle
Confirming button, complete the unblock of input position.
Handheld control unit 2 and speech capture control unit 4 can be integrated in equipment handle, speech capture control is single
Member is also to pass through button control, and in beginning and the end time of control voice capture, the corresponding button of long-press equipment handle is long
By period, voice messaging is persistently captured, release button stops capture speech data.
For the data transfer of the speech capture unit 3 and computer terminal 1 to be wirelessly transferred, the speech capture unit can be with
For Wearable, can also be built in head mounted display.
The voice converting unit 5 and text importing are built into computer terminal 1 with edit cell 6, and voice conversion is single
After member receives the voice messaging that speech capture unit sends over, i.e., the voice messaging is converted into text information in real time.Text
Word is shown to be used to show the text information after changing with edit cell, supports dummy keyboard to carry out the word of speech recognition errors
Delete and correct.Dummy keyboard has the function button of true computer, supports the input such as Chinese, English, numeral, symbol.It is described
Text importing is made up of with edit cell text box and dummy keyboard, and text box is used to show word input and the result of editor,
Dummy keyboard is used to manually enter and edit.Only when handheld control unit completes the selection and locking of input position, virtually
Keyboard just occurs that, when input position is when being unlocked, dummy keyboard disappears.
Text importing and display location of the edit cell in three-dimension virtual reality scene are fixed position, the fixed position
Refer to, three-dimensional scene design teacher is when design is with editor's three-dimensional scenic, some or certain several spies in three-dimensional scenic in advance
Implantation text importing and edit cell are put in positioning.When user puts on head mounted display experience type in three-dimension virtual reality environment
When, text importing is fixed with position of the edit cell in three-dimensional scenic, and user can only select and lock pre-selection setting
Fixed position could input word.
When the deletion of errors in text needs occur and correcting, first, selected and locked in text box by handheld control unit
The right side of deletion text point is needed, is specifically：Virtual ray/cursor is moved to the right positions for needing to delete word, passes through
Button is determined by lower handle, completes the selection and locking of delete position in text box, the position of locking passes through sudden strain of a muscle in text box
Bright cursor is shown.Then, the deletion button on dummy keyboard is clicked on virtual ray/cursor, deletes mistake on the left of blinking cursor
Word.Finally, word is re-entered by dummy keyboard or voice, the text importing re-entered passage of scintillation light in text box
On the left of target.
The implementation process of character input method of the present invention, it is specific as follows：
Step 1: choosing the position for needing to input word in virtual reality scenario, and eject dummy keyboard interface.
In embodiment, user dresses and opens head mounted display and handheld control unit, passes through handheld control unit
Position of the virtual ray/virtual cursor in three-dimension virtual reality scene is controlled, user hovers over virtual ray/virtual cursor
Need to input the position of word and press the confirming button of handheld control unit, complete the selection and locking of input position, and phase
The ejection dummy keyboard interface answered.
The head mounted display, handheld control unit and attached virtual ray/virtual cursor are in three-dimension virtual reality field
Position in scape is positioned by optical positioning system.
At this time it is also possible to word is directly inputted by dummy keyboard., can be direct if being not desired to input word by dummy keyboard
Perform step 2.
Step 2: the button that long-press handheld control unit is set in advance, triggers speech capture control unit, voice is waken up
Capture unit and the voice messaging that user sends during catching long-press button, catch beginning, end time and the length of voice messaging
It is consistent by the beginning of handheld control unit button, end time.The voice messaging captured transmits from speech capture unit in real time
To voice converting unit, it can use and be wirelessly transferred.
Step 3: the voice messaging received is converted into text information by voice converting unit in real time.
Step 4: the text information appears in the input position.
If Step 5: text information input is errorless, input is completed；If the word has a small amount of mistake, by hand-held
Control unit control dummy keyboard completes word modification and editor in three-dimension virtual reality scene, after modification is correct, completes defeated
Enter.
Embodiment described above is only that the preferred embodiment of the present invention is described, not to the model of the present invention
Enclose and be defined, on the premise of design spirit of the present invention is not departed from, technical side of the those of ordinary skill in the art to the present invention
The various modifications and improvement that case is made, it all should fall into the protection domain of claims of the present invention determination.
Claims (8)
1. a kind of character input method based on three-dimension virtual reality scene, it is characterised in that comprise the following steps：
1）Choose the word input position under reality environment；
2）The beginning of control voice capture and end time；
3）The voice messaging of user is captured, and is transferred to computer terminal；
4）Voice messaging is converted into text information in real time；
5）Shown in the word input position chosen conversion after text information, and to identification mistake word carry out delete and
Amendment.
2. a kind of character input system based on three-dimension virtual reality, including computer terminal, it is characterised in that also include：
Handheld control unit, for choosing and locking the word input position under reality environment；
Speech capture unit, for capturing the voice messaging of user, and it is real-time transmitted to computer terminal；
Speech capture control unit, beginning and end time for control voice capture；
Voice converting unit, it is placed in computer terminal, for converting speech information into text information；
Text importing and edit cell, it is placed in computer terminal, for showing the text information after changing, and can be by virtual
Keyboard enters edlin and amendment to the word of identification mistake.
3. character input system according to claim 2, it is characterised in that the handheld control unit passes through optical alignment
System positions the position of virtual cursor or virtual ray in three-dimension virtual reality scene.
4. character input system according to claim 2, it is characterised in that handheld control unit and the speech capture control
Unit processed is integrated in equipment handle.
5. according to the character input system described in claim any one of 2-4, it is characterised in that the handheld control unit includes
Subelement and locking subelement are selected, the selection subelement controls the position of virtual cursor or virtual ray in reality environment
Put, locking subelement is used for the locking and unblock for completing input position；When the virtual cursor controlled by selection subelement or virtual
When light is moved to text importing with edit cell, triggering locking subelement, the selection and locking of input position are completed；When by
The virtual cursor or virtual ray of selection subelement control are moved to when outside text importing and edit cell, triggering locking
Unit, complete the unblock of input position.
6. character input system according to claim 2, it is characterised in that the speech capture unit and computer terminal
Data transfer is to be wirelessly transferred.
7. character input system according to claim 2, it is characterised in that the speech capture unit is Wearable
Or it is built in head mounted display.
8. character input system according to claim 2, it is characterised in that the text importing is with edit cell by text
Frame and dummy keyboard composition, text frame be used for show word input and editor result, dummy keyboard be used for manually enter and
Editor, when handheld control unit completes the selection and locking of input position, dummy keyboard is recalled, when input position is unlocked
When, dummy keyboard disappears.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710656786.6A CN107436749A (en) | 2017-08-03 | 2017-08-03 | Character input method and system based on three-dimension virtual reality scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710656786.6A CN107436749A (en) | 2017-08-03 | 2017-08-03 | Character input method and system based on three-dimension virtual reality scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107436749A true CN107436749A (en) | 2017-12-05 |
Family
ID=60461439
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710656786.6A Pending CN107436749A (en) | 2017-08-03 | 2017-08-03 | Character input method and system based on three-dimension virtual reality scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107436749A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109871195A (en) * | 2019-03-01 | 2019-06-11 | 黄小四 | The control method and device that can voice input and identify |
| CN111475132A (en) * | 2020-04-07 | 2020-07-31 | 捷开通讯(深圳)有限公司 | Virtual or augmented reality character input method, system and storage medium |
| WO2021212603A1 (en) * | 2020-04-23 | 2021-10-28 | 捷开通讯(深圳)有限公司 | Method and apparatus for achieving voice input by using head control |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106527729A (en) * | 2016-11-17 | 2017-03-22 | 科大讯飞股份有限公司 | Non-contact type input method and device |
| CN106648096A (en) * | 2016-12-22 | 2017-05-10 | 宇龙计算机通信科技(深圳)有限公司 | Virtual reality scene-interaction implementation method and system and visual reality device |
| CN106775555A (en) * | 2016-11-24 | 2017-05-31 | 歌尔科技有限公司 | A kind of input control method of virtual reality device and virtual reality device |
| CN106814844A (en) * | 2015-12-01 | 2017-06-09 | 深圳市掌网科技股份有限公司 | A kind of virtual reality interactive system and method |
-
2017
- 2017-08-03 CN CN201710656786.6A patent/CN107436749A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106814844A (en) * | 2015-12-01 | 2017-06-09 | 深圳市掌网科技股份有限公司 | A kind of virtual reality interactive system and method |
| CN106527729A (en) * | 2016-11-17 | 2017-03-22 | 科大讯飞股份有限公司 | Non-contact type input method and device |
| CN106775555A (en) * | 2016-11-24 | 2017-05-31 | 歌尔科技有限公司 | A kind of input control method of virtual reality device and virtual reality device |
| CN106648096A (en) * | 2016-12-22 | 2017-05-10 | 宇龙计算机通信科技(深圳)有限公司 | Virtual reality scene-interaction implementation method and system and visual reality device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109871195A (en) * | 2019-03-01 | 2019-06-11 | 黄小四 | The control method and device that can voice input and identify |
| CN111475132A (en) * | 2020-04-07 | 2020-07-31 | 捷开通讯(深圳)有限公司 | Virtual or augmented reality character input method, system and storage medium |
| WO2021203511A1 (en) * | 2020-04-07 | 2021-10-14 | 捷开通讯(深圳)有限公司 | Virtual or augmented reality text input method and system, and storage medium |
| EP4134809A4 (en) * | 2020-04-07 | 2024-03-20 | Jrd Communication Shenzhen Ltd | Virtual or augmented reality text input method and system, and storage medium |
| WO2021212603A1 (en) * | 2020-04-23 | 2021-10-28 | 捷开通讯(深圳)有限公司 | Method and apparatus for achieving voice input by using head control |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107436749A (en) | Character input method and system based on three-dimension virtual reality scene | |
| CN110266992A (en) | A kind of long-distance video interactive system and method based on augmented reality | |
| CN105096324B (en) | A kind of camera device scaling method and camera device | |
| CN106097794A (en) | The Chinese phonetic alphabet based on augmented reality combination is recognized reading learning system and recognizes reading method | |
| CN106782551A (en) | A kind of speech recognition system and method | |
| CN107155092A (en) | Operating room monitoring method and operating room supervising device | |
| CN104090664B (en) | A kind of interactive projection method, apparatus and system | |
| CN105227830A (en) | A kind of method for processing video frequency and processing system for video | |
| CN106446861A (en) | Sign language recognition system, device and method | |
| CN107357434A (en) | Information input equipment, system and method under a kind of reality environment | |
| CN109993130A (en) | One kind being based on depth image dynamic sign language semantics recognition system and method | |
| CN107992780A (en) | A kind of code recognition method and mobile terminal | |
| CN107656991A (en) | A kind of remote guide method, apparatus and system | |
| CN107977070B (en) | Method, device and system for controlling virtual reality video through gestures | |
| KR102048208B1 (en) | Method and program of x-ray simulation using augmented reality | |
| CN205726069U (en) | Unmanned vehicle controls end and unmanned vehicle | |
| CN103139457B (en) | A kind of image obtains control method and electronic equipment | |
| CN106215404A (en) | A kind of check the method for integral of motion, Apparatus and system at any time | |
| CN107526162A (en) | Virtual glasses | |
| CN106686089B (en) | Voice-based control method and system for cloud sharing of motion capture data | |
| CN106933355A (en) | The quick method for obtaining moving object information in real time in augmented reality | |
| CN107765848A (en) | A kind of control method and device of projected image | |
| CN206922960U (en) | A kind of intelligent TV set using gesture remote control | |
| CN106527720A (en) | Immersive interaction control method and system | |
| CN109215408A (en) | A kind of drawing teaching auxiliary device extracted based on image outline |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171205 |
|
| RJ01 | Rejection of invention patent application after publication |