Content of the invention
In view of this, the embodiment of the present invention provides a kind of virtual input method and system and device, is set with improving nearly mesh and showing
Standby information input efficiency.
For achieving the above object, one embodiment of the invention provides following technical scheme:
A kind of virtual input method, is applied to nearly mesh display device, including:
When getting information input instruction, generate and match with the character entry key of external input device and function key
Dummy keyboard;
Set up between character entry key for the button in described dummy keyboard and described external input device and function key
One-to-one mapping relations;
Adjust described dummy keyboard according to the character entry key of described external input device and the layout type of function key
Layout;
Dummy keyboard after projection adjustment layout in nearly mesh display environment;
Obtain and the input information entering information as described nearly mesh display device by described external input device.
According to an embodiment, nearly mesh display environment is a kind of visualization display interface, generally by nearly mesh display device
Image is presented to the visualization display interface in user's human eye.
According to an embodiment, when the button on described external input device is detected and being triggered by user, according to virtual key
Mapping relations between the input button of the virtual key of disk and external input device, control on described dummy keyboard be triggered
Button match virtual key simulation one click action.
According to an embodiment, when the input button on described external input device is detected and being triggered by user, also include:
A pair of words frame region of simulation in nearly mesh display environment, it is outside defeated that described dialog box region is used for showing that user passes through
Enter the input information of equipment key entry.
According to an embodiment, the external input device be connected including nearly mesh display device and with described nearly mesh display device;
According to an embodiment, described nearly mesh display device can be led to described external input device by way of wired
Letter, the such as wired mode such as usb communication, serial communication.
According to an embodiment, described nearly mesh display device can wirelessly be led to described external input device
Letter, the such as wireless mode such as 2.5GHz radio communication, 5GHz radio communication.
According to an embodiment, the first information input system of described nearly mesh display device includes:
Instruction acquisition unit, when getting information input instruction, generate with the character entry key of external input device and
The dummy keyboard that function key matches;
Map unit, for for the character entry key of the button in described dummy keyboard and described external input device and work(
One-to-one mapping relations can be set up between key;
Layout adjusting unit, for adjusting according to the character entry key of described external input device and the layout type of function key
The layout of whole described dummy keyboard;
Projecting unit, for the dummy keyboard after projection adjustment layout in nearly mesh display environment;
Input information collecting unit, shows for obtaining and by the described nearly mesh that enters information as of described external input device
Show the input information of equipment.
According to an embodiment, described first information input system also includes:
Virtual click module, for when the button on described external input device is detected and being triggered by user, according to empty
Intend the mapping relations between the virtual key of keyboard and the input button of external input device, with quilt on the described dummy keyboard of control
The virtual key simulation one click action that the button of triggering matches.
According to an embodiment, described first information input system also includes:
Input information display unit, for a pair of words frame region of simulation in nearly mesh display environment, described outer when detecting
When input button on portion's input equipment is triggered by user, obtain user and given birth to by triggering the input button of external input device
The input information becoming, described input information is shown in described dialog box region.
According to an embodiment, described nearly mesh display device is head-mounted display apparatus.
According to an embodiment, described nearly mesh display device is virtual implementing helmet.
According to an embodiment, described external input device is two-dimentional interactive device.
According to an embodiment, described external input device is touch screen type input equipment.
According to an embodiment, in described external input device, it is configured with the second information input system, described second information is defeated
Enter system for when getting information input instruction, controlling described touch screen type input equipment to switch to information input pattern.
According to an embodiment, it is configured with multiple input methods in described second information input system, described second information is defeated
Enter system and control the switching between multiple input methods according to user operation.
According to an embodiment, in described second information input system, the input method of configuration can include:Endian format inputs
Method, full key board disc type input method etc..
According to an embodiment, described external input device is touch screen type input equipment, under information input pattern, described tactile
The input button of screen formula input equipment includes:The virtual input button that shown by touch screen and to be arranged on described touch screen type defeated
Enter the entity input button on equipment;
According to an embodiment, described physical button, including:
It is arranged at the first function key of the side of described touch screen type input equipment first corner position;
It is arranged at the second function key of the side of described touch screen type input equipment second corner position;
It is arranged at the 3rd function key at described touch screen type input equipment display surface bottom position, the 4th function key and the 5th
Function key.
According to an embodiment, described second information input system, including:
After described touch screen type input equipment enters input pattern, described instruction recognition unit is used for:
Monitor the triggering state of described 3rd function key, when described 3rd function key is triggered, control user to pass through to touch
The letter touching screen input is capitalization, when described 3rd button is not triggered, controls the word that user is inputted by touch screen
Female is lower case;
When described 3rd function key is detected and the first function key is triggered simultaneously, a upper input is deleted in described execution
The operation of character or the operation of input pattern switching, described input pattern at least includes:Input in Chinese pattern, English input mould
Formula, symbol input pattern and number entry mode;
When described 3rd key is detected and the 4th key is triggered simultaneously, carry out input method handover operation.
According to an embodiment, by carrying out the information input of nearly mesh display device using external input device, defeated in information
During entering, generate the dummy keyboard corresponding with described external input device in described nearly mesh display environment, by described
Virtual keyboard user can intuitively be checked and external input device is operated, and its effect Approximate Equivalent is not being worn in user
Directly external input device is operated in the case of wearing nearly mesh display device, thus, improve the input efficiency of user.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation description is it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of not making creative work
Embodiment, broadly falls into the scope of protection of the invention.
It is directed to the low problem of the input efficiency of nearly mesh display device in prior art, this application discloses a kind of virtual defeated
Enter method and system device, to improve the speed of user input information.
In scheme disclosed in an embodiment, described nearly mesh display device can be apart from human eye pupil certain distance scope
(usually 5 millimeters to 60 millimeters scopes), to represent the head-mounted display apparatus of display picture to user.Can also be to be attached to people
Circle on eye eyeball pupil or ellipse, to represent the miniature display device of display picture to user.For example it can be void
Intend realizing (VR) helmet or glasses, augmented reality (AR) helmet or glasses, the mixed reality helmet or glasses, video eyeglasses etc..
In scheme disclosed in an embodiment, described external input device is the input equipment for keying in information, and it can
Think keyboard, touch screen interaction system, the single camera of collection two dimensional surface epigraph information, dual camera system or many shootings
Head system etc..More specifically, in technical scheme disclosed in the embodiment of the present application, described external input device is capacitive touch
Screen interactive device.
In scheme disclosed in an embodiment, this application discloses a kind of virtual input method, the method is applied to nearly mesh
In display device, referring to Fig. 1, the method includes:
Step S101:When getting information input instruction, execution step S102;
In this step, wherein, the generation form of described information input instruction is multiple, for example, when system enters word
During document, automatically generate information input instruction, when system enters chat interface, automatically generate information input instruction etc.;
Step S102:Generate the dummy keyboard matching with external input device;
In this step, after predetermined registration operation is detected, show that user needs to carry out Data Enter, user sees for convenience
Examine inputting interface to go forward side by side row information input, it is virtual that this step generates one according to the character entry key of external input device and function key
Keyboard;
Step S103:Character entry key for the button in described dummy keyboard and described external input device and function key
Between set up one-to-one mapping relations;
In this step, user observes in Information Inputting Process for convenience, carries out self by external input device
Which kind of operation, the character entry key also to the virtual key in described dummy keyboard and external input device for the application and function
Establish one-to-one mapping relations between key, when user is when triggering certain button of external input device, control and be somebody's turn to do
The dummy keyboard that button matches acts accordingly, and enable a user to know itself this triggering is that outside input sets
Which standby button;
Here it is pointed out that when described external input device carries out information input by the way of handwriting input
When, each pixel of the handwriting area of described external input device can be equivalent to a character input button;
Step S104:Adjust described void according to the character entry key of described external input device and the layout type of function key
Intend the layout of keyboard;
In method disclosed in an embodiment, what user can observe directly is described dummy keyboard, and cannot be clear
Observe external input device, user operates to external input device for convenience, improve the accuracy of user operation, ginseng
See Fig. 4 and Fig. 5, in this step, also need to adjust according to the character entry key of external input device and the layout type of function key
The layout of described dummy keyboard, i.e. make the case layout type of described dummy keyboard and the character input of external input device
The layout type of key and function key is consistent, certainly, in addition to layout type is consistent, can also obtain external input device
The character representated by each character entry key, and on the corresponding button of described dummy keyboard arrange respective identification information, obtain
Take the identification information of each function key of external input device, and this mark letter is arranged on the respective keys of described dummy keyboard
Breath;
For example, with reference to Fig. 4 and Fig. 5, when external input device is detected using endian format input method, described virtual key
Disk is shown as nine grids pattern, and when external input device adopts full key board disc type input method, described dummy keyboard is shown as full key board
Disk pattern, referring to Fig. 6-Fig. 7, when external input device enters number entry mode, the button on described dummy keyboard shows
Be corresponding numeric keypad pattern, when external input device enter symbol input pattern when, the button on described dummy keyboard
Show corresponding keyboard symbol pattern, when external input device enters alphabetic entry mode, the button on described dummy keyboard
Display that corresponding alphabetic keypad pattern;
Step S105:Project described dummy keyboard in nearly mesh display environment;
In this step, the dummy keyboard adjusted is mapped in nearly mesh display environment, so that user is in input,
Vision is combined with tactile and memory etc., improves the input efficiency of user;
Step S106:Obtain and the input letter entering information as described nearly mesh display device by external input device
Breath.
Visible by technical scheme disclosed in the above embodiments of the present application, in technical scheme disclosed in above-described embodiment,
By carrying out the information input of nearly mesh display device using external input device, in Information Inputting Process, show in described nearly mesh
Show the generation dummy keyboard corresponding with described external input device in environment, can be intuitively by described virtual keyboard user
Check and external input device is operated, its effect Approximate Equivalent is in user in the case of not wearing nearly mesh display device
Directly input equipment is operated, thus, improve the input efficiency of user.
In scheme disclosed in the above embodiments of the present application, described external input device may be configured with input methods, example
As endian format input method, full key board disc type input method or handwritten input method etc., it is suitable that user can select according to self-demand
Input method carry out information input, in this regard, after projecting described dummy keyboard in nearly mesh display environment in said method, also wrapping
Include:
Judge whether the input method (endian format, full key board disc type or handwritten etc.) of described external input device becomes
Change, if it is, execution step S102;Whether the input pattern judging external input device changes, and (letter input, numeral are defeated
Enter or symbol input etc.), if it is, according to change after input pattern update described dummy keyboard on virtual key mark
Information.
What user knew to carry out to be triggered during information input is which button of external input device for convenience, the application
Method disclosed in above-described embodiment can also include:
When detect the button on described external input device (this button can be character entry key and function key) by with
During the triggering of family, the mapping relations between the virtual key of foundation dummy keyboard and the button of external input device are (in dummy keyboard
Button and the character entry key of described external input device and function key between mapping relations), control described dummy keyboard
The virtual key that button that is upper and being triggered matches simulates one click action or flicker once naturally it is also possible to be other
Prompt action.
When the input method of described portable mobile termianl is hand-writing input method, the work that above-mentioned prompting mode is pointed out to user
With little, for this reason, being directed to hand-writing input method, disclosed herein as well is a kind of others prompt modes, Ke Yiwei:According to described
Default mapping relations, control the character entry key of the light on and off state of button and described external input device in dummy keyboard (outward
Each pixel of portion input equipment viewing area all can be considered a character entry key) triggering state consistent.For example, exist
During handwriting area input character, the pixel that the character of described user's write is covered is considered as the character input being triggered
Key, controls the button in the dummy keyboard corresponding with these character entry keys to brighten.
In technical scheme disclosed in the above embodiments of the present application, user checks the input of previous moment input for convenience
Information, when the input button on described external input device is detected and being triggered by user, can also include:
A pair of words frame region of simulation in nearly mesh display environment, it is outside defeated that described dialog box region is used for showing that user passes through
Enter the input information of equipment key entry;
When having new input information or having input information to be deleted, update the display in described dialog box region
Content.
Corresponding with said method, referring to Fig. 2, disclosed herein as well is a kind of virtual input system device, described nearly void
Intend input system device to include:The nearly mesh display device A and external input device B being connected with described nearly mesh display device;
Wherein, there is the first information input system corresponding with above-mentioned virtual input method in described nearly mesh display device A
System, because described first information input system is corresponding with said method, therefore, this introduction is more succinct, its detail portion
Divide and mutually can use for reference with the description of method part, referring to Fig. 3, described first information input system can include:
Instruction acquisition unit 100, when getting information input instruction, generates the character entry key with external input device
The dummy keyboard matching with function key;
In scheme disclosed in the embodiment of the present application, described information input instruction can be in described nearly mesh display device
Other application sends to described first information input system, and these applications can be the documents such as word naturally it is also possible to be it
His chat software, can also be other game applications etc., when getting information input instruction, described first information input system
Start unit to start working;
Map unit 200, for the character entry key for the button in described dummy keyboard and described external input device
One-to-one mapping relations are set up and function key between;
Here it is pointed out that when described external input device carries out information input by the way of handwriting input
When, each pixel of the handwriting area of described external input device can be equivalent to a character input button;
Layout adjusting unit 300, for according to the character entry key of described external input device and the layout side of function key
Formula adjusts the layout of described dummy keyboard so that the case layout type of described dummy keyboard is defeated with the character of external input device
Enter key and the layout type of function key is consistent;To obtain external input device each character entry key representated by character,
And respective identification information is arranged on the corresponding button of described dummy keyboard, obtain each function key of external input device
Identification information, and this identification information is arranged on the respective keys of described dummy keyboard;
Projecting unit 400, for the dummy keyboard after projection adjustment layout in nearly mesh display environment;
Input information collecting unit 500, for obtain and will described external input device enter information as described near
The input information of mesh display device.
Corresponding with said method so that user understand that itself this triggering be external input device that
Individual button, described first information input system can also include:Virtual click module 600, for when user outside defeated in triggering
Enter equipment certain button when, control the virtual key that matches with this button in dummy keyboard to act accordingly;Specifically,
Which kind of action prompting is made to user using, can be according to user's request sets itself, for example described virtual click module detection
When button on described external input device is triggered by user, according to virtual key and the external input device of dummy keyboard
Mapping relations between input button, control the virtual key simulation one matching on described dummy keyboard with the button being triggered
Secondary click action or flicker are once.
When the input method of described portable mobile termianl is hand-writing input method, above-mentioned virtual to click module 600 acceptable
For:According to described default mapping relations, control the light on and off state of button and described external input device in dummy keyboard
The triggering state of character entry key (each pixel of external input device viewing area all can be considered a character entry key)
Consistent.For example, in handwriting area input character, pixel that the character of described user write is covered be considered as by
The character entry key of triggering, controls the button in the dummy keyboard corresponding with these character entry keys to brighten.
Corresponding with said method, described first information input system, also include:
Input information display unit 700, for a pair of words frame region of simulation in nearly mesh display environment, described when detecting
When input button on external input device is triggered by user, obtain user by the input button of triggering external input device
The input information generating, described input information is shown in described dialog box region, is additionally operable to new when having when detecting
Input information or when having input information to be deleted, update the display content in described dialog box region.
In order to realize information input, in described external input device, it is configured with the second information input system, described second letter
Breath input system is used for, when getting information input instruction, controlling described external input device to switch to information input pattern,
In one embodiment, when there being information input instruction to generate in described nearly mesh display system, also need described information input instruction
Send to the second information input system of described external input device.
Introduction in one embodiment, is configured with multiple input methods, described second letter in described second information input system
Breath input system controls the switching between multiple input methods according to user operation.Wherein, join in described second information input system
The input method put can include:Endian format input method and full key board disc type input method, can also include hand-writing input method, word certainly
Symbol keyboard.
In one embodiment, described external input device is touch screen type input equipment, under information input pattern, described tactile
The input button of screen formula input equipment includes:By the virtual input button of touch screen and be arranged on the input of described touch screen type and set
Standby upper entity inputs button;
In one embodiment, referring to Fig. 4, described entity inputs button, including:
It is arranged at the first function key K1 of the side of described touch screen type input equipment first corner position;
It is arranged at the second function key K2 of the side of described touch screen type input equipment second corner position;
Be arranged at the 3rd function key K3 at described touch screen type input equipment display surface bottom position, the 4th function key K4 and
Five-function key K5.
Certainly, the setting quantity of above-mentioned layout type and physical button is a kind of citing disclosed in the present application, actual raw
During product, its quantity and layout can be according to user's request sets itself.
In one embodiment, after the entity input button of touch screen type input equipment is triggered, generate corresponding function and refer to
Order, in order to be identified to these instructions, described second information input system, including:Instruction recognition unit.
After described touch screen type input equipment enters input pattern, described instruction recognition unit is used for monitoring each function key
Triggering state, and control external input device execution corresponding actions according to monitoring result;
Specifically, described instruction recognition unit is used for, and monitors the triggering state of described 3rd function key, when described 3rd work(
When energy key is triggered, the letter that user is inputted by touch screen is controlled to be capitalization, when described 3rd button is not triggered,
User is controlled to be lower case by the letter that touch screen inputs;When described 3rd function key and the first function key is detected simultaneously
When being triggered, the operation of a upper input character or the operation of input pattern switching are deleted in described execution, and described input pattern is extremely
Few inclusion:Input in Chinese pattern, English input mode, symbol input pattern and number entry mode;When detecting the described 3rd
When key and the 4th key are triggered simultaneously, carry out input method handover operation.
In one embodiment, the function of described 3rd function key can matching convention FN function key, the 4th function key can be right
Acknowledgement key that should be conventional, five-function key can matching convention esc key.
In one embodiment, when described 3rd function key and the first function key are triggered simultaneously, in described execution deletion
The operation of one input character or the operation of input pattern switching, described input pattern includes letter, symbol and figure pattern, example
As, when described 3rd function key is triggered, and the triggered time of described first function key less than the first Preset Time when, execution is deleted
Division operation, when described 3rd function key is triggered, and when the triggered time of the first function key reaches the first Preset Time, by current
Input pattern switches to next input pattern, wherein, described first function key, the second function key, the 4th function key and the 5th
Function key is only just in the state of being triggered when user presses, and described 3rd function key is often clicked on and once switched once triggering shape
State, the such as the 3rd function key current state is to trigger, and it is clicked on once, and described 3rd function key enters non-triggering state,
Again it is clicked on once, described 3rd function key enters triggering state;
Each embodiment in this specification is all described by the way of going forward one by one, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.Especially for system or
For system embodiment, because it is substantially similar to embodiment of the method, so describing fairly simple, referring to method in place of correlation
The part of embodiment illustrates.System described above and system embodiment are only schematically wherein said conduct
Separating component explanation unit can be or may not be physically separate, as the part that unit shows can be or
Person may not be physical location, you can with positioned at a place, or can also be distributed on multiple NEs.Can root
Factually border need select the purpose to realize this embodiment scheme for some or all of module therein.Ordinary skill
Personnel are not in the case of paying creative work, you can to understand and to implement.
Professional further appreciates that, in conjunction with the unit of each example of the embodiments described herein description
And algorithm steps, can with electronic hardware, computer software or the two be implemented in combination in, in order to clearly demonstrate hardware and
The interchangeability of software, generally describes composition and the step of each example in the above description according to function.These
Function to be executed with hardware or software mode actually, the application-specific depending on technical scheme and design constraint.Specialty
Technical staff can use different methods to each specific application realize described function, but this realization should
Think beyond the scope of this invention.
The step of the method in conjunction with the embodiments described herein description or algorithm can directly be held with hardware, processor
The software module of row, or the combination of the two is implementing.Software module can be placed in random access memory (RAM), internal memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, depositor, hard disk, moveable magnetic disc, CD-ROM, flash memory
In known any other form of storage medium in (Flash Memory) or technical field.
Also, it should be noted herein, such as first and second or the like relational terms are used merely to one
Entity or operation are made a distinction with another entity or operation, and not necessarily require or imply between these entities or operation
There is any this actual relation or order.And, term " inclusion ", "comprising" or its any other variant are intended to contain
Comprising of lid nonexcludability, wants so that including a series of process of key elements, method, article or equipment and not only including those
Element, but also include other key elements being not expressly set out, or also include for this process, method, article or equipment
Intrinsic key element.In the absence of more restrictions, the key element that limited by sentence "including a ..." it is not excluded that
Also there is other identical element including in the process of described key element, method, article or equipment.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses the present invention.
Multiple modifications to these embodiments will be apparent from for those skilled in the art, as defined herein
General Principle can be realized without departing from the spirit or scope of the present invention in other embodiments.Therefore, the present invention
It is not intended to be limited to the embodiments shown herein, and be to fit to and principles disclosed herein and features of novelty phase one
The scope the widest causing.