CN106383652A - Virtual input method and system apparatus - Google Patents
Virtual input method and system apparatus Download PDFInfo
- Publication number
- CN106383652A CN106383652A CN201610798668.4A CN201610798668A CN106383652A CN 106383652 A CN106383652 A CN 106383652A CN 201610798668 A CN201610798668 A CN 201610798668A CN 106383652 A CN106383652 A CN 106383652A
- Authority
- CN
- China
- Prior art keywords
- input
- virtual
- information
- key
- button
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
The invention provides a virtual input method and system apparatus. The method comprises the steps of generating a virtual keyboard matched with character input keys and function keys of an external input device when an information input instruction is obtained; establishing a one-to-one correspondence mapping relationship between keys in the virtual keyboard and the character input and function keys of the external input device; adjusting a layout of the virtual keyboard according to a layout mode of the character input keys and the function keys of the external input device; projecting the virtual keyboard after layout adjustment in a near-eye display environment; and obtaining and taking input information of the external input device as input information of a near-eye display device. The effect of the method is approximately equivalent to the process that a user directly performs operation on the input device without wearing the near-eye display device, so that the input efficiency of the user is improved.
Description
Technical field
The present invention relates to Iron ore concentration technical field is and in particular to a kind of virtual input method and system and device.
Background technology
With scientific and technological continuous development, nearly mesh display device has progressively come into the life of people, described nearly mesh display device
It is usually headset equipment, such as VR equipment, because equipment can affect human eye sight when using, impact user observes real generation
Object in boundary so that user cannot precisely, effectively using the peripheral hardware input equipment such as keyboard, user can only be by fuzzy sense
The operation external input device such as feel, often results in the information of user input mistake, and using to user makes troubles.
Content of the invention
In view of this, the embodiment of the present invention provides a kind of virtual input method and system and device, is set with improving nearly mesh and showing
Standby information input efficiency.
For achieving the above object, one embodiment of the invention provides following technical scheme：
A kind of virtual input method, is applied to nearly mesh display device, including：
When getting information input instruction, generate and match with the character entry key of external input device and function key
Dummy keyboard；
Set up between character entry key for the button in described dummy keyboard and described external input device and function key
One-to-one mapping relations；
Adjust described dummy keyboard according to the character entry key of described external input device and the layout type of function key
Layout；
Dummy keyboard after projection adjustment layout in nearly mesh display environment；
Obtain and the input information entering information as described nearly mesh display device by described external input device.
According to an embodiment, nearly mesh display environment is a kind of visualization display interface, generally by nearly mesh display device
Image is presented to the visualization display interface in user's human eye.
According to an embodiment, when the button on described external input device is detected and being triggered by user, according to virtual key
Mapping relations between the input button of the virtual key of disk and external input device, control on described dummy keyboard be triggered
Button match virtual key simulation one click action.
According to an embodiment, when the input button on described external input device is detected and being triggered by user, also include：
A pair of words frame region of simulation in nearly mesh display environment, it is outside defeated that described dialog box region is used for showing that user passes through
Enter the input information of equipment key entry.
According to an embodiment, the external input device be connected including nearly mesh display device and with described nearly mesh display device；
According to an embodiment, described nearly mesh display device can be led to described external input device by way of wired
Letter, the such as wired mode such as usb communication, serial communication.
According to an embodiment, described nearly mesh display device can wirelessly be led to described external input device
Letter, the such as wireless mode such as 2.5GHz radio communication, 5GHz radio communication.
According to an embodiment, the first information input system of described nearly mesh display device includes：
Instruction acquisition unit, when getting information input instruction, generate with the character entry key of external input device and
The dummy keyboard that function key matches；
Map unit, for for the character entry key of the button in described dummy keyboard and described external input device and work(
One-to-one mapping relations can be set up between key；
Layout adjusting unit, for adjusting according to the character entry key of described external input device and the layout type of function key
The layout of whole described dummy keyboard；
Projecting unit, for the dummy keyboard after projection adjustment layout in nearly mesh display environment；
Input information collecting unit, shows for obtaining and by the described nearly mesh that enters information as of described external input device
Show the input information of equipment.
According to an embodiment, described first information input system also includes：
Virtual click module, for when the button on described external input device is detected and being triggered by user, according to empty
Intend the mapping relations between the virtual key of keyboard and the input button of external input device, with quilt on the described dummy keyboard of control
The virtual key simulation one click action that the button of triggering matches.
According to an embodiment, described first information input system also includes：
Input information display unit, for a pair of words frame region of simulation in nearly mesh display environment, described outer when detecting
When input button on portion's input equipment is triggered by user, obtain user and given birth to by triggering the input button of external input device
The input information becoming, described input information is shown in described dialog box region.
According to an embodiment, described nearly mesh display device is head-mounted display apparatus.
According to an embodiment, described nearly mesh display device is virtual implementing helmet.
According to an embodiment, described external input device is two-dimentional interactive device.
According to an embodiment, described external input device is touch screen type input equipment.
According to an embodiment, in described external input device, it is configured with the second information input system, described second information is defeated
Enter system for when getting information input instruction, controlling described touch screen type input equipment to switch to information input pattern.
According to an embodiment, it is configured with multiple input methods in described second information input system, described second information is defeated
Enter system and control the switching between multiple input methods according to user operation.
According to an embodiment, in described second information input system, the input method of configuration can include：Endian format inputs
Method, full key board disc type input method etc..
According to an embodiment, described external input device is touch screen type input equipment, under information input pattern, described tactile
The input button of screen formula input equipment includes：The virtual input button that shown by touch screen and to be arranged on described touch screen type defeated
Enter the entity input button on equipment；
According to an embodiment, described physical button, including：
It is arranged at the first function key of the side of described touch screen type input equipment first corner position；
It is arranged at the second function key of the side of described touch screen type input equipment second corner position；
It is arranged at the 3rd function key at described touch screen type input equipment display surface bottom position, the 4th function key and the 5th
Function key.
According to an embodiment, described second information input system, including：
After described touch screen type input equipment enters input pattern, described instruction recognition unit is used for：
Monitor the triggering state of described 3rd function key, when described 3rd function key is triggered, control user to pass through to touch
The letter touching screen input is capitalization, when described 3rd button is not triggered, controls the word that user is inputted by touch screen
Female is lower case；
When described 3rd function key is detected and the first function key is triggered simultaneously, a upper input is deleted in described execution
The operation of character or the operation of input pattern switching, described input pattern at least includes：Input in Chinese pattern, English input mould
Formula, symbol input pattern and number entry mode；
When described 3rd key is detected and the 4th key is triggered simultaneously, carry out input method handover operation.
According to an embodiment, by carrying out the information input of nearly mesh display device using external input device, defeated in information
During entering, generate the dummy keyboard corresponding with described external input device in described nearly mesh display environment, by described
Virtual keyboard user can intuitively be checked and external input device is operated, and its effect Approximate Equivalent is not being worn in user
Directly external input device is operated in the case of wearing nearly mesh display device, thus, improve the input efficiency of user.
Brief description
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Have technology description in required use accompanying drawing be briefly described it should be apparent that, drawings in the following description be only this
Inventive embodiment, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
The accompanying drawing providing obtains other accompanying drawings.
Fig. 1 is a kind of schematic flow sheet of virtual input method according to disclosed in an embodiment；
Fig. 2 is a kind of structural representation of virtual input system device according to disclosed in an embodiment；
Fig. 3 is a kind of structural representation of first information input system according to disclosed in an embodiment；
Fig. 4 is a kind of structural representation of external input device according to disclosed in an embodiment；
Fig. 5 be according to disclosed in an embodiment with Fig. 3 in external input device maps mutually dummy keyboard display and
Layout effect diagram；
When Fig. 6 is that external input device enters number entry mode under nine grids input method according to disclosed in an embodiment
Display effect schematic diagram；
Fig. 7 be according to disclosed in an embodiment with Fig. 6 in external input device maps mutually dummy keyboard display and
Layout effect diagram.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation description is it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of not making creative work
Embodiment, broadly falls into the scope of protection of the invention.
It is directed to the low problem of the input efficiency of nearly mesh display device in prior art, this application discloses a kind of virtual defeated
Enter method and system device, to improve the speed of user input information.
In scheme disclosed in an embodiment, described nearly mesh display device can be apart from human eye pupil certain distance scope
(usually 5 millimeters to 60 millimeters scopes), to represent the head-mounted display apparatus of display picture to user.Can also be to be attached to people
Circle on eye eyeball pupil or ellipse, to represent the miniature display device of display picture to user.For example it can be void
Intend realizing (VR) helmet or glasses, augmented reality (AR) helmet or glasses, the mixed reality helmet or glasses, video eyeglasses etc..
In scheme disclosed in an embodiment, described external input device is the input equipment for keying in information, and it can
Think keyboard, touch screen interaction system, the single camera of collection two dimensional surface epigraph information, dual camera system or many shootings
Head system etc..More specifically, in technical scheme disclosed in the embodiment of the present application, described external input device is capacitive touch
Screen interactive device.
In scheme disclosed in an embodiment, this application discloses a kind of virtual input method, the method is applied to nearly mesh
In display device, referring to Fig. 1, the method includes：
Step S101：When getting information input instruction, execution step S102；
In this step, wherein, the generation form of described information input instruction is multiple, for example, when system enters word
During document, automatically generate information input instruction, when system enters chat interface, automatically generate information input instruction etc.；
Step S102：Generate the dummy keyboard matching with external input device；
In this step, after predetermined registration operation is detected, show that user needs to carry out Data Enter, user sees for convenience
Examine inputting interface to go forward side by side row information input, it is virtual that this step generates one according to the character entry key of external input device and function key
Keyboard；
Step S103：Character entry key for the button in described dummy keyboard and described external input device and function key
Between set up one-to-one mapping relations；
In this step, user observes in Information Inputting Process for convenience, carries out self by external input device
Which kind of operation, the character entry key also to the virtual key in described dummy keyboard and external input device for the application and function
Establish one-to-one mapping relations between key, when user is when triggering certain button of external input device, control and be somebody's turn to do
The dummy keyboard that button matches acts accordingly, and enable a user to know itself this triggering is that outside input sets
Which standby button；
Here it is pointed out that when described external input device carries out information input by the way of handwriting input
When, each pixel of the handwriting area of described external input device can be equivalent to a character input button；
Step S104：Adjust described void according to the character entry key of described external input device and the layout type of function key
Intend the layout of keyboard；
In method disclosed in an embodiment, what user can observe directly is described dummy keyboard, and cannot be clear
Observe external input device, user operates to external input device for convenience, improve the accuracy of user operation, ginseng
See Fig. 4 and Fig. 5, in this step, also need to adjust according to the character entry key of external input device and the layout type of function key
The layout of described dummy keyboard, i.e. make the case layout type of described dummy keyboard and the character input of external input device
The layout type of key and function key is consistent, certainly, in addition to layout type is consistent, can also obtain external input device
The character representated by each character entry key, and on the corresponding button of described dummy keyboard arrange respective identification information, obtain
Take the identification information of each function key of external input device, and this mark letter is arranged on the respective keys of described dummy keyboard
Breath；
For example, with reference to Fig. 4 and Fig. 5, when external input device is detected using endian format input method, described virtual key
Disk is shown as nine grids pattern, and when external input device adopts full key board disc type input method, described dummy keyboard is shown as full key board
Disk pattern, referring to Fig. 6-Fig. 7, when external input device enters number entry mode, the button on described dummy keyboard shows
Be corresponding numeric keypad pattern, when external input device enter symbol input pattern when, the button on described dummy keyboard
Show corresponding keyboard symbol pattern, when external input device enters alphabetic entry mode, the button on described dummy keyboard
Display that corresponding alphabetic keypad pattern；
Step S105：Project described dummy keyboard in nearly mesh display environment；
In this step, the dummy keyboard adjusted is mapped in nearly mesh display environment, so that user is in input,
Vision is combined with tactile and memory etc., improves the input efficiency of user；
Step S106：Obtain and the input letter entering information as described nearly mesh display device by external input device
Breath.
Visible by technical scheme disclosed in the above embodiments of the present application, in technical scheme disclosed in above-described embodiment,
By carrying out the information input of nearly mesh display device using external input device, in Information Inputting Process, show in described nearly mesh
Show the generation dummy keyboard corresponding with described external input device in environment, can be intuitively by described virtual keyboard user
Check and external input device is operated, its effect Approximate Equivalent is in user in the case of not wearing nearly mesh display device
Directly input equipment is operated, thus, improve the input efficiency of user.
In scheme disclosed in the above embodiments of the present application, described external input device may be configured with input methods, example
As endian format input method, full key board disc type input method or handwritten input method etc., it is suitable that user can select according to self-demand
Input method carry out information input, in this regard, after projecting described dummy keyboard in nearly mesh display environment in said method, also wrapping
Include：
Judge whether the input method (endian format, full key board disc type or handwritten etc.) of described external input device becomes
Change, if it is, execution step S102；Whether the input pattern judging external input device changes, and (letter input, numeral are defeated
Enter or symbol input etc.), if it is, according to change after input pattern update described dummy keyboard on virtual key mark
Information.
What user knew to carry out to be triggered during information input is which button of external input device for convenience, the application
Method disclosed in above-described embodiment can also include：
When detect the button on described external input device (this button can be character entry key and function key) by with
During the triggering of family, the mapping relations between the virtual key of foundation dummy keyboard and the button of external input device are (in dummy keyboard
Button and the character entry key of described external input device and function key between mapping relations), control described dummy keyboard
The virtual key that button that is upper and being triggered matches simulates one click action or flicker once naturally it is also possible to be other
Prompt action.
When the input method of described portable mobile termianl is hand-writing input method, the work that above-mentioned prompting mode is pointed out to user
With little, for this reason, being directed to hand-writing input method, disclosed herein as well is a kind of others prompt modes, Ke Yiwei：According to described
Default mapping relations, control the character entry key of the light on and off state of button and described external input device in dummy keyboard (outward
Each pixel of portion input equipment viewing area all can be considered a character entry key) triggering state consistent.For example, exist
During handwriting area input character, the pixel that the character of described user's write is covered is considered as the character input being triggered
Key, controls the button in the dummy keyboard corresponding with these character entry keys to brighten.
In technical scheme disclosed in the above embodiments of the present application, user checks the input of previous moment input for convenience
Information, when the input button on described external input device is detected and being triggered by user, can also include：
A pair of words frame region of simulation in nearly mesh display environment, it is outside defeated that described dialog box region is used for showing that user passes through
Enter the input information of equipment key entry；
When having new input information or having input information to be deleted, update the display in described dialog box region
Content.
Corresponding with said method, referring to Fig. 2, disclosed herein as well is a kind of virtual input system device, described nearly void
Intend input system device to include：The nearly mesh display device A and external input device B being connected with described nearly mesh display device；
Wherein, there is the first information input system corresponding with above-mentioned virtual input method in described nearly mesh display device A
System, because described first information input system is corresponding with said method, therefore, this introduction is more succinct, its detail portion
Divide and mutually can use for reference with the description of method part, referring to Fig. 3, described first information input system can include：
Instruction acquisition unit 100, when getting information input instruction, generates the character entry key with external input device
The dummy keyboard matching with function key；
In scheme disclosed in the embodiment of the present application, described information input instruction can be in described nearly mesh display device
Other application sends to described first information input system, and these applications can be the documents such as word naturally it is also possible to be it
His chat software, can also be other game applications etc., when getting information input instruction, described first information input system
Start unit to start working；
Map unit 200, for the character entry key for the button in described dummy keyboard and described external input device
One-to-one mapping relations are set up and function key between；
Here it is pointed out that when described external input device carries out information input by the way of handwriting input
When, each pixel of the handwriting area of described external input device can be equivalent to a character input button；
Layout adjusting unit 300, for according to the character entry key of described external input device and the layout side of function key
Formula adjusts the layout of described dummy keyboard so that the case layout type of described dummy keyboard is defeated with the character of external input device
Enter key and the layout type of function key is consistent；To obtain external input device each character entry key representated by character,
And respective identification information is arranged on the corresponding button of described dummy keyboard, obtain each function key of external input device
Identification information, and this identification information is arranged on the respective keys of described dummy keyboard；
Projecting unit 400, for the dummy keyboard after projection adjustment layout in nearly mesh display environment；
Input information collecting unit 500, for obtain and will described external input device enter information as described near
The input information of mesh display device.
Corresponding with said method so that user understand that itself this triggering be external input device that
Individual button, described first information input system can also include：Virtual click module 600, for when user outside defeated in triggering
Enter equipment certain button when, control the virtual key that matches with this button in dummy keyboard to act accordingly；Specifically,
Which kind of action prompting is made to user using, can be according to user's request sets itself, for example described virtual click module detection
When button on described external input device is triggered by user, according to virtual key and the external input device of dummy keyboard
Mapping relations between input button, control the virtual key simulation one matching on described dummy keyboard with the button being triggered
Secondary click action or flicker are once.
When the input method of described portable mobile termianl is hand-writing input method, above-mentioned virtual to click module 600 acceptable
For：According to described default mapping relations, control the light on and off state of button and described external input device in dummy keyboard
The triggering state of character entry key (each pixel of external input device viewing area all can be considered a character entry key)
Consistent.For example, in handwriting area input character, pixel that the character of described user write is covered be considered as by
The character entry key of triggering, controls the button in the dummy keyboard corresponding with these character entry keys to brighten.
Corresponding with said method, described first information input system, also include：
Input information display unit 700, for a pair of words frame region of simulation in nearly mesh display environment, described when detecting
When input button on external input device is triggered by user, obtain user by the input button of triggering external input device
The input information generating, described input information is shown in described dialog box region, is additionally operable to new when having when detecting
Input information or when having input information to be deleted, update the display content in described dialog box region.
In order to realize information input, in described external input device, it is configured with the second information input system, described second letter
Breath input system is used for, when getting information input instruction, controlling described external input device to switch to information input pattern,
In one embodiment, when there being information input instruction to generate in described nearly mesh display system, also need described information input instruction
Send to the second information input system of described external input device.
Introduction in one embodiment, is configured with multiple input methods, described second letter in described second information input system
Breath input system controls the switching between multiple input methods according to user operation.Wherein, join in described second information input system
The input method put can include：Endian format input method and full key board disc type input method, can also include hand-writing input method, word certainly
Symbol keyboard.
In one embodiment, described external input device is touch screen type input equipment, under information input pattern, described tactile
The input button of screen formula input equipment includes：By the virtual input button of touch screen and be arranged on the input of described touch screen type and set
Standby upper entity inputs button；
In one embodiment, referring to Fig. 4, described entity inputs button, including：
It is arranged at the first function key K1 of the side of described touch screen type input equipment first corner position；
It is arranged at the second function key K2 of the side of described touch screen type input equipment second corner position；
Be arranged at the 3rd function key K3 at described touch screen type input equipment display surface bottom position, the 4th function key K4 and
Five-function key K5.
Certainly, the setting quantity of above-mentioned layout type and physical button is a kind of citing disclosed in the present application, actual raw
During product, its quantity and layout can be according to user's request sets itself.
In one embodiment, after the entity input button of touch screen type input equipment is triggered, generate corresponding function and refer to
Order, in order to be identified to these instructions, described second information input system, including：Instruction recognition unit.
After described touch screen type input equipment enters input pattern, described instruction recognition unit is used for monitoring each function key
Triggering state, and control external input device execution corresponding actions according to monitoring result；
Specifically, described instruction recognition unit is used for, and monitors the triggering state of described 3rd function key, when described 3rd work(
When energy key is triggered, the letter that user is inputted by touch screen is controlled to be capitalization, when described 3rd button is not triggered,
User is controlled to be lower case by the letter that touch screen inputs；When described 3rd function key and the first function key is detected simultaneously
When being triggered, the operation of a upper input character or the operation of input pattern switching are deleted in described execution, and described input pattern is extremely
Few inclusion：Input in Chinese pattern, English input mode, symbol input pattern and number entry mode；When detecting the described 3rd
When key and the 4th key are triggered simultaneously, carry out input method handover operation.
In one embodiment, the function of described 3rd function key can matching convention FN function key, the 4th function key can be right
Acknowledgement key that should be conventional, five-function key can matching convention esc key.
In one embodiment, when described 3rd function key and the first function key are triggered simultaneously, in described execution deletion
The operation of one input character or the operation of input pattern switching, described input pattern includes letter, symbol and figure pattern, example
As, when described 3rd function key is triggered, and the triggered time of described first function key less than the first Preset Time when, execution is deleted
Division operation, when described 3rd function key is triggered, and when the triggered time of the first function key reaches the first Preset Time, by current
Input pattern switches to next input pattern, wherein, described first function key, the second function key, the 4th function key and the 5th
Function key is only just in the state of being triggered when user presses, and described 3rd function key is often clicked on and once switched once triggering shape
State, the such as the 3rd function key current state is to trigger, and it is clicked on once, and described 3rd function key enters non-triggering state,
Again it is clicked on once, described 3rd function key enters triggering state；
Each embodiment in this specification is all described by the way of going forward one by one, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.Especially for system or
For system embodiment, because it is substantially similar to embodiment of the method, so describing fairly simple, referring to method in place of correlation
The part of embodiment illustrates.System described above and system embodiment are only schematically wherein said conduct
Separating component explanation unit can be or may not be physically separate, as the part that unit shows can be or
Person may not be physical location, you can with positioned at a place, or can also be distributed on multiple NEs.Can root
Factually border need select the purpose to realize this embodiment scheme for some or all of module therein.Ordinary skill
Personnel are not in the case of paying creative work, you can to understand and to implement.
Professional further appreciates that, in conjunction with the unit of each example of the embodiments described herein description
And algorithm steps, can with electronic hardware, computer software or the two be implemented in combination in, in order to clearly demonstrate hardware and
The interchangeability of software, generally describes composition and the step of each example in the above description according to function.These
Function to be executed with hardware or software mode actually, the application-specific depending on technical scheme and design constraint.Specialty
Technical staff can use different methods to each specific application realize described function, but this realization should
Think beyond the scope of this invention.
The step of the method in conjunction with the embodiments described herein description or algorithm can directly be held with hardware, processor
The software module of row, or the combination of the two is implementing.Software module can be placed in random access memory (RAM), internal memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, depositor, hard disk, moveable magnetic disc, CD-ROM, flash memory
In known any other form of storage medium in (Flash Memory) or technical field.
Also, it should be noted herein, such as first and second or the like relational terms are used merely to one
Entity or operation are made a distinction with another entity or operation, and not necessarily require or imply between these entities or operation
There is any this actual relation or order.And, term " inclusion ", "comprising" or its any other variant are intended to contain
Comprising of lid nonexcludability, wants so that including a series of process of key elements, method, article or equipment and not only including those
Element, but also include other key elements being not expressly set out, or also include for this process, method, article or equipment
Intrinsic key element.In the absence of more restrictions, the key element that limited by sentence "including a ..." it is not excluded that
Also there is other identical element including in the process of described key element, method, article or equipment.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses the present invention.
Multiple modifications to these embodiments will be apparent from for those skilled in the art, as defined herein
General Principle can be realized without departing from the spirit or scope of the present invention in other embodiments.Therefore, the present invention
It is not intended to be limited to the embodiments shown herein, and be to fit to and principles disclosed herein and features of novelty phase one
The scope the widest causing.
Claims (15)
1. a kind of virtual input method is it is characterised in that be applied to nearly mesh display device, including：
When getting information input instruction, generate virtual with what the character entry key of external input device and function key matched
Keyboard；
Set up one by one between character entry key for the button in described dummy keyboard and described external input device and function key
Corresponding mapping relations；
Adjust the layout of described dummy keyboard according to the character entry key of described external input device and the layout type of function key；
Dummy keyboard after projection adjustment layout in nearly mesh display environment；
Obtain and the input information entering information as described nearly mesh display device by described external input device.
2. virtual input method according to claim 1 detects on described external input device it is characterised in that working as
When button is triggered by user, close according to the virtual key of dummy keyboard and the mapping inputting between button of external input device
System, controls the virtual key simulation one click action matching on described dummy keyboard with the button being triggered.
3. virtual input method according to claim 1 detects on described external input device it is characterised in that working as
When input button is triggered by user, also include：
A pair of words frame region of simulation in nearly mesh display environment, described dialog box region is used for showing that user is set by outside input
The standby input information keyed in.
4. a kind of virtual input system device it is characterised in that include nearly mesh display device and with described nearly mesh display device phase
External input device even；
The first information input system of described virtual input system device includes：
Instruction acquisition unit, when getting information input instruction, generates the character entry key with external input device and function
The dummy keyboard that key matches；
Map unit, for for the character entry key of the button in described dummy keyboard and described external input device and function key
Between set up one-to-one mapping relations；
Layout adjusting unit, for according to the character entry key of described external input device and the layout type adjustment institute of function key
State the layout of dummy keyboard；
Projecting unit, for the dummy keyboard after projection adjustment layout in nearly mesh display environment；
Input information collecting unit, shows and sets for obtaining and by the described nearly mesh that enters information as of described external input device
Standby input information.
5. virtual input system device according to claim 4 is it is characterised in that described first information input system also wraps
Include：
Virtual click module, for when the button on described external input device is detected and being triggered by user, according to virtual key
Mapping relations between the input button of the virtual key of disk and external input device, control on described dummy keyboard be triggered
Button match virtual key simulation one click action.
6. virtual input system device according to claim 4 is it is characterised in that first information input system also includes：
Input information display unit, for a pair of words frame region of simulation in nearly mesh display environment, when detecting, described outside is defeated
When entering the input button on equipment and being triggered by user, obtain user and pass through to trigger inputting button and generating of external input device
Input information, described input information is shown in described dialog box region.
7. the virtual input system device according to claim 4-6 any one is it is characterised in that described nearly mesh shows sets
Standby for head-mounted display apparatus.
8. virtual input system device according to claim 7 is it is characterised in that described nearly mesh display device is virtual existing
The real helmet.
9. virtual input system device according to claim 4 is it is characterised in that described external input device is two dimension friendship
Mutually equipment.
10. virtual input system device according to claim 9 is it is characterised in that described external input device is touch screen
Formula input equipment.
11. virtual input system devices according to claim 4 are it is characterised in that configure in described external input device
There is the second information input system, described second information input system is used for, when getting information input instruction, controlling described touching
Screen formula input equipment switches to information input pattern.
12. virtual input system devices according to claim 11 are it is characterised in that in described second information input system
It is configured with one or more input methods, described second information input system controls cutting between different input methods according to user operation
Change.
13. virtual input system devices according to claim 12 are it is characterised in that in described second information input system
The input method of configuration at least includes：Endian format input method and full key board disc type input method.
14. virtual input system devices according to claim 11 are it is characterised in that described external input device is touch screen
Formula input equipment, under information input pattern, the input button of described touch screen type input equipment includes：Virtual by touch screen
Input button and the entity being arranged on described touch screen type input equipment input button；
Described entity inputs button, including：
It is arranged at the first function key of the side of described touch screen type input equipment first corner position；
It is arranged at the second function key of the side of described touch screen type input equipment second corner position；
It is arranged at the 3rd function key at described touch screen type input equipment display surface bottom position, the 4th function key and five-function
Key.
15. virtual input system devices according to claim 14 it is characterised in that described second information input system,
Including：
After described touch screen type input equipment enters input pattern, described instruction recognition unit is used for：
Monitor the triggering state of described 3rd function key, when described 3rd function key is triggered, control user to pass through touch screen
The letter of input is capitalization, and when described 3rd button is not triggered, control user by the letter that touch screen inputs is
Lower case；
When described 3rd function key is detected and the first function key is triggered simultaneously, a upper input character is deleted in described execution
Operation or input pattern switching operation, described input pattern at least includes：Input in Chinese pattern, English input mode, symbol
Number input pattern and number entry mode；
When described 3rd key is detected and the 4th key is triggered simultaneously, carry out input method handover operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610798668.4A CN106383652A (en) | 2016-08-31 | 2016-08-31 | Virtual input method and system apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610798668.4A CN106383652A (en) | 2016-08-31 | 2016-08-31 | Virtual input method and system apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106383652A true CN106383652A (en) | 2017-02-08 |
Family
ID=57939012
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610798668.4A Pending CN106383652A (en) | 2016-08-31 | 2016-08-31 | Virtual input method and system apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106383652A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106873899A (en) * | 2017-03-21 | 2017-06-20 | 网易（杭州）网络有限公司 | The acquisition methods and device of input information, storage medium and processor |
| CN107145401A (en) * | 2017-06-01 | 2017-09-08 | 努比亚技术有限公司 | Incoming event distribution method, terminal and computer-readable recording medium |
| CN107688388A (en) * | 2017-08-20 | 2018-02-13 | 平安科技（深圳）有限公司 | Control device, method and the computer-readable recording medium of Password Input |
| CN107728923A (en) * | 2017-10-20 | 2018-02-23 | 维沃移动通信有限公司 | The processing method and mobile terminal of a kind of operation |
| CN107766719A (en) * | 2017-09-18 | 2018-03-06 | 北京华伟恒远信息系统技术有限公司 | A kind of method and device that log-on message is encrypted |
| CN108415654A (en) * | 2017-02-10 | 2018-08-17 | 上海真曦通信技术有限公司 | Virtual input system and correlation technique |
| CN108632483A (en) * | 2017-03-23 | 2018-10-09 | 京瓷办公信息系统株式会社 | Display device and display system |
| CN108700957A (en) * | 2017-06-30 | 2018-10-23 | 广东虚拟现实科技有限公司 | Electronic system and method for text input in virtual environment |
| CN109658758A (en) * | 2019-02-18 | 2019-04-19 | 西安科技大学 | A kind of computer accounting teaching simulation System |
| CN110007845A (en) * | 2018-01-05 | 2019-07-12 | 曜越科技股份有限公司 | Control input system |
| CN110442245A (en) * | 2019-07-26 | 2019-11-12 | 广东虚拟现实科技有限公司 | Display methods, device, terminal device and storage medium based on physical keyboard |
| CN110837308A (en) * | 2019-11-13 | 2020-02-25 | 联想(北京)有限公司 | Information processing method and device and electronic equipment |
| CN111241790A (en) * | 2018-11-12 | 2020-06-05 | 珠海金山办公软件有限公司 | Document editing method and device, electronic equipment and readable storage medium |
| CN112631498A (en) * | 2020-12-08 | 2021-04-09 | 青岛海尔电冰箱有限公司 | Method for controlling household appliance and household appliance |
| CN112860013A (en) * | 2021-01-29 | 2021-05-28 | 亮风台（北京）信息科技有限公司 | Method and device for processing data through wearable display device |
| CN113220136A (en) * | 2021-04-27 | 2021-08-06 | 北京麟卓信息科技有限公司 | Method and device for automatically switching keyboard mapping schemes based on window layout perception |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101165538A (en) * | 2006-10-16 | 2008-04-23 | 索尼株式会社 | Imaging display apparatus and method |
| US20100302165A1 (en) * | 2009-05-26 | 2010-12-02 | Zienon, Llc | Enabling data entry based on differentiated input objects |
| CN101963840A (en) * | 2009-07-22 | 2011-02-02 | 罗技欧洲公司 | Be used for system and method long-range, the virtual screen input |
| CN102478956A (en) * | 2010-11-25 | 2012-05-30 | 安凯(广州)微电子技术有限公司 | Virtual laser keyboard input device and input method |
| CN103019377A (en) * | 2012-12-04 | 2013-04-03 | 天津大学 | Head-mounted visual display equipment-based input method and device |
| CN104076512A (en) * | 2013-03-25 | 2014-10-01 | 精工爱普生株式会社 | Head-mounted display device and method of controlling head-mounted display device |
| CN105511620A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | Chinese three-dimensional input device, head-wearing device and Chinese three-dimensional input method |
-
2016
- 2016-08-31 CN CN201610798668.4A patent/CN106383652A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101165538A (en) * | 2006-10-16 | 2008-04-23 | 索尼株式会社 | Imaging display apparatus and method |
| US20100302165A1 (en) * | 2009-05-26 | 2010-12-02 | Zienon, Llc | Enabling data entry based on differentiated input objects |
| CN104808821A (en) * | 2009-05-26 | 2015-07-29 | 美国智能科技有限公司 | Method and apparatus for data entry input |
| CN104898879A (en) * | 2009-05-26 | 2015-09-09 | 美国智能科技有限公司 | Method and apparatus for data input |
| CN101963840A (en) * | 2009-07-22 | 2011-02-02 | 罗技欧洲公司 | Be used for system and method long-range, the virtual screen input |
| CN102478956A (en) * | 2010-11-25 | 2012-05-30 | 安凯(广州)微电子技术有限公司 | Virtual laser keyboard input device and input method |
| CN103019377A (en) * | 2012-12-04 | 2013-04-03 | 天津大学 | Head-mounted visual display equipment-based input method and device |
| CN104076512A (en) * | 2013-03-25 | 2014-10-01 | 精工爱普生株式会社 | Head-mounted display device and method of controlling head-mounted display device |
| CN105511620A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | Chinese three-dimensional input device, head-wearing device and Chinese three-dimensional input method |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108415654A (en) * | 2017-02-10 | 2018-08-17 | 上海真曦通信技术有限公司 | Virtual input system and correlation technique |
| CN106873899A (en) * | 2017-03-21 | 2017-06-20 | 网易（杭州）网络有限公司 | The acquisition methods and device of input information, storage medium and processor |
| US10530945B2 (en) | 2017-03-23 | 2020-01-07 | Kyocera Document Solutions Inc. | Display device and display system |
| CN108632483B (en) * | 2017-03-23 | 2019-11-15 | 京瓷办公信息系统株式会社 | Display device and display system |
| CN108632483A (en) * | 2017-03-23 | 2018-10-09 | 京瓷办公信息系统株式会社 | Display device and display system |
| CN107145401B (en) * | 2017-06-01 | 2021-06-15 | 努比亚技术有限公司 | Input event distribution method, terminal, and computer-readable storage medium |
| CN107145401A (en) * | 2017-06-01 | 2017-09-08 | 努比亚技术有限公司 | Incoming event distribution method, terminal and computer-readable recording medium |
| CN108700957A (en) * | 2017-06-30 | 2018-10-23 | 广东虚拟现实科技有限公司 | Electronic system and method for text input in virtual environment |
| CN108700957B (en) * | 2017-06-30 | 2021-11-05 | 广东虚拟现实科技有限公司 | Electronic system and method for text entry in a virtual environment |
| CN107688388A (en) * | 2017-08-20 | 2018-02-13 | 平安科技（深圳）有限公司 | Control device, method and the computer-readable recording medium of Password Input |
| CN107688388B (en) * | 2017-08-20 | 2020-08-28 | 平安科技（深圳）有限公司 | Password input control apparatus, method and computer-readable storage medium |
| CN107766719A (en) * | 2017-09-18 | 2018-03-06 | 北京华伟恒远信息系统技术有限公司 | A kind of method and device that log-on message is encrypted |
| CN107728923B (en) * | 2017-10-20 | 2020-11-03 | 维沃移动通信有限公司 | Operation processing method and mobile terminal |
| CN107728923A (en) * | 2017-10-20 | 2018-02-23 | 维沃移动通信有限公司 | The processing method and mobile terminal of a kind of operation |
| CN110007845A (en) * | 2018-01-05 | 2019-07-12 | 曜越科技股份有限公司 | Control input system |
| CN111241790A (en) * | 2018-11-12 | 2020-06-05 | 珠海金山办公软件有限公司 | Document editing method and device, electronic equipment and readable storage medium |
| CN111241790B (en) * | 2018-11-12 | 2023-10-31 | 珠海金山办公软件有限公司 | Document editing method and device, electronic equipment and readable storage medium |
| CN109658758A (en) * | 2019-02-18 | 2019-04-19 | 西安科技大学 | A kind of computer accounting teaching simulation System |
| CN110442245A (en) * | 2019-07-26 | 2019-11-12 | 广东虚拟现实科技有限公司 | Display methods, device, terminal device and storage medium based on physical keyboard |
| CN110837308A (en) * | 2019-11-13 | 2020-02-25 | 联想(北京)有限公司 | Information processing method and device and electronic equipment |
| CN110837308B (en) * | 2019-11-13 | 2022-06-28 | 联想(北京)有限公司 | Information processing method and device and electronic equipment |
| CN112631498B (en) * | 2020-12-08 | 2023-03-24 | 青岛海尔电冰箱有限公司 | Method for controlling household appliance and household appliance |
| CN112631498A (en) * | 2020-12-08 | 2021-04-09 | 青岛海尔电冰箱有限公司 | Method for controlling household appliance and household appliance |
| CN112860013A (en) * | 2021-01-29 | 2021-05-28 | 亮风台（北京）信息科技有限公司 | Method and device for processing data through wearable display device |
| CN112860013B (en) * | 2021-01-29 | 2024-02-09 | 亮风台（北京）信息科技有限公司 | Method and device for data processing through wearable display device |
| CN113220136A (en) * | 2021-04-27 | 2021-08-06 | 北京麟卓信息科技有限公司 | Method and device for automatically switching keyboard mapping schemes based on window layout perception |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106383652A (en) | Virtual input method and system apparatus | |
| CN110832441B (en) | Keyboard for virtual, augmented and mixed reality display systems | |
| US10620699B2 (en) | Head mounted display, mobile information terminal, image processing apparatus, display control program, display control method, and display system | |
| US20170293351A1 (en) | Head mounted display linked to a touch sensitive input device | |
| US10203760B2 (en) | Display device and control method thereof, gesture recognition method, and head-mounted display device | |
| US20120056989A1 (en) | Image recognition apparatus, operation determining method and program | |
| CN103105930A (en) | Non-contact type intelligent inputting method based on video images and device using the same | |
| CN102629164B (en) | A kind of multi-point touch equipment and method for information display and apply processing unit | |
| CN109558061A (en) | A kind of method of controlling operation thereof and terminal | |
| CN105094675B (en) | A kind of man-machine interaction method and touch screen wearable device | |
| CN106681503A (en) | Display control method, terminal and display device | |
| CN102880304A (en) | Character inputting method and device for portable device | |
| JP2004078977A (en) | Interface device | |
| CN106846496A (en) | DICOM images based on mixed reality technology check system and operating method | |
| CN109857306A (en) | Screenshotss method and terminal device | |
| CN109190356A (en) | A kind of unlocking screen method and terminal | |
| CN110045843A (en) | Electronic pen, electronic pen control method and terminal device | |
| US20200168121A1 (en) | Device for Interpretation of Digital Content for the Visually Impaired | |
| JP6255731B2 (en) | Display system, display method, and display terminal | |
| CN106873763B (en) | Virtual reality equipment and information input method thereof | |
| CN109582194A (en) | A kind of display control method and mobile terminal | |
| CN108897477A (en) | A kind of method of controlling operation thereof and terminal device | |
| CN102253765B (en) | Interactive display system with emphasis mode | |
| TW201915662A (en) | Electronic device with eyeball tracking function and control method thereof | |
| US20160224808A1 (en) | Information input method having confidentiality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20170307 Address after: 100142 Beijing, West Fourth Ring Road, North Road, No. 1, building 6, No. 6042, No. 158 Applicant after: Beijing Wei Wei Technology Co., Ltd. Address before: 100089 Beijing city Haidian District daoxiangyuan West No. 8 three storey office building 301 Applicant before: BEIJING GEVEK TECHNOLOGY CO., LTD. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190418 Address after: 430223 No. 02, No. 27 Building, 4 Building, No. 7 Finance Port Road, Donghu New Technology Development Zone, Wuhan City, Hubei Province Applicant after: Wuhan Liuwei Technology Co., Ltd. Address before: 100142 No. 6042, 6th floor, No. 158 West Fourth Ring North Road, Haidian District, Beijing Applicant before: Beijing Wei Wei Technology Co., Ltd. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170208 |