CN106293127A - Array input method in three dimensions and system - Google Patents
Array input method in three dimensions and system Download PDFInfo
- Publication number
- CN106293127A CN106293127A CN201610652247.0A CN201610652247A CN106293127A CN 106293127 A CN106293127 A CN 106293127A CN 201610652247 A CN201610652247 A CN 201610652247A CN 106293127 A CN106293127 A CN 106293127A
- Authority
- CN
- China
- Prior art keywords
- input
- user
- dimensions
- input element
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
- G06F3/0236—Character input methods using selection techniques to select from displayed items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
Abstract
The present invention proposes a kind of array input method in three dimensions and system, including: receive the input request of user；Response input request, and alternative input element display layout in three dimensions is set according to the type of element to be entered；Alternative input element is shown at the three dimensions in user front with cubical array form；Use the input medium medium of three-dimensional fix technology for detection user, and real-time positioning user is with this input medium shift position in cubical array, detect the three-dimensional coordinate of each position, and then using alternative input element corresponding for each three-dimensional coordinate as the input element of user, until detect that the confirmation of user completes operation；The input element of user is transmitted to subsequent operation system, completes input operation.Numeral, letter or symbol etc. are distributed on different depth layer by the present invention in three dimensions, solve the problem inputting inconvenience in three dimensions, make user's input in three dimensions more orderly and efficient.
Description
Technical field
The present invention relates to virtual three-dimensional space processing technology field, particularly to a kind of array in three dimensions
Input method and system.
Background technology
Along with VR (Virtual Reality, virtual reality), AR (Augmented Reality, augmented reality) and MR
The development of (Mix Reality, mixed reality) technology, user also increases sharply in the input operation frequency of virtual three-dimensional space,
Therefore in virtual three-dimensional space, the input that completes rapidly and efficiently becomes to be even more important.
Present stage, in (virtual) three dimensions, input pattern uses plane, two-dimensional approach mostly.In some AR scene
In, although having fraction with going deep into the input logic of information, these operations are for slight operation or non-a large amount of input operation
It is feasible, but when user needs to input the information such as a lot of password, word, just seem very poor efficiency, and can not
Making full use of the depth information in three dimensions, the safety of information also can not get improving.
Summary of the invention
The purpose of the present invention is intended at least solve one of described technological deficiency.
To this end, it is an object of the invention to propose a kind of array input method in three dimensions and system, can
To realize being distributed on different depth layer numeral, letter or symbol etc. in three dimensions, thus greatly reduce every layer of unit
Element quantity, solve input in three dimensions inconvenience problem so that user's input in three dimensions more added with
Orderliness is with efficient.
To achieve these goals, the embodiment of one aspect of the present invention provides a kind of array in three dimensions defeated
Enter method, comprise the steps:
Step S1, receives the input request of user, and wherein, described input request includes: the type of element to be entered；
Step S2, responds described input request, and arranges alternative input element according to the type of described element to be entered and exist
Display layout in three dimensions, wherein, described display layout include the described alternative input element number of plies in three dimensions and
Arrangement, each described alternative input element has unique three-dimensional coordinate in described three dimensions；
Step S3, shows described alternative input element at the three dimensions in described user front with cubical array form；
Step S4, uses the input medium medium of three-dimensional fix technology for detection user, and real-time positioning user is with this
Input medium shift position in described cubical array, detects the three-dimensional coordinate of each position, and then by each described three
Alternative input element corresponding to dimension coordinate is as the input element of user, until detecting that the confirmation of user completes operation；
Step S5, transmits the input element of described user to subsequent operation system, completes input operation.
Further, the type of described input element at least includes the combination of one or more of: numeral, letter, symbol
And operation control key.
Further, in described step S2, according to the type of described element to be entered, alternative input element is set in three-dimensional
Display layout in space, including:
When the type of described input element includes: numeral, letter, symbol and during operation control key, according to distance users by
Proximal and distal mode, successively to described operation control key, numeral, letter, symbol hierarchal arrangement, each type of input element divides
Cloth arranges at one or more layers；
When the type of described input element includes: when numeral and operation control key and described user ask to input password, press
According to distance users mode from the close-by examples to those far off, successively to described operation control key and numeral hierarchal arrangement, wherein, described operation controls
Key is distributed in same layer, and described digital distribution arranges in multilamellar, and same numbers is in different layers repeated arrangement；
When the type of described input element includes: when letter and operation control key, according to distance users side from the close-by examples to those far off
Formula, successively to described operation control key and letter hierarchal arrangement, wherein, described operation control key is distributed in same layer, described word
Mother is distributed in multilamellar arrangement, and same letter is in different layers repeated arrangement.
Further, described alternative input element display layout in three dimensions choose the following two mode that includes:
1) system is pre-configured with, and automatically chooses configuration according to the type of the element to be entered in described input request；
2) configured in described input request by user.
Further, in described step S4, described three-dimensional fix technology at least includes following one: the flight time
TOF location technology, binocular camera location technology, ultrasonic locating technology, optical locating techniques, kinect body-sensing location skill
Art, dynamic controller Ps move location technology, beacon Light house location technology, laser radar location technology, ultra broadband
UWB location technology, synchronization position and build figure SLAM technology, Virtuix omni location technology, structure light projection technology.
Further, in described step S4, the input medium medium of described user includes: hand input, the outside control of utilization
Device processed inputs, utilizes keyboard and mouse to input.
Further, in described step S4,
First, use described three-dimensional fix technical limit spacing user be currently entered position in described cubical array with
The coordinate of the place x-y axial plane that described user perspective is parallel；
Then, use user described in described three-dimensional fix technology for detection by input medium in described cubical array
Movement, obtain the coordinate on the z-axis depth information that described user is vertical with described user perspective, and then obtain described user's
It is currently entered the three-dimensional coordinate of position；
Finally, according to the corresponding relation of the alternative input element corresponding to each three-dimensional coordinate of configuration in described step S2,
Using alternative input element corresponding for this three-dimensional coordinate as the input element of user；
Wherein, in described step S3, often orient an input element, this input element is carried out highlighted process to carry
Show user, and after the confirmation receiving user operates, this input element is transmitted to subsequent operation system.
Another embodiment of the present invention provides a kind of array input system in three dimensions, including: communication mould
Block, for receiving the input request of user, wherein, described input request includes: the type of element to be entered；Cubical array generates
And display module, described cubical array generates and display module is connected with described communication module, is used for responding described input request,
And alternative input element display layout in three dimensions is set according to the type of described element to be entered, by described alternative input
Element shows at the three dimensions in described user front with cubical array form, and wherein, described display layout includes described alternative
The input element number of plies in three dimensions and arrangement, each described alternative input element has uniquely in described three dimensions
Three-dimensional coordinate；Three-dimensional fix module, described three-dimensional fix module generates and display module with described cubical array
Being connected, for using the input medium medium of three-dimensional fix technology for detection user, and real-time positioning user is with this input hands
Section shift position in described cubical array, detects the three-dimensional coordinate of each position, and each described three-dimensional coordinate is corresponding
Alternative input element as the input element of user, until detecting that the confirmation of user completes operation；Described communication module is also
For transmitting the input element of described user to subsequent operation system, complete input operation.
Further, the type of described input element at least includes the combination of one or more of: numeral, letter, symbol
And operation control key,
Described cubical array generates and display module arranges alternative input element display layout in three dimensions, including
Following form:
When the type of described input element includes: numeral, letter, symbol and during operation control key, according to distance users by
Proximal and distal mode, successively to described operation control key, numeral, letter, symbol hierarchal arrangement, each type of input element divides
Cloth arranges at one or more layers；
When the type of described input element includes: when numeral and operation control key and user ask to input password, according to away from
From user's mode from the close-by examples to those far off, successively to described operation control key and numeral hierarchal arrangement, wherein, described operation control key divides
Cloth is at same layer, and described digital distribution arranges in multilamellar, and same numbers is in different layers repeated arrangement；
When the type of described input element includes: when letter and operation control key, according to distance users side from the close-by examples to those far off
Formula, successively to described operation control key and letter hierarchal arrangement, wherein, described operation control key is distributed in same layer, described word
Mother is distributed in multilamellar arrangement, and same letter is in different layers repeated arrangement.
Further, described alternative input element display layout in three dimensions choose the following two mode that includes:
1) system is pre-configured with, and automatically chooses configuration according to the type of the element to be entered in described input request；
2) configured in described input request by user.
Further, the three-dimensional fix technology that described three-dimensional fix module uses at least includes following one: fly
Row time TOF location technology, binocular camera location technology, ultrasonic locating technology, optical locating techniques, kinect body-sensing are fixed
Position technology, dynamic controller Ps move location technology, beacon Light house location technology, laser radar location technology, super
Broadband UWB location technology, synchronization position and build figure SLAM technology, Virtuix omni location technology, structure light projection technology.
Further, described three-dimensional fix module uses being currently entered of described three-dimensional fix technical limit spacing user
The coordinate of the place x-y axial plane that position is parallel with described user perspective in described cubical array；Then described three-dimensional is used
Space orientation technique detects described user and passes through input medium movement in described cubical array, obtains described user with described
The coordinate on z-axis depth information that user perspective is vertical, and then obtain the three-dimensional coordinate being currently entered position of described user；?
Afterwards according to the corresponding relation of the alternative input element corresponding to each three-dimensional coordinate of configuration, by corresponding for this three-dimensional coordinate alternative defeated
Enter the element input element as user,
Wherein, described three-dimensional fix module often orients an input element, and this input element is carried out highlighted place
Reason is to point out user, and after the confirmation receiving user operates, transmits this input element to subsequent operation system.
Further, the input medium medium of described user includes: hand inputs, utilizes external control device input, utilizes
Keyboard and mouse inputs；
Described array input system in three dimensions be installed on Virtual Reality equipment or augmented reality AR and
On mixed reality MR equipment, communicate with the operating system in described Virtual Reality equipment or AR and MR equipment.
The array input method in three dimensions according to embodiments of the present invention and system, take full advantage of (empty
Intend) three-dimensional depth dimension information, by elements such as a fairly large number of numeral, letter or symbols originally according to input convenience
It is regularly distributed on different depth layer, thus greatly reduces the quantity of every layer of element, solve and input not in three dimensions
Problem easily so that user's input in three dimensions is more orderly and efficient.Further, by using three dimensions fixed
The input of user is accurately positioned by position technology, can be accurately positioned out the input element of user.Shown by cubical array
Array, relative to two dimensional surface display format, can be greatly improved the safety of user's input information.
Aspect and advantage that the present invention adds will part be given in the following description, and part will become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Accompanying drawing explanation
Above-mentioned and/or the additional aspect of the present invention and advantage are from combining the accompanying drawings below description to embodiment and will become
Substantially with easy to understand, wherein:
Fig. 1 is the flow chart of the array input method in three dimensions according to one embodiment of the invention；
Fig. 2 is the flow chart of the array input method in three dimensions according to another embodiment of the present invention；
Fig. 3 is the schematic diagram of the three dimensions array according to the embodiment of the present invention；
Fig. 4 is the schematic diagram of the three layer digital keyboard arrays according to the embodiment of the present invention；
Fig. 5 is the schematic diagram of three layers of English alphabet keys disk array according to the embodiment of the present invention；
Fig. 6 is the schematic diagram that the 3-dimensional digital array according to the embodiment of the present invention clicks ground floor " 5 " element；
Fig. 7 is that the 3-dimensional digital array according to the embodiment of the present invention clicks the second layer " 0 " element schematic diagram；
Fig. 8 is the structure chart according to embodiment of the present invention array input system in three dimensions.
Detailed description of the invention
Embodiments of the invention are described below in detail, and the example of described embodiment is shown in the drawings, the most from start to finish
Same or similar label represents same or similar element or has the element of same or like function.Below with reference to attached
The embodiment that figure describes is exemplary, it is intended to is used for explaining the present invention, and is not considered as limiting the invention.
In the present invention, unless otherwise clearly defined and limited, term " install ", " being connected ", " connection ", " fixing " etc.
Term should be interpreted broadly, and connects for example, it may be fixing, it is also possible to be to removably connect, or be integrally connected；It can be machine
Tool connects, it is also possible to be electrical connection；Can be to be joined directly together, it is also possible to be indirectly connected to by intermediary, can be two units
Connection within part.For the ordinary skill in the art, can understand that above-mentioned term is at this as the case may be
Concrete meaning in bright.
The present invention proposes a kind of array input method in (virtual) three dimensions and system, by before user
In the three dimensions of side, utilize three-dimensional depth information by alternative input element with the arrangement display of cubical array form, this
Plant form opposite planar and the arrangement of elements mode of two dimension, depth information can be made full use of, also improve the letter of user's input
Breath safety.
As it is shown in figure 1, the array input method in three dimensions of the embodiment of the present invention, comprise the steps:
Step S1, receives the input request of user.
When user wishes input information, trigger the input pattern of equipment to send input request.Wherein, input request bag
Include: the type of element to be entered.Such as, user can include by element the most to be entered in input request: letter and number
Combination or letter, the combination etc. of numbers and symbols.In this step, equipment can provide the selection showing element to be entered to carry
Show that frame, user select as required, after confirmation, send this input request.
Step S2, response input request, and according to the type of element to be entered, alternative input element is set at three dimensions
Middle display layout.
Specifically, after the input receiving user is asked, startup responds this input request, and obtains note in input request
The type of the element to be entered of record.Alternative input element is shown by type according to this element to be entered in three dimensions
Layout.
In one embodiment of the invention, it is achieved one of following means of above-mentioned display layout:
(1) render in virtual screen into corresponding three-dimensional picture, it is achieved three dimensional display；
(2) before eyes, some centimeters arrange an optical light guides eyeglass, by getting corresponding three on this eyeglass
Dimension image, it is achieved 3-D effect.
It should be noted that the means realizing three dimensional display layout are not limited to above two, it is also possible to take its user side
Formula, as long as the purpose of three dimensional display can be reached to carry out input element, does not repeats them here.
Wherein, display layout includes the alternative input element number of plies in three dimensions and arrangement, utilizes above-mentioned three-dimensional to show
Show that alternative input element is carried out arrangement display in front of the user by means with cubical array form.Additionally, each alternative input unit
Element is respectively provided with unique three-dimensional coordinate in three dimensions, and this is in order to follow-up position matching in three dimensions uses.
As it is shown on figure 3, from distance users order from the close-by examples to those far off, be arranged in sequence with: numeral, letter and symbol, wherein word
Female quantity is more can a point multilamellar be arranged.Certainly, Fig. 3 is only the purpose of example, the putting in order of dissimilar element,
The number of plies and position can be configured with user habit as required by system and user.
In one embodiment of the invention, the type of input element at least includes the combination of one or more of: number
Word, letter, symbol and operation control key.Wherein, operation control key is for example: backspace key, line feed key, acknowledgement key.Need explanation
, the type of input element is not limited to above-mentioned, it is also possible to include its user type, and the type of input element can basis
Needs are added and delete.
Specifically, alternative input element display layout in three dimensions is set according to the type of element to be entered, including:
(1) include when the type of input element: when numeral, letter, symbol and operation control key, according to distance users by closely
And remote mode, successively to operation control key, numeral, letter, symbol hierarchal arrangement, each type of input element is distributed in one
Layer or multilamellar arrangement.
(2) include when the type of input element: when numeral and operation control key, according to distance users side from the close-by examples to those far off
Formula, successively to operation control key and numeral hierarchal arrangement, wherein, operation control key is distributed in same layer, and numeral can be distributed in
One or more layers arrangement, same numbers is in different layers repeated arrangement.Operation control key and numeral arrangement between the different layers are suitable
Sequence is configured by system or user.Such as, operation control key is at ground floor, if numeral dried layer behind；Or numeral is front,
Operation control key, at last layer, can be arranged voluntarily according to user habit.
For example, when user needs to input password, then dividing multilamellar to arrange numeral, this mode can improve input
The safety of information.With reference to Fig. 4, it is that 10 numerals of 0-9 show in multilamellar, and same numbers is in multilamellar repeated arrangement
Display, and distinguish different layers.When using multilamellar arrangement, user can switch between many layer digital, thus people around cannot
The password that user inputs is inferred from the relative displacement of hands.
As a example by 6 passwords of input, common two-dimensional digital password, the safety coefficient of user is 1/10^6.But use
The present invention, inputs in three dimensions array, owing to having distinguished different layers, so 6 same bit digital passwords, its peace
Congruence level is 1/30^6.Understanding, the input of safety coefficient relative two dimensional improves 729 times.When input password figure place is more or layer
When number is more, safety coefficient should be able to obtain lifting by a larger margin mutually.
In the case of user need to input numeral at daily, numeral monolayer alignment, with reference to the ground floor of Fig. 3.With
Family can clear and definite in input request oneself whether be this time Password Input, or by system according to the currently used function of user
Automatically infer that user carries out Password Input, thus configure corresponding numerical monitor layout.
(3) include when the type of input element: when letter and operation control key, according to distance users side from the close-by examples to those far off
Formula, successively to operation control key and letter hierarchal arrangement, wherein, operation control key is distributed in same layer, and letter is distributed in multilamellar
Arrangement, same letter is in different layers repeated arrangement.Operation control key and letter between the different layers put in order by system or
User is configured.Such as, with reference to Fig. 5, operation control key is at ground floor, if letter dried layer behind；Or letter is front, behaviour
Make control key at last layer, can arrange voluntarily according to user habit.Such as, 26 English alphabets can divide two-layer to arrange, often
Layer 13 letter of arrangement, in every layer, each concrete spread pattern of letter is arbitrarily arranged.Additionally, 26 English alphabets also can divide
3 layers of arrangement, front two-layer respectively arranges 8 alphabetical elements, third layer 10 alphabetical elements of arrangement.Certainly, above-mentioned is only to be given preferably
Embodiment, cubical array does not limit the number of elements of the number of plies and every layer, depending on actual form is according to concrete input requirements.
In one embodiment of the invention, alternative input element display layout in three dimensions choose include following
Two ways:
1) system is pre-configured with, and automatically chooses configuration according to the type of the element to be entered in input request；
2) configured in input request by user.
It should be noted that alternative input element display layout in three dimensions, its hierarchical rule is according to user
Depending on the convenience of input content and operation, can be according to the number of plies of the hobby selection layering of oneself and every layer of content to be entered
Arrangement.
Step S3, shows alternative input element at the three dimensions in user front with cubical array form.
In this step, before user's field of vision, one at (field of view) correct position, is generated (virtual) three
Cubical array in dimension space, this cubical array includes all of alternative input element, checks for user and select.
Step S4, uses the input medium medium of three-dimensional fix technology for detection user, and real-time positioning user is with this
Input medium shift position in cubical array, detects the three-dimensional coordinate of each position, and then by each three-dimensional coordinate pair
The alternative input element answered is as the input element of user, until detecting that the confirmation of user completes operation.
After numeral, letter or symbols etc. to be entered have arranged the most in three dimensions, and in user front
Three dimensions in show.When user is ready for input operation, then pass through the defeated of three-dimensional fix technology for detection user
Enter means medium.In an embodiment of the present invention, the input medium medium of user includes: hand inputs, utilizes external control to fill
Put input, utilize keyboard and mouse to input.That is, user can use hands, control the means such as device, keyboard, mouse at cubical array
Space is moved, and completes to select to confirm operation.Additionally, user can use one hand or the input medium of single control device, can
The element in cubical array is clicked with both hands or double control device.
Utilizing three-dimensional fix technology that user shift position in three dimensions carries out space orientation, real-time positioning is used
The three-dimensional coordinate of each position, with this input medium shift position in cubical array, is detected in family.According in step S2, often
Individual alternative input element is respectively provided with unique three-dimensional coordinate in three dimensions.By the three-dimensional coordinate of shift position detected and
The three-dimensional coordinate of alternative input element is compared, it is judged that the alternative input element that user selects, and then by each three-dimensional seat
The alternative input element of mark correspondence is as the input element of user, until detecting that the confirmation of user completes operation.
In one embodiment of the invention, three-dimensional fix technology at least includes following one: flight time TOF is fixed
Position technology, binocular camera location technology, ultrasonic locating technology, optical locating techniques, kinect body-sensing location technology, dynamically
Controller Ps move location technology, beacon Light house location technology, laser radar location technology, ultra broadband UWB position
Technology, synchronization position and build figure SLAM technology, Virtuix omni location technology, structure light projection technology.
It should be noted that the three-dimensional fix technology that the present invention uses is not limited to the example above, it is also possible to use for it
The location technology of family type, as long as being capable of positioning three-dimensional, does not repeats them here.
Step S5, transmits the input element of user to subsequent operation system, completes input operation.
Below as a example by flight time TOF location technology, position fixing process is illustrated:
Fig. 2 is the flow chart of the array input method in three dimensions according to another embodiment of the present invention.
Step S201, is determined the number of plies and the arrangement of element to be entered by demand.
By user according to oneself the type inputting motivated input element, it may be assumed that input numeral, letter or symbol etc. need
Ask, or numeral, letter, symbol all have.
According to clear and definite input requirements, before user's field of vision, at (field of view) correct position, generation one exists
Cubical array in (virtual) three dimensions, i.e. contains the array of z-axis depth information.Wherein, z-axis depth information and respective operations
The depth information one_to_one corresponding of means.
Step S202, shows corresponding three-dimensional array.
Step S203, uses three-dimensional fix technological orientation input medium medium.
Utilize the input medium medium of three-dimensional fix technical limit spacing user, such as by hand, control device, keyboard
The operational means such as mouse.
Step S204, selects with this input medium is mobile in cubical array.
After knowing the input medium medium of user, three-dimensional fix technical limit spacing user is utilized to use this input medium
Mobile location information in cubical array, the corresponding array element that this positional information is mapped in the three dimensions array of generation
Position, and give corresponding feedback.
First, utilize three-dimensional fix technical limit spacing user be currently entered position in cubical array with user perspective
The coordinate of parallel place x-y axial plane.
Then, use three-dimensional fix technology for detection user by input medium movement in cubical array, obtain
The coordinate on z-axis depth information that user is vertical with user perspective, and then obtain the three-dimensional coordinate being currently entered position of user.
Specifically, relative to the relative movement of the input mediums such as hands or control device, real-time for change in location information is corresponded to three
The three-dimensional coordinate of alternative input element in dimension array.When moving on in cubical array in the trigger range of certain alternative input element,
Then realize choosing the operation of the element of corresponding position.
Finally, according to the corresponding relation of the alternative input element corresponding to each three-dimensional coordinate of configuration, by this three-dimensional coordinate
Corresponding alternative input element is as the input element of user.
Below using TOF location technology as space orientation scheme, input as case input medium using gesture, to input 0-
9 passwords, as case real needs, describe the running of the present invention.
First after the demand of the numerical ciphers of user oneself 0-9 to be inputted clear and definite, by this explicit requirement in input request.
Generate the cubical array including numeral and operation control key in three dimensions according to this demand, its number of plies and order can be according to
Depending on user, such as, it is set to 3 layers.
Then, generate the cubical array of band depth information and be presented in user visual field in (virtual) three dimensions.
Concrete generating mode is: each array element (i.e. attaches individual digit or the array block of operation control key), has one only
The three-dimensional coordinate of one, including: two-dimensional coordinate information and the depth information of z-axis.Additionally, for three-layer set, the second layer, third layer
Array configuration can according to perspective principle in two-dimensional space, do some deformation and perspective, so that also have in visual effect
The sensation of cubical array.Here z-axis depth information and the depth information one_to_one corresponding of input medium afterwards.When establishing three
After dimension array, TOF location technology is utilized first the input medium of user to be positioned.
Concrete, in the present embodiment, user makes to use gesture as input medium.By the input of TOF location technology location
The medium of means, the position of the most concrete hands.TOF passes through distinctive camera, to the hands of the medium of input medium, i.e. user, even
Supervention send light pulse, then receives the light pulse returned from hand with sensor, by the two-way time of detecting optical pulses
Depth information in one's hands.TOF camera can obtain its visual field simultaneously in the depth information of whole sub-picture, i.e. the z-axis degree of depth of hand
Information.
The present invention, with TOF camera as object of reference, assert the phase para-position of cubical array and this TOF camera of TOF camera, generation
Put the most constant.Material is thus formed a set of with TOF camera and three-dimensional volumetric array the three-dimensional system of coordinate as reference, pre-specified
The X of changeless cubical array, Y-axis and Z axis coordinate.Meanwhile, provide the depth information of hand by TOF camera and sit at this
X in mark system and y-axis coordinate.Hand moves in this coordinate system, relative to constant cubical array, such that it is able to calculate
Hand relative movement coordinate in three dimensions.The depth information carried due to z-axis depth information and cubical array is one by one
Corresponding.Therefore, by obtaining the hand relative movement in z-axis, it is also possible to reflection to constant cubical array depth information z
On axle.Based on this, it is possible to achieve utilize the TOF location technology medium to input medium: the demarcation of the three-dimensional coordinate of hand and obtaining
Take.
After determining the particular location of hands, user moves hand and can move in the three layer digital arrays set up
Select.When TOF detection in one's hands after, initialize hand initial position, and with generate three dimensions array in initial position
Corresponding.Thus, it is only necessary to the relative movement of detection hand, just may determine that hand is at three-dimensional particular location.Such as Fig. 6
Shown in, when hand being detected, if be detected that now the three-dimensional coordinate of hand position is V1, by judging this V1 of discovery and life
The three-dimensional coordinate V0 of the numeral " 5 " of the ground floor of the 3 layer digital arrays become is corresponding, the most tentatively judges that user currently chooses defeated
Entering element is 5.Now, i.e. " 5 " of ground floor can be highlighted, and to prompt the user with, the position of its hand is corresponding with cubical array closes
System.
User is after seeing this highlighted prompting, if it is confirmed that correctly, then by moving the hands of oneself in cubical array space
In complete select confirm.Such as, user wants to select " 0 " element of the second layer, then need to move down hand.Now TOF camera meeting
In real time the position of monitoring hand also provides feedback, in moving process, can through ground floor " 8 ", it also can highlighted once, represent
Choose it.Also move down continuing due to hand, when, after the response range of removal ground floor " 8 ", this button will
Become normal from highlighted；Hand continues to move down, and " 0 " element of ground floor can highlighted response.At this time hands can stop downwards
Mobile, and move to the bearing of trend of z-axis, now TOF camera can capture the three-dimensional information of hand, the degree of depth of hand detected
Information is increasing, and when the depth information with cubical array element compares generation relative displacement, hand moves to the second layer
" 0 " element three-dimensional coordinate response range in after, " 0 " element of the second layer becomes highlighted, so far, just completes mobile clicking
Operation.As it is shown in fig. 7, when, behind " 0 " choosing the second layer with hand, needing to confirm to trigger.Wherein, concrete input medium is tactile
Originating party formula can be any, is not construed as limiting.Such as, forefinger is chosen as triggering mode etc. by hand.Thus, " 0 " of the second layer
Will be input in corresponding registers.
Step S205, is completed to confirm operation by the standard of this input medium.
After making confirmation operation by input mediums such as hand or control devices, corresponding element will be triggered, complete
Input operation.
Step S206, it is thus achieved that corresponding input demand is also transferred to operating system.
Often orient an input element, this input element is carried out highlighted process to point out user, and receiving use
After the confirmation operation at family, this input element is transmitted to subsequent operation system.
As shown in Figure 8, the embodiment of the present invention also proposes a kind of array input system in three dimensions, including:
Communication module 1, cubical array generate and display module 2 and three-dimensional fix module 3.
Specifically, communication module 1 is for receiving the input request of user.
When user wishes input information, trigger the input pattern of equipment and to the communication module 1 of input system of the present invention
Send input request.Wherein, input request includes: the type of element to be entered.Such as, user can in input request clearly
Element to be entered includes: the combination of letter and number or letter, the combination etc. of numbers and symbols.In this step, equipment can
To provide the selection prompting frame showing element to be entered, user selects as required, sends this input request after confirmation.
Cubical array generates and display module 2 is connected with communication module 1, is used for responding input request, and according to be entered
The type of element arranges alternative input element display layout in three dimensions, is existed with cubical array form by alternative input element
The three dimensions in user front shows.
In one embodiment of the invention, it is achieved one of following means of above-mentioned display layout:
(1) render in virtual screen into corresponding three-dimensional picture, it is achieved three dimensional display；
(2) before eyes, some centimeters arrange an optical light guides eyeglass, by getting corresponding three on this eyeglass
Dimension image, it is achieved 3-D effect.
It should be noted that the means realizing three dimensional display layout are not limited to above two, it is also possible to take its user side
Formula, as long as the purpose of three dimensional display can be reached to carry out input element, does not repeats them here.
Wherein, display layout includes the alternative input element number of plies in three dimensions and arrangement, utilizes above-mentioned three-dimensional to show
Show that alternative input element is carried out arrangement display in front of the user by means with cubical array form.Additionally, each alternative input unit
Element is respectively provided with unique three-dimensional coordinate in three dimensions, and this is in order to follow-up position matching in three dimensions uses.
In one embodiment of the invention, the type of input element at least includes the combination of one or more of: number
Word, letter, symbol and operation control key.Wherein, operation control key is for example: backspace key, line feed key, acknowledgement key.Need explanation
, the type of input element is not limited to above-mentioned, it is also possible to include its user type, and the type of input element can basis
Needs are added and delete.
Specifically, cubical array generates and display module 2 arranges alternative input element according to the type of element to be entered and exists
Display layout in three dimensions, including:
(1) include when the type of input element: when numeral, letter, symbol and operation control key, according to distance users by closely
And remote mode, successively to operation control key, numeral, letter, symbol hierarchal arrangement, each type of input element is distributed in one
Layer or multilamellar arrangement.
(2) include when the type of input element: when numeral and operation control key and user ask to input password, according to distance
User's mode from the close-by examples to those far off, successively to operation control key and numeral hierarchal arrangement, wherein, operation control key is distributed in same
Layer, numeral can be distributed in one or more layers arrangement, and same numbers is in different layers repeated arrangement.Operation control key and numeral be not
It is configured by system or user with putting in order between layer.Such as, operation control key is at ground floor, and numeral is the most some
Layer；Or numeral is front, operation control key, at last layer, can be arranged voluntarily according to user habit.
(3) include when the type of input element: when letter and operation control key, according to distance users side from the close-by examples to those far off
Formula, successively to operation control key and letter hierarchal arrangement, wherein, operation control key is distributed in same layer, and letter is distributed in multilamellar
Arrangement, same letter is in different layers repeated arrangement.Operation control key and letter between the different layers put in order by system or
User is configured.
In one embodiment of the invention, alternative input element display layout in three dimensions choose include following
Two ways:
1) system is pre-configured with, and automatically chooses configuration according to the type of the element to be entered in input request；
2) configured in input request by user.
It should be noted that alternative input element display layout in three dimensions, its hierarchical rule is according to user
Depending on the convenience of input content and operation, can be according to the number of plies of the hobby selection layering of oneself and every layer of content to be entered
Arrangement.
Cubical array generate and display module 2 further by alternative input element with cubical array form in user front
Three dimensions shows.
Specifically, cubical array generates and display module 2 is before user's field of vision at (field of view) correct position
Generating a cubical array in (virtual) three dimensions, this cubical array includes all of alternative input element, for user
Check and select.
Three-dimensional fix module 3 generates with cubical array and display module 2 is connected, and is used for using three-dimensional fix skill
The input medium medium of art detection user, and real-time positioning user is with this input medium shift position in cubical array, inspection
Survey the three-dimensional coordinate of each position, using alternative input element corresponding for each three-dimensional coordinate as the input element of user, directly
Operation is completed to confirmation user being detected.Then, the input element of user is transmitted to subsequent operation system by communication module 1 again
System, completes input operation.
Cubical array generate and display module 2 by numeral to be entered, letter or symbol etc. on demand at three-dimensional space
After having arranged between, and show in the three dimensions in user front.When user is ready for input operation, then by three
Dimension space locating module 3 detects the input medium medium of user.In an embodiment of the present invention, the input medium medium bag of user
Include: hand inputs, utilizes external control device input, utilizes keyboard and mouse to input.That is, user can use hands, control device,
The means such as keyboard, mouse move in cubical array space, and complete to select to confirm operation.Additionally, user can use one hand
Or the input medium of single control device, the element in cubical array can be clicked with both hands or double control device.
Three-dimensional fix module 3 utilizes three-dimensional fix technology that user shift position in three dimensions is carried out sky
Between position, real-time positioning user, with this input medium shift position in cubical array, detects the three-dimensional seat of each position
Mark.Unique three-dimensional coordinate it is respectively provided with in three dimensions according to each alternative input element.By the shift position that detects
The three-dimensional coordinate of three-dimensional coordinate and alternative input element is compared, it is judged that the alternative input element that user selects, and then will
Alternative input element corresponding to each three-dimensional coordinate is as the input element of user, until detecting that the confirmation of user completes behaviour
Make.
In one embodiment of the invention, the three-dimensional fix technology that three-dimensional fix module 3 uses at least is wrapped
Include following one: flight time TOF location technology, binocular camera location technology, ultrasonic locating technology, optical alignment skill
Art, kinect body-sensing location technology, dynamic controller Ps move location technology, beacon Light house location technology, laser
Radar fix technology, ultra broadband UWB location technology, synchronization position and build figure SLAM technology, Virtuix omni location technology, knot
Structure light projection technology.
It should be noted that the three-dimensional fix technology that the present invention uses is not limited to the example above, it is also possible to use for it
The location technology of family type, as long as being capable of positioning three-dimensional, does not repeats them here.
In one embodiment of the invention, the array input system in three dimensions that the present invention provides is installed
On Virtual Reality equipment or augmented reality AR and mixed reality MR equipment, and in Virtual Reality equipment or AR and MR equipment
Operating system communicate.
It should be noted that the equipment that the present invention is suitable for is not limited to the example above, as long as have three dimensional display and input
Demand, the three-dimensional array type arrangement input that the present invention provides all can be applied, and does not repeats them here.
The array input method in three dimensions according to embodiments of the present invention and system, take full advantage of (empty
Intend) three-dimensional depth dimension information, by elements such as a fairly large number of numeral, letter or symbols originally according to input convenience
It is regularly distributed on different depth layer, thus greatly reduces the quantity of every layer of element, solve and input not in three dimensions
Problem easily so that user's input in three dimensions is more orderly and efficient.Further, by using three dimensions fixed
The input of user is accurately positioned by position technology, can be accurately positioned out the input element of user.Shown by cubical array
Array, relative to two dimensional surface display format, can be greatly improved the safety of user's input information.
In the description of this specification, reference term " embodiment ", " some embodiments ", " example ", " specifically show
Example " or the description of " some examples " etc. means to combine this embodiment or example describes specific features, structure, material or spy
Point is contained at least one embodiment or the example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Necessarily refer to identical embodiment or example.And, the specific features of description, structure, material or feature can be any
One or more embodiments or example in combine in an appropriate manner.
Although above it has been shown and described that embodiments of the invention, it is to be understood that above-described embodiment is example
Property, it is impossible to be interpreted as limitation of the present invention, those of ordinary skill in the art is without departing from the principle of the present invention and objective
In the case of above-described embodiment can be changed within the scope of the invention, revise, replace and modification.The scope of the present invention
Limited by claims and equivalent thereof.
Claims (12)
1. the array input method in three dimensions, it is characterised in that comprise the steps:
Step S1, receives the input request of user, and wherein, described input request includes: the type of element to be entered；
Step S2, responds described input request, and arranges alternative input element in three-dimensional according to the type of described element to be entered
Display layout in space, wherein, described display layout includes the described alternative input element number of plies in three dimensions and arrangement,
Each described alternative input element has unique three-dimensional coordinate in described three dimensions；
Step S3, shows described alternative input element at the three dimensions in described user front with cubical array form；
Step S4, uses the input medium medium of three-dimensional fix technology for detection user, and real-time positioning user is with this input
Means shift position in described cubical array, detects the three-dimensional coordinate of each position, and then by each described three-dimensional seat
The alternative input element of mark correspondence is as the input element of user, until detecting that the confirmation of user completes operation；
Step S5, transmits the input element of described user to subsequent operation system, completes input operation.
2. the array input method in three dimensions as claimed in claim 1, it is characterised in that described input element
Type at least include the combination of one or more of: numeral, letter, symbol and operation control key,
In described step S2, alternative input element is set according to the type of described element to be entered and shows cloth in three dimensions
Office, including:
When the type of described input element includes: numeral, letter, symbol and during operation control key, according to distance users by near and
Remote mode, successively to described operation control key, numeral, letter, symbol hierarchal arrangement, each type of input element is distributed in
One or more layers arrangement；
When the type of described input element includes: when numeral and operation control key and described user ask to input password, according to away from
From user's mode from the close-by examples to those far off, successively to described operation control key and numeral hierarchal arrangement, wherein, described operation control key divides
Cloth is at same layer, and described digital distribution arranges in multilamellar, and same numbers is in different layers repeated arrangement；
When the type of described input element includes: when letter and operation control key, according to distance users mode from the close-by examples to those far off, depend on
Secondary to described operation control key with letter hierarchal arrangement, wherein, described operation control key is distributed in same layer, described letter distribution
Arranging in multilamellar, same letter is in different layers repeated arrangement.
3. the array input method in three dimensions as claimed in claim 1, it is characterised in that described alternative input
Element display layout in three dimensions chooses the following two mode that includes:
1) system is pre-configured with, and automatically chooses configuration according to the type of the element to be entered in described input request；
2) configured in described input request by user.
4. the array input method in three dimensions as claimed in claim 1, it is characterised in that in described step S4
In, described three-dimensional fix technology at least includes following one: flight time TOF location technology, binocular camera position skill
Art, ultrasonic locating technology, optical locating techniques, kinect body-sensing location technology, dynamic controller Ps move location technology,
Beacon Light house location technology, laser radar location technology, ultra broadband UWB location technology, synchronization position and build figure SLAM
Technology, Virtuix omni location technology, structure light projection technology.
5. the array input method in three dimensions as claimed in claim 1, it is characterised in that in described step S4
In, the input medium medium of described user includes: hand inputs, utilizes external control device input, utilizes keyboard and mouse to input.
6. the array input method in three dimensions as claimed in claim 1, it is characterised in that in described step S4
In,
First, use described three-dimensional fix technical limit spacing user's to be currently entered position in described cubical array with described
The coordinate of the place x-y axial plane that user perspective is parallel；
Then, use user described in described three-dimensional fix technology for detection by input medium shifting in described cubical array
Dynamic, obtain the coordinate on the z-axis depth information that described user is vertical with described user perspective, and then obtain the current of described user
The three-dimensional coordinate of input position；
Finally, according to the corresponding relation of the alternative input element corresponding to each three-dimensional coordinate of configuration in described step S2, should
Alternative input element corresponding to three-dimensional coordinate is as the input element of user；
Wherein, in described step S3, often orient an input element, this input element is carried out highlighted process to point out use
Family, and after the confirmation receiving user operates, this input element is transmitted to subsequent operation system.
7. the array input system in three dimensions, it is characterised in that including:
Communication module, for receiving the input request of user, wherein, described input request includes: the type of element to be entered；
Cubical array generates and display module, and described cubical array generates and display module is connected with described communication module, is used for
Respond described input request, and alternative input element is set according to the type of described element to be entered shows cloth in three dimensions
Office, shows described alternative input element at the three dimensions in described user front with cubical array form, wherein, and described display
Layout includes the described alternative input element number of plies in three dimensions and arrangement, and each described alternative input element is described three
Dimension space has unique three-dimensional coordinate；
Three-dimensional fix module, described three-dimensional fix module generates with described cubical array and display module is connected, and uses
In use three-dimensional fix technology for detection user input medium medium, and real-time positioning user with this input medium described
Shift position in cubical array, detects the three-dimensional coordinate of each position, by corresponding for each described three-dimensional coordinate alternative defeated
Enter the element input element as user, until detecting that the confirmation of user completes operation；
Described communication module is additionally operable to transmit to subsequent operation system the input element of described user, completes input operation.
8. the array input system in three dimensions as claimed in claim 7, it is characterised in that described input element
Type at least include the combination of one or more of: numeral, letter, symbol and operation control key,
Described cubical array generates and display module arranges alternative input element display layout in three dimensions, including following
Form:
When the type of described input element includes: numeral, letter, symbol and during operation control key, according to distance users by near and
Remote mode, successively to described operation control key, numeral, letter, symbol hierarchal arrangement, each type of input element is distributed in
One or more layers arrangement；
When the type of described input element includes: when numeral and operation control key and user ask to input password, use according to distance
Family mode from the close-by examples to those far off, successively to described operation control key and numeral hierarchal arrangement, wherein, described operation control key is distributed in
Same layer, described digital distribution arranges in multilamellar, and same numbers is in different layers repeated arrangement；
When the type of described input element includes: when letter and operation control key, according to distance users mode from the close-by examples to those far off, depend on
Secondary to described operation control key with letter hierarchal arrangement, wherein, described operation control key is distributed in same layer, described letter distribution
Arranging in multilamellar, same letter is in different layers repeated arrangement.
9. the array input system in three dimensions as claimed in claim 7, it is characterised in that described alternative input
Element display layout in three dimensions chooses the following two mode that includes:
1) system is pre-configured with, and automatically chooses configuration according to the type of the element to be entered in described input request；
2) configured in described input request by user.
10. the array input system in three dimensions as claimed in claim 7, it is characterised in that described three-dimensional space
Between the three-dimensional fix technology that uses of locating module at least include following one: flight time TOF location technology, binocular camera shooting
Head location technology, ultrasonic locating technology, optical locating techniques, kinect body-sensing location technology, dynamic controller Psmove are fixed
Position technology, beacon Light house location technology, laser radar location technology, ultra broadband UWB location technology, synchronize location with
Build figure SLAM technology, Virtuix omni location technology, structure light projection technology.
11. are used for the array input system in three dimensions as claimed in claim 7, it is characterised in that described three-dimensional space
Between locating module use described three-dimensional fix technical limit spacing user be currently entered position in described cubical array with institute
State the coordinate of the parallel place x-y axial plane of user perspective；Then user described in described three-dimensional fix technology for detection is used
By input medium movement in described cubical array, obtain the z-axis degree of depth letter that described user is vertical with described user perspective
Coordinate on breath, and then obtain the three-dimensional coordinate being currently entered position of described user；Each three-dimensional finally according to configuration is sat
The corresponding relation of the alternative input element that mark is corresponding, alternative input element corresponding for this three-dimensional coordinate is first as the input of user
Element,
Wherein, described three-dimensional fix module often orients an input element, this input element is carried out highlighted process with
Prompting user, and after the confirmation receiving user operates, this input element is transmitted to subsequent operation system.
12. are used for the array input system in three dimensions as claimed in claim 7, it is characterised in that described user's
Input medium medium includes: hand inputs, utilizes external control device input, utilizes keyboard and mouse to input；
Described array input system in three dimensions is installed on Virtual Reality equipment or augmented reality AR and mixing
On reality MR equipment, communicate with the operating system in described Virtual Reality equipment or AR and MR equipment.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610652247.0A CN106293127B (en) | 2016-08-10 | 2016-08-10 | For the array input method and system in three-dimensional space |
| PCT/CN2016/095986 WO2018028003A1 (en) | 2016-08-10 | 2016-08-19 | Array type input method and system for use in three-dimensional space |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610652247.0A CN106293127B (en) | 2016-08-10 | 2016-08-10 | For the array input method and system in three-dimensional space |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106293127A true CN106293127A (en) | 2017-01-04 |
| CN106293127B CN106293127B (en) | 2019-03-19 |
Family
ID=57668149
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610652247.0A Active CN106293127B (en) | 2016-08-10 | 2016-08-10 | For the array input method and system in three-dimensional space |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106293127B (en) |
| WO (1) | WO2018028003A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106873796A (en) * | 2017-01-13 | 2017-06-20 | 河源市汉祖文化科技有限公司 | A kind of gesture input method and system based on three-stroke digital input method |
| CN107329566A (en) * | 2017-06-23 | 2017-11-07 | 联想(北京)有限公司 | Virtual objects processing method and its system, virtual reality device |
| CN107688388A (en) * | 2017-08-20 | 2018-02-13 | 平安科技（深圳）有限公司 | Control device, method and the computer-readable recording medium of Password Input |
| CN108958573A (en) * | 2017-05-26 | 2018-12-07 | 阿里巴巴集团控股有限公司 | Identity identifying method and device based on virtual reality scenario |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1042250A (en) * | 1989-10-20 | 1990-05-16 | 胡书彬 | Chinese character three-figure coding method and keyboard thereof |
| CN1150272A (en) * | 1995-12-25 | 1997-05-21 | 中国中文信息学会 | Full-spelling double-spelling normalized code Chinese character enter mode |
| US20040136564A1 (en) * | 2002-08-20 | 2004-07-15 | Helena Roeber | System and method for determining an input selected by a user through a virtual interface |
| CN102402379A (en) * | 2010-09-14 | 2012-04-04 | Lg电子株式会社 | Mobile terminal and controlling method thereof |
| CN105224069A (en) * | 2014-07-03 | 2016-01-06 | 王登高 | The device of a kind of augmented reality dummy keyboard input method and use the method |
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
| CN105808086A (en) * | 2014-12-30 | 2016-07-27 | Tcl集团股份有限公司 | Virtual keyboard input method and device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101728725B1 (en) * | 2010-10-04 | 2017-04-20 | 엘지전자 주식회사 | Mobile terminal and method for controlling thereof |
| KR101763263B1 (en) * | 2010-12-24 | 2017-07-31 | 삼성전자주식회사 | 3d display terminal apparatus and operating method |
| WO2012099592A1 (en) * | 2011-01-20 | 2012-07-26 | Research In Motion Limited | Three-dimensional, multi-depth presentation of icons in association with differing input components of a user interface |
| CN105808015B (en) * | 2016-05-27 | 2018-10-12 | 京东方科技集团股份有限公司 | Peep-proof user interaction means and method |
-
2016
- 2016-08-10 CN CN201610652247.0A patent/CN106293127B/en active Active
- 2016-08-19 WO PCT/CN2016/095986 patent/WO2018028003A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1042250A (en) * | 1989-10-20 | 1990-05-16 | 胡书彬 | Chinese character three-figure coding method and keyboard thereof |
| CN1150272A (en) * | 1995-12-25 | 1997-05-21 | 中国中文信息学会 | Full-spelling double-spelling normalized code Chinese character enter mode |
| US20040136564A1 (en) * | 2002-08-20 | 2004-07-15 | Helena Roeber | System and method for determining an input selected by a user through a virtual interface |
| US7151530B2 (en) * | 2002-08-20 | 2006-12-19 | Canesta, Inc. | System and method for determining an input selected by a user through a virtual interface |
| CN102402379A (en) * | 2010-09-14 | 2012-04-04 | Lg电子株式会社 | Mobile terminal and controlling method thereof |
| CN105224069A (en) * | 2014-07-03 | 2016-01-06 | 王登高 | The device of a kind of augmented reality dummy keyboard input method and use the method |
| CN105808086A (en) * | 2014-12-30 | 2016-07-27 | Tcl集团股份有限公司 | Virtual keyboard input method and device |
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106873796A (en) * | 2017-01-13 | 2017-06-20 | 河源市汉祖文化科技有限公司 | A kind of gesture input method and system based on three-stroke digital input method |
| CN106873796B (en) * | 2017-01-13 | 2019-11-26 | 河源市汉祖文化科技有限公司 | A kind of gesture input method and system based on three-stroke digital input method |
| CN108958573A (en) * | 2017-05-26 | 2018-12-07 | 阿里巴巴集团控股有限公司 | Identity identifying method and device based on virtual reality scenario |
| CN108958573B (en) * | 2017-05-26 | 2021-06-29 | 创新先进技术有限公司 | Identity authentication method and device based on virtual reality scene |
| CN107329566A (en) * | 2017-06-23 | 2017-11-07 | 联想(北京)有限公司 | Virtual objects processing method and its system, virtual reality device |
| WO2018233162A1 (en) * | 2017-06-23 | 2018-12-27 | 联想(北京)有限公司 | Virtual object processing method and system and virtual reality device |
| US11538222B2 (en) | 2017-06-23 | 2022-12-27 | Lenovo (Beijing) Limited | Virtual object processing method and system and virtual reality device |
| CN107688388A (en) * | 2017-08-20 | 2018-02-13 | 平安科技（深圳）有限公司 | Control device, method and the computer-readable recording medium of Password Input |
| CN107688388B (en) * | 2017-08-20 | 2020-08-28 | 平安科技（深圳）有限公司 | Password input control apparatus, method and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106293127B (en) | 2019-03-19 |
| WO2018028003A1 (en) | 2018-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106293127A (en) | Array input method in three dimensions and system | |
| CN104572004B (en) | A kind of information processing method and electronic equipment | |
| CN105100390B (en) | A method of control mobile terminal | |
| CN102129290B (en) | Image processing device, object selection method and program | |
| CN103946766B (en) | Finger gesture user interface based on light | |
| JP6028351B2 (en) | Control device, electronic device, control method, and program | |
| US10600253B2 (en) | Information processing apparatus, information processing method, and program | |
| CN108334199A (en) | The multi-modal exchange method of movable type based on augmented reality and device | |
| US9501176B1 (en) | Method, apparatus, and manufacture for document writing and annotation with virtual ink | |
| EP2974509B1 (en) | Personal information communicator | |
| CN102207770A (en) | Vehicle user interface unit for a vehicle electronic device | |
| KR20150129386A (en) | Foldable display device and method for controlling the same | |
| CN104081307A (en) | Image processing apparatus, image processing method, and program | |
| CN102760308B (en) | Method and device for node selection of object in three-dimensional virtual reality scene | |
| KR20120000894A (en) | 3d image displaying system and 3d displaying method using the same | |
| US20220163334A1 (en) | Method for providing navigation service using mobile terminal, and mobile terminal | |
| US20150084936A1 (en) | Method and apparatus for drawing three-dimensional object | |
| CN107102750B (en) | The selection method of target in a kind of virtual three-dimensional space based on pen type interactive system | |
| US9288385B2 (en) | Image sharing system and related computer program product | |
| CN102221880A (en) | Display method and system for 3D (Three-dimensional) graphical interface | |
| CN105847110A (en) | Position information displaying method and mobile terminal | |
| CN103593050A (en) | Method and system for selecting press screen and transferring pictures through mobile terminal | |
| US10643393B2 (en) | Method, electronic device, and storage medium for information processing | |
| CN102770836A (en) | Method for controlling motions of an object in a 3-dimensional virtual environment | |
| CN105988640A (en) | Optical touch device and touch detection method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |