CN102810015B - Input method based on space motion and terminal - Google Patents

Input method based on space motion and terminal Download PDF

Info

Publication number
CN102810015B
CN102810015B CN201110143787.3A CN201110143787A CN102810015B CN 102810015 B CN102810015 B CN 102810015B CN 201110143787 A CN201110143787 A CN 201110143787A CN 102810015 B CN102810015 B CN 102810015B
Authority
CN
China
Prior art keywords
movement locus
projection
input
efficiency flat
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110143787.3A
Other languages
Chinese (zh)
Other versions
CN102810015A (en
Inventor
赛斌
郑伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201110143787.3A priority Critical patent/CN102810015B/en
Priority to PCT/CN2012/072063 priority patent/WO2012163124A1/en
Publication of CN102810015A publication Critical patent/CN102810015A/en
Application granted granted Critical
Publication of CN102810015B publication Critical patent/CN102810015B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a kind of input method based on space motion and system, operator moves input terminal according to object to be identified shape in space, described input terminal performs following steps: gathering its effective motion trace data, described motion trace data at least includes three-dimensional space data;Project to described motion trace data respectively, on three two dimensional surfaces of pairwise orthogonal, obtain three groups of movement locus data for projection;Calculate corresponding movement locus according to described movement locus data for projection and project the area occupied, the two dimensional surface at movement locus projection place maximum for area is defined as there is efficiency flat;According to the described movement locus projection having efficiency flat or the mirror image identification input object of movement locus projection.The inventive method and system overcome the application limitation of existing input method.

Description

Input method based on space motion and terminal
Technical field
The present invention relates to input technology, particularly relate to a kind of input method based on space motion and terminal.
Background technology
Developing rapidly the requirement the highest to Consumer's Experience with people along with mobile communication technology, mobile terminal product presents the most all the more diversification and personalized trend.Particularly in terms of man-machine interaction, that user thirsts for using is more convenient, more humane, break through traditional method.
Traditional mobile terminal character input and feature operation are realized by keyboard, have that button is intensive to be awkward, and chinese character input needs to combine phonetic, the input methods such as five, input speed more slowly, the shortcoming such as the most directly perceived.
Emerging touch screen man-machine interaction method, needs mobile terminal to have writing pencil and a bigger touch curtain, only could realize when using touch screen inputting, it is impossible at any time, respond rapidly to input or the operational order of user.
The application of the technology such as gravity sensing enables the terminal to identify the simple motion of user, but it is currently limited to the single application such as unlocking screen, easy game operation, the most do not support the corresponding relation setting according to user habit between the specific operating instructions of certain action and needs execution flexibly, the most do not support to be realized by gravity sensing the input of character or figure.The gravity sensing technology being applied to mobile terminal at present can not accurately catch the spatial position change of terminal, can only identify simple directional operation, and range of application is restricted.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind of input method based on space motion and system, the problem limited to solve the application of existing input method.
For solving above technical problem, the present invention is supplied to a kind of input method based on space motion, and operator moves input terminal according to object to be identified shape in space, and described input terminal performs following steps:
Gathering its effective motion trace data, described motion trace data at least includes three-dimensional space data;
Project to described motion trace data respectively, on three two dimensional surfaces of pairwise orthogonal, obtain three groups of movement locus data for projection;
Calculate corresponding movement locus according to described movement locus data for projection and project the area occupied, the two dimensional surface at movement locus projection place maximum for area is defined as there is efficiency flat;
According to the described movement locus projection having efficiency flat or the mirror image identification input object of movement locus projection.
Further, described three two dimensional surfaces are horizontal plane and orthogonal with horizontal plane two vertical planes respectively.
Further, if according to the described movement locus projection having efficiency flat or the mirror image None-identified input object of movement locus projection, the method also includes:
Rotate there being efficiency flat for axle with special angle stepping with it with the intersecting lens of other two planes respectively, every stepping rotates once, the area of the movement locus projection calculated after rotating in new plane, if the area that in new plane, the area of movement locus projection projects less than the aforementioned movement locus having efficiency flat, stop rotating to the direction, and rotate to opposite direction stepping;If in new plane the area of movement locus projection be more than described in have the movement locus of efficiency flat to project area, then this new plane there is efficiency flat as revised, again this revised mirror image having the projection of movement locus on efficiency flat or movement locus projection is identified, if still can not identify, then continue to rotate by direction stepping, repeat said process until can recognize that or reaching preset stop condition.
Further, include according to the described mirror image identification input object having efficiency flat or the projection of revised movement locus or movement locus projection:
Identify described input object according to the projection of described movement locus, such as None-identified, then the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, further according to input object described in the picture identification of described movement locus projection lens.
Further, described input object is Chinese character, described motion trace data and described movement locus data for projection also include temporal information and/or stroke index, include according to the described mirror image identification input object having efficiency flat or the revised movement locus projection having efficiency flat or movement locus projection:
Whether the movement locus projection having efficiency flat described in the two dimensional surface position judgment according to described its correspondence of temporal information meets the sequential write of Chinese character, meet then according to as described in movement locus projection identify as described in input object, otherwise the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, according to input object described in the picture identification of described movement locus projection lens.
Further, before having efficiency flat described in determining, described input terminal judges that whether the time interval between effective motion trace data is more than preset value, if time interval is more than preset value, then think that object to be identified input is complete, determine there is efficiency flat according to the movement locus projection that complete object to be identified is corresponding, otherwise continue to gather next effective motion trace data.
Further, described input terminal has the input switch controlled by operator, described input switch uses software or hardware to realize, and described input terminal controls the start-stop of exercise data data acquisition according to the state of described input switch or judges the effectiveness of the motion trace data gathered;Described input terminal uses multidirectional gravity sensing technology, gyroscope or black light location technology to gather motion trace data.
Further, described object to be identified is Chinese character, the stroke of Chinese character, letter, numeral, symbol, figure or the self-defined shape representing specific instruction.
Further, described movement locus is projected on each two dimensional surface the area occupied is maximum spacing long-pending that this movement locus is projected in that the maximum spacing of the X direction of this two dimensional surface is projected in the y direction of this two dimensional surface with this movement locus.
For solving above technical problem, the present invention also provides for giving a kind of input terminal based on space motion, and this input terminal includes:
Data acquisition unit, for gathering the data of the effective movement locus of described input terminal, described motion trace data at least includes that three-dimensional space data, described movement locus are the tracks that operator moves input terminal according to object to be identified shape in space;
Plane projection unit, for described motion trace data projects to three two dimensional surfaces of pairwise orthogonal respectively, obtains three groups of movement locus data for projection, it is preferable that described three two dimensional surfaces are horizontal plane and orthogonal with horizontal plane two vertical planes respectively;
There is efficiency flat to determine unit, project, for calculating corresponding movement locus according to described movement locus data for projection, the area occupied, the two dimensional surface at movement locus projection place maximum for area is defined as there is efficiency flat;
Input object recognition unit, for having movement locus projection or the mirror image identification input object of movement locus projection of efficiency flat described in basis.
Present invention input method based on space motion and input terminal, Gather and input terminal is projected on two dimensional surface at the three-dimensional space data that any space is moved, maximum according to movement locus projected area on two dimensional surface determines there is efficiency flat, and have the projection on efficiency flat or the mirror image identification input object of projection according to this, thus the input of respective symbols, figure or operational order is realized according to terminal motion track, overcome the limitation of existing input method.
Accompanying drawing explanation
Fig. 1 is present invention input method based on space motion embodiment schematic diagram;
Fig. 2 is the present invention another embodiment schematic diagram of input method based on space motion;
Fig. 3 is the terminal motion track mapping schematic diagram to 5 dimension coordinate systems;
Fig. 4 is the schematic diagram that character projection carries out Mirroring Mapping process;
Fig. 5 is the embodiment schematic diagram of present invention input terminal based on space motion;
Fig. 6 is the another embodiment schematic diagram of present invention input terminal based on space motion.
Detailed description of the invention
The main thought of present invention input method based on space motion and input terminal is the motion trace data including three-dimensional space data that Gather and input terminal moves in any space, and project on two dimensional surface, maximum according to movement locus projected area on two dimensional surface determines there is efficiency flat, and have the projection on efficiency flat or the mirror image identification input object of projection according to this, thus the input of respective symbols, figure or operational order is realized according to terminal motion track, overcome the limitation of existing input method.
Below in conjunction with accompanying drawing, embodiments of the invention are described in detail.It should be noted that in the case of not conflicting, the embodiment in the application and the feature in embodiment can be mutually combined.
Present invention input method based on space motion, operator moves input terminal according to object to be identified shape in space, according to concrete input method type, such as spelling input method, stroke input method, English input method, digital inputting method, symbol input method, pattern input method, described object to be identified can be Chinese character, the stroke of Chinese character, letter, numeral, symbol, figure or the self-defined shape representing specific instruction, described input terminal execution step as shown in Figure 1:
Step 101: gather its effective motion trace data, described motion trace data at least includes three-dimensional space data;
Preferably, described input terminal has the input switch controlled by operator, described input switch uses software or hardware to realize, and described input terminal controls the start-stop of exercise data data acquisition according to the state of described input switch or judges the effectiveness of the motion trace data gathered.
Described input terminal can use multidirectional gravity sensing technology, gyroscope or black light location technology to gather motion trace data.
Step 102: project to described motion trace data respectively, on three two dimensional surfaces of pairwise orthogonal, obtain three groups of movement locus data for projection, it is preferable that described three two dimensional surfaces are horizontal plane and orthogonal with horizontal plane two vertical planes respectively;
Step 103: calculate corresponding movement locus according to described movement locus data for projection and project the area occupied, is defined as there is efficiency flat by the two dimensional surface at movement locus projection place maximum for area;
Preferably, before having efficiency flat described in determining, described input terminal judges that whether the time interval between effective motion trace data is more than preset value, if time interval is more than preset value, then think that object to be identified input is complete, determine there is efficiency flat according to the movement locus projection that complete object to be identified is corresponding, otherwise continue to gather next effective motion trace data.
It is maximum spacing long-pending that this movement locus is projected in that the maximum spacing of the X direction of this two dimensional surface is projected in the y direction of this two dimensional surface with this movement locus that described movement locus is projected on each two dimensional surface the area occupied.
Step 104: according to the described movement locus projection having efficiency flat or the mirror image identification input object of movement locus projection.
When implementing, can by inquiry local data base coupling with movement locus project or movement locus project mirror image consistent or close be Chinese character, the stroke of Chinese character, letter, numeral, symbol, figure or the self-defined shape representing specific instruction.
Specifically, step 104 can have a following two preferred version according to the motion trace data gathered:
Scheme one: step 104 includes:
Identify described input object according to the projection of described movement locus, such as None-identified, then the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, further according to input object described in the picture identification of described movement locus projection lens.
Scheme two: described input object is Chinese character, described motion trace data and described movement locus data for projection also include temporal information and/or stroke index, and step 104 specifically includes:
Whether the movement locus projection having efficiency flat described in the two dimensional surface position judgment according to described its correspondence of temporal information meets the sequential write of Chinese character, meet then according to as described in movement locus projection identify as described in input object, otherwise the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, according to input object described in the picture identification of described movement locus projection lens.
After performing step 104, if still None-identified, input terminal can be pointed out and be re-entered, and terminates flow process.
Preferably it is achieved in that, it is impossible to during identification, to there being efficiency flat to be modified, re-recognizes, the most after step 104, execution following steps:
Efficiency flat (i.e. according to the plane that the projected area that step 103 is selected is maximum) will be had to rotate for axle with special angle (such as 15 °) stepping with it with the intersecting lens of other two planes respectively, preferably, rotate with the intersecting lens having plane that efficiency flat takes second place with movement locus projected area for axle;Every stepping rotates once, the area of the movement locus projection calculated after rotating in new plane, if the area that in new plane, the area of movement locus projection projects less than the aforementioned movement locus having efficiency flat, stops rotating to the direction, and rotates to opposite direction stepping;If the area that in new plane, the area of movement locus projection projects more than the aforementioned movement locus having efficiency flat, then this new plane there is efficiency flat as revised, according to above step 104, this revised mirror image having the projection of movement locus on efficiency flat or movement locus projection is identified, if still can not identify, then continue to rotate by direction stepping, repeat said process until can recognize that or reaching preset stop condition (such as number of revolutions threshold value or recognition time threshold value).
Below in conjunction with accompanying drawing be given a kind of gather 5 dimension motion trace data specifically input flow process.Its core is by setting up 5 dimension coordinate systems, the every unicursal of Real-time Collection is the locus of mobile terminal, time and stroke index information in the first stroke of a Chinese character to an only time, utilize these informixs to judge and select a projection plane easily identifying meaningful content and complete character recognition, track terminal moved is converted to corresponding character, figure or operational order, it is achieved the input of character, figure or operational order.As in figure 2 it is shown, and combine Fig. 3 and Fig. 4, this patent said method comprising the steps of:
Step 201: often before the first stroke of 1 character of input or 1 figure, set up 5 dimension coordinate systems inside mobile terminal, initialize origin coordinates (x, the y of mobile terminal, z, t, n) be (x1, y1, z1, t1,1), wherein x, y, z are the point in the 3-dimensional xyz coordinate system of space, wherein, x/y plane i.e. horizontal plane, yz plane and zx plane are the vertical plane orthogonal with x/y plane, t represents the time, and n represents the n-th stroke being currently entered this character or figure, i.e. n is stroke index;
Input in Fig. 3 Chinese character " with " as a example by, before starting input, set up coordinate system, initializing the first stroke first stroke of a Chinese character point 301 coordinate is (x1, y1, z1, t1,1);
Step 202: starting input, the stroke that the hand-held described mobile terminal of operator inputs character or figure as required at any free space moves so that the track that described mobile terminal slips at free space is consistent with the stroke of the character of required input or figure;
Input in Fig. 3 Chinese character " with " as a example by, terminal according to runic solid line word in Fig. 2 " with " stroke order slip at free space, in figure, bold dashed lines word is the projection in yz, zx plane of the track that slips in space of terminal;
Step 203: described mobile terminal determines whether to detect the mark of the first stroke of a Chinese character, if be detected that just carry out step 204, otherwise returns to step 201;
Fig. 3 has on mobile terminal 313 dark buttons 314, new one is currently had to press this button immediately when starting to input, being always maintained at pressing this button until this input action terminates just to unclamp, i.e. starting to press described button is first stroke of a Chinese character mark, and unclamping described button is only pen mark;
The judgement of described each stroke beginning and ending time, special for indicating the hardware switch of start-stop time to realize by using, described hardware switch is pressed when every unicursal starts the first stroke of a Chinese character, in this stroke writing process, this switch keeps the state that is pressed, until this stroke write complete only time unclamp this switch;
Step 204: described mobile terminal Real-time Collection from the current stroke first stroke of a Chinese character start the position of continuous multiple sampling point, temporal information and stroke index, and save as 5 dimension coordinates (x, y, z, t, n);
The Real-time Collection of described mobile terminal locus, can use multiple technologies, the most multidirectional gravity sensing technology, gyroscope, black light location technology etc.;
Step 205: described mobile terminal determines whether to detect only pen mark, if be detected that just carry out step 206, otherwise repeating step 204, only the detection of pen mark uses described button 314 equally, and described button 314 is represented only pen mark from pressing the action becoming unclamping;
Step 206: described mobile terminal judges that the input action of current input character or all strokes of figure is the most complete, if complete, just carry out step 207, otherwise comes back for step 203;
Before described judgement, the input action of input character or all strokes of figure is the most complete can realize by being not detected by the methods such as new first stroke of a Chinese character mark, special software/hardware switch in the long period;
Step 207: all 5 dimension coordinate points of this character collected or all strokes of figure are projected to the x/y plane of xyz coordinate system, yz plane and zx plane by described mobile terminal respectively, front 3-dimensional (the x of 5 dimension coordinates during projection, y, z) directly carry out according to the geometric projection of xyz coordinate system, the rear 2 dimension (t of 5 dimension coordinates, n) not doing after the new coordinate after any conversion is projected directly into x/y plane, yz plane and zx plane, the coordinate after projection becomes (x, y respectively, t, n), (y, z, t, n), (z, x, t, n);
Fig. 3 such as input " with " word has 8 strokes, the 1st first stroke of a Chinese character point 301 coordinate is (x1, y1, z1, t1,1), 1st stop pen to be put 302 coordinates is (x2, y2, z2, t2,1) point 305 coordinate that, the 1st first stroke of a Chinese character point is mapped to yz plane is (y1 ', z1 ', t1,1), be mapped to point 309 coordinate of zx plane for (x1 "; z1 ", t1,1), the 1st only pen point is mapped to point 306 coordinate of yz plane is (y2 ', z2 ', t2,1) point 310 coordinate of zx plane, it is mapped to for (x2 ", z2 ", t2,1);8th first stroke of a Chinese character point 303 coordinate is (x3, y3, z3, t3, 8), 8th is stopped pen and puts 304 coordinate (x4, y4, z4, t4, 8), point 307 coordinate that 8th first stroke of a Chinese character point is mapped to yz plane is (y3 ', z3 ', t3, 8), be mapped to point 311 coordinate of zx plane for (x3 ", z3 ", t3, 8), 8th only pen point is mapped to point 308 coordinate of yz plane is (y4 ', z4 ', t4, 8), be mapped to point 312 coordinate of zx plane for (x4 ", z4 ", t4, 8), t4 > t3 > t2 > t1 in premises coordinate.
That is the time coordinate in the coordinate after projection and stroke indexed coordinates keep constant, the time of this coordinate collected before remaining projection and stroke index.
Step 208: calculate respectively described character or figure be projected in x/y plane, maximum area (the also referred to as area of movement locus projection) S that yz plane, zx plane occupyxy、Syz、Szx, find out Sxy、Syz、SzxMaximum one of middle numerical value, and this maximum place plane selected is for there being efficiency flat, preliminary this maximum selected in the plane be projected as the projection of use during character recognition;
Maximum value calculation formula in x/y plane projection footprint area is:
Sxy=| (xmax-xmin)|*|(ymax-ymin)|
In above formula, SxyRepresent described character or figure is projected in the maximum area that x/y plane occupies, xmax、ymaxRepresent described character or the figure maximum of x and y, x in all sampling point coordinates that x/y plane projects respectivelyminAnd yminRepresent described character or the figure minima of x and y in all sampling point coordinates that x/y plane projects respectively;
Being similar to, the maximum value calculation formula in yz plane projection footprint area is:
Syz=| (ymax-ymin)|*|(zmax-zmin)|
In above formula, SyzRepresent described character or figure is projected in the maximum area that yz plane occupies, ymax、zmaxRepresent described character or the figure maximum of y and z, y in all sampling point coordinates of yz plane projection respectivelyminAnd zminRepresent described character or the figure minima of y and z in all sampling point coordinates of yz plane projection respectively;
Maximum value calculation formula in zx plane projection footprint area is:
Szx=| (zmax-zmin)|*|(xmax-xmin)|
In above formula, SzxRepresent described character or figure is projected in the maximum area that zx plane occupies, zmax、xmaxRepresent described character or the figure maximum of z and x, z in all sampling point coordinates of zx plane projection respectivelyminAnd xminRepresent described character or the figure minima of z and x in all sampling point coordinates of zx plane projection respectively;
In Fig. 3, from " with " word projection size can be seen that Szx> Syz> Sxy, wherein SxyIt is 0, so preliminary selected " with " projection that uses when the projection of zx plane is as character recognition of word;
Step 209: index the horizontal stroke of sampling point on n and each stroke according to the stroke of sampling point coordinate in the projection tentatively selected by step 208, vertical coordinate, the relative position between stroke can be obtained, general character whether is met from top to bottom according to this projection of relative position judgment between stroke index with stroke, stroke sequential write from left to right, if meeting, the projection used when directly using this selected projection as final character recognition, if not meeting, then in this projection planar the coordinate of this projection is done Mirroring Mapping about transverse axis or the longitudinal axis, character as meeting is projected from top to bottom after making to map, stroke sequential write from left to right, and the projection used when using the projection after this Mirroring Mapping as final character recognition;
Judge when whether this most selected projection meets general character stroke sequential write from top to bottom, from left to right, in addition to using stroke index and the horizontal stroke of each stroke, vertical coordinate and judging, can also do judge more accurately by the time coordinate t of projection.
nullSuch as in Fig. 3,According to step 208 initial option " with " word in the projection of zx plane as the projection of character recognition,By comparing the stroke of all sampling points of this projection and index and abscissa seeing to draw that all abscissas of the 1st of this projection abscissa all than the 8th is little,Illustrate the 8th of this projection in the left side of the 1st,Do not meet general chinese character from top to bottom、Sequential write from left to right,For the ease of successive character identification,Need about z-axis, projection to be done mirror image processing according to the method for Fig. 4,Mirror image processing throw after the 1st first stroke of a Chinese character point of this projection become 309 ' (-x1 ",z1″,t1,1),1st only pen point become 310 ' (-x2 ",z2″,t2,1),8th first stroke of a Chinese character point become 311 ' (-x3 ",z3″,t3,8),8th only pen point become 312 ' (-x4 ",z4″,t4,8),The coordinate of all sampling points of other all strokes also completes same mirror image processing,Projection after completing mirror image processing is gone forward side by side line character identification as the projection of final character recognition.
Step 210: described mobile terminal judges it is currently to need to input character, figure to be also intended to enter the operating instructions, and is put into step 211 if entering the operating instructions, if needing input character, figure to be put into step 212;
Can switch instruction by software/hardware before proceeding by input action in reality is to need input character, figure to need for input operation order;
Step 211: described mobile terminal is at operational order that is pre-set and that be saved in oneself internal memory and the character identified in finding step 209 in character, the corresponding table of figure or figure, if finding it to have the instruction of correspondence, it is carried out this instruction and is then back to step 201, if not finding the instruction having correspondence, the most directly return step 201;
Step 212: the character identified in described mobile terminal input step 209 or figure, carries out character recognition according to the algorithm being similar to two dimensional surface handwriting recognition and completes the input of character or instruction, returns step 201 after input.
If being specific character or figure by some instruction encoding in described mobile terminal in advance, use described method, it is possible to realize identification and the execution of the various action command of user flexibly.
As seen from the above description, the basic principle having efficiency flat to select is to make character big as far as possible in the projection footprint area of this plane, reaches with this and identifies fast and accurately.The projection finally selected as performed step 212 cannot be identified as significant character, the most preferably, efficiency flat correction flow process can have been performed, with Fig. 3, as a example by 4, preferably, xz face is rotated for step angle with 15 ° around z-axis, often step rotates the area of the movement locus projection calculated the most afterwards in new plane after rotation, if the area that in new plane, the area of movement locus projection projects less than the aforementioned movement locus having efficiency flat, stop rotating to the direction, and combine Fig. 3 to opposite direction stepping rotation, rotate as born half direction of principal axis to y-axis, then projected area reduces, should stop the rotation, rotate to y-axis positive axis direction;If the area that in new plane, the area of movement locus projection projects more than the aforementioned movement locus having efficiency flat, then according to above step 209, the mirror image of movement locus projection or movement locus projection in this new plane is identified, if still can not identify, then continue to rotate by direction stepping, repeat said process until can recognize that or reaching preset stop condition (such as number of revolutions threshold value or recognition time threshold value).
In described method, it is also possible to utilize the information of character sampling point 5 dimension coordinate collected more fully, the locus of sampling point, time, stroke index is utilized comprehensively to be realized the identification of character by methods such as calculating acceleration, the mathematical modeies setting up terminal motion track.
Apply input method based on 5 dimension coordinate location mobile terminals of the present invention, the most dynamically location to mobile terminal locus can be realized and its movement locus is converted to character, figure, it is achieved without character, the figure input of special media under naturalness.Identifying schemes is combined in locus based on stroke start-stop position and time signal collection, record stroke index, xyz coordinate space projection etc. that the method proposes, can be greatly improved discrimination that motion of mobile terminals track identification is character, figure.
Additionally, by in advance some instruction encoding in mobile terminal being set as specific character or figure, method described in application this patent, identification and the execution of the various action command of user can be realized flexibly, making input method more convenient, more humane, to visual disorder, personage also has very great help.Can also be as a kind of alternative input scheme in the case of Mobile terminal keyboard or touch screen are the most malfunctioning, this is less than other input method.
Corresponding to above method, present invention also offers a kind of input terminal embodiment based on space motion, as it is shown in figure 5, this input terminal includes:
Data acquisition unit, for gathering the data of the effective movement locus of described input terminal, described motion trace data at least includes that three-dimensional space data, described movement locus are the tracks that operator moves input terminal according to object to be identified shape in space;Described object to be identified is Chinese character, the stroke of Chinese character, letter, numeral, symbol, figure or the self-defined shape representing specific instruction.
Plane projection unit, for described motion trace data projects to three two dimensional surfaces of pairwise orthogonal respectively, obtains three groups of movement locus data for projection, it is preferable that described three two dimensional surfaces are horizontal plane and orthogonal with horizontal plane two vertical planes respectively;
There is efficiency flat to determine unit, project, for calculating corresponding movement locus according to described movement locus data for projection, the area occupied, the two dimensional surface at movement locus projection place maximum for area is defined as there is efficiency flat;
It is maximum spacing long-pending that this movement locus is projected in that the maximum spacing of the X direction of this two dimensional surface is projected in the y direction of this two dimensional surface with this movement locus that described movement locus is projected on each two dimensional surface the area occupied.
Input object recognition unit, for having movement locus projection or the mirror image identification input object of movement locus projection of efficiency flat described in basis.
Preferably, described input object recognition unit includes projecting identification module, Mirroring Mapping module and mirror projection identification module, wherein:
Described projection identification module, for identifying described input object according to the projection of described movement locus;
Described Mirroring Mapping module, for when movement locus projection None-identified, doing Mirroring Mapping by the projection of described movement locus about transverse axis or the longitudinal axis;
Mirror projection identification module, for according to input object described in the picture identification of described movement locus projection lens.
Described data acquisition unit uses multidirectional gravity sensing technology, gyroscope or black light location technology to gather the three-dimensional space data of described movement locus.
Alternatively, described input object is Chinese character, and the movement locus data for projection that the motion trace data of described data acquisition unit collection and plane projection unit obtain also includes temporal information and/or stroke index;In the another embodiment of input equipment, as shown in Figure 6, it is in place of the difference of input equipment shown in Fig. 5, and described input object recognition unit includes:
Described sequential write identification module, indexes for temporal information and/or stroke and has whether the movement locus projection of efficiency flat meets the sequential write of Chinese character described in judging;
Described projection identification module, during for meeting the sequential write of Chinese character in the projection of described movement locus, identifies described input object according to the projection of described movement locus;
Described Mirroring Mapping module, during for not meeting the sequential write of Chinese character in the projection of described movement locus, does Mirroring Mapping by the projection of described movement locus about transverse axis or the longitudinal axis;
Mirror projection identification module, for according to input object described in the picture identification of described movement locus projection lens.
Further, described input terminal also includes input switch and data collection control unit, wherein:
Described input switch uses software or hardware to realize, and by operator's control;
Data collection control unit, is used for identifying input switch state, and controls the start-stop of described data acquisition unit collection motion trace data according to described input switch state or judge the effectiveness of its motion trace data gathered.
Preferably, described input terminal also includes inputting integrity recognition unit, for judging whether the time interval between effective motion trace data is more than preset value, if time interval is more than preset value, then it is assumed that object to be identified input is complete;Described have efficiency flat to determine unit, determines there is efficiency flat for the movement locus projection corresponding according to complete object to be identified.
Present invention also offers a kind of input terminal embodiment based on space motion, it is with the difference of the embodiment shown in Fig. 5, Fig. 6, and described input terminal also includes:
There is efficiency flat amending unit, for after input object recognition unit recognition failures, efficiency flat is had to be modified to described, including: the currently active plane is rotated for axle with special angle (such as 15 °) stepping with it with the intersecting lens of other two planes respectively, every stepping rotates once, the area of the movement locus projection in calculating new plane after rotation, if the area that in new plane, the area of movement locus projection projects less than the aforementioned movement locus having efficiency flat, stop rotating to the direction, and rotate to opposite direction stepping;If the area that in new plane, the area of movement locus projection projects more than the aforementioned movement locus having efficiency flat, then this new plane there is efficiency flat as revised;Described have efficiency flat amending unit to repeat said process until can recognize that or reaching preset stop condition (such as number of revolutions threshold value or recognition time threshold value).
Preferably, efficiency flat amending unit is had to carry out rotating with the intersecting lens of plane that has efficiency flat and take second place with movement locus projected area for axle and revise described in;
Described input block recognition unit, is additionally operable to according to the described revised movement locus projection having efficiency flat or the mirror image identification input object of movement locus projection.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.All within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. made, should be included within the scope of the present invention.

Claims (18)

1. an input method based on space motion, it is characterised in that operator moves input terminal according to object to be identified shape in space, described input terminal performs following steps:
Gathering its effective motion trace data, described motion trace data at least includes three-dimensional space data;
Project to described motion trace data respectively, on three two dimensional surfaces of pairwise orthogonal, obtain three groups of movement locus data for projection;
Calculate corresponding movement locus according to described movement locus data for projection and project the area occupied, the two dimensional surface at movement locus projection place maximum for area is defined as there is efficiency flat;
According to the described movement locus projection having efficiency flat or the mirror image identification input object of movement locus projection.
2. the method for claim 1, it is characterised in that: described three two dimensional surfaces are horizontal plane and orthogonal with horizontal plane two vertical planes respectively.
3. the method for claim 1, it is characterised in that: if according to the described movement locus projection having efficiency flat or the mirror image None-identified input object of movement locus projection, the method also includes:
Rotate there being efficiency flat for axle with special angle stepping with it with the intersecting lens of other two planes respectively, every stepping rotates once, the area of the movement locus projection calculated after rotating in new plane, if the area that in new plane, the area of movement locus projection projects less than the aforementioned movement locus having efficiency flat, stop rotating to the direction, and rotate to opposite direction stepping;If in new plane the area of movement locus projection be more than described in have the movement locus of efficiency flat to project area, then this new plane there is efficiency flat as revised, again this revised mirror image having the projection of movement locus on efficiency flat or movement locus projection is identified, if still can not identify, then continue to rotate by direction stepping, repeat said process until can recognize that or reaching preset stop condition.
4. the method as according to any one of claim 1 to 2, it is characterised in that: include according to the mirror image identification input object of the described movement locus projection having efficiency flat or movement locus projection:
Identify described input object according to the projection of described movement locus, such as None-identified, then the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, further according to input object described in the picture identification of described movement locus projection lens.
5. method as claimed in claim 3, it is characterised in that: include according to the mirror image identification input object of the described revised movement locus projection having efficiency flat or movement locus projection:
Identify described input object according to the projection of described movement locus, such as None-identified, then the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, further according to input object described in the picture identification of described movement locus projection lens.
6. the method as according to any one of claim 1 to 2, it is characterized in that: described input object is Chinese character, described motion trace data and described movement locus data for projection also include temporal information or temporal information and stroke index, include according to the mirror image identification input object of the described movement locus projection having efficiency flat or movement locus projection:
Whether the movement locus projection having efficiency flat described in the two dimensional surface position judgment according to described its correspondence of temporal information meets the sequential write of Chinese character, meet then according to as described in movement locus projection identify as described in input object, otherwise the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, according to input object described in the picture identification of described movement locus projection lens.
7. the method as according to any one of claim 1 to 2, it is characterised in that: described input object is Chinese character, and described motion trace data and described movement locus data for projection also include that stroke indexes.
8. method as claimed in claim 3, it is characterized in that: described input object is Chinese character, described motion trace data and described movement locus data for projection also include temporal information or temporal information and stroke index, include according to the mirror image identification input object of the described revised movement locus projection having efficiency flat or movement locus projection:
Whether the revised movement locus projection having efficiency flat described in the two dimensional surface position judgment according to described its correspondence of temporal information meets the sequential write of Chinese character, meet then according to as described in movement locus projection identify as described in input object, otherwise the projection of described movement locus is done Mirroring Mapping about transverse axis or the longitudinal axis, according to input object described in the picture identification of described movement locus projection lens.
9. method as claimed in claim 3, it is characterised in that: described input object is Chinese character, and described motion trace data and described movement locus data for projection also include that stroke indexes.
10. the method for claim 1, it is characterized in that: before having efficiency flat described in determining, described input terminal judges that whether the time interval between effective motion trace data is more than preset value, if time interval is more than preset value, then think that object to be identified input is complete, determine there is efficiency flat according to the movement locus projection that complete object to be identified is corresponding, otherwise continue to gather next effective motion trace data.
11. the method for claim 1, it is characterized in that: described input terminal has the input switch controlled by operator, described input switch uses software or hardware to realize, and described input terminal controls the start-stop of exercise data data acquisition according to the state of described input switch or judges the effectiveness of the motion trace data gathered;Described input terminal uses multidirectional gravity sensing technology, gyroscope or black light location technology to gather motion trace data.
12. the method for claim 1, it is characterised in that: described object to be identified is Chinese character, the stroke of Chinese character, letter, numeral, symbol, figure or the self-defined shape representing specific instruction.
13. the method for claim 1, it is characterised in that: it is maximum spacing long-pending that this movement locus is projected in that the maximum spacing of the X direction of this two dimensional surface is projected in the y direction of this two dimensional surface with this movement locus that described movement locus is projected on each two dimensional surface the area occupied.
14. 1 kinds of input terminals based on space motion, it is characterised in that this input terminal includes:
Data acquisition unit, for gathering the data of the effective movement locus of described input terminal, described motion trace data at least includes that three-dimensional space data, described movement locus are the tracks that operator moves input terminal according to object to be identified shape in space;
Plane projection unit, for described motion trace data projects to three two dimensional surfaces of pairwise orthogonal respectively, obtains three groups of movement locus data for projection;
There is efficiency flat to determine unit, project, for calculating corresponding movement locus according to described movement locus data for projection, the area occupied, the two dimensional surface at movement locus projection place maximum for area is defined as there is efficiency flat;
Input object recognition unit, for having movement locus projection or the mirror image identification input object of movement locus projection of efficiency flat described in basis.
15. input terminals as claimed in claim 14, it is characterised in that: described three two dimensional surfaces are horizontal plane and orthogonal with horizontal plane two vertical planes respectively.
16. input terminals as claimed in claim 14, it is characterised in that: described input terminal also includes:
There is efficiency flat amending unit, for after input object recognition unit recognition failures, efficiency flat is had to be modified to described, including: the currently active plane is rotated for axle with special angle stepping with it with the intersecting lens of other two planes respectively, every stepping rotates once, the area of the movement locus projection in calculating new plane after rotation, if the area that in new plane, the area of movement locus projection projects less than the aforementioned movement locus having efficiency flat, stop rotating to the direction, and rotate to opposite direction stepping;If the area that in new plane, the area of movement locus projection projects more than the aforementioned movement locus having efficiency flat, then this new plane there is efficiency flat as revised;Described have efficiency flat amending unit to repeat said process until can recognize that or reaching preset stop condition;
Described input object recognition unit, is additionally operable to according to the described revised movement locus projection having efficiency flat or the mirror image identification input object of movement locus projection.
17. input terminals as according to any one of claim 14 to 16, it is characterized in that: described input object is Chinese character, the movement locus data for projection that the motion trace data of described data acquisition unit collection and plane projection unit obtain also includes temporal information and/or stroke index;Described input object recognition unit includes:
Sequential write identification module, for indexing the sequential write having the movement locus projection of efficiency flat whether to meet Chinese character described in judgement according to temporal information and/or stroke;
Projection identification module, during for meeting the sequential write of Chinese character in the projection of described movement locus, identifies described input object according to the projection of described movement locus;
Mirroring Mapping module, during for not meeting the sequential write of Chinese character in the projection of described movement locus, does Mirroring Mapping by the projection of described movement locus about transverse axis or the longitudinal axis;
Mirror projection identification module, for according to input object described in the picture identification of described movement locus projection lens.
18. as according to any one of claim 14 to 16 input terminal, it is characterised in that: it is maximum spacing long-pending that this movement locus is projected in that the maximum spacing of the X direction of this two dimensional surface is projected in the y direction of this two dimensional surface with this movement locus that described movement locus is projected on each two dimensional surface the area occupied.
CN201110143787.3A 2011-05-31 2011-05-31 Input method based on space motion and terminal Expired - Fee Related CN102810015B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201110143787.3A CN102810015B (en) 2011-05-31 2011-05-31 Input method based on space motion and terminal
PCT/CN2012/072063 WO2012163124A1 (en) 2011-05-31 2012-03-07 Spatial motion-based input method and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110143787.3A CN102810015B (en) 2011-05-31 2011-05-31 Input method based on space motion and terminal

Publications (2)

Publication Number Publication Date
CN102810015A CN102810015A (en) 2012-12-05
CN102810015B true CN102810015B (en) 2016-08-03

Family

ID=47233729

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110143787.3A Expired - Fee Related CN102810015B (en) 2011-05-31 2011-05-31 Input method based on space motion and terminal

Country Status (2)

Country Link
CN (1) CN102810015B (en)
WO (1) WO2012163124A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103064594B (en) * 2012-12-21 2016-10-26 北京瑞星国际软件有限公司 A kind of method of authentication, device and terminal
CN104035552B (en) * 2013-03-08 2017-08-25 广州三星通信技术研究有限公司 Three-dimensional manipulating method and three-dimensional manipulating device
CN104571603B (en) * 2013-10-10 2018-02-27 北京壹人壹本信息科技有限公司 A kind of aerial hand writing system and writing pencil
CN104331192B (en) * 2014-10-20 2017-12-08 深圳市天英联合教育股份有限公司 Electronic whiteboard display methods
CN106778201A (en) * 2016-11-30 2017-05-31 百度在线网络技术(北京)有限公司 For the safe verification method and device of mobile device
CN108632585B (en) * 2017-03-24 2021-03-09 中兴通讯股份有限公司 Image correction method and device, storage medium and projection equipment
CN107203278A (en) * 2017-05-17 2017-09-26 努比亚技术有限公司 One-handed performance input method, mobile terminal and storage medium
CN107609593B (en) * 2017-09-15 2019-12-10 杭州电子科技大学 Three-dimensional space handwritten character dimension reduction method based on longest track projection
CN109993999B (en) * 2019-03-28 2022-01-28 广东小天才科技有限公司 Intelligent reading method based on writing progress and electronic equipment
CN112686134B (en) * 2020-12-29 2023-12-01 科大讯飞股份有限公司 Handwriting recognition method, handwriting recognition device, electronic equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1512298A (en) * 2002-12-26 2004-07-14 �ʼҷ����ֵ��ӹɷ����޹�˾ Method for three dimension hand writing identification and its system
CN101918911A (en) * 2007-12-12 2010-12-15 吉田健治 Information input device, information processing device, information input system, information processing system, two-dimensional format information server, information input method, control program, and recording medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011043986A (en) * 2009-08-21 2011-03-03 Seiko Epson Corp Optical information input device, electronic equipment with optical input function, and optical information input method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1512298A (en) * 2002-12-26 2004-07-14 �ʼҷ����ֵ��ӹɷ����޹�˾ Method for three dimension hand writing identification and its system
CN101918911A (en) * 2007-12-12 2010-12-15 吉田健治 Information input device, information processing device, information input system, information processing system, two-dimensional format information server, information input method, control program, and recording medium

Also Published As

Publication number Publication date
CN102810015A (en) 2012-12-05
WO2012163124A1 (en) 2012-12-06

Similar Documents

Publication Publication Date Title
CN102810015B (en) Input method based on space motion and terminal
Lin et al. Ubii: Physical world interaction through augmented reality
US20220129060A1 (en) Three-dimensional object tracking to augment display area
US9122916B2 (en) Three dimensional fingertip tracking
CN107077197B (en) 3D visualization map
CN102906671B (en) Gesture input device and gesture input method
KR101705924B1 (en) Spatial, Multi-Modal Control Device for Use with Spatial Operating System
CN102096471B (en) Human-computer interaction method based on machine vision
TW201816548A (en) Virtual reality interaction method, device and system
CN109933190B (en) Head-mounted display equipment and interaction method thereof
CN104571521B (en) Hand-written recording equipment and hand-written recording method
CN105184200B (en) Input object identification device, method and the device with RFID label tag
JP2016224686A (en) Information processing apparatus, control method thereof, program, and storage medium
CN102163108A (en) Method and device for identifying multiple touch points
CN103399629A (en) Method and device for capturing gesture displaying coordinates
CN108628455B (en) Virtual sand painting drawing method based on touch screen gesture recognition
CN106598422A (en) Directivity-based control and hybrid control methods, control system and electronic equipment
Ye et al. 3D curve creation on and around physical objects with mobile AR
CN106547339B (en) Control method and device of computer equipment
CN113934323B (en) Multi-point display method and device based on intelligent blackboard and terminal equipment
CN106020712A (en) Touch control gesture recognition method and device
Fujiwara et al. Interactions with a line-follower: An interactive tabletop system with a markerless gesture interface for robot control
CN113296616B (en) Pen point selection method and device and intelligent terminal
KR101668747B1 (en) Apparatus and Method for authoring 3D animation contents
CN110609626B (en) Virtual reality control system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160803

Termination date: 20190531

CF01 Termination of patent right due to non-payment of annual fee