CN102023784A - Method and equipment for inputting characters in non-contact mode - Google Patents

Method and equipment for inputting characters in non-contact mode Download PDF

Info

Publication number
CN102023784A
CN102023784A CN2009101751030A CN200910175103A CN102023784A CN 102023784 A CN102023784 A CN 102023784A CN 2009101751030 A CN2009101751030 A CN 2009101751030A CN 200910175103 A CN200910175103 A CN 200910175103A CN 102023784 A CN102023784 A CN 102023784A
Authority
CN
China
Prior art keywords
gesture
input
character
track
stroke
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2009101751030A
Other languages
Chinese (zh)
Inventor
J·利奥沃
倪楠
朱贵锋
曹亚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Creative Technology Ltd
Original Assignee
Creative Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Creative Technology Ltd filed Critical Creative Technology Ltd
Priority to CN2009101751030A priority Critical patent/CN102023784A/en
Publication of CN102023784A publication Critical patent/CN102023784A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a method and equipment for inputting characters in a non-contact mode. A prompt method for inputting characters in the non-contact mode comprises the following steps of: acquiring input in a non-contact mode and displaying the input as a cursor on a displaying device; and moving the cursor into an input area, wherein the different input states of the input area are marked with different colors. The method for inputting characters in the non-contact mode comprises the following steps of: inputting information in a non-contact mode; processing the information and sending the processed information to an output port by a processing device; and displaying corresponding characters. Information processing equipment comprises an acquiring device used for acquiring input information in a non-contact mode, the processing device used for processing the information and sending the processed information to the output port, and the displaying device used for displaying characters. Therefore, the invention solves the technical difficulty of non-contact character input so that a user can quickly and correctly complete non-contact input.

Description

The method and apparatus of contactless input character
Technical field
The present invention relates to character input field, relate in particular to the method, apparatus and system of contactless input character.
Background technology
In traditional character input field, the polytype input media of ubiquity is used in the computing system executable operations, for example button or key, mouse, touch sensor panel, touch-screen etc.Especially, touch-screen is because the simplicity of its operation and versatility and more and more lower price and the increased popularity that just becoming.Usually, touch-screen can allow the user by use finger or stylus simply touch display screen select and moving cursor.Touch-screen can be discerned the position that touches and touch on display screen, and computing system can explain touch, and carries out action based on touch event then.But, the recognition system to hand-written literal, symbol of available technology adopting is to understand the notes of describing on the plate of pressure-sensitive, perhaps understand the system of the notes of describing with the mouse of computing machine, can not be to the contactless literal of describing, symbol is imported and handle.
In the prior art, for example the publication number of also submitting to February 28 calendar year 2001 at Garden Tian Zhi is opened 2002-259046 for the spy, in the Japanese patent application of title for " aerial In hand is retouched I literal notation and gone into power シ ス テ system " a kind of character input system has been described, literal (the English of aloft drawing with hand is wherein disclosed, numeral), in the mark input system, obtain imaged frame with dynamic camera for shooting, obtain sound with transmitter simultaneously, sound equipment, pass through this imaged frame of obtaining wireless, wire cable sends to computing machine, by this computing machine to this imaged frame and this sound, acoustic signal is carried out dissection process.But in input the obtaining of commencing signal, be to implement, and be not complete contactless input character by the input system of imaginary touch-pad type and specific sound, sound equipment.The full content of this application file is incorporated herein by reference.
In addition, for a kind of convenience, imputting Chinese characters efficiently are provided to people, developed a lot of technology in the prior art.Referring to the application number of being submitted on Dec 14th, 2007 by the applicant is that CN200710160980.1, title are the Chinese patent application of " importing to determine the method and the corresponding input equipment of Chinese character according to the user ".Structural information (the structure of representing this Chinese character of a Chinese character of Chinese character input system reception user input is wherein disclosed, as semi-surrounding, single character etc.), and preferably the stroke information of this Chinese character of user input is combined with described structural information, thereby provide alternative Chinese character for the user.More preferably, the stroke of this Chinese character of user input satisfies pre-defined rule, as for stroke number greater than four Chinese character, import that preceding two of this Chinese character is drawn and back two pictures.And five dimension knot shape input method of Chinese character wherein are the structures according to Chinese character, Chinese character is divided into single character, left and right sides structure (comprising the left, center, right structure) Chinese character, up-down structure (comprising the upper, middle and lower structure) Chinese character, semi-surrounding structure Chinese character and full investing mechanism Chinese character, and every kind of structure is corresponding one by one with an enter key.In the input Chinese character, at first import the structural information of Chinese character.Secondly, according to the stroke feature of Chinese character, stroke is divided into five classes: from left to right: (one) horizontal (comprising " carrying "); From top to bottom: (Shu) perpendicular; From upper right to sitting down: (Pie) cast aside; From left to bottom right: (Dian) point (comprising " right-falling stroke "); The stroke of band turnover: (second) folding (comprising " crotch "); Every kind of stroke is corresponding one by one with an enter key.Thereby after the structural information of input Chinese character, the stroke of importing Chinese character is successively finished the input of Chinese character.The full content of this application file is incorporated herein by reference.
In addition, referring to the application number of being submitted on July 16th, 2008 by the applicant is that CN200810133642.3, title are the Chinese patent application of " method, keyboard and the signal conditioning package that utilize the concentrated character of button input character ", wherein disclose described button all distributed in the character in the described character set, at least one key assignments in the described button has a plurality of characters in the character set; The character of described at least one button is distributed in differentiation; Wherein select the complete character of the combination results expectation of the character that distinguishes in the character set, reduce thus need in the character input by bond number, reduce keyboard volume.The full content of this patented claim is incorporated herein by reference.
All be not given in the method for complete contactless input character in the process of whole input character in the prior art.Yet,, all need contactless input character in a lot of places, and any button be not provided along with the development of character input technology.As seen traditional method of utilizing button or touch input character can't adapt to.
Summary of the invention
The present invention by captured in real time, detect user's gesture or be similar to the gesture thing of gesture or the action of hand/hand held object, be converted into input signal and offer display device, realizes the input of contactless character, solved the problems referred to above.
An object of the present invention is to adapt to the needs of modern character input technology, realize contactless input character.
According to an embodiment, the invention provides a kind of reminding method of contactless input character, said method comprising the steps of: cursor is imported and be shown as to contactless obtaining on display device; And cursor moved on in the input area, wherein input area is represented different input states with different colours.
According to an embodiment, the invention provides a kind of applicable sector split plot design and discern the method for input, comprise image pre-service, gesture modeling, feature extraction, parameter estimation, gesture identification and coupling and produce control command, described method is further comprising the steps of: according to user's input, use this sector split plot design and identify input under the control of microprocessor.
According to an embodiment, the invention provides a kind of method of contactless input character, said method comprising the steps of: contactless input information; The information that treating apparatus will be handled after this information also will be handled sends output port to; And show corresponding character.
According to an embodiment, the invention provides a kind of messaging device, use the method for above-mentioned qualification.
According to an embodiment, the invention provides a kind of messaging device, comprising: deriving means is used for the contactless information of obtaining input; Treating apparatus, the information that is used to handle after this information also will be handled sends output port to; And display device, be used for character display.
According to an embodiment, the invention provides a kind of information handling system, comprise messaging device as above-mentioned qualification.
According to square frame anticipation method of the present invention, the difficult problem that each input phase is divided when having solved the noncontact input character.According to sector of the present invention split plot design, solved the difficult problem that different actions and gesture are represented different implications.And the present invention can show input information in real time and more help the quick correct input of finishing of user.Be input as example with Chinese character in this article, in conjunction with five dimension knot shape input method of Chinese character comprehensive description above the whole bag of tricks, also exemplified the input of English and special character simultaneously.
Because the present invention realized not adopting any button ground input character, the character of therefore can operated from a distance also effectively, promptly being imported and obtaining to expect.
Contactless character input device of the present invention can be installed on the computing machine that has camera or video camera, the mobile computer terminating machine, perhaps be integrated in the robot, literal, symbol can be passed to robot, the means of communicating by letter of expansion people and robot.
Contactless characters input method of the present invention and device can use in fields such as recreation, finance, and can be by using infrared lamp, even also can carry out input operation at night, the old man of legs and feet inconvenience, patient and deaf-mute just can carry out input operation by contactless input character thus.
The present invention can also be when this editor, browsing document of the enterprising style of writing of giant-screen key word input, the input of web search key word, the character input functions such as input of network address, need not relevant apparatus such as button, realize remote contactless input.
Description of drawings
Below in the description of preferred embodiments with reference to the accompanying drawings, show in an exemplary fashion wherein in the accompanying drawings and can implement specific embodiment of the present invention.Should be appreciated that, under the situation of the scope that does not deviate from embodiments of the invention, can use other embodiment, and can change structure.In the accompanying drawings:
Fig. 1 shows man-machine interactive system synoptic diagram according to an embodiment of the invention;
Fig. 2 shows the calcspar of messaging device according to an embodiment of the invention;
Fig. 3 a shows the sector of distinguishing gesture according to an embodiment of the invention and cuts apart figure;
Fig. 3 b shows the sector of distinguishing track according to an embodiment of the invention and cuts apart figure;
Fig. 4 shows the process flow diagram of the method for contactless input character according to an embodiment of the invention;
Fig. 5 a-5e shows gesture synoptic diagram according to an embodiment of the invention respectively;
Fig. 6 a-6c shows gesture synoptic diagram according to an embodiment of the invention respectively; With
Fig. 7 a-7e shows track synoptic diagram according to an embodiment of the invention respectively.
Embodiment
Fig. 1 shows man-machine interactive system synoptic diagram according to an embodiment of the invention.This man-machine interactive system comprises deriving means (for example, camera 101) at least and such as the display device of monitor 102, camera 101 can be integrated on the display device.Show on the display device such as virtual hand icon 103 (perhaps cursor) and input area 104.Particularly, in this man-machine interactive system, space between the display screen from user to the display device is referred to as virtual screen space 107, point on user's mobile and operation and the screen produces mapping, therefore the user moves and operates in virtual screen space 107, be equivalent to directly moving and operation on screen, the moving direction 106 that for example shows on the display device is corresponding to the moving direction 105 of user in the Virtual Space.
In order to divide each stage of the input of for example moving and operating, the invention provides the square frame anticipation method.The input area 104 that shows on the display device is illustrated as a boxed area, and this boxed area is accepted user's input, for example the gesture thing of gesture, similar gesture or action, track.When the user moved to virtual hand in the square frame, respective change took place in virtual hand icon 103, for example glimmered or three time or become specific cursor, and the prompting user has entered input area 104.Square frame can be represented different input states by three kinds of colors (for example, yellow, green, red), and promptly yellow expression prepares to accept input, and input is being accepted in green expression and input is confirmed in red expression.Wherein this square frame is preferably a meter font square frame, so that certain prompting and guiding to be provided to the user.
The concrete operations flow process of this square frame anticipation method is: at first, when square frame is yellow, the user can move to virtual hand and wait for input in the square frame, virtual hand (has for example stopped very first time T1 in square frame, 0.5 second) during the time, the color of square frame changes green into from yellow, and this moment, expression can be accepted input; If the time that virtual hand stops in square frame is less than very first time T1 (for example, 0.5 second), square frame remains yellow, and state rests on prepares to accept user's input.Secondly, when square frame was green, the user can pass through gesture or action (track) input information.Keep gesture or, confirm input in the action stop position residence time second time T 2 (for example, 1 second); If in second time T 2 (for example, the 1 second) time virtual hand is shifted out square frame, then input is this time abandoned in expression, and the square frame yellowing promptly returns and prepares to accept input state.At last, when system validation user's input this time, square frame will become red expression from green and confirm that input finishes.The 3rd time T 3 is after (for example, the 0.5 second) time, and square frame is automatically changeb to yellow and ready for import next time from redness.It will be appreciated by those skilled in the art that first, second and the 3rd time includes but not limited to above-mentioned numerical value, and color also is not limited to Huang, green, red three kinds of colors, can adopt other method to design and change in conjunction with the GUI technology.
Fig. 2 shows the calcspar of messaging device according to an embodiment of the invention.This messaging device comprises: be provided with for example deriving means 201 of camera 101, be used for the contactless information of obtaining input, wherein both can be solidificated on the display device 211 also can be plug-n-play type to camera 101, and the imageing sensor that is adopted can be CCD or CMOS; Treating apparatus, the information of handling after the information of importing also will be handled sends output port 210 to, and this information comprises gesture or track and display device 211, is used for character display.
Wherein for input each time, the analytic unit 205 that is arranged in messaging device judges it is gesture input or track input according to the information of input, and the sector split plot design that employing is hereinafter mentioned obtains the signal (perhaps semaphore) of input representative and sends it to microprocessor 212.And for input each time, deriving means 201 (for example, camera) is captured in action or the gesture of user in the input area 104, generates image, and deposits in the input block 204 by input port 202.Under the control of microprocessor (CPU) 212, graphics processing unit 203 sense data and original image is processed into satisfactory image from input block 204 according to Flame Image Process flow process and algorithm.Analytic unit 205 comprises analysis module 206, comparison module 207 and storer 208, and judges action (track) input or gesture input according to the image that graphics processing unit 203 is handled well.If be judged as the action input, analytic unit 205 sends to microprocessor with the signal of track representative; If be judged as gesture input, analytic unit 205 will call comparison module 207 so that the gesture in the database of this gesture and storer 208 storages is compared, and the signal that gesture is represented sends to microprocessor 212.Microprocessor 212 is presented on the display device 211 by display port according to the database of signal search memory 208 storages that obtain and the character information that signal is represented.Particularly, if action input, analysis module 206 is sent the action diagram picture frame into output buffer 209 and is shown synchronously on display device 211 by output port 210, analyzes the implication of action according to the successive image frame of action and will move the signal of representing to send to microprocessor 212 when action (track) finishes; If gesture input, analytic unit 205 will call comparison module 207 with the gesture database of storer 208 storages in gesture compare one by one, obtain the implication of gesture and will move the signal of representing to send to microprocessor 212.Microprocessor 212 comes the database of search memory 208 storages according to the signal that obtains and the character information of signal representative is presented on the display device 211.
Wherein, all or part of of said apparatus can be integrated in any information handling system.
In user's input process, system can show user's input information synchronously on giant-screen.If user's input is gesture, then the input information with the gesture representative is presented on the giant-screen; If user's input is action, the then track of display action.
In order to represent the signal of the implication that different actions and gesture are represented, a kind of sector split plot design has been proposed.The sector split plot design, as its name suggests: suppose that virtual input region is circular (perhaps other shapes) zone, border circular areas is divided into different sectors, and user's action input drops on the combination of different single sectors or several sectors all will represent the information that input is different.The boxed area that shows on border circular areas and the display device 211 is not to overlap fully, and this border circular areas size is regulated size automatically according to the action or the gesture of user's input, and the sector split plot design provides basis for the analysis user input.
Sector of the present invention split plot design comprises image pre-service, gesture modeling, feature extraction, parameter estimation, gesture identification and coupling and produces control command etc.Particularly, following steps are generally adopted in the identification of gesture and action, this method is ripe and be widely used:
(1) image pre-service comprises: a) be converted into gray-scale map; B) level and smooth (template is level and smooth) of image; C) sharpening of image (differential method, high-pass filtering method); D) illustrate the input of Chinese character, English, numeral and special character below the binaryzation of image.
(2) gesture modeling: realize the man-machine interaction of nature, set up an effective gesture model, specific definition the implication of various gestures and action.
(3) feature extraction comprises: a) marginal test: promptly draw the profile sell, calculate the major axis and the minor axis of selling then so that determine gesture really butt to; B) finger tip feature extraction: adopt multiple dimensioned model,, detect the position of the different piece of hand with by detecting the search model of different scale.Specifically, detect the position in user's palm centre of the palm and then adopt the model suitable with user's hand size to carry out search matched, the optimal match point that obtains is exactly the position at place, user's palm centre of the palm.The position of detecting user's finger tip is then adopted with the sizable model of user's finger tip and is carried out search matched, and the some points that meet the demands that obtain like this are exactly the position of finger tip, has also obtained the quantity of finger tip simultaneously.The position and the angle that detect user's finger then adopt the model suitable with user's finger size to carry out search matched, and the some points that meet the demands that obtain are exactly the position of finger, the quantity that can obtain pointing simultaneously and the angle of each finger.After the parameter that has obtained the centre of the palm, finger tip and finger, can draw the result of gesture identification according to specific recognition rule; C), comprise that finger tip and finger root global feature and local feature constitute a proper vector and be used for identification and follow the tracks of gesture based on the local feature of profile.
(4) parameter estimation.
(5) gesture identification and coupling.
(6) result's output: the result according to identification produces control command.
As shown in Figure 2, judge it is after gesture input or track are imported according to the information of input at analytic unit 205, the gesture that analytic unit 205 also needs to adopt the sector split plot design to judge input and the signal of track representative, the advantage of this sector dividing method are to allow the user that certain error originated from input is arranged.Thereby under the control of microprocessor (CPU) 212, the applicable sector split plot design can draw the implication of user's input when analytic unit 206 is resolved the gesture of user's input and moved.
Fig. 3 a shows the sector of distinguishing gesture according to an embodiment of the invention and cuts apart figure, wherein adopts this sector split plot design to judge the gesture of input when distinguishing the gesture of input.In Fig. 3 a, zone 1 is a gesture 301, and zone 2 is a gesture 302, and zone 3 is a gesture 303, and zone 4 is a gesture 304.When being input as gesture, analytic unit 205 judges that according to the marginal test method whether this gesture is for clenching fist; If not for clenching fist, then determine the direction of gesture, and be projected in the plane parallel and become projection line with display device by the major axis and the minor axis that calculate gesture, when projection line drop on [45 °, 135 °) interval, be the gesture that makes progress; When projection line drop on [135 °, 225 °) interval, be gesture left; When projection line drop on [225 °, 315 °) interval, be downward gesture; And when projection line drop on [45 °, 45 °) interval, be gesture to the right.
Fig. 3 b shows the sector of distinguishing track according to an embodiment of the invention and cuts apart figure, wherein adopts this sector split plot design to judge the stroke of input when distinguishing the stroke of input.Zone 301 ' is for erecting in Fig. 3 b, and zone 302 ' is to cast aside, and zone 303 ' is horizontal or carries that regional 304 ' is point or right-falling stroke, trans-regional for rolling over.When being input as track, the track of importing is projected in the plane coordinate system parallel with display device; Whether there is flex point to judge whether this track is folding or crotch according to track; And if be not folding or crotch, then pass through to calculate the terminal point coordinate of input with respect to the skew of starting point coordinate on plane coordinate system X and Y direction, determine the signal of input, further comprise: to the value negate tangent of Δ y/ Δ x, draw terminal point and starting point line angle with respect to X-axis, perhaps to the value negate tangent of Δ x/ Δ y, draw terminal point and starting point line angle with respect to Y-axis, wherein Δ y represents the absolute value to the relativity shift of terminal point coordinate y and starting point coordinate y, Δ x represents the absolute value to the relativity shift of terminal point coordinate x and starting point coordinate x, when this angle [0 °, 30 °) interval, be judged as horizontal stroke or carry; When this angle in [60 °, 90 °] interval, be judged as perpendicular; When this angle [30 °, 60 °) interval, and the x coordinate figure of terminal point is judged as a little or presses down greater than the x coordinate figure of starting point; And when this angle [30 °, 60 °) interval, and the x coordinate figure of terminal point is judged as left-falling stroke less than the x coordinate figure of starting point.
Fig. 4 shows the process flow diagram of the method for contactless input character according to an embodiment of the invention.Wherein, the user can import various characters by contactless input gesture or track, includes but not limited to Chinese, English, numeral and special character etc.And in the process that this method is used, be after once input is identified input, import again next time.
With reference to Fig. 4, the flow process of this input character is in square frame 401 beginnings.Enter square frame 402 then and whether obtain input and be shown as cursor,, enter square frame 403, judge whether cursor moves to input area if be "Yes" to detect; If be "No", turn back to previous step suddenly to re-enter.Judge in square frame 403 whether cursor moves to input area,, then enter square frame 404 to select the type of character if be "Yes"; If be "No", then turn back to previous step suddenly to continue judgement.
When selecting input Chinese, at square frame 405 input Hanzi structures, enter square frame 406 then, show the Hanzi structure of input.Then enter square frame 407, judge whether to confirm input, if be "No", then return square frame 405, to carry out next input; If be "Yes", then confirm to have finished Hanzi structure input this time.Then enter square frame 408, judge whether to finish input, if find that required character in the alternative characters frame, then for "Yes" can finish input, then enters square frame 415, the selection corresponding Chinese character; If be "No", then enter square frame 409, begin to import Chinese-character stroke.Enter square frame 410 then, show the stroke of input, then enter square frame 411, judge whether to confirm input, if be "No", then return square frame 409, to carry out next input; If be "Yes", then confirm to have finished stroke input this time.Then enter square frame 412, show alternative Chinese character.Then enter square frame 413, judge that target characters whether in alternative, if be "No", then then returns square frame 409,, to carry out next input; If be "Yes", then enter square frame 414 and finish input, then enter square frame 415 and select corresponding Chinese character.Enter square frame 416 at last, finish input.
When selecting input English, the scope at square frame 425 input English character places enters square frame 426 then, shows the scope of the English character of input.Then enter square frame 427, judge whether to confirm input,, then return square frame 425 if be "No"; If be "Yes", then confirm to have finished the input of the scope of English character this time.Then enter square frame 428, show alternative English character.Then enter square frame 429, judge that the target English character whether in alternative, if be "No", then then returns square frame 425, to carry out next input; If be "Yes", then enter square frame 430, finish input, then enter square frame 431 and select corresponding English character.Enter square frame 432 at last, finish input.
When selecting input digit or special character, the scope at square frame 417 input digits or special character character place enters square frame 418 then, shows the numeral of input or the scope of special character character.Then enter square frame 419, judge whether to confirm input,, then return square frame 417 if be "No"; If be "Yes", then the input of the scope of this numeral or special character character has been finished in affirmation.Then enter square frame 420, show alternative numeral or special character character.Then enter square frame 421, judge that target number or special character character whether in alternative, if be "No", then then return square frame 417, to carry out next input; If be "Yes", then enter square frame 422, finish input, then enter square frame 423 and select corresponding digital or special character.Enter square frame 424 at last, finish input.
The flow process of above-mentioned each input will be described in further detail below.When a plurality of input patterns or type are arranged in the system; as comprise Chinese, English, numeral and special character etc.; can be by (for example importing particular track or gesture; two hands are put into identified region simultaneously or one hand is drawn a circle) switch to select the type of character; import different characters thereby satisfy the user, this certain gestures also can be distinguished according to the sector split plot design.
The process particular instantiation of Chinese, English, numeral and special character input is as follows.
One, Zhong Wen input
The step of this contactless input Chinese mainly comprises: the input Hanzi structure; The input Chinese-character stroke; Finish input; And selection corresponding Chinese character; Wherein in response to each input, display device shows related information synchronously.By defining five required buttons of five kinds of gestures or action (track) correspondence, five dimension knot shape Chinese characters inputs, increase affirmation and deletion and select the operation of Chinese character to be selected can realize the noncontact input in Chinese.In view of input method has association function, promptly every input primary information all can show the respective alternative Chinese character, when the user finds target characters in alternative Chinese character, then uses OK gesture (end gesture) to come the ending message input, to select Chinese character.
That is: at first, the structural information of input Chinese character:
(1) semi-surrounding structure, for example: " disease ";
(2) full investing mechanism, for example: " state ";
(3) up-down structure and upper, middle and lower structure, for example: " grass ", " Ji ";
(4) left and right sides structure and left, center, right structure, for example: " woods ", " storage ";
(5) single character, for example: " being ", " by ".
Secondly, order is imported the stroke of Chinese character.
At last, when the input of all structures and stroke information finishes or the user finds that required character is in the alternative characters frame and after adopting OK gesture (end gesture) to finish input, the character that acquiescence is selected is first character, user's upwards page turning or page turning downwards in the alternative characters frame by importing gesture or action simultaneously.When adopting gesture to select alternative characters, as select second alternative characters, user can stretch out any two fingers, this is not limited thereto certainly.
Example one: gesture input
When but camera detects object in one's hands or that be similar to hand and is positioned at identified region, on screen, be shown as virtual hand, the virtual hand icon is done on screen accordingly according to the motion up and down of user's hand of photographing and is moved up and down, show rice font literal input frame simultaneously on the screen, in the time of in virtual hand moves to input frame, virtual hand becomes cursor, the icon that for example holds a pen, screen prompt enters input state, the prompting user imports character structure information in the prompt column, and point out the structural information of every kind of gesture correspondence, and the user is by after the gesture input structure information, and the prompting user imports follow-up stroke and points out the stroke information of every kind of gesture correspondence in the prompt column.After the user is by gesture input stroke, find the incorrect of input, can use deletion gesture deletion input last time, and enter the state of re-entering.Confirm that gesture can confirm that this Chinese character information input finishes and go forward side by side into selection input Chinese character interface, system provides 5 every page Chinese characters to be selected such as (4 or 6) and system of selection and page turning method corresponding to control information is provided, the input of a Chinese character finished in the Chinese character that the user will import according to the prompting selection.
Fig. 5 a-5e shows gesture synoptic diagram according to an embodiment of the invention.The corresponding relation of Hanzi structure and gesture is: first gesture, corresponding to the semi-surrounding structure; Second gesture is corresponding to full investing mechanism; The 3rd gesture is corresponding to up-down structure or upper, middle and lower structure; The 4th gesture is corresponding to left and right sides structure or left, center, right structure; And the 5th gesture, corresponding to the independent body structure.The corresponding relation of Chinese-character stroke and gesture is: first gesture, cast aside corresponding to stroke; Second gesture is corresponding to stroke point or right-falling stroke; The 3rd gesture, perpendicular corresponding to stroke; The 4th gesture, horizontal or carry corresponding to stroke; And the 5th gesture, corresponding to stroke folding or crotch.Wherein, second gesture also represents to move to the alternative Chinese character of page or leaf; The 4th gesture also represents to move to the alternative Chinese character of nextpage.
Fig. 6 a-6c shows gesture synoptic diagram according to an embodiment of the invention.The corresponding relation of control information and gesture is: the 6th gesture, finish input; The 7th gesture, the deletion error input; With the 8th gesture, select alternative Chinese character.Wherein select gesture to select corresponding to the sequence number of alternative Chinese character by the number that thrusts out one's fingers, for example a finger is corresponding to first alternative Chinese character, and two fingers are corresponding to second alternative Chinese character or the like.Described the first, second, third, fourth, the 5th, the 6th, the 7th and the 8th gesture correspond respectively to upwards gesture, left gesture, downwards gesture, to the right gesture, clench fist, finish gesture, deletion gesture and select gesture.
In conjunction with Fig. 5 a-5e and Fig. 6 a-6c, listed in the table 1 according to the sector split plot design and judged the gesture of input and the relation between corresponding Chinese character structure, stroke or the control information.
Figure B2009101751030D0000121
Table 1
With " Room " is example." Room " be a semi-surrounding structure Chinese character, and corresponding stroke is as the Room=one+Pie+one+second, referring to table 1a:
Figure B2009101751030D0000131
Table 1a
Associative list 1a, the concrete steps of Chinese character input are described below:
1) gesture of input semi-surrounding structural information correspondence (as Fig. 5 a).At this moment showing five Chinese characters in alternative Chinese character frame, is " military formula of two longevity of rectifying " successively.This moment the user can import the OK gesture (a) stops the input of stroke as Fig. 6, by about page turning search " Room "; Also can continue the stroke of input " Room " word.
2) gesture (as Fig. 5 d) of input " Room " first stroke horizontal stroke.At this moment showing five Chinese characters in the alternative Chinese character frame, is " military formula of two longevity of rectifying " successively, and according to the description in the first step, the user both can stop input also can continue to import stroke.
3) gesture of input " Room " second stroke left-falling stroke (as Fig. 5 a).At this moment showing five Chinese characters in the alternative Chinese character frame, is " a doctor left side, the lip clam Room " successively." Room " word has appeared in the alternative Chinese character, and the user can import the OK gesture, and (a) stop the input of stroke as Fig. 6, gesture " 4 " is selected in input, chooses " Room ", finishes input; The user also can continue to import stroke.
4) gesture (as Fig. 5 d) of input " Room " the 3rd stroke horizontal stroke.At this moment showing five Chinese characters in the alternative Chinese character frame, is " press on a left side, the lip clam Room " successively." Room " word has appeared in the alternative Chinese character, and the user can import the OK gesture, and (a) stop the input of stroke as Fig. 6, gesture " 3 " is selected in input, chooses " Room ", finishes input; The user also can continue to import stroke.
5) gesture (as Fig. 5 e) of input " Room " the 4th stroke folding.At this moment showing five Chinese characters in the alternative Chinese character frame, is " the strict prestige the eleventh of the twelve Earthly Branches of Room village, often used in village names " successively." Room " word has appeared in the alternative Chinese character, and the user can import the OK gesture, and (a) stop the input of stroke as Fig. 6, gesture " 1 " is selected in input, chooses " Room ", finishes input; If the user imports stroke once more, require and can not appear in the alternative Chinese character because of " Room " will no longer satisfy the input stroke.
Example two: track input
Enter Chinese character input option, when deriving means (as camera) but detect in one's hands when being positioned at identified region, the icon that on screen, shows hand, icon is done on screen accordingly according to the motion up and down of user's hand of photographing and is moved up and down, show rice font literal input frame simultaneously on the screen, in the time of in icon moves to input frame, the icon of hand becomes the icon that holds a pen, screen prompt enters input state, the prompting user imports character structure information in the prompt column, and point out every kind of structural information that action is corresponding, and the user is by after the track input structure information, and the prompting user imports follow-up stroke and points out every kind of stroke information that action is corresponding in the prompt column.After the user is by track input stroke, find the incorrect of input, can pass through deletion gesture deletion input last time, and enter the state of re-entering.Confirm that gesture confirms that this Chinese character information input finishes and go forward side by side into selection input Chinese character interface, system provides every page of 5 Chinese characters to be selected and corresponding system of selection and page turning method is provided, the input of a Chinese character finished in the Chinese character that the user will import according to the prompting selection.
Fig. 7 a-7e shows track synoptic diagram according to an embodiment of the invention.The corresponding relation of Hanzi structure and track is: first track, corresponding to left and right sides structure or left, center, right structure; Second track is corresponding to up-down structure or upper, middle and lower structure; The 3rd track is corresponding to the semi-surrounding structure; The 4th track is corresponding to full investing mechanism; And the 5th track, corresponding to the independent body structure.The corresponding relation of Chinese-character stroke and track is: first track, and horizontal or carry corresponding to stroke; Second track, perpendicular corresponding to stroke; The 3rd track is cast aside corresponding to stroke; The 4th track is corresponding to stroke point or right-falling stroke; And the 5th track, corresponding to stroke folding or crotch.The sector split plot design of employing track is judged the stroke of input when distinguishing the stroke of input.The corresponding relation of control information and gesture or track is: the 6th gesture, finish input; The 7th gesture, the deletion error input; The 8th gesture is selected alternative Chinese character; First track moves to the alternative Chinese character of nextpage; And the 4th track, move to the alternative Chinese character of page or leaf.Described the first, second, third, fourth, the 5th track and the 6th, the 7th and the 8th gesture correspond respectively to from left to right, from top to bottom, from upper right to the lower-left, from left to bottom right, top to bottm again to right, finish gesture, deletion gesture and select gesture.
In conjunction with Fig. 7 a-7e and Fig. 6 a-6c, table 2 shows the action and the corresponding function thereof of system default standard, promptly judges the track of input and the relation between corresponding Chinese character stroke or the control information according to the sector split plot design.
Figure B2009101751030D0000151
Table 2
With " wound " is example." wound " be the Chinese character of a left and right sides structure, and corresponding stroke is as wound=Pie+Dian+second+second+Shu+second, referring to table 2a:
Table 2a
Associative list 2a can be by action (track) input Chinese character " wound ", and wherein the concrete steps of Chinese character input are similar to above-mentioned step by gesture input Chinese character.
Two, Ying Wen input
Import Chinese in like manner with above-mentioned employing gesture, English input also can be according to identical method, and just the gesture implication is distinguished to some extent.When selecting input English, the scope at input English character place; Show corresponding English character in response to input; Finish input; And select corresponding English character.The sector split plot design of employing gesture is judged the gesture of input when distinguishing the gesture of input.The corresponding relation of its Chinese and English character and gesture is: first gesture, corresponding to English character ABCDEF; Second gesture is corresponding to English character GHIJKL; The 3rd gesture is corresponding to English character MNOPQR; The 4th gesture is corresponding to English character STUVWX; The 5th gesture, corresponding to English character YZ and/.@_.The corresponding relation of control information and gesture is: the 5th gesture, corresponding to selecting the 6th character; The 6th gesture is corresponding to finishing input; The 7th gesture is imported corresponding to deletion error; And the 8th gesture, corresponding to selecting alternative characters.
In conjunction with Fig. 5 a-5e and Fig. 6 a-6c, table 3 has been listed the relation of gesture and English alphabet or character.
Table 3
Associative list 3, the concrete steps of English input are:
The classification of first gesture input English character as the gesture of input such as Fig. 5 a, then prompting alternative characters ABCDEF occurs in display device, selects the character that needs by second gesture of input.
Gesture such as Fig. 5 e both can import English character YZ and symbol/.@_ and also select the 6th character in selection course, and four special characters of back also can be other characters, can replace as required.
With letter " B " is example, referring to table 3a.
Figure B2009101751030D0000171
Table 3a
Associative list 3a, the concrete steps of English character input are described below:
1) classified information of inputting English letter, B promptly imports gesture shown in Fig. 5 a in the first kind.At this moment show in alternative alphabetical frame that six letters are " ABCDEF " successively.
2) gesture 2 is selected in input, chooses letter b.
Three, the input of numeral or special character
Import in like manner with English, the input of numeral or special character also can be according to identical method, and just the gesture implication is slightly had any different.Gesture such as Fig. 5 a be corresponding to 12345, and gesture such as Fig. 5 c be corresponding to 67890, other gestures, and for example Fig. 5 b, 5d can distribute to other special characters.Other control information is similar to English character to the corresponding relation of gesture.
With input digit 2 is example, referring to table 3b.
Figure B2009101751030D0000172
Table 3b
Associative list 3b, the concrete steps of numeral or special character input are similar to the step of English input.
This method can also expand to the character input of all the other types, gives an example no longer one by one.
Be appreciated that and also provide gesture or track custom block the acquiescence gesture or track that in embodiments of the invention, provides for the user.The user can the typing gesture or one section effective action (not identical with default-action, otherwise the prompting typing is invalid), function corresponding to this gesture or action is set simultaneously, deposit in the database, when conforming to, promptly carry out this function with the gesture of the gesture of convenient user operation or track and storage or track.
Here used such as Intel with reference to those TMThe embodiment of processor and the foregoing description is described.Yet should understand, also can use other processors to implement different embodiment here.Can implement some or all step of specific embodiment in addition with hardware mode.
Can carry out favourable combination or sub-portfolio to above invention disclosed in other embodiments of the invention.For the ease of understanding, structured flowchart and flow chart step have been carried out combination here.Yet should understand, also can expect in an alternate embodiment of the invention piece, structure are made up and readjust or the like.
Although describe the present invention with reference to specific embodiment, for those of ordinary skills, other embodiment are conspicuous equally.Therefore except the indicated restriction of accessory claim, here intention does not limit the invention.And those skilled in the art can make various deformation and modification to the foregoing description and can not break away from the protection domain that claim of the present invention limits.

Claims (32)

1. the reminding method of a contactless input character said method comprising the steps of:
Cursor is imported and be shown as to contactless obtaining on display device; And
Cursor is moved on in the input area, and wherein input area is represented different input states with different colours.
2. method according to claim 1, wherein this input state comprises that input is accepted in preparation, acceptance is imported and three kinds of states of affirmation input.
3. method according to claim 1, wherein represent that with different colours the step of different input states comprises:
When input area was first color, expression prepared to accept input;
When input area was second color, input was accepted in expression; And
When input area was the 3rd color, input was confirmed in expression.
4. method according to claim 3 wherein also comprises:
Preparing under the state of accepting to import, when cursor stopped less than the very first time in input area, input area kept first color always, if stop greater than the very first time in input area, input area is second color from first color transition;
Under the state of accepting input, be marked on when stopping in the input area in each end of input time greater than second time, input state changes into and confirms input from accepting input, when input area when second color transition is the 3rd color, finish affirmation;
When finishing the affirmation back greater than the 3rd time, input area is that first color is to return the state of preparing to accept input from the 3rd color transition; And
In accepting input process,, then abandon this time importing and returning the state of preparing to accept input if cursor shifts out outside the input area.
5. according to each described method among the claim 1-4, wherein first, second is respectively yellow, green and red with the 3rd color.
6. method according to claim 4, wherein the very first time is 0.5 second, second time was that 1 second and the 3rd time are 0.5 second.
7. an applicable sector split plot design is discerned the method for input, comprises image pre-service, gesture modeling, feature extraction, parameter estimation, gesture identification and coupling and produces control command, and described method is further comprising the steps of:
According to user's input, under the control of microprocessor, use this sector split plot design and identify input.
8. method according to claim 7, this sector split plot design also comprise by the analytic unit that is connected with microprocessor carries out following operation:
When being input as gesture,
Judge that according to the marginal test method whether this gesture is for clenching fist; And
If not for clenching fist, then determine the direction of gesture, and be projected in the plane parallel and become projection line with display device by the major axis and the minor axis that calculate gesture,
When projection line drop on [45 °, 135 °) interval, be upwards gesture;
When projection line drop on [135 °, 225 °) interval, be gesture left;
When projection line drop on [225 °, 315 °) interval, be downward gesture; And
When projection line drop on [45 °, 45 °) interval, be gesture to the right.
9. method according to claim 7, this sector split plot design also comprise by the analytic unit that is connected with microprocessor carries out following operation:
When being input as track,
The track of input is projected in the plane coordinate system parallel with display device;
Whether there is flex point to judge whether this track is folding or crotch according to track; And
If for rolling over or crotch, the terminal point coordinate that then passes through to calculate input comes definite signal of importing with respect to the skew of starting point coordinate on plane coordinate system X and Y direction, further comprises:
Value negate tangent to Δ y/ Δ x, draw terminal point and starting point line angle with respect to X-axis, perhaps to the value negate tangent of Δ x/ Δ y, draw terminal point and starting point line angle with respect to Y-axis, wherein Δ y represents the absolute value to the relativity shift of terminal point coordinate y and starting point coordinate y, Δ x represents the absolute value to the relativity shift of terminal point coordinate x and starting point coordinate x
When this angle [0 °, 30 °) interval, be judged as horizontal stroke or carry;
When this angle in [60 °, 90 °] interval, be judged as perpendicular;
When this angle [30 °, 60 °) interval, and the x coordinate figure of terminal point is judged as a little or presses down greater than the x coordinate figure of starting point; And
When this angle [30 °, 60 °) interval, and the x coordinate figure of terminal point is judged as left-falling stroke less than the x coordinate figure of starting point.
10. the method for a contactless input character said method comprising the steps of:
Contactless input information;
The information that treating apparatus will be handled after this information also will be handled sends output port to; And
Show corresponding character.
11. method according to claim 10, once the input be identified finish after, import again next time.
12. method according to claim 10 comprises that also input gesture or track select the type of character.
13. method according to claim 10, wherein for input each time, the database for the treatment of apparatus search memory storage also sends corresponding character information to output port.
14. method according to claim 12 is wherein selected the gesture of type of character or track to comprise two hands are put into input area simultaneously or one hand is drawn a circle.
15. method according to claim 12, if select Chinese, then according to gesture or the track imported,
The input Hanzi structure;
The input Chinese-character stroke;
Finish input; And
Select corresponding Chinese character;
Wherein, show related information synchronously in response to each input.
16. method according to claim 15, the corresponding relation of Hanzi structure and gesture is:
First gesture is corresponding to the semi-surrounding structure;
Second gesture is corresponding to full investing mechanism;
The 3rd gesture is corresponding to up-down structure or upper, middle and lower structure;
The 4th gesture is corresponding to left and right sides structure or left, center, right structure; And
The 5th gesture is corresponding to the independent body structure;
17. method according to claim 15, the corresponding relation of Chinese-character stroke and gesture is:
First gesture is cast aside corresponding to stroke;
Second gesture is corresponding to stroke point or right-falling stroke;
The 3rd gesture, perpendicular corresponding to stroke;
The 4th gesture, horizontal or carry corresponding to stroke; And
The 5th gesture is corresponding to stroke folding or crotch;
18. method according to claim 15, the corresponding relation of control information and gesture is:
The 6th gesture finishes input;
The 7th gesture, the deletion error input;
The 8th gesture is selected alternative Chinese character;
Second gesture, move to the page or leaf alternative Chinese character; And
The 4th gesture moves to the alternative Chinese character of nextpage.
19. according to each described method among the claim 16-18, described the first, second, third, fourth, the 5th, the 6th, the 7th and the 8th gesture correspond respectively to upwards gesture, left gesture, downwards gesture, to the right gesture, clench fist, finish gesture, deletion gesture and select gesture.
20., wherein utilize the sector split plot design to judge the stroke of input according to claim 15 or 17 described methods.
21. method according to claim 15, the corresponding relation of Hanzi structure and track is:
First track is corresponding to left and right sides structure or left, center, right structure;
Second track is corresponding to up-down structure or upper, middle and lower structure;
The 3rd track is corresponding to the semi-surrounding structure;
The 4th track is corresponding to full investing mechanism; And
The 5th track is corresponding to the independent body structure.
22. method according to claim 15, the corresponding relation of Chinese-character stroke and track is:
First track, horizontal or carry corresponding to stroke;
Second track, perpendicular corresponding to stroke;
The 3rd track is cast aside corresponding to stroke;
The 4th track is corresponding to stroke point or right-falling stroke; And
The 5th track is corresponding to stroke folding or crotch.
23. method according to claim 15, the corresponding relation of control information and gesture or track is:
The 6th gesture finishes input;
The 7th gesture, the deletion error input;
The 8th gesture is selected alternative Chinese character;
First track moves to the alternative Chinese character of nextpage; And
The 4th track, move to the page or leaf alternative Chinese character.
24. according to each described method among the claim 21-23, described the first, second, third, fourth, the 5th track and the 6th, the 7th and the 8th gesture correspond respectively to from left to right, from top to bottom, from upper right to the lower-left, from left to bottom right, top to bottm again to right, finish gesture, deletion gesture and select gesture.
25. method according to claim 12, if select English, then according to gesture or the track imported,
The scope at input English character place;
Show corresponding English character in response to input;
Finish input; And
Select corresponding English character.
26. method according to claim 25, the corresponding relation of English character and gesture is:
First gesture is corresponding to English character ABCDEF;
Second gesture is corresponding to English character GHIJKL;
The 3rd gesture is corresponding to English character MNOPQR;
The 4th gesture is corresponding to English character STUVWX;
The 5th gesture, corresponding to English character YZ and/.@_.
27. method according to claim 25, the corresponding relation of control information and gesture is:
The 5th gesture is corresponding to selecting the 6th character;
The 6th gesture is corresponding to finishing input;
The 7th gesture is imported corresponding to deletion error; And
The 8th gesture is corresponding to selecting alternative characters.
28. according to claim 26 or 27 described methods, described the first, second, third, fourth, the 5th, the 6th, the 7th and the 8th gesture correspond respectively to upwards gesture, left gesture, downwards gesture, to the right gesture, clench fist, finish gesture, deletion gesture and select gesture.
29. method according to claim 12, if select numeral or special character, then according to gesture or the track imported,
The scope at input digit or special character place;
Show corresponding digital or special character in response to input;
Finish input; And
Select corresponding digital or special character.
30. method according to claim 29, the corresponding relation of numeral or special character and gesture is:
First gesture is corresponding to numerical character 12345;
Second gesture is corresponding to numerical character 67890; And
Other gestures are corresponding to special character.
31. method according to claim 29, first, second gesture and other gestures correspond respectively to upwards gesture, downward gesture and gesture or gesture left to the right.
32. a messaging device uses according to each described method among the claim 1-31.
CN2009101751030A 2009-09-16 2009-09-16 Method and equipment for inputting characters in non-contact mode Pending CN102023784A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009101751030A CN102023784A (en) 2009-09-16 2009-09-16 Method and equipment for inputting characters in non-contact mode

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009101751030A CN102023784A (en) 2009-09-16 2009-09-16 Method and equipment for inputting characters in non-contact mode

Publications (1)

Publication Number Publication Date
CN102023784A true CN102023784A (en) 2011-04-20

Family

ID=43865130

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009101751030A Pending CN102023784A (en) 2009-09-16 2009-09-16 Method and equipment for inputting characters in non-contact mode

Country Status (1)

Country Link
CN (1) CN102023784A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102662465A (en) * 2012-03-26 2012-09-12 北京国铁华晨通信信息技术有限公司 Method and system for inputting visual character based on dynamic track
CN103197761A (en) * 2013-03-28 2013-07-10 深圳泰山在线科技有限公司 Gesture recognition method and device
CN103294219A (en) * 2012-02-28 2013-09-11 联想(北京)有限公司 Character input method and device
CN103345307A (en) * 2013-07-16 2013-10-09 深圳大学 Figure key input device and input method thereof
CN103369383A (en) * 2012-03-26 2013-10-23 乐金电子(中国)研究开发中心有限公司 Control method and device of spatial remote controller, spatial remote controller and multimedia terminal
CN103488407A (en) * 2012-06-11 2014-01-01 联想(北京)有限公司 Method and equipment for controlling display position of operation object icon
CN103513902A (en) * 2012-06-28 2014-01-15 深圳富泰宏精密工业有限公司 Touch screen unlocking method and system
CN103543943A (en) * 2012-07-16 2014-01-29 三星电子株式会社 Touch and gesture input-based control method and terminal therefor
CN103869954A (en) * 2012-12-17 2014-06-18 联想(北京)有限公司 Processing method as well as processing device and electronic device
CN103941846A (en) * 2013-01-18 2014-07-23 联想(北京)有限公司 Electronic device and input method
CN104978049A (en) * 2015-07-23 2015-10-14 上海斐讯数据通信技术有限公司 Touch screen based Chinese character inputting method and inputting system
CN105723301A (en) * 2013-07-31 2016-06-29 微软技术许可有限责任公司 Ergonomic physical interaction zone cursor mapping
CN105759950A (en) * 2014-12-18 2016-07-13 宇龙计算机通信科技(深圳)有限公司 Mobile terminal information input method and mobile terminal
CN107025453A (en) * 2017-03-31 2017-08-08 上海斐讯数据通信技术有限公司 A kind of contactless digital input unit and the method for content input
CN107562358A (en) * 2017-09-05 2018-01-09 闫如月 Touch screen intelligent search method
CN112462935A (en) * 2020-11-05 2021-03-09 深圳市易平方网络科技有限公司 Text input processing method, device, terminal and medium based on remote gestures
WO2023112463A1 (en) * 2021-12-13 2023-06-22 マクセル株式会社 Aerial image information display system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1573666A (en) * 2003-06-20 2005-02-02 于尚民 Touch-free input equipment and method
CN1595435A (en) * 2004-07-09 2005-03-16 北京中文之星数码科技有限公司 Character cutting method for handwriting input
CN2757223Y (en) * 2004-12-22 2006-02-08 郦东 Inductive switch type user interface device and its portable terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1573666A (en) * 2003-06-20 2005-02-02 于尚民 Touch-free input equipment and method
CN1595435A (en) * 2004-07-09 2005-03-16 北京中文之星数码科技有限公司 Character cutting method for handwriting input
CN2757223Y (en) * 2004-12-22 2006-02-08 郦东 Inductive switch type user interface device and its portable terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
柳阳: "基于手势的文本输入方法及其在穿戴计算机中的应用", 《第一届全国普适计算机学术会议》 *

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103294219A (en) * 2012-02-28 2013-09-11 联想(北京)有限公司 Character input method and device
CN102662465A (en) * 2012-03-26 2012-09-12 北京国铁华晨通信信息技术有限公司 Method and system for inputting visual character based on dynamic track
CN103369383A (en) * 2012-03-26 2013-10-23 乐金电子(中国)研究开发中心有限公司 Control method and device of spatial remote controller, spatial remote controller and multimedia terminal
CN103488407A (en) * 2012-06-11 2014-01-01 联想(北京)有限公司 Method and equipment for controlling display position of operation object icon
CN103513902A (en) * 2012-06-28 2014-01-15 深圳富泰宏精密工业有限公司 Touch screen unlocking method and system
CN103543943A (en) * 2012-07-16 2014-01-29 三星电子株式会社 Touch and gesture input-based control method and terminal therefor
CN103869954A (en) * 2012-12-17 2014-06-18 联想(北京)有限公司 Processing method as well as processing device and electronic device
CN103941846A (en) * 2013-01-18 2014-07-23 联想(北京)有限公司 Electronic device and input method
CN103197761A (en) * 2013-03-28 2013-07-10 深圳泰山在线科技有限公司 Gesture recognition method and device
CN103197761B (en) * 2013-03-28 2016-12-28 深圳泰山在线科技有限公司 Gesture identification method and device
CN103345307A (en) * 2013-07-16 2013-10-09 深圳大学 Figure key input device and input method thereof
CN103345307B (en) * 2013-07-16 2016-09-21 深圳大学 A kind of digital input equipment and input method thereof
CN105723301B (en) * 2013-07-31 2019-06-04 微软技术许可有限责任公司 Ergonomics computer interactive method
CN105723301A (en) * 2013-07-31 2016-06-29 微软技术许可有限责任公司 Ergonomic physical interaction zone cursor mapping
CN105759950A (en) * 2014-12-18 2016-07-13 宇龙计算机通信科技(深圳)有限公司 Mobile terminal information input method and mobile terminal
CN105759950B (en) * 2014-12-18 2019-08-02 宇龙计算机通信科技(深圳)有限公司 Information of mobile terminal input method and mobile terminal
CN104978049A (en) * 2015-07-23 2015-10-14 上海斐讯数据通信技术有限公司 Touch screen based Chinese character inputting method and inputting system
CN107025453A (en) * 2017-03-31 2017-08-08 上海斐讯数据通信技术有限公司 A kind of contactless digital input unit and the method for content input
CN107562358A (en) * 2017-09-05 2018-01-09 闫如月 Touch screen intelligent search method
CN112462935A (en) * 2020-11-05 2021-03-09 深圳市易平方网络科技有限公司 Text input processing method, device, terminal and medium based on remote gestures
WO2023112463A1 (en) * 2021-12-13 2023-06-22 マクセル株式会社 Aerial image information display system

Similar Documents

Publication Publication Date Title
CN102023784A (en) Method and equipment for inputting characters in non-contact mode
US6438523B1 (en) Processing handwritten and hand-drawn input and speech input
US7424154B2 (en) Boxed and lined input panel
US8600163B2 (en) Handwriting determination apparatus and method and program
US9069386B2 (en) Gesture recognition device, method, program, and computer-readable medium upon which program is stored
CN1661538B (en) Pointing device for a terminal having a touch screen and method for using the same
US20060119588A1 (en) Apparatus and method of processing information input using a touchpad
US20100020033A1 (en) System, method and computer program product for a virtual keyboard
CN101458586B (en) Method for operating objects on touch control screen by multi-fingers
CN101196794A (en) Scrolling method and apparatus
US20150154444A1 (en) Electronic device and method
CN109074224A (en) For the method for insertion character and corresponding digital device in character string
CN101901106A (en) The method and the device that are used for the data input
EP2871563A1 (en) Electronic device, method and storage medium
JP5728592B1 (en) Electronic device and handwriting input method
CN102253709A (en) Method and device for determining gestures
US20130212511A1 (en) Apparatus and method for guiding handwriting input for handwriting recognition
Heo et al. Expanding touch input vocabulary by using consecutive distant taps
US9182908B2 (en) Method and electronic device for processing handwritten object
CN109074223A (en) For carrying out the method and system of character insertion in character string
CN103226399A (en) Computer input device
CN105242776A (en) Control method for intelligent glasses and intelligent glasses
KR20160097410A (en) Method of providing touchless input interface based on gesture recognition and the apparatus applied thereto
WO2014137766A1 (en) Enhanced canvas environments
CN102841752B (en) The characters input method of a kind of human-computer interaction device and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20110420