CN104714650A - Information input method and information input device - Google Patents
Information input method and information input device Download PDFInfo
- Publication number
- CN104714650A CN104714650A CN201510156133.2A CN201510156133A CN104714650A CN 104714650 A CN104714650 A CN 104714650A CN 201510156133 A CN201510156133 A CN 201510156133A CN 104714650 A CN104714650 A CN 104714650A
- Authority
- CN
- China
- Prior art keywords
- operating article
- dimensional
- field picture
- track
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
- G06F3/005—Input arrangements through a video camera
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an information input method and an information input device applied to mobile equipment provided with a dynamic double-eye camera. The information input method comprises the following steps: acquiring each frame image of an operated object in a sliding process by virtue of the double-eye camera by the mobile equipment; processing the acquired each frame image so as to acquire a position coordinate of the operated object, and acquiring a three-dimensional track corresponding to a three-dimensional coordinate of the operated object in the sliding process according to the position coordinate of the operated object and a double-eye distance measurement theory; mapping the three-dimensional track to a plane so as to acquire a two-dimensional track of the operated object; carrying out character recognition according to the two-dimensional track, matching corresponding characters in a configured database by virtue of a character recognition result, and displaying. According to the information input method and the information input device, the low-power-consumption information input can be realized in various screens.
Description
Technical field
The present invention relates to communication technical field, particularly a kind of data inputting method and device.
Background technology
Character, as letter, word, numeral etc., as a kind of Information Communication of generally using and media of communication, plays important role in man-machine interactive system.
Now widely used character input system comprises: keyboard, touch screen, handwriting pad etc.These input modes have respective advantage, but also there is respective deficiency, as keyboard, are subject to the restriction of size and number of keys, the equipment such as touch screen and handwriting pad be subject to volume size restriction, to write region limited etc.Therefore, design is more natural, convenient, character input modes is particularly important efficiently.
Summary of the invention
In view of this, the application provides a kind of data inputting method and device, low-power consumption can realize the input of information under many scenes.
For solving the problems of the technologies described above, the technical scheme of the application is achieved in that
A kind of data inputting method, be applied on the mobile device of installation based on dynamic binocular camera, the method comprises:
The each two field picture in operating article sliding process is obtained by binocular camera;
Image procossing is carried out to each two field picture obtained, obtains the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process;
Described three-dimensional track is mapped in plane, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Carry out character recognition according to described two-dimentional track, in the database of configuration, match corresponding character by using character identification result and show.
A kind of message input device, is characterized in that, be applied on the mobile device of installation based on dynamic binocular camera, this device comprises: acquiring unit, processing unit, map unit and identification display unit;
Described acquiring unit, for obtaining each two field picture in operating article sliding process by binocular camera;
Described processing unit, each two field picture for obtaining described acquiring unit carries out image procossing, obtain the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process;
Described map unit, is mapped to plane for the described three-dimensional track obtained by described processing unit, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Described identification display unit, carries out character recognition for the two-dimentional track obtained according to described map unit, matches corresponding character by using character identification result and shows in the database of configuration.
From technical scheme above, in the application, mobile device is by obtaining the bianry image between slide thing and static background based on the camera of dynamic pattern, and the two-dimentional track of operating article motion is obtained by image procossing, character recognition is carried out according to described two-dimentional track, by using character identification result match corresponding character and show in the database of configuration, under many scenes, low-power consumption the input of information can be realized.
Accompanying drawing explanation
Fig. 1 is data inputting method schematic flow sheet in the embodiment of the present application one;
Fig. 2 is data inputting method schematic flow sheet in the embodiment of the present application two;
Fig. 3 is data inputting method schematic flow sheet in the embodiment of the present application three;
The three-dimensional track schematic diagram of input character " exit " in Fig. 4 the embodiment of the present application;
Fig. 5 is the two-dimentional track connecting an input character " exit " in the embodiment of the present application;
A kind of glasses schematic diagram of Fig. 6 for providing in the embodiment of the present application;
Fig. 7 is data inputting method schematic flow sheet in the embodiment of the present application four;
Fig. 8 is the schematic diagram by dummy keyboard input character " quick " in the embodiment of the present application;
Fig. 9 is data inputting method schematic flow sheet in the embodiment of the present application five;
Figure 10 is the apparatus structure schematic diagram being applied to technique scheme in the embodiment of the present application.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, to develop simultaneously embodiment below in conjunction with accompanying drawing, technical scheme of the present invention is described in detail.
A kind of data inputting method is proposed in the embodiment of the present application, be applied on the mobile device of installation based on the binocular camera of dynamic mode, mobile device is by obtaining the bianry image between slide thing and static background based on the camera of dynamic pattern, and the two-dimentional track of operating article motion is obtained by image procossing, character recognition is carried out according to described two-dimentional track, by using character identification result match corresponding character and show in the database of configuration, under many scenes, low-power consumption the input of information can be realized.
In the embodiment of the present application, can use operating article can in the scope of pickup image at mobile device, slidably input, as used operating article to slidably input aloft, the character of input can be English word, also can be phonetic transcriptions of Chinese characters, also can be numeral etc.Operating article can be writing pencil, finger etc.
Below in conjunction with accompanying drawing, describe the realization of data inputting method in the embodiment of the present application in detail.
Embodiment one
Be data inputting method schematic flow sheet in the embodiment of the present application one see Fig. 1, Fig. 1.Concrete steps are:
Step 101, mobile device obtains each two field picture in operating article sliding process by binocular camera.
Based on dynamic binocular camera, as DVS camera, when obtaining image, its ultimate principle is the change according to object moving state, and each camera of binocular camera gets the bianry image of object of which movement respectively.According to practical application configuration, as 200ms, cumulative movement pixel obtains a two field picture.
Therefore, in the embody rule scene of the application, aloft, or during some sliding on planes, each object in background is geo-stationary to operating article.
Step 102, this mobile device carries out image procossing to each two field picture obtained, and obtains the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process.
This mobile device obtains the position coordinates of operating article, refers to the coordinate of fixed position on operating article, namely all selects the coordinate of a location point to carry out relevant treatment for this operating article.
Step 103, described three-dimensional track is mapped in plane by this mobile device, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane.
Step 104, this mobile device carries out character recognition according to described two-dimentional track, matches corresponding character by using character identification result and shows in the database of configuration.
This mobile device carries out character recognition according to two-dimentional track, and the specific implementation of the character identified coupling in a database, is not all restricted in the embodiment of the present application.
Embodiment two
Not carry the operating article of luminophor, luminophor can be LED etc.; This operating article can be writing pen, finger etc.Under this kind of implementation, allocation window length is W; Wherein, W be greater than 0 integer, be configured according to practical application, as can the position of clear display operating article after the imaging importing that how many frame binocular camera obtains, then the value configuring W be how many.
Be data inputting method schematic flow sheet in the embodiment of the present application two see Fig. 2, Fig. 2.Concrete steps are:
Step 201, mobile device obtains each two field picture in operating article sliding process by binocular camera.
Step 202, this mobile device obtains the order of picture frame according to binocular camera, and the picture frame obtained by each camera is divided into W two field picture one group respectively, and the often group image for each camera is superposed to a two field picture.
In this step, mobile device is for each camera, and W+1 to W+10 two field picture, to the superposition of W two field picture, then superposes by obtained 1, until process all images of each camera acquisition; If the last image obtained less than W frame, then obtains a few two field picture and uses a few two field picture to superpose.
Step 203, this mobile device obtains the coordinate of point of fixity on operating article for each two field picture after each camera overlap-add procedure.
When using finger to slide as operating article, the coordinate of point of fixity can use the coordinate of finger tip; When using writing pencil to slide as operating article, the coordinate of point of fixity can use the coordinate on the summit of writing pencil, during the application's specific implementation, the coordinate how choosing point of fixity is not restricted, just selects same position as point of fixity to in a collection of image.
As for primary information input, obtain the matrix pixel point of operating article in each picture frame after, all select the upper left corner of this matrix, or the coordinate of the pixel in the upper right corner is as the marking of point of fixity of operating article.
Step 204, this mobile device, according to binocular range measurement principle, uses the coordinate of the point of fixity on the operating article that obtains for each camera, calculates the three-dimensional coordinate that each apex coordinate is corresponding; The three-dimensional coordinate calculated is arranged, as the three-dimensional track that this operating article slides by calculating acquisition order.
Step 205, described three-dimensional track is mapped in plane by this mobile device, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane.
Step 206, this mobile device carries out character recognition according to described two-dimentional track, matches corresponding character by using character identification result and shows in the database of configuration.
When using the operating article with luminophor to slidably input, during in order to avoid obtaining and processing image unnecessary in a large number, some special actions can be used to indicate the beginning and end slidably inputed, clenching fist as used when the information of slidably inputing starts, stretching out one's hand the action identification such as the palm, also using identical or different action identification information end of input when terminating.
Embodiment three
To carry the operating article of luminophor, this operating article can for carrying the operating articles such as the writing pen of luminophor, and luminophor can be carried at the position that writing pencil can be made a video recording by binocular camera.Under this kind of implementation, allocation window length is M, and sliding step is N; Wherein, M, N be greater than 0 integer, according to practical application configuration M, N occurrence.
Be data inputting method schematic flow sheet in the embodiment of the present application three see Fig. 3, Fig. 3.Concrete steps are:
Step 301, mobile device obtains each two field picture in operating article sliding process by binocular camera.
Step 302, when described operating article is with luminophor, this mobile device is for each camera in binocular camera at interval of N two field picture, and the centre coordinate for the luminophor in the every two field picture in M two field picture is averaged, as the centre coordinate of the luminophor of described M two field picture.
What namely obtain for each camera the 1st averages to the centre coordinate of the luminophor in M two field picture; And then average according to the centre coordinate of the luminophor in N to N+M two field picture, by that analogy, until process all picture frames of each camera acquisition, when usually realizing, configuration N is less than M.
Step 303, this mobile device is according to binocular range measurement principle, use each camera for the three-dimensional centre coordinate of luminophor often organizing M two field picture and obtain operating article, by the three-dimensional centre coordinate of luminophor that obtains by the arrangement of acquisition order, as the three-dimensional track that this operating article slides.
After this mobile device obtains the three-dimensional track of this operating article, determine that whether the number of the three-dimensional centre coordinate of the luminophor obtaining operating article is for being greater than predetermined number threshold value, if, by the three-dimensional centre coordinate of the luminophor of described acquisition by the arrangement of acquisition order, as the three-dimensional track that this operating article slides; Otherwise, continue through binocular camera and obtain picture frame, according to the operating article sliding process process not with luminophor, obtain the three-dimensional track that this operating article slides, namely obtain the three-dimensional track of operating article slip according to the mode in embodiment two.
Step 304, described three-dimensional track is mapped in plane by this mobile device, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane.
Step 305, this mobile device carries out character recognition according to described two-dimentional track, matches corresponding character by using character identification result and shows in the database of configuration.
Suppose the operating article company's of slip input character " exit " aloft in the embodiment of the present application one to three, then operated by the process of embodiment one to embodiment three, the three-dimensional track that the operating article obtained slides is see the three-dimensional track schematic diagram of input character " exit " in Fig. 4, Fig. 4 the embodiment of the present application.
Three-dimensional track schematic diagram in Fig. 4 is determined by each three-dimensional coordinate obtained, and the number of three-dimensional coordinate is by the frame number obtaining image, and length of window M, and sliding step N determines.
It is the two-dimentional track connecting an input character " exit " in the embodiment of the present application see Fig. 5, Fig. 5.The three-dimensional track that Fig. 5 is Fig. 4 is mapped to the two-dimentional track in the plane shown in Fig. 5, and each coordinate points on three-dimensional track is minimum to the distance sum of the plane in Fig. 5.
Be described in operation on dummy keyboard below by embodiment four and embodiment five and input the specific implementation of the mode of information, the realization of this mode, mobile device is required to be the mobile device can worn on eyes, as there being the helmet etc. of transparent shelter before glasses, eyes, on the eyeglass of glasses, or transparent shelter on the helmet shows dummy keyboard at the moment.
Embodiment four
To be slided on the virtual keyboard by operating article in the embodiment of the present application and the mode inputting information is example.
See Fig. 6, Fig. 6 a kind of glasses schematic diagram for providing in the embodiment of the present application.On the eyeglass of the glasses shown in Fig. 6 when needs input information, display dummy keyboard, has installed binocular camera in the eyeglass side of glasses.Glasses in Fig. 6 are the schematic diagram of an example of mobile device in the embodiment of the present application, the structure of the application to the mobile device realizing the embodiment of the present application does not do this restriction, dummy keyboard on glasses is identical with input keyboard layout corresponding on the computor-keyboard in practical application or mobile device, only shows a schematic diagram in Fig. 6.
Can button or display menu be passed through on the mobile device, select to input on the virtual keyboard, still aloft input, if display inputs on the virtual keyboard, just can show dummy keyboard on the mobile apparatus.
Be data inputting method schematic flow sheet in the embodiment of the present application four see Fig. 7, Fig. 7.Concrete steps are:
Step 701, mobile device obtains each two field picture in operating article sliding process by binocular camera.
Step 702, this mobile device carries out image procossing to each two field picture obtained, and obtains the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process.
In the present embodiment, mobile device obtains the mode of three-dimensional coordinate that operating article slides and is also divided into two kinds, and a kind of be operating article is when carrying luminophor, uses in embodiment three three-dimensional track obtaining operating article and slide; Be operating article a when not carrying luminophor, use in embodiment two three-dimensional track obtaining operating article and slide.Here be not described in detail.
Step 703, described three-dimensional track is mapped in plane by this mobile device, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane.
Step 704, this mobile device determines whether described mobile device shows dummy keyboard, if so, performs step 705; Otherwise, perform step 706.
Dummy keyboard whether is used to carry out the concrete processing mode of information input in the embodiment of the present application inconsistent, therefore, here need to judge whether use dummy keyboard to carry out information input, concrete use-pattern, the mode of dummy keyboard how is selected to compare with configuration, if before input information, choice for use dummy keyboard, then determines to employ dummy keyboard here; If before input information, non-selected use dummy keyboard, then determines not use dummy keyboard here.
Step 705, this mobile device determines the character indicated by the virtual key on described dummy keyboard according to described two-dimentional track, and the character indicated by the described virtual key on described dummy keyboard determined, and the input method coupling of current selection exports associated candidate characters and shows, process ends.
Step 706, this mobile device carries out character recognition according to described two-dimentional track, matches corresponding character by using character identification result and shows in the database of configuration.
See the schematic diagram that Fig. 8, Fig. 8 are by dummy keyboard input character " quick " in the embodiment of the present application.In Fig. 8, display be input " quick " time, operating article slide two-dimentional trajectory diagram.After mobile device process goes out two-dimentional track, according to input method, and candidate characters is determined in two-dimentional track position on the virtual keyboard, if English input, then show character " quick " etc., namely two-dimentional track process dummy keyboard on the English word that can form of the character shown by button, select the word that really will input further for user.
If use Chinese phonetic alphabet input method, or five-stroke input method, then show the Chinese character that can spell out, or phrase character.Character in the embodiment of the present application, comprises word, numeral, letter etc., also can comprise phrase etc.
Embodiment five
To be clicked on the virtual keyboard by operating article in the embodiment of the present application and the mode inputting information is example.
Be data inputting method schematic flow sheet in the embodiment of the present application five see Fig. 9, Fig. 9.Concrete steps are:
Step 901, mobile device obtains by binocular camera each two field picture that operating article clicks the virtual key on dummy keyboard.
Step 902, this mobile device carries out image procossing to each two field picture obtained, and obtains the positional information of operating article, and according to the positional information of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article click process.
In the present embodiment, mobile device obtains the mode of three-dimensional coordinate that operating article slides and is also divided into two kinds, and a kind of be operating article is when carrying luminophor, uses in embodiment three three-dimensional track obtaining operating article and slide; Be operating article a when not carrying luminophor, use in embodiment two three-dimensional track obtaining operating article and slide.Here be not described in detail.
Step 903, described three-dimensional track is mapped in plane by this mobile device, distinguishes point on the plane according to cluster, sorting algorithm; And determine the character indicated by virtual key of the some correspondence position on described dummy keyboard on the plane that falls distinguished, according to the character determined, and the input method of current selection matches associated candidate characters and shows.
Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane.
In the application's specific embodiment, can by the button on mobile device, or the mode of the menu setecting current input information of display still slidably inputs for clicking input, thus mobile device is when processing image, determines the processing mode for the image got according to the input mode of current selection.
For the embodiment that embodiment one provides to embodiment five, all can go out candidate characters according to the information displaying of input, user selects the actual character that will input according to candidate characters, be described below in detail on the basis of mobile device display candidate characters, select the implementation of a candidate characters.
Mobile device is when obtaining operation and clicking each two field picture selecting candidate characters by binocular camera, according to the position of candidate characters display, and the image number obtained, determination operation thing is in the residence time of each candidate characters position, when determining that described operating article is greater than preset time threshold in arbitrary candidate characters position residence time, determine that this candidate characters is that user chooses the character of input and shows.
Known by above-described embodiment, during the application's specific implementation, be divided into using and carry the operating article of luminophor, and do not carry luminophor operating article be embodied as example, two kinds of implementations are described below respectively:
Each two field picture that mobile device is obtained by binocular camera, when specific implementation, the image that can process a camera acquisition also can realize.
When operating article is the operating article carrying luminophor, mobile device is according to the band of position in acquisition image of the candidate characters of display, determine that in this band of position, the number of image frames of the operating article of luminophor is carried in display, the time of adjacent two frame pictures is obtained again according to binocular camera, thus can time of stopping on this candidate characters of determination operation thing, when determining that the residence time is greater than preset time threshold, then determine that character that user selects is character corresponding to the described band of position.
When operating article is the operating article not carrying luminophor, mobile device allocation window length Q and sliding step P.
When mobile device gets image, at interval of P two field picture, for Q two field picture, determination operation thing from region, each display character position from the process being shown to disappearance, the number of picture frame of process; Also Q and P all can be configured to 1 for every frame picture, determination operation thing is from having to nothing, the number of picture frame of process, the time of adjacent two frame pictures is obtained again according to binocular camera, thus can time of stopping on this candidate characters of determination operation thing, when determining that the residence time is greater than preset time threshold, then determine that character that user selects is character corresponding to the described band of position.
During the application's specific implementation, if an operating article carries luminophor, then can be whether luminous by this luminophor of switch control rule, when mentioning the operating article carrying luminophor in the embodiment of the present application, all refer to that this operating article is open for the switch of luminophor, namely luminous.
The requirement of luminophor to background and light is smaller, if when having the operating article carrying luminophor, can preferentially use this operating article.
Require less to background environment in the embodiment of the present application, and acquisition is bianry image, relative colour imagery shot, power consumption is less.
Based on same inventive concept, the application also proposes a kind of message input device, is applied on the mobile device of installation based on dynamic binocular camera.It is the apparatus structure schematic diagram being applied to technique scheme in the embodiment of the present application see Figure 10, Figure 10.This device comprises: acquiring unit 1001, processing unit 1002, map unit 1003 and identification display unit 1004;
Acquiring unit 1001, for obtaining each two field picture in operating article sliding process by binocular camera;
Processing unit 1002, each two field picture for obtaining acquiring unit 1001 carries out image procossing, obtain the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process;
Map unit 1003, is mapped to plane for the described three-dimensional track obtained by processing unit 1002, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Identify display unit 1004, carry out character recognition for the two-dimentional track obtained according to map unit 1003, in the database of configuration, match corresponding character by using character identification result and show.
Preferably, described device comprises preferably further, dispensing unit 1005;
Dispensing unit 1005 is W for allocation window length; Wherein, W be greater than 0 integer;
Processing unit 1002, specifically for obtaining the order of picture frame according to binocular camera, the picture frame obtained by each camera is divided into the W two field picture one group that dispensing unit 1005 configures respectively, and the often group image for each camera is superposed to a two field picture; The coordinate of point of fixity on operating article is obtained for each two field picture after each camera overlap-add procedure; According to binocular range measurement principle, use the coordinate of the point of fixity on the operating article that obtains for each camera, calculate the three-dimensional coordinate that each apex coordinate is corresponding; The three-dimensional coordinate calculated is arranged, as the three-dimensional track that this operating article slides by calculating acquisition order.
Preferably, described device comprises further: dispensing unit 1005;
Dispensing unit 1005 is M for allocation window length, and sliding step is N; Wherein, M, N be greater than 0 integer;
Processing unit 1002, specifically for when described operating article is with luminophor, for the N two field picture that each camera in binocular camera configures at interval of dispensing unit 1005, centre coordinate for the luminophor in the every two field picture in M two field picture is averaged, as the centre coordinate of the luminophor of described M two field picture; According to binocular range measurement principle, use each camera for the three-dimensional centre coordinate of luminophor often organizing M two field picture and obtain operating article; The three-dimensional centre coordinate of the luminophor obtained is arranged, as the three-dimensional track that this operating article slides by acquisition order.
Preferably,
Processing unit 1002, whether be further used for the number of the three-dimensional centre coordinate determining the luminophor obtaining operating article for being greater than predetermined number threshold value, if so, by the three-dimensional centre coordinate of the luminophor of described acquisition by the arrangement of acquisition order, as the three-dimensional track that this operating article slides; Otherwise, continue through binocular camera and obtain picture frame, according to the operating article sliding process process not with luminophor, obtain the three-dimensional track that this operating article slides.
Preferably, described mobile device is can with the mobile device on eyes;
Identify display unit 1004, be further used for determining whether this unit place mobile device shows dummy keyboard, if, character indicated by the virtual key that described two-dimentional track is determined on described dummy keyboard, and the character indicated by the described virtual key on described dummy keyboard determined, and the input method coupling of current selection exports associated candidate characters and shows; Otherwise, perform and describedly carry out two-dimentional character recognition and subsequent operation according to two-dimentional track.
Preferably, described mobile device is can with the mobile device on eyes;
Acquiring unit 1001, is further used for obtaining by binocular camera each two field picture that operating article clicks the virtual key on dummy keyboard;
Processing unit 1002, each two field picture be further used for obtaining carries out image procossing, obtains the positional information of operating article, and according to the positional information of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article click process;
Map unit 1003, is further used for described three-dimensional track to be mapped in plane, and described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Identify display unit 1004, be further used for distinguishing point on the plane according to cluster, sorting algorithm; And determine the character indicated by virtual key of the some correspondence position on described dummy keyboard on the plane that falls distinguished, according to the character determined, and the input method of current selection matches associated candidate characters and shows.
Preferably,
Processing unit 1002, be further used for when being obtained operation by binocular camera and clicking each two field picture selecting candidate characters, according to the position of candidate characters display, and the image number obtained, determination operation thing is in the residence time of each candidate characters position, when determining that described operating article is greater than preset time threshold in arbitrary candidate characters position residence time, determine this candidate characters be user choose the character of input and trigger identify display unit 1004 show.
The unit of above-described embodiment can be integrated in one, and also can be separated deployment; A unit can be merged into, also can split into multiple subelement further.
In sum, the application by mobile device by obtaining the bianry image between slide thing and static background based on the camera of dynamic pattern, and the two-dimentional track of operating article motion is obtained by image procossing, character recognition is carried out according to described two-dimentional track, by using character identification result match corresponding character and show in the database of configuration, under many scenes, low-power consumption the input of information can be realized.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within the scope of protection of the invention.
Claims (14)
1. a data inputting method, is characterized in that, be applied on the mobile device of installation based on dynamic binocular camera, the method comprises:
The each two field picture in operating article sliding process is obtained by binocular camera;
Image procossing is carried out to each two field picture obtained, obtains the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process;
Described three-dimensional track is mapped in plane, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Carry out character recognition according to described two-dimentional track, in the database of configuration, match corresponding character by using character identification result and show.
2. method according to claim 1, is characterized in that, described method comprises further: allocation window length is W; Wherein, W be greater than 0 integer;
Described each two field picture to obtaining carries out image procossing, obtains the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process, comprising:
Obtain the order of picture frame according to binocular camera, the picture frame obtained by each camera is divided into W two field picture one group respectively, and the often group image for each camera is superposed to a two field picture;
The coordinate of point of fixity on operating article is obtained for each two field picture after each camera overlap-add procedure;
According to binocular range measurement principle, use the coordinate of the point of fixity on the operating article that obtains for each camera, calculate the three-dimensional coordinate that each apex coordinate is corresponding;
The three-dimensional coordinate calculated is arranged, as the three-dimensional track that this operating article slides by calculating acquisition order.
3. method according to claim 1, is characterized in that, described method comprises further: allocation window length is M, and sliding step is N; Wherein, M, N be greater than 0 integer;
Described each two field picture to obtaining carries out image procossing, obtains the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process, comprising:
When described operating article is with luminophor, for each camera in binocular camera at interval of N two field picture, the centre coordinate for the luminophor in the every two field picture in M two field picture is averaged, as the centre coordinate of the luminophor of described M two field picture;
According to binocular range measurement principle, use each camera for the three-dimensional centre coordinate of luminophor often organizing M two field picture and obtain operating article;
The three-dimensional centre coordinate of the luminophor obtained is arranged, as the three-dimensional track that this operating article slides by acquisition order.
4. method according to claim 3, is characterized in that, after the two-dimentional track of described this operating article of acquisition, described carry out character recognition according to described two-dimentional track before, described method comprises further:
Determine that whether the number of the three-dimensional centre coordinate of the luminophor obtaining operating article is for being greater than predetermined number threshold value, if so, by the three-dimensional centre coordinate of the luminophor of described acquisition by the arrangement of acquisition order, as the three-dimensional track that this operating article slides; Otherwise, continue through binocular camera and obtain picture frame, according to the operating article sliding process process not with luminophor, obtain the three-dimensional track that this operating article slides.
5. method according to claim 1, is characterized in that, described mobile device is can with the mobile device on eyes;
After the two-dimentional track of described this operating article of acquisition, described carry out character recognition according to described two-dimentional track before, described method comprises further:
Determine whether described mobile device shows dummy keyboard, if, character indicated by the virtual key that described two-dimentional track is determined on described dummy keyboard, and the character indicated by the described virtual key on described dummy keyboard determined, and the input method coupling of current selection exports associated candidate characters and shows; Otherwise, perform and describedly carry out two-dimentional character recognition and subsequent operation according to two-dimentional track.
6. method according to claim 1, is characterized in that, described mobile device is can with the mobile device on eyes;
Each two field picture that operating article clicks the virtual key on dummy keyboard is obtained by binocular camera;
Image procossing is carried out to each two field picture obtained, obtains the positional information of operating article, and according to the positional information of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article click process;
And described three-dimensional track is mapped in plane, distinguish point on the plane according to cluster, sorting algorithm; And determine the character indicated by virtual key of the some correspondence position on described dummy keyboard on the plane that falls distinguished, according to the character determined, and the input method of current selection matches associated candidate characters and shows; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane.
7. the method according to claim 5 or 6, is characterized in that, described method comprises further:
When being obtained operation by binocular camera and clicking each two field picture selecting candidate characters, according to the position of candidate characters display, and the image number obtained, determination operation thing is in the residence time of each candidate characters position, when determining that described operating article is greater than preset time threshold in arbitrary candidate characters position residence time, determine that this candidate characters is that user chooses the character of input and shows.
8. a message input device, is characterized in that, be applied on the mobile device of installation based on dynamic binocular camera, this device comprises: acquiring unit, processing unit, map unit and identification display unit;
Described acquiring unit, for obtaining each two field picture in operating article sliding process by binocular camera;
Described processing unit, each two field picture for obtaining described acquiring unit carries out image procossing, obtain the position coordinates of operating article, and according to the position coordinates of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article sliding process;
Described map unit, is mapped to plane for the described three-dimensional track obtained by described processing unit, obtains the two-dimentional track of this operating article; Described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Described identification display unit, carries out character recognition for the two-dimentional track obtained according to described map unit, matches corresponding character by using character identification result and shows in the database of configuration.
9. device according to claim 8, is characterized in that, described device comprises further: dispensing unit;
Described dispensing unit is W for allocation window length; Wherein, W be greater than 0 integer;
Described processing unit, specifically for obtaining the order of picture frame according to binocular camera, the picture frame obtained by each camera is divided into the W two field picture one group of described dispensing unit configuration respectively, and the often group image for each camera is superposed to a two field picture; The coordinate of point of fixity on operating article is obtained for each two field picture after each camera overlap-add procedure; According to binocular range measurement principle, use the coordinate of the point of fixity on the operating article that obtains for each camera, calculate the three-dimensional coordinate that each apex coordinate is corresponding; The three-dimensional coordinate calculated is arranged, as the three-dimensional track that this operating article slides by calculating acquisition order.
10. device according to claim 8, is characterized in that, described device comprises further: dispensing unit;
Described dispensing unit is M for allocation window length, and sliding step is N; Wherein, M, N be greater than 0 integer;
Described processing unit, specifically for when described operating article is with luminophor, for the N two field picture that each camera in binocular camera configures at interval of described dispensing unit, centre coordinate for the luminophor in the every two field picture in M two field picture is averaged, as the centre coordinate of the luminophor of described M two field picture; According to binocular range measurement principle, use each camera for the three-dimensional centre coordinate of luminophor often organizing M two field picture and obtain operating article; The three-dimensional centre coordinate of the luminophor obtained is arranged, as the three-dimensional track that this operating article slides by acquisition order.
11. devices according to claim 10, is characterized in that,
Described processing unit, whether be further used for the number of the three-dimensional centre coordinate determining the luminophor obtaining operating article for being greater than predetermined number threshold value, if so, by the three-dimensional centre coordinate of the luminophor of described acquisition by the arrangement of acquisition order, as the three-dimensional track that this operating article slides; Otherwise, continue through binocular camera and obtain picture frame, according to the operating article sliding process process not with luminophor, obtain the three-dimensional track that this operating article slides.
12. devices according to claim 8, is characterized in that, described mobile device is can with the mobile device on eyes;
Described identification display unit, be further used for determining whether this unit place mobile device shows dummy keyboard, if, character indicated by the virtual key that described two-dimentional track is determined on described dummy keyboard, and the character indicated by the described virtual key on described dummy keyboard determined, and the input method coupling of current selection exports associated candidate characters and shows; Otherwise, perform and describedly carry out two-dimentional character recognition and subsequent operation according to two-dimentional track.
13. devices according to claim 8, is characterized in that, described mobile device is can with the mobile device on eyes;
Described acquiring unit, is further used for obtaining by binocular camera each two field picture that operating article clicks the virtual key on dummy keyboard;
Described processing unit, each two field picture be further used for obtaining carries out image procossing, obtains the positional information of operating article, and according to the positional information of operating article, and binocular range measurement principle obtains three-dimensional track corresponding to three-dimensional coordinate in operating article click process;
Described map unit, is further used for described three-dimensional track to be mapped in plane, and described plane makes all three-dimensional coordinate points of acquisition minimum to the distance sum of this plane;
Described identification display unit, is further used for distinguishing point on the plane according to cluster, sorting algorithm; And determine the character indicated by virtual key of the some correspondence position on described dummy keyboard on the plane that falls distinguished, according to the character determined, and the input method of current selection matches associated candidate characters and shows.
14. devices according to claim 12 or 13, is characterized in that,
Described processing unit, be further used for when being obtained operation by binocular camera and clicking each two field picture selecting candidate characters, according to the position of candidate characters display, and the image number obtained, determination operation thing is in the residence time of each candidate characters position, when determining that described operating article is greater than preset time threshold in arbitrary candidate characters position residence time, determine that this candidate characters is that user chooses the character of input and triggers the display of described identification display unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510156133.2A CN104714650B (en) | 2015-04-02 | 2015-04-02 | A kind of data inputting method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510156133.2A CN104714650B (en) | 2015-04-02 | 2015-04-02 | A kind of data inputting method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104714650A true CN104714650A (en) | 2015-06-17 |
| CN104714650B CN104714650B (en) | 2017-11-24 |
Family
ID=53414060
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510156133.2A Active CN104714650B (en) | 2015-04-02 | 2015-04-02 | A kind of data inputting method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104714650B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106774974A (en) * | 2016-11-29 | 2017-05-31 | 网易（杭州）网络有限公司 | The method and apparatus of output information |
| CN110414225A (en) * | 2019-07-24 | 2019-11-05 | 广州魅视电子科技有限公司 | A kind of system and method for anti-HID keyboard attack |
| US10698068B2 (en) | 2017-03-24 | 2020-06-30 | Samsung Electronics Co., Ltd. | System and method for synchronizing tracking points |
| US10812711B2 (en) | 2018-05-18 | 2020-10-20 | Samsung Electronics Co., Ltd. | Semantic mapping for low-power augmented reality using dynamic vision sensor |
| CN112183521A (en) * | 2020-09-30 | 2021-01-05 | 中国银行股份有限公司 | Intelligent input method, system, equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1485711A (en) * | 2002-09-28 | 2004-03-31 | �ʼҷ����ֵ��ӹɷ�����˾ | Three-dimensional hand-written identification process and system thereof |
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| US20100103092A1 (en) * | 2008-10-23 | 2010-04-29 | Tatung University | Video-based handwritten character input apparatus and method thereof |
| CN101950222A (en) * | 2010-09-28 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Handwriting input method, device and system for digital television receiving terminal |
| CN102880304A (en) * | 2012-09-06 | 2013-01-16 | 天津大学 | Character inputting method and device for portable device |
| CN103839040A (en) * | 2012-11-27 | 2014-06-04 | 株式会社理光 | Gesture identification method and device based on depth images |
-
2015
- 2015-04-02 CN CN201510156133.2A patent/CN104714650B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1485711A (en) * | 2002-09-28 | 2004-03-31 | �ʼҷ����ֵ��ӹɷ�����˾ | Three-dimensional hand-written identification process and system thereof |
| US20100103092A1 (en) * | 2008-10-23 | 2010-04-29 | Tatung University | Video-based handwritten character input apparatus and method thereof |
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| CN101950222A (en) * | 2010-09-28 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Handwriting input method, device and system for digital television receiving terminal |
| CN102880304A (en) * | 2012-09-06 | 2013-01-16 | 天津大学 | Character inputting method and device for portable device |
| CN103839040A (en) * | 2012-11-27 | 2014-06-04 | 株式会社理光 | Gesture identification method and device based on depth images |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106774974A (en) * | 2016-11-29 | 2017-05-31 | 网易（杭州）网络有限公司 | The method and apparatus of output information |
| CN106774974B (en) * | 2016-11-29 | 2019-08-13 | 网易（杭州）网络有限公司 | The method and apparatus of output information |
| US10698068B2 (en) | 2017-03-24 | 2020-06-30 | Samsung Electronics Co., Ltd. | System and method for synchronizing tracking points |
| US10812711B2 (en) | 2018-05-18 | 2020-10-20 | Samsung Electronics Co., Ltd. | Semantic mapping for low-power augmented reality using dynamic vision sensor |
| US11202006B2 (en) | 2018-05-18 | 2021-12-14 | Samsung Electronics Co., Ltd. | CMOS-assisted inside-out dynamic vision sensor tracking for low power mobile platforms |
| US11381741B2 (en) | 2018-05-18 | 2022-07-05 | Samsung Electronics Co., Ltd. | CMOS-assisted inside-out dynamic vision sensor tracking for low power mobile platforms |
| CN110414225A (en) * | 2019-07-24 | 2019-11-05 | 广州魅视电子科技有限公司 | A kind of system and method for anti-HID keyboard attack |
| CN112183521A (en) * | 2020-09-30 | 2021-01-05 | 中国银行股份有限公司 | Intelligent input method, system, equipment and readable storage medium |
| CN112183521B (en) * | 2020-09-30 | 2023-09-12 | 中国银行股份有限公司 | Intelligent input method, system, equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104714650B (en) | 2017-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10585488B2 (en) | System, method, and apparatus for man-machine interaction | |
| US10261595B1 (en) | High resolution tracking and response to hand gestures through three dimensions | |
| CN113238650B (en) | Gesture recognition and control method and device and virtual reality equipment | |
| Shen et al. | Vision-based hand interaction in augmented reality environment | |
| CN106598227B (en) | Gesture identification method based on Leap Motion and Kinect | |
| US9891822B2 (en) | Input device and method for providing character input interface using a character selection gesture upon an arrangement of a central item and peripheral items | |
| CN108700957B (en) | Electronic system and method for text entry in a virtual environment | |
| CN110310288A (en) | Method and system for the Object Segmentation in mixed reality environment | |
| CN104714650A (en) | Information input method and information input device | |
| CN107615214A (en) | Interface control system, interface control device, interface control method and program | |
| CN109344793A (en) | Aerial hand-written method, apparatus, equipment and computer readable storage medium for identification | |
| US20150241984A1 (en) | Methods and Devices for Natural Human Interfaces and for Man Machine and Machine to Machine Activities | |
| WO2013016104A1 (en) | Specifying values by occluding a pattern on a target | |
| KR20130099317A (en) | System for implementing interactive augmented reality and method for the same | |
| CN109074223A (en) | For carrying out the method and system of character insertion in character string | |
| CN105549890B (en) | One-dimensional handwriting input equipment and one-dimensional hand-written character input method | |
| US10621766B2 (en) | Character input method and device using a background image portion as a control region | |
| EP3413179B1 (en) | Rejecting extraneous touch inputs in an electronic presentation system | |
| Alam et al. | Implementation of a character recognition system based on finger-joint tracking using a depth camera | |
| CN105242776A (en) | Control method for intelligent glasses and intelligent glasses | |
| CN111831112A (en) | Text input system and method based on eye movement and finger micro-gesture | |
| Saoji et al. | Air canvas application using Opencv and numpy in python | |
| JP7419003B2 (en) | Information display device, information display method, and information display system | |
| US20070177806A1 (en) | System, device, method and computer program product for using a mobile camera for controlling a computer | |
| CN102609734A (en) | Machine vision-based handwriting recognition method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |