Summary of the invention
In view of above-mentioned, the object of the present invention is to provide a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, its method is by detecting the parameters such as different motion distance, movement velocity and the direction of motion of camera on the camera mobile phone, corresponding the different motion parameter of camera with the respective keys operation of mobile phone, to reach the control handset program, thereby the purpose of different key operation is represented in the difference action that realizes camera, to replace manual button operation.
To achieve these goals, of the present invention a kind of by detecting the method for camera mobile phone cam movement replacing key-press operation, comprise the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out the frame of video in initial analysis and this video sequence of classification;
Step 3: utilize estimation and image tracking technique that above-mentioned video sequence is carried out the extraction of kinematic parameter, wherein above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity, the move distance at least;
Step 4: move coupling, promptly the button operation that the kinematic parameter of said extracted and button are sorted out in the sequence is corresponding; For example the direction of motion is represented the direction options button of mobile phone, and movement velocity is represented digital input key, the handover operation between move distance representative program, as by numeral to the letter switching etc., can freely define here with convenient difference in functionality and the specific operation realized;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
Wherein, the preliminary treatment of in the above-mentioned steps 2 video sequence being carried out comprises at least and adopts filtering, denoising and edge to strengthen one or more operation in the operation.
Above-mentioned steps 3 comprises the steps:
Step 301: in the first frame video, select object of reference, wherein can select the zone of video hub position 8 * 8 usually, but also can select other any suitable zones in this first frame video;
Step 302: in the second frame video, seek this object of reference The corresponding area, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference; If in second frame, do not find the object of reference in first frame, can be zero or other parameters with all kinematic parameter assignment, promptly think and do not move.
Above-mentioned steps 3 keys comprise following two aspects:
1) choosing of object of reference: in order to guarantee the precision of parameter, select three objects of reference usually, be the zone of 8 * 8 sizes, and distribution triangular in shape; But also can select other any suitable zones, and it is distributed by any suitable mode;
2) coupling of object of reference:, can adopt one or more the method in motion estimation techniques and the three-step approach fast algorithm to realize coupling at least in order to improve matching speed and to guarantee precision.Wherein above-mentioned motion estimation techniques and three-step approach fast algorithm all have introduction in common video technical finesse teaching material and books.
Button in the above-mentioned steps 4 is sorted out sequence and is comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, know the function of its representative, it is sorted out, usually can be divided into numeric class, alphabetic class, selection class at least, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence.
Certainly, under the in running order situation of the method for the invention (promptly replacing the mobile phone key operation) by the motion that detects camera, the user still wishes to return to by the mode of button to carry out relevant operation sometimes, this can be by on mobile phone, setting in advance " hot key " mode or the mode of special mobile phone motor pattern (as continuous several times fast moving up and down), clicking " hot key " or carrying out mobile phone special exercise pattern operation back and realize.
Adopt method of the present invention, it is not only in operation with use more quick and easy and hommization more, and has more recreational and more convenient old man, child and individuals with disabilities and use without barrier.And for the enforcement of the method for the invention, mobile phone producer can design after obtaining the method for the invention and realize voluntarily, and the problem that does not exist a pre-designed cover software to buy or install by mobile phone producer.In addition, mobile phone producer can be applied to method of the present invention in the management of any application of mobile phone.
Below in conjunction with accompanying drawing, the concrete enforcement of the method for the invention is described in further detail.For those skilled in the art that, from the detailed description to the inventive method, above-mentioned and other purposes of the present invention, feature and advantage will be apparent.
Embodiment
Below in conjunction with accompanying drawing, the concrete enforcement of the method for the invention is described in further detail.
The method of the invention is by detecting the parameters such as different motion distance, movement velocity and the direction of motion of camera on the camera mobile phone, corresponding the different motion parameter of camera with the respective keys operation of mobile phone, reaching the control handset program, thereby realize the purpose that on behalf of different key, the difference action of camera operate.Because the diversity of move distance, movement velocity and the direction of motion of camera on the camera mobile phone, so on behalf of people, it can to a certain extent want the meaning of expressing, and can the instead of manual button.In the application process of camera mobile phone or in mobile communication application (3-G (Generation Three mobile communication system), i.e. 3G),, then can make the people feel to use more convenient and quick if people only can steering program by just moving of camera mobile phone.
Fig. 1 is the schematic diagram of the method for the invention.As shown in Figure 1, method of the present invention comprises the steps:
Step 1: obtain video by the camera on the mobile phone, promptly when selected program brings into operation, start camera operation simultaneously on the backstage, finish shooting to site environment;
Step 2: the video sequence that obtains in the above-mentioned steps 1 is carried out preliminary treatment, carry out initial analysis and sort out frame of video in this video sequence, wherein comprise at least and adopt filtering, denoising and edge to strengthen one or more operation in the operation;
Step 3: utilize estimation and image tracking technique above-mentioned video sequence to be carried out the extraction of kinematic parameter; Above-mentioned kinematic parameter comprises one or more the parameter in the direction of motion, movement velocity, the move distance at least; Wherein at first in the first frame video, select object of reference, wherein can select the zone of video hub position 8 * 8 usually, but also can select other any suitable zones in this first frame video; In the second frame video, seek this object of reference The corresponding area then, after finding, calculate the displacement and the direction of motion between itself and the first frame video, and then calculate the kinematic parameter of this object of reference; If in second frame, do not find the object of reference in first frame, can be zero or other parameters with all kinematic parameter assignment, promptly think and do not move;
Step 4: move coupling, promptly all button operations that the kinematic parameter of said extracted and button are sorted out in the sequence are corresponding; For example the direction of motion is represented the direction options button of mobile phone, and movement velocity is represented digital input key, the handover operation between move distance representative program, as by numeral to the letter switching etc., can freely define here with convenient difference in functionality and the specific operation realized;
Step 5: by mobile camera mobile phone, mobile phone detects the kinematic parameter of camera automatically, carries out corresponding operation according to the different implications of its representative.
Wherein, the button in the above-mentioned steps 4 is sorted out sequence and is comprised following performing step:
Step 401: the button on the mobile phone of different styles and different model is extracted;
Step 402: the keypress function to the mobile phone of different model is analyzed, and analyzes the major function that its button is finished;
Step 403: by the analysis of 402 pairs of buttons of above-mentioned steps, know the function of its representative, it is sorted out, usually can be divided into numeric class, alphabetic class, selection class at least, confirm one or more the classification in the class;
Step 404: the content that button in the above-mentioned steps 403 is sorted out is ranked and is put in storage, and each class button is loaded in the database by the sequence number classification, forms button and sorts out sequence.
For the enforcement of the method for the invention, mobile phone producer can design after obtaining the method for the invention and realize voluntarily, and the problem that does not exist a pre-designed cover software to buy or install by mobile phone producer.In addition, mobile phone producer can be applied to method of the present invention in the management of any application of mobile phone, for example be applied in the broadcast of mobile phone MP3 song, for example suppose that the mobile phone kinematic parameter (kinematic parameter can comprise direction, speed, distance etc.) and the defining relation of button are: mobile phone moves forward, and turns over button in the representative; Mobile phone moves backward, turns over button under the representative; Mobile phone moves right, and represents volume to increase button; Mobile phone is moved to the left, and represents volume to turn button down, and mobile phone moves upward and represents selection key (selection is and begins to play), and mobile phone moves downward, representative cancellation button (cancellation is and stops to play), and it mainly comprises following operation:
1) selects mobile phone MP3 play menu, unfolding mode keys available or method of the present invention (promptly detecting the method for cam movement); At this time mobile phone cam is in background work, and in the hypothesis mobile phone how first MP3 song arranged;
2) move mobile phone after, mobile phone moves after by the movement confirmation mobile phone that detects camera, then corresponding under turn over button, the cursor in the mobile phone display screen moves to next song position in the MP3 menu;
3) reach mobile phone, mobile phone be by detecting the movement confirmation mobile phone reach of camera, then corresponding on turn over button, the cursor in the mobile phone display screen moves to last one first song position in the MP3 menu;
4) mobile phone that moves to right, mobile phone moves to right by the movement confirmation mobile phone that detects camera, then transfers big key corresponding to volume, and mobile phone is transferred big broadcast sound volume automatically;
5) mobile phone that moves to left, mobile phone moves to left by the movement confirmation mobile phone that detects camera, then turns button down corresponding to volume, and mobile phone is turned broadcast sound volume automatically down.
6) move mobile phone on, mobile phone is by moving on the movement confirmation mobile phone that detects camera, and then corresponding to selection key, mobile phone is play the MP3 song of selection automatically;
7) move down mobile phone, mobile phone moves down by the movement confirmation mobile phone that detects camera, and then corresponding to the cancellation button, mobile phone stops to play the MP3 song.
The operation of mobile phone games for another example, be " driving an automobile that shows on the mobile phone screen " such as these mobile phone games, turn on having in the keyboard of this mobile phone, turn over down, turn on a left side, the four direction operation keys is turned on the right side (except numerical key and letter key, also having the button of upper and lower, left and right four direction on the keyboard of a lot of mobile phones).Before not adopting this method, the button operation of this recreation is: click upturning key, the operation automobile moves forward; Click downturning key, the operation automobile moves backward; Click a left side and turn over key, the operation automobile is turned left; Click the right side and turn over key, the operation automobile is turned right.After adopting this method, for example suppose that the defining relation of mobile phone kinematic parameter and button is: mobile phone moves forward, and upturning key is clicked in representative; Mobile phone moves backward, and downturning key is clicked in representative; Mobile phone moves right, and representative is clicked the right side and turned over key; Mobile phone is moved to the left, and representative is clicked a left side and turned over key.It mainly comprises following operation:
1) selects the recreation that drives a car in the mobile phone, unfolding mode keys available or method of the present invention (promptly detecting the method for cam movement); At this time mobile phone cam is in background work;
2) reach mobile phone, mobile phone be by detecting the movement confirmation mobile phone reach of camera, then corresponding on turn over button, automobile moves ahead;
3) move mobile phone after, mobile phone moves after by the movement confirmation mobile phone that detects camera, then corresponding under turn over button, back of automobile;
4) mobile phone that moves to right, mobile phone moves to right by the movement confirmation mobile phone that detects camera, then turns over button corresponding to the right side, and automobile is turned right;
5) mobile phone that moves to left, mobile phone moves to left by the movement confirmation mobile phone that detects camera, then turns over button corresponding to a left side, and automobile turns left.
More than describe operation principle of the present invention in detail, but the example of this visualization of just lifting for the ease of understanding should not be considered to be limitation of the scope of the invention.Equally; the ordinary skill of technical field all can be according to the description of technical scheme of the present invention and preferred embodiment thereof under any; make various possible being equal to and change or replacement, but all these changes or replacement all should belong to the protection range of claim of the present invention.