CN103577023A

CN103577023A - Video processing method and terminal

Info

Publication number: CN103577023A
Application number: CN201210253287.XA
Authority: CN
Inventors: 丁世鹏
Original assignee: Huawei Device Co Ltd
Current assignee: Huawei Device Co Ltd
Priority date: 2012-07-20
Filing date: 2012-07-20
Publication date: 2014-02-12
Anticipated expiration: 2032-07-20
Also published as: CN103577023B

Abstract

The invention discloses a video processing method and a terminal and belongs to the field of terminals. The method comprises the steps of respectively collecting an ith frame of image and a next related frame of image of the ith frame; enabling the next related frame of image of the ith frame to be an nth frame of image after the ith frame, and enabling n to be an integer larger than or equal to 1; respectively obtaining the spatial location of the terminal at the present moment and the spatial location of the terminal at a next moment; enabling the present moment to be the moment for collecting the ith frame of image, and enabling the next moment to be the moment for collecting the next related frame of image of the ith frame; and enabling the next related frame of image of the ith frame to be replaced with a reserved image when the difference between the spatial location corresponding to the present moment and the spatial location corresponding to the next moment is larger than a threshold. According to the video processing method, the problem that when the terminal shakes, obtained videos also shake is solved, the picture experience senses of users are improved, and the effect of obtaining stable videos when the terminal shakes is achieved.

Description

Method for processing video frequency and terminal

Technical field

The present invention relates to terminal field, particularly method for processing video frequency and terminal.

Background technology

Along with the development of mobile communication technology, the function of mobile terminal is also in continuous complicated and high efficiency.Utilize mobile terminal to carry out the shooting of video and process also becoming one of conventional technology of people thereupon.

In prior art, the method for processing video frequency being commonly used in mobile terminal is: mobile terminal gathers video data, and this video data comprises continuous some two field pictures; According to coding standard, every two field picture is encoded; Utilize wireless network in real time the image transmitting after coding to be arrived to another terminal.

In realizing process of the present invention, inventor finds that prior art at least exists following problem: due to the mobility of mobile terminal, locus when user uses mobile terminal may be in continuous variation, and the common hand-held mobile terminal of user, easily causes shake.And when mobile terminal is when gathering present image, may shake due to variation or the mobile terminal of customer location, cause the video after collection to occur the problem of shaking.Take and use mobile phone to carry out video calling as example, the posture of user's handheld mobile phone may be in continuous variation, for example user is constantly mobile (as walking) in the situation that, mobile phone is inevasible can be shaken, thereby shake with the video council that this user is just getting other users of video calling, if user's mobile phone continues dither state for a long time, the picture experience sense of other user video calls will non-constant so.

Summary of the invention

The object of the embodiment of the present invention is to provide a kind of method for processing video frequency and terminal, is intended to solve the problem of the video image dithering causing when shake occurs mobile terminal.

First aspect, provides a kind of method for processing video frequency, and described method comprises: gather respectively the i two field picture of video source and next associated frame image of i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and described n is more than or equal to 1 integer; Obtain respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame; When the difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, next associated frame image of described i frame is replaced with predetermined image.

In the possible implementation of the first of first aspect, described predetermined image is described i two field picture; Or, the image that before next associated frame image that described predetermined image is described i frame, a nearest frame is not replaced.

In conjunction with the possible implementation of the first of first aspect or first aspect, in the possible implementation of the second, described locus comprises at least one in position angle, the angle of pitch and the roll angle of described terminal; When described difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, next associated frame image of described i frame is replaced with predetermined image, comprise: when in position angle, the angle of pitch and roll angle in the corresponding locus of described current time and described next corresponding locus of the moment, the difference of unspecified angle is greater than threshold value, next associated frame image of described i frame is replaced with predetermined image.

The possible implementation of the second in conjunction with the possible implementation of the first of first aspect or first aspect or first aspect, in the third possible implementation, described method for processing video frequency also comprises: whether the continuous N two field picture that judgement is processed is recently the image being replaced, and M is more than or equal to 1 integer; If so, the value that changes described n switches to the second predetermined value by the first predetermined value, and described the first predetermined value is greater than described the second predetermined value, and described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1.

The third possible implementation in conjunction with the possible implementation of the second of the possible implementation of the first of first aspect or first aspect or first aspect or first aspect, in the 4th kind of possible implementation, described method for processing video frequency also comprises: whether the N continuous two field picture that judgement is processed is recently the image not being replaced, and N is more than or equal to 1 integer; If so, the value that changes described n switches to the 3rd predetermined value by the first predetermined value, and described the first predetermined value is less than described the 3rd predetermined value, and described the first predetermined value and the 3rd predetermined value are the integer that is more than or equal to 1.

In conjunction with the third possible implementation of the possible implementation of the second of the possible implementation of the first of first aspect or first aspect or first aspect or first aspect or the 4th kind of possible implementation of first aspect, in the 5th kind of possible implementation, the described terminal of obtaining respectively, in current time and next locus constantly, specifically comprises: obtain respectively the acceleration transducer of terminal and magnetic induction sensor in described current time and described next data that constantly gather; Utilize sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtain respectively described terminal in described current time and the locus in described next moment.

In conjunction with the third possible implementation of the possible implementation of the second of the possible implementation of the first of first aspect or first aspect or first aspect or first aspect or the 4th kind of possible implementation of first aspect, in the 6th kind of possible implementation, the described terminal of obtaining respectively, in current time and next locus constantly, specifically comprises: obtain respectively the acceleration transducer of terminal and magnetic induction sensor in described current time and described next data that constantly gather; Utilize sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtain respectively described terminal in described current time and the initial space position in described next moment; The data that utilization is arranged on the gyro sensor collection in described terminal are revised and are obtained described current time and the locus in described next moment described current time and described next initial space position constantly.

Second aspect, provides a kind of terminal, and described terminal comprises: video acquisition unit, for gathering respectively the i two field picture of video source and next associated frame image of described i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and described n is more than or equal to 1 integer; Locus acquiring unit, for obtaining respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame; Video processing unit, while being greater than threshold value for the difference when between the corresponding locus of described current time and described next corresponding locus of the moment, replaces next associated frame image of described i frame with predetermined image.

In the possible implementation of the first of second aspect, described predetermined image is described i two field picture, or, the image that before next associated frame image that described predetermined image is described i frame, a nearest frame is not replaced.

In conjunction with the possible implementation of the first of second aspect or second aspect, in the possible implementation of the second, the locus obtaining in the acquiring unit of described locus comprises at least one in position angle, the angle of pitch and the roll angle of described terminal; Described video processing unit specifically for: when the corresponding locus of described current time and described next when constantly the difference of unspecified angle is greater than threshold value in position angle, the angle of pitch and the roll angle in corresponding locus, next associated frame image of described i frame is replaced with predetermined image.

In conjunction with the possible implementation of the second of the possible implementation of the first of second aspect or second aspect or second aspect, in the third possible implementation, described terminal also comprises: first processes judgment sub-unit and the first interval switching subelement; Described first processes judgment sub-unit, for judging whether the continuous N two field picture of nearest processing is the image being replaced, and M is more than or equal to 1 integer; Subelement is switched at described the first interval, if process judgment result is that of judgment sub-unit for described first, be, the value that changes described n switches to the second predetermined value by the first predetermined value, described the first predetermined value is greater than described the second predetermined value, and described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1.

The third possible implementation in conjunction with the possible implementation of the second of the possible implementation of the first of second aspect or second aspect or second aspect or second aspect, in the 4th kind of possible implementation, described terminal also comprises: second processes judgment sub-unit and the second interval switching subelement; Described second processes judgment sub-unit, for judging whether the N continuous two field picture of nearest processing is the image not being replaced, and N is more than or equal to 1 integer; Subelement is switched at described the second interval, if process judgment result is that of judgment sub-unit for described second, be, the value that changes described n switches to the 3rd predetermined value by the first predetermined value, described the first predetermined value is less than described the 3rd predetermined value, and described the first predetermined value and described the 3rd predetermined value are the integer that is more than or equal to 1.

In conjunction with the third possible implementation of the possible implementation of the second of the possible implementation of the first of second aspect or second aspect or second aspect or second aspect or the 4th kind of possible implementation of second aspect, in the 5th kind of possible implementation, described locus acquiring unit specifically comprises: sensor gathers subelement and fusion calculation subelement; Described sensor gathers subelement, for obtaining respectively the acceleration transducer of terminal and magnetic induction sensor in described current time and described next data that constantly gather; Described fusion calculation subelement, for utilizing sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtains respectively described terminal in described current time and the locus in described next moment.

In conjunction with the third possible implementation of the possible implementation of the second of the possible implementation of the first of second aspect or second aspect or second aspect or second aspect or the 4th kind of possible implementation of second aspect, in the 6th kind of possible implementation, described locus acquiring unit specifically comprises: sensor gathers subelement, angle calculation subelement and compensation and revises subelement; Described sensor gathers subelement, for obtaining respectively the acceleration transducer of terminal and magnetic induction sensor in described current time and described next data that constantly gather; Described angle calculation subelement, for utilizing sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtains respectively described terminal in described current time and the initial space position in described next moment; Described compensation correction subelement, revises and obtains described current time and the locus in described next moment described current time and described next initial space position constantly for the data of utilizing the gyro sensor collection that is arranged on described terminal.

The third aspect, provides a kind of terminal, and described terminal comprises camera, sensor, storer and processor; Described camera, for gathering the i two field picture of video source and next the associated frame image of i frame as described in as arbitrary in claim 1 to 7, and is sent to described storer by the image collecting; Described processor, for obtaining respectively terminal as described in as arbitrary in claim 1 to 7 according to the data of described sensor collection in current time and next locus constantly, and is sent to described storer by the locus obtaining; Described processor, be used for calling the i two field picture of described storer, next associated frame image of i frame and current time and next locus constantly, and when carrying out the described difference when between the corresponding locus of current time and next corresponding locus of the moment as arbitrary in claim 1 to 7 and being greater than threshold value, next associated frame image of i frame is replaced with predetermined image.

The beneficial effect that the technical scheme that the embodiment of the present invention provides is brought is:

By judge whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than terminal described in threshold decision and whether shakes in video capture process, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.

Accompanying drawing explanation

For the technical scheme in the clearer explanation embodiment of the present invention, below the accompanying drawing of required use during embodiment is described is briefly described.Apparently, the accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, is not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.

Fig. 1 is the mode of the setting up schematic diagram of the related end coordinates system of the embodiment of the present invention;

Fig. 2 is that another of the related end coordinates of embodiment of the present invention system set up the schematic diagram of mode;

Fig. 3 is the method flow diagram of the method for processing video frequency that provides of the embodiment of the present invention one;

Fig. 4 is the method flow diagram of the method for processing video frequency that provides of the embodiment of the present invention two;

Fig. 5 is the processing mode schematic diagram of the method for processing video frequency that provides of the embodiment of the present invention two;

Fig. 6 is the method flow diagram of the method for processing video frequency that provides of the embodiment of the present invention three;

Fig. 7 is the processing mode schematic diagram of the method for processing video frequency that provides of the embodiment of the present invention three;

Fig. 8 is the method flow diagram of the method for processing video frequency that provides of the embodiment of the present invention four;

Fig. 9 is the other method process flow diagram of the method for processing video frequency that provides of the embodiment of the present invention four;

Figure 10 is the block diagram of the terminal that provides of the embodiment of the present invention five;

Figure 11 is the block diagram of the terminal that provides of the embodiment of the present invention six;

Figure 12 is the block diagram of the terminal that provides of the embodiment of the present invention seven;

Figure 13 is the block diagram of the terminal that provides of the embodiment of the present invention eight;

Figure 14 is the block diagram of the terminal that provides of the embodiment of the present invention nine;

Figure 15 is the block diagram of the terminal that provides of the embodiment of the present invention ten;

Figure 16 is the block diagram of the terminal that provides of the embodiment of the present invention 11;

Figure 17 is the block diagram of the terminal that provides of the embodiment of the present invention 12.

Embodiment

For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing, embodiment of the present invention is described further in detail.

For convenience of description, first the locus of terminal in this patent and obtain manner are described in detail, " terminal " herein can be the mobile terminal of mobile phone, panel computer or E-book reader of being provided with camera and so on, and " locus " herein comprises in position angle, the angle of pitch and roll angle at least one.

The mode of setting up of end coordinates system is: the display interface of setting terminal is xy plane, wherein, the center of gravity of terminal is true origin, what sensing terminal was right-hand is the positive axis of x axle, perpendicular to x axle in terminal plane is y axle, what point to terminal top is the positive axis of y axle, perpendicular to terminal plane is z axle, what point to terminal the place ahead is the positive axis of z axle, details please refer to Fig. 1 or Fig. 2, and wherein Fig. 1 is that the reading direction such as mobile phone is the establishment of coordinate system mode that vertical mobile terminal adopts conventionally; Fig. 2 is that the reading direction such as panel computer is the establishment of coordinate system mode that horizontal mobile terminal adopts conventionally.

The mode of setting up that is based on above-mentioned end coordinates, position angle, the angle of pitch and roll angle are defined as follows:

Position angle is y axle or the projection of y axle on the surface level of true origin and the angle of magnetic north of end coordinates system, and its angular range is 0 ° to 360 °.

The angle of pitch is the y axle of end coordinates system and the angle of surface level, and when the positive axis of y axle is positioned on the surface level of true origin, the angle of pitch is for just, and its angular range is-180 ° to 180 °.

Roll angle is the x axle of end coordinates system and the angle of surface level, and when the positive axis of x axle is positioned on the surface level of true origin, roll angle is for just, and its angular range is-90 ° to 90 °.

The obtain manner of common position angle, the angle of pitch and roll angle is any in following two kinds of modes:

The first obtain manner: utilize sensor fusion algorithm to obtain to being arranged on acceleration transducer in terminal and the data of magnetic induction sensor collection;

Its concrete acquisition methods is as follows:

First, the terminal that acceleration transducer gathers is (G in the weight component of x, y, z axle _x, G _y, G _z), the pass between three is:

G _x=gsinθ；

G _x ²+G _y ²+G _z ²＝g ²；

So, the angle of pitch

for:

Roll angle θ is:

θ = \arctan (\frac{G_{x}}{\sqrt{{G_{y}}^{2} + {G_{z}}^{2}}});

Three axle components of the terminal that secondly, magnetic induction sensor gathers are (M _x, M _y, M _z), according to the angle of pitch having obtained and known ground of roll angle magnetic vector, at the component of x axle, y axle, be respectively:

Therefore, position angle

In sum, the position angle of terminal, the angle of pitch and roll angle are respectively:

θ = \arctan (\frac{G_{x}}{\sqrt{{G_{y}}^{2} + {G_{z}}^{2}}}) .

The second obtain manner: utilize sensor fusion algorithm to calculate initial orientation angle, the angle of pitch and roll angle to being arranged on acceleration transducer in terminal and the data of magnetic induction sensor collection, utilize the data that are arranged on the gyro sensor collection in terminal to obtain initial orientation angle, the angle of pitch and roll angle correction.

While being kept in motion due to terminal, acceleration transducer is more accurate at the measured value of long period, but within a short period of time due to the existence of signal noise, error is larger; And magnetic induction sensor is very easily subject to the interference of electronic equipment itself and external magnetic field, cause measured data to have deviation, so utilize above-mentioned the first measuring method there will be to postpone high, real-time is poor, be subject to the serious problem of magnetic interference.For this reason, a gyro sensor can be set in terminal, gyro sensor has the accurate advantage of measured value in the short time more, especially for the spinning movement of terminal.

Then, can utilize the data of gyro sensor collection to revise initial orientation angle, the angle of pitch and roll angle.Specifically: the data that gyro sensor can be gathered and the concrete numerical value of initial orientation angle, the angle of pitch and roll angle, according to different weight calculation mean value, obtain revised position angle, the angle of pitch and roll angle.Or the data that acceleration transducer, magnetic induction sensor and gyro sensor are gathered are come in conjunction with calculating by other sensor fusion algorithm, the implementation of sensor fusion algorithm can be according to sensor supplier's difference and is different, at this, will repeat no more.

Embodiment mono-

Please refer to Fig. 3, it shows the method flow diagram of the method for processing video frequency that the embodiment of the present invention one provides, this method for processing video frequency can be for being provided with in the mobile terminal such as mobile phone, panel computer or E-book reader of camera, and this method for processing video frequency can comprise:

Step 101, gathers respectively the i two field picture of video source and next associated frame image of i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and n is more than or equal to 1 integer;

The terminal of take is that the mobile phone that is provided with camera is example, and mobile phone is when carrying out video record or video calling, and camera can gather continuous some two field pictures as video source, and continuous some two field pictures comprise next associated frame image of i two field picture and i frame.Wherein, next associated frame image of i frame is the n two field picture after i frame, and n is more than or equal to 1 integer.

Step 102, obtains respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame;

Camera corresponding concrete moment all when gathering each two field picture.In corresponding each moment, mobile phone has a locus, and mobile phone can gather each locus constantly.Each locus constantly comprises current time and next locus constantly.Wherein, current time is for gathering the moment of i two field picture, and next is constantly for gathering the moment of next associated frame image of i frame, and locus comprises at least one in position angle, the angle of pitch and the roll angle of mobile phone.

Step 103, when the difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, replaces next associated frame image of described i frame with predetermined image.

Get mobile phone after current time and next locus constantly, whether mobile phone is greater than threshold value by the difference of unspecified angle in the position angle, the angle of pitch and the roll angle that judge in the corresponding locus of current time and next corresponding locus of the moment, if so, next associated frame image of i frame is replaced with predetermined image.Wherein, described threshold value can be by user or systemic presupposition in mobile phone.Such as, the mobile phone several groups of values that size is identical or different that can prestore, user selects according to self-demand, can be also user's self-defining value when mobile phone carries out Video processing.The threshold value that the mobile phone of take prestores is example as (a, b, c), wherein, a be corresponding to azimuthal threshold value, b for the threshold value corresponding to the angle of pitch, c be the threshold value corresponding to roll angle, the corresponding locus of current time and next the constantly difference between corresponding locus are (△ Az

△ θ), △ Az=Az wherein ₁-Az ₂,

△ θ=θ ₁-θ ₂, mobile phone by judge △ Az whether be greater than a,

whether be greater than b or whether △ θ is greater than c, if above three have any one to meet, judge that shake has occurred mobile phone, mobile phone is replaced next associated frame image of i frame with predetermined image.

Wherein, predetermined image can be described i two field picture; Or described predetermined image can be the image that before next associated frame image of described i frame, a nearest frame is not replaced.

In sum, the method for processing video frequency that the present embodiment one provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.

Because next associated frame image of i frame is the n two field picture after i frame, different according to the value of n, and the difference of predetermined image, can form different embodiment.For this reason, please continue to refer to as follows:

Embodiment bis-

, only there is slightly long and slight shake of duration in application scenarios: the spatial position change of supposing terminal is relatively steady, and rare violent shake, such as, the scene of user's hand-held use terminal by train time.Now, next the associated frame image that can set i two field picture and i frame is adjacent image, also next associated frame image of i frame is i+1 two field picture, and next is the moment that gathers i+1 two field picture constantly accordingly, and current time is for gathering the moment of i two field picture.

Meanwhile, setting predetermined image is described i two field picture.It should be noted that, this is the hypothesis scene of the present embodiment, and " next associated frame image of setting i frame is i+1 two field picture " this technical characterictic can combine with " setting predetermined image is the image that the before nearest frame of next associated frame image of described i frame is not replaced " equally.

Please refer to Fig. 4, it shows the method flow diagram of the method for processing video frequency that embodiment bis-provides, and this method for processing video frequency can be applied to be provided with in the mobile terminal of camera, and this mobile terminal can be mobile phone, panel computer or E-book reader etc.This method for processing video frequency can comprise:

Step 201, gathers respectively i two field picture and the i+1 two field picture of video source;

The terminal of take is that the mobile phone that is provided with camera is example, mobile phone is when carrying out video record or video calling, camera can gather continuous some two field pictures as video source, such as the speed with 24 frames per second gathers a series of image, these images comprise i two field picture and the i+1 two field picture collecting respectively.

Step 202, obtains respectively terminal in current time and next locus constantly;

Mobile phone also can, in the every two field picture of camera collection, gather the locus of self.Wherein, locus comprises in position angle, the angle of pitch and the roll angle of mobile phone at least one.In the locus collecting, the corresponding locus of current time and next corresponding locus of the moment have been comprised.Locus when also, the locus while gathering i two field picture is with collection i+1 two field picture.Mobile phone gathers the locus of self, can comprise:

1, obtain respectively acceleration transducer in mobile phone and magnetic induction sensor in current time and data that next gathers constantly;

2, utilize sensor fusion algorithm to calculate respectively current time and data that next gathers constantly, obtain respectively terminal in current time and next locus constantly.

Such as, the locus while gathering i two field picture is (Az ₁,

θ ₁), the space while gathering i+1 two field picture is (Az ₂,

θ ₂).

Step 203, when the difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, replaces described i+1 two field picture with described i two field picture.

Mobile phone can judge whether the difference between counterparty's parallactic angle, the corresponding angle of pitch and the corresponding roll angle in the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, if have the difference of unspecified angle to be greater than threshold value, i+1 two field picture replaced with i two field picture.

Incorporated by reference to reference to figure 5, suppose that the camera collection in mobile phone has arrived 5 continuous two field pictures, mobile phone to the processing procedure of this 5 two field picture can be:

For the 1st two field picture and the 2nd two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 1st two field picture and the locus while gathering the 2nd two field picture, all do not change, represent that mobile phone now do not shake in other words in steady state (SS), the 2nd two field picture is not replaced;

For the 2nd two field picture and the 3rd two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 2nd two field picture and the locus while gathering the 3rd two field picture, exist difference and this difference between position angle to be greater than threshold value (supposing that arrow shown in figure represents azimuthal variation), the 3rd two field picture is replaced with the 2nd two field picture;

For the 3rd two field picture and the 4th two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 3rd two field picture and the locus while gathering the 4th two field picture, exist difference and this difference between position angle to be less than threshold value, the 4th two field picture is not replaced;

For the 4th two field picture and the 5th two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 4th two field picture and the locus while gathering the 5th two field picture, exist difference and this difference between position angle to be less than threshold value, the 5th two field picture is not replaced.

Obviously, the 3rd two field picture that larger shake occurs is replaced, and the video that the image after replacement forms is stable video.

In sum, the method for processing video frequency that the present embodiment two provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting next associated frame image of i two field picture and i frame, be adjacent image, also get less n value, can occur under the scene of slighter shake in terminal, obtain the effect of good elimination shake.In addition, by setting predetermined image, be i two field picture, can be when there is shake in mobile phone, replace the image that shake is larger, retain the less image of shake, mobile phone is occurred in the process of shake, produce and still have the video changing, and only there is extremely slight shake in this video.

Embodiment tri-

Application scenarios: the spatial position change of supposing terminal is relatively violent, has more of short duration and violent shake, such as, user is taking bus or using the scene of terminal during the vehicles of two wheeler and so on.Now, next the associated frame image that can set i frame is i+2 two field picture.Now, next is constantly for gathering the moment of i+2 two field picture, and current time is for gathering the moment of i two field picture.

Meanwhile, set next associated frame image image that a nearest frame is not replaced before that predetermined image is described i frame.It should be noted that, this is the hypothesis of the present embodiment, and " next associated frame image of setting i frame is i+2 two field picture " this technical characterictic can combine with " setting predetermined image is next associated frame image of described i frame " equally.

Please refer to Fig. 6, it shows the method flow diagram of the method for processing video frequency that embodiment tri-provides, and this method for processing video frequency can be applied to be provided with in the mobile terminal of camera, and this mobile terminal can be mobile phone, panel computer or E-book reader etc.This method for processing video frequency can comprise:

Step 201, gathers respectively i two field picture and the i+2 two field picture of video source;

The terminal of take is that the panel computer that is provided with camera is example, panel computer is when carrying out video record or video calling, camera in panel computer can gather continuous some two field pictures as video source, such as the speed with 48 frames per second gathers a series of image, these images comprise i two field picture and the i+2 image collecting respectively.

Panel computer also can, in the every two field picture of camera collection, gather the locus of self.Wherein, locus comprises in position angle, the angle of pitch and the roll angle of panel computer at least one.In the locus collecting, the corresponding locus of current time and next corresponding locus of the moment have been comprised.Locus when also, the locus while gathering i two field picture is with collection i+2 image.Panel computer gathers the locus of self, can comprise:

1, obtain respectively acceleration transducer in panel computer and magnetic induction sensor in current time and data that next gathers constantly;

2, utilize sensor fusion algorithm to calculate respectively current time and data that next gathers constantly, obtain respectively panel computer in current time and next initial space position constantly;

3, utilize the data be arranged on the gyro sensor collection in panel computer to revise and obtain current time and the locus in next moment current time and next initial space position constantly.

Such as, the locus while gathering i two field picture is (Az ₁,

θ ₁), the locus while gathering i+2 two field picture is (Az ₂, θ ₂).

Step 203, when the difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, by the i+2 two field picture image replacement that a nearest frame is not replaced before for described i+2 two field picture.

Panel computer can judge whether the difference between counterparty's parallactic angle, the corresponding angle of pitch or the corresponding roll angle in the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, if exist the difference of unspecified angle to be greater than threshold value, the image i+2 two field picture not being replaced with a nearest frame before i+2 two field picture is replaced.

Incorporated by reference to reference to figure 7, establish camera collection in panel computer to 5 two field pictures, mobile phone to the processing procedure of this 5 two field picture can be:

For the 1st two field picture and the 3rd two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 1st two field picture and the locus while gathering the 3rd two field picture, exist difference and this difference between the angle of pitch to be greater than threshold value (supposing that arrow shown in figure represents the variation of the angle of pitch), the image the 3rd two field picture not being replaced with a nearest frame before the 3rd two field picture is replaced, and the image that before the 3rd two field picture, a nearest frame is not replaced is the 2nd two field picture, is also about to the 3rd two field picture and replaces with the 2nd two field picture;

For the 2nd two field picture and the 4th two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 2nd two field picture and the locus while gathering the 4th two field picture, exist difference and this difference between the angle of pitch to be greater than threshold value (supposing that arrow shown in figure represents the variation of the angle of pitch), the image the 4th two field picture not being replaced with a nearest frame before the 4th two field picture is replaced, and the image that before the 4th two field picture, a nearest frame is not replaced is the 2nd two field picture, is also about to the 4th two field picture and replaces with the 2nd two field picture;

For the 3rd two field picture and the 5th two field picture, if compared between position angle, the angle of pitch and roll angle in the locus while gathering the 3rd two field picture and the locus while gathering the 5th two field picture, exist difference and this difference between the angle of pitch to be greater than threshold value (supposing that arrow shown in figure represents the variation of the angle of pitch), the image the 5th two field picture not being replaced with a nearest frame before the 5th two field picture is replaced, and the image that before the 5th two field picture, a nearest frame is not replaced is the 2nd two field picture, is also about to the 5th two field picture and replaces with the 2nd two field picture;

Obviously, the 3rd two field picture, the 4th two field picture and the 5th two field picture that shake occurs are replaced, and the video that the image after replacement forms is stable video.

In sum, the method for processing video frequency that the present embodiment three provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting next associated frame image of i frame, be i+2 two field picture, can reach the similar effect of the threshold value that diminishes, the susceptibility while having made to reduce judgement shake.In addition, by setting next associated frame image image that a nearest frame is not replaced before that predetermined image is i frame, can, when shake occurs mobile phone, replace the image of all shakes, mobile phone is occurred in the process of shake, and it is level and smooth that the video of generation keeps.

Embodiment tetra-

Application scenarios: from above-described embodiment, next associated frame image of i frame is the n two field picture after i frame, the value of n wherein, and judges that the susceptibility whether terminal shakes is relevant.And the spatial position change of terminal does not have stable tendency, may in section sometime, often occur that violent shake also may be in held stationary variation in section sometime, such as, terminal user ran after a period of time, change walking into, then after walking a period of time, be changed to again the automobile of taking pubic transport., in the present embodiment, can set the value of n for changing.Also, the initial value of n is the first predetermined value, and can between the first predetermined value and the second predetermined value, switch, and the first predetermined value is greater than the second predetermined value, and the first predetermined value and the second predetermined value are the integer that is more than or equal to 1.Such as, the first predetermined value is that 4, the second predetermined values are 2.

In the present embodiment, for convenience of description, setting described predetermined image is described i two field picture.

Please refer to Fig. 8, it shows the method flow diagram of the method for processing video frequency that embodiment tetra-provides, and this method for processing video frequency can be applied to be provided with in the mobile terminal of camera, and this mobile terminal can be mobile phone, panel computer or E-book reader etc.This method for processing video frequency can comprise:

Step 401, gathers respectively i two field picture and the i+4 two field picture of video source;

It is that the mobile phone that is provided with camera is example that terminal is take in continuation, mobile phone is when carrying out video record or video calling, camera in mobile phone can gather continuous some two field pictures as video source, such as the speed with 24 frames per second gathers a series of image, these images comprise i two field picture and the i+4 two field picture collecting respectively.

Step 402, obtains respectively terminal in current time and next locus constantly;

Mobile phone also can, in the every two field picture of camera collection, gather the locus of self.Wherein, locus comprises in position angle, the angle of pitch and the roll angle of mobile phone at least one.In the locus collecting, the corresponding locus of current time and next corresponding locus of the moment have been comprised.Locus when also, the locus while gathering i two field picture is with collection i+4 two field picture.

Such as, the locus while gathering i two field picture is (Az ₁,

θ ₁), the space while gathering i+4 two field picture is (Az ₂,

θ ₂).

Step 403, when the difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, replaces described i+4 two field picture with described i two field picture.

Mobile phone can judge whether the difference between counterparty's parallactic angle, the corresponding angle of pitch and the corresponding roll angle in the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, if the difference of unspecified angle is greater than threshold value, i+4 two field picture is replaced with i two field picture.

Step 404, whether the continuous N two field picture that judgement is processed is recently the image being replaced, and M is more than or equal to 1 integer; If so, enter step 405; If not, return to step 401;

After mobile phone is processed i+n two field picture, whether the continuous N two field picture that judgement is processed is recently the image being replaced, and M is more than or equal to 1 integer.Such as, M is 15.

Also be, if the continuous N two field picture that mobile phone judgement is processed is recently the image being replaced, represent that the angular deflection between next associated frame image of i two field picture and i frame is too large, causes the variation of mobile phone locus very responsive because the value of n is too large.Now, the initial value of n need to be changed into less value, described method is reduced the susceptibility of mobile phone locus.

Step 405, the value that changes described n switches to the second predetermined value by the first predetermined value, and described the first predetermined value is greater than described the second predetermined value, and described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1.

Now, mobile phone switches to the second predetermined value by the value that changes n by the first predetermined value, and the first predetermined value is greater than the second predetermined value, and the first predetermined value and the second predetermined value are the integer that is more than or equal to 1.Such as, n is switched to the second predetermined value 2 by the first predetermined value 4.

Easily full of beard and, if the N continuous two field picture that mobile phone judgement is processed is recently the image not being replaced, such as, N is 200.Represent, because the value of n is too little, to cause the variation of mobile phone locus insensitive.Now, the initial value of n need to be changed into larger value.

In other words, please refer to Fig. 9, the processing after step 403, can be also:

Step 406, whether the N continuous two field picture that judgement is processed is recently the image not being replaced, and N is more than or equal to 1 integer; If so, enter step 407; If not, return to step 401;

Step 407, the value that changes described n switches to the 3rd predetermined value by the first predetermined value, and described the first predetermined value is less than described the 3rd predetermined value, and described the first predetermined value and described the 3rd predetermined value are the integer that is more than or equal to 1.Such as, the first predetermined value is that the 4 and the 3rd predetermined value is 6.

In addition, can also by predetermined value k, adjust the concrete value of n, its processing procedure is as follows:

If judgment result is that of step 404 is the value that changes n to be switched to n-k by n; If the judged result of step 404 is still yes next time, the value that changes n is switched to n-2k by n-k;

In like manner, if judgment result is that of step 406 is that the value that changes n switches to n+k by n; If the judged result of step 406 is still yes next time, the value that changes n is switched to n+2k by n+k.

In sum, the method for processing video frequency that the present embodiment four provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting the value of n for changing, the susceptibility while making terminal can regulate adaptively judgement shake, reaches better determine effect and eliminates shake effect.

Embodiment five to embodiment 12 is apparatus of the present invention embodiment, can be for carrying out the inventive method embodiment.Ins and outs for not disclosing in apparatus of the present invention embodiment, please refer to the inventive method embodiment.

Embodiment five

Please refer to Figure 10, it shows the block diagram of the terminal that embodiment five provides, and this terminal can comprise video acquisition unit 510, locus acquiring unit 520 and video processing unit 530.

Described video acquisition unit 510 is for gathering respectively the i two field picture of video source and next associated frame image of i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and n is more than or equal to 1 integer;

Described locus acquiring unit 520 is for obtaining respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame;

When described video processing unit 530 is greater than threshold value for the difference when between the corresponding locus of described current time and described next corresponding locus of the moment, next associated frame image of described i frame is replaced with predetermined image.

In sum, the terminal that the present embodiment five provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i two field picture is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.

Embodiment six

Please refer to Figure 11, it shows the block diagram of the terminal that embodiment six provides, and this terminal can comprise video acquisition unit 510, locus acquiring unit 520 and video processing unit 530.

Described video acquisition unit 510 is for gathering respectively the i two field picture of video source and next associated frame image of i frame; Wherein, next associated frame image of described i two field picture and i frame is adjacent image, and also next associated frame image of i frame is i+1 two field picture.

Described locus acquiring unit 520 is for obtaining respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of described i+1 two field picture; Preferably, described locus acquiring unit 520 can comprise that sensor gathers subelement 522 and fusion calculation subelement 524.Wherein, described sensor gathers subelement 522 for obtaining respectively the acceleration transducer of terminal and magnetic induction sensor in current time and next data that constantly gather; Described fusion calculation subelement 524, for utilizing sensor fusion algorithm to calculate respectively described current time and next data that constantly gather, obtains respectively described terminal in described current time and next locus constantly.

When described video processing unit 530 is greater than threshold value for the difference when between the corresponding locus of described current time and described next corresponding locus of the moment, next associated frame image of described i frame is replaced with predetermined image, wherein, described predetermined image is described i two field picture.

In sum, the terminal that the present embodiment six provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting next associated frame image of i two field picture and i frame, be adjacent image, also get less n value, can occur under the scene of slighter shake in terminal, obtain the effect of good elimination shake.In addition, by setting predetermined image, be i two field picture, can be when there is shake in mobile phone, replace the image that shake is larger, retain the less image of shake, mobile phone is occurred in the process of shake, produce and still have the video changing, and only there is extremely slight shake in this video.

Embodiment seven

Please refer to Figure 12, it shows the block diagram of the terminal that embodiment seven provides, and this terminal can comprise video acquisition unit 510, locus acquiring unit 520 and video processing unit 530.

Described video acquisition unit 510 is for gathering respectively the i two field picture of video source and next associated frame image of i frame, and wherein, next associated frame image of described i frame is i+2 two field picture.

Described locus acquiring unit 520 is for obtaining respectively terminal in current time and next locus constantly, and wherein, described current time is for gathering the moment of i two field picture, described next constantly for gathering the moment of i+2 two field picture; Preferably, described locus acquiring unit 520 can comprise that sensor gathers subelement 522, angle calculation subelement 526 and compensation and revises subelement 528.Wherein, described sensor gathers subelement 522 for obtaining respectively the acceleration transducer of terminal and magnetic induction sensor in current time and next data that constantly gather; Described angle calculation subelement 526, for utilizing sensor fusion algorithm to calculate respectively described current time and next data that constantly gather, obtains respectively described terminal in described current time and next initial space position constantly; Described compensation correction subelement 528 is for utilizing the data of the gyro sensor collection that is arranged on described terminal to revise and obtain described current time and next locus constantly described current time and next initial space position constantly.

When described video processing unit 530 is greater than threshold value for the difference when between the corresponding locus of described current time and described next corresponding locus of the moment, next associated frame image of described i frame is replaced with predetermined image, wherein, predetermined image is next associated frame image image that a nearest frame is not replaced before of described i frame.

In sum, the terminal that the present embodiment seven provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting next associated frame image of i frame, be i+2 two field picture, can reach the similar effect of the threshold value that diminishes, the susceptibility while having made to reduce judgement shake.In addition, by setting next associated frame image image that a nearest frame is not replaced before that predetermined image is i frame, can, when shake occurs mobile phone, replace the image of all shakes, mobile phone is occurred in the process of shake, and it is level and smooth that the video of generation keeps.

Embodiment eight

Please refer to Figure 13, it shows the block diagram of the terminal that embodiment eight provides, and this terminal can comprise video acquisition unit 510, locus acquiring unit 520, video processing unit 530, first processes judgment sub-unit 540 and subelement 550 is switched at the first interval.

Described video acquisition unit 510 is for gathering respectively the i two field picture of video source and next associated frame image of i frame, wherein, next associated frame image of described i frame is the n two field picture after described i frame, described n is more than or equal to 1 integer, the initial value of n is the first predetermined value, and can switch between the first predetermined value and the second predetermined value, described the first predetermined value is greater than described the second predetermined value, described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1;

Described locus acquiring unit 520 is for obtaining respectively terminal in current time and next locus constantly, wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame;

Described first processes judgment sub-unit 540 for judging whether the continuous N two field picture of nearest processing is the image being replaced, and M is more than or equal to 1 integer;

Subelement 550 is switched at described the first interval, if process judgment result is that of judgment sub-unit for described first, be, the value that changes described n switches to the second predetermined value by the first predetermined value, described the first predetermined value is greater than described the second predetermined value, and described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1.

In sum, the terminal that the present embodiment eight provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting the value of n for changing, the susceptibility while making terminal can regulate adaptively judgement shake, reaches better determine effect and eliminates shake effect.

Embodiment nine

Please refer to Figure 14, it shows the block diagram of the terminal that embodiment nine provides, and this terminal can comprise video acquisition unit 510, locus acquiring unit 520, video processing unit 530, second processes judgment sub-unit 560 and subelement 570 is switched at the second interval.

Described video acquisition unit 510, for gathering respectively the i two field picture of video source and next associated frame image of i frame, wherein, gathers respectively the i two field picture of video source and next associated frame image of i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, described n is more than or equal to 1 integer, the initial value of n is the first predetermined value, and can between the first predetermined value and the 3rd predetermined value, switch, the first predetermined value is less than the 3rd predetermined value, and the first predetermined value and the 3rd predetermined value are the integer that is more than or equal to 1;

Described second processes judgment sub-unit 560, for judging whether the N continuous two field picture of nearest processing is the image not being replaced, and N is more than or equal to 1 integer;

Subelement 570 is switched at described the second interval, if process judgment result is that of judgment sub-unit for described second, be, the value that changes described n switches to the 3rd predetermined value by the first predetermined value, described the first predetermined value is less than described the 3rd predetermined value, and described the first predetermined value and described the 3rd predetermined value are the integer that is more than or equal to 1.

In sum, the terminal that the present embodiment nine provides, by judging whether the difference of terminal between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, thereby when Video processing, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, has improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.Meanwhile, by setting the value of n for changing, the susceptibility while making terminal can regulate adaptively judgement shake, reaches better determine effect and eliminates shake effect.

Embodiment ten

Please refer to Figure 15, it shows the structure of the terminal that the embodiment of the present invention ten provides, the terminal that the embodiment of the present invention ten provides can be for implementing the method for the embodiment of the present invention one to four realization, for convenience of explanation, only show the part relevant to the embodiment of the present invention, concrete ins and outs do not disclose, and please refer to the embodiment of the present invention one to four.

This terminal can be for comprising mobile phone, panel computer, electronic reader, PDA(Personal Digital Assistant, personal digital assistant), POS(Point of Sales, point-of-sale terminal), the terminal device such as vehicle-mounted computer.The present embodiment take terminal as mobile phone be example, shown in Figure 15 is the block diagram of the part-structure of the mobile phone 600 that the terminal that provides to the embodiment of the present invention is relevant.With reference to Figure 15, mobile phone 600 comprises RF(Radio Frequency, radio frequency) parts such as circuit 610, storer 620, input block 630, display unit 640, sensor 650, voicefrequency circuit 660, WiFi (wireless fidelity, Wireless Fidelity) module 670, processor 680, power supply 682, camera 690.It will be understood by those skilled in the art that the handset structure shown in Figure 15 does not form the restriction to mobile phone, can comprise the parts more more or less than diagram, or combine some parts, or different parts are arranged.

Below in conjunction with Figure 15, each component parts of mobile phone 600 is carried out to concrete introduction:

RF circuit 610 can be used for receiving and sending messages or communication process in, the reception of signal and transmission, especially, after the downlink information of base station is received, process to processor 680; In addition, the up data of design are sent to base station.Conventionally, RF circuit includes but not limited to antenna, at least one amplifier, transceiver, coupling mechanism, LNA(Low Noise Amplifier, low noise amplifier), diplexer etc.In addition, RF circuit 610 can also be by radio communication and network and other devices communicatings.Described radio communication can be used arbitrary communication standard or agreement, include but not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (GeneralPacket Radio Service, general packet radio service), CDMA (Code Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access (WCDMA)), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short Messaging Service, Short Message Service) etc.

Storer 620 can be used for storing software program and module, and processor 680 is stored in software program and the module of storer 620 by operation, thereby carries out various function application and the data processing of mobile phone 600.Storer 620 can mainly comprise storage program district and storage data field, wherein, and the application program (such as sound-playing function, image player function etc.) that storage program district can storage operation system, at least one function is required etc.; The data (such as voice data, phone directory etc.) that create according to the use of mobile phone 600 etc. can be stored in storage data field.In addition, storer 620 can comprise high-speed random access memory, can also comprise nonvolatile memory, for example at least one disk memory, flush memory device or other volatile solid-state parts.

Input block 630 can be used for receiving numeral or the character information of input, and generation arranges with the user of mobile phone 600 and function is controlled relevant key signals input.Particularly, input block 630 can comprise contact panel 631 and other input equipments 632.Contact panel 631, also referred to as touch-screen, can collect user or near touch operation (using any applicable object or near the operations of annex on contact panel 631 or contact panel 631 such as finger, stylus such as user) thereon, and drive corresponding coupling arrangement according to predefined formula.Optionally, contact panel 631 can comprise touch detecting apparatus and two parts of touch controller.Wherein, touch detecting apparatus detects user's touch orientation, and detects the signal that touch operation is brought, and sends signal to touch controller; Touch controller receives touch information from touch detecting apparatus, and converts it to contact coordinate, then gives processor 680, and the order that energy receiving processor 680 is sent is also carried out.In addition, can adopt the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave to realize contact panel 631.Except contact panel 631, input block 630 can also comprise other input equipments 632.Particularly, other input equipments 632 can include but not limited to one or more in physical keyboard, function key (controlling button, switch key etc. such as volume), trace ball, mouse, control lever etc.

Display unit 640 can be used for showing the information inputted by user or the various menus of the information that offers user and mobile phone 600.Display unit 640 can comprise display panel 641, optionally, can adopt the forms such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) to configure display panel 641.Further, contact panel 631 can cover display panel 641, when contact panel 631 detect thereon or near touch operation after, send processor 680 to determine the type of touch event, corresponding vision output is provided according to the type of touch event with preprocessor 680 on display panel 641.Although in Figure 15, contact panel 631 and display panel 641 be as two independently parts realize input and the input function of mobile phone 600, but in certain embodiments, can contact panel 631 and display panel 641 is integrated and realize the input and output function of mobile phone 600.

Mobile phone 600 also can comprise at least one sensor 650, such as gyro sensor, magnetic induction sensor, optical sensor, motion sensor and other sensors.Particularly, optical sensor can comprise ambient light sensor and proximity transducer, and wherein, ambient light sensor can regulate according to the light and shade of ambient light the brightness of display panel 641, proximity transducer can, when mobile phone 600 moves in one's ear, cut out display panel 641 and/or backlight.A kind of as motion sensor; acceleration transducer can detect the size of the acceleration that (is generally three axles) in all directions; when static, can detect size and the direction of gravity, can be used for identifying application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as passometer, knock) of mobile phone attitude etc.; As for mobile phone 600 other sensors such as configurable barometer, hygrometer, thermometer, infrared ray sensor also, do not repeat them here.

Voicefrequency circuit 660, loudspeaker 661, microphone 662 can provide the audio interface between user and mobile phone 600.Voicefrequency circuit 660 can be transferred to loudspeaker 661 by the electric signal after the voice data conversion receiving, and is converted to voice signal exports by loudspeaker 661; On the other hand, microphone 662 is converted to electric signal by the voice signal of collection, after being received by voicefrequency circuit 660, be converted to voice data, after again voice data output processor 680 being processed, through RF circuit 610, to send to such as another mobile phone, or export voice data to storer 620 to further process.

WiFi belongs to short range wireless transmission technology, mobile phone 600 by WiFi module 670 can help that user sends and receive e-mail, browsing page and access streaming video etc., it provides wireless broadband internet access for user.Although Figure 15 shows WiFi module 670, be understandable that, it does not belong to must forming of mobile phone 600, completely can be as required in not changing the essential scope of invention and omit.

Processor 680 is control centers of mobile phone 600, utilize the various piece of various interface and the whole mobile phone of connection, by moving or carry out software program and/or the module being stored in storer 620, and call the data that are stored in storer 620, carry out various functions and the deal with data of mobile phone 600, thereby mobile phone is carried out to integral monitoring.Optionally, processor 680 can comprise one or more processing units; Preferably, processor 680 can integrated application processor and modem processor, and wherein, application processor is mainly processed operating system, user interface and application program etc., and modem processor is mainly processed radio communication.Be understandable that, above-mentioned modem processor also can not be integrated in processor 680.

Mobile phone 600 also comprises that the power supply 682(powering to all parts is such as battery), preferably, power supply can be connected with processor 682 logics by power-supply management system, thereby realizes the functions such as management charging, electric discharge and power managed by power-supply management system.

Camera 690 is generally comprised of camera lens, imageing sensor, interface, digital signal processor, CPU, display screen etc.Wherein, camera lens is fixed on the top of imageing sensor, can change focusing by manual adjustments camera lens; Imageing sensor is equivalent to traditional camera " film ", is the heart of camera collection image; Interface, for utilizing winding displacement, board to board connector, spring connected mode to be connected with cell phone mainboard camera, sends to described storer 620 by the image of collection; Digital signal processor is processed the image gathering by mathematical operation, and the analog image of collection is converted to digital picture and sends to storer 620 by interface.

Although not shown, mobile phone 600 can also comprise bluetooth module etc., does not repeat them here.

In embodiments of the present invention, included storer 620, sensor 650 processors 680, the camera 690 of this terminal also has following functions:

Described camera 690, also for gathering respectively next associated frame image of i two field picture and i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and described n is more than or equal to 1 integer, and the image obtaining is sent to described storer 620.

Described sensor 650 is for obtaining respectively terminal in described current time and the data in described next moment, and send to described processor 680, by described processor 680, according to algorithm, calculate described terminal in described current time and the locus in described next moment, further alternative, described processor 680 can send to described storer 620 by described current time and the locus in described next moment.Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame.

Described processor 680, also for calculating the difference between described current time and the locus in described next moment, or for transferring described current time and the locus in described next moment of described storer 620 preservations and calculating the difference between the two, and call default threshold value in described storer 620.When the difference between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, described processor is transferred next associated frame image and predetermined image of the described i frame of preserving in described storer 620, next associated frame image of i frame is replaced with predetermined image, described predetermined image is described i two field picture, or, the image that before next associated frame image that described predetermined image is described i frame, a nearest frame is not replaced.

In the embodiment of the present invention, by camera 690, gather next associated frame image of i two field picture and i frame, wherein, next associated frame image of i frame is the n two field picture after i frame, and n is more than or equal to 1 integer, and the image obtaining is sent to described storer 620, the heat transfer agent computing terminal that processor 680 obtains according to sensor 650 is in current time and next locus constantly, wherein, current time is for gathering the moment of i two field picture, next is constantly for gathering the moment of next associated frame image of i frame, then processor 680 calls the i two field picture of preservation in storer 620 and next associated frame image of i frame, and processor 680 calls threshold value default in storer 620 simultaneously, thereby carry out when the difference between the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, next associated frame image of i frame is replaced with predetermined image, predetermined image is i two field picture, or, predetermined image is next associated frame image image that a nearest frame is not replaced before of i frame.

In the embodiment of the present invention, provide a kind of storer 620 that comprises, sensor 650, processor 680, the terminal of camera 690 grades, by camera 690, gather next associated frame image of i two field picture and i frame, and the image of collection is sent to storer 620, the heat transfer agent computing terminal that processor 680 obtains according to sensor 650 is in current time and next locus constantly, processor 680 calculates the difference of described current time and next locus constantly, and call default threshold value in described storer 620 simultaneously, when described difference is greater than described threshold value, next associated frame image of i frame is replaced with predetermined image, while having solved terminal generation shake, also there is the problem of shake in the video obtaining, improved user's picture experience sense, reached terminal and can obtain the effect of stable video when there is shake.

Embodiment 11

Please refer to Figure 16, it shows the structure of the terminal that the embodiment of the present invention 11 provides, the terminal that the embodiment of the present invention 11 provides can be for implementing the method for the embodiment of the present invention one to four realization, for convenience of explanation, only show the part relevant to the embodiment of the present invention, concrete ins and outs do not disclose, and please refer to the embodiment of the present invention one to four.

Particularly, shown in Figure 16, be the block diagram of the part-structure of the mobile phone 700 that the terminal that provides to the embodiment of the present invention is relevant.On the basis of the structure shown in Figure 16, in the embodiment of the present invention, use processor 71 to replace the processor 680 shown in Figure 15.

This processor 71 is also for obtaining respectively acceleration transducer that the sensor 650 of terminal comprises and magnetic induction sensor in current time and next data that constantly gather, utilize sensor fusion algorithm to calculate respectively current time and next data that constantly gather, obtain respectively terminal in current time and next locus constantly.

Further, this processor 71 is also for calling the default threshold value of storer 620, when the difference of the unspecified angle in position angle, the angle of pitch and roll angle in the corresponding locus of current time and next corresponding locus of the moment is greater than threshold value, call next associated frame image and predetermined image of the i frame of camera 690 transmissions that receive in storer 620, next associated frame image of i frame is replaced with predetermined image, and the present embodiment supposes that described predetermined image is i two field picture.

Further, this processor 71 is also for judging whether the continuous N two field picture of nearest processing is the image being replaced, and M is more than or equal to 1 integer; If so, the value that changes n switches to the second predetermined value by the first predetermined value, and the first predetermined value is greater than the second predetermined value, and the first predetermined value and the second predetermined value are the integer that is more than or equal to 1.

In embodiments of the present invention, this processor 71 can call the i two field picture preserved in storer and next associated frame image of i frame, thereby judgement is after processing next associated frame image of i frame, whether the continuous N two field picture of processing is recently the image being replaced, and M is more than or equal to 1 integer; If so, the value that changes n switches to the second predetermined value by the first predetermined value, and the first predetermined value is greater than the second predetermined value, and the first predetermined value and the second predetermined value are the integer that is more than or equal to 1.Realized by setting the value of n for changing, the susceptibility while making terminal can regulate adaptively judgement shake, reaches better determine effect and eliminates shake effect.

Embodiment 12

Please refer to Figure 17, it shows the structure of the terminal that the embodiment of the present invention 12 provides, the terminal that the embodiment of the present invention 12 provides can be for implementing the method for the embodiment of the present invention one to four realization, for convenience of explanation, only show the part relevant to the embodiment of the present invention, concrete ins and outs do not disclose, and please refer to the embodiment of the present invention one to four.

Particularly, shown in Figure 17, be the block diagram of the part-structure of the mobile phone 800 that the terminal that provides to the embodiment of the present invention is relevant.On the basis of the structure shown in Figure 17, in the embodiment of the present invention, use processor 81 to replace the processor 680 shown in Figure 15.

This processor 81 is also for obtaining respectively acceleration transducer that the sensor 650 of terminal comprises and magnetic induction sensor at current time and next sensing data constantly gathering; Utilize sensor fusion algorithm to calculate respectively current time and next data that constantly gather, obtain respectively terminal in current time and next initial space position constantly; Then utilize the data be arranged on the gyro sensor collection that the sensor 650 in terminal comprises to revise and obtain current time and the locus in next moment current time and next initial space position constantly.

Further, this processor 81 is also for judging whether the N continuous two field picture of nearest processing is the image not being replaced, and N is more than or equal to 1 integer; If so, the value that changes n switches to the 3rd predetermined value by the first predetermined value, and the first predetermined value is less than the 3rd predetermined value, and the first predetermined value and the 3rd predetermined value are the integer that is more than or equal to 1.

In embodiments of the present invention, this processor 81 can call the i two field picture preserved in storer and next associated frame image of i frame, thereby judgement is after processing next associated frame image of i frame, whether the N continuous two field picture of processing is recently the image not being replaced, and N is more than or equal to 1 integer; If so, the value that changes n switches to the 3rd predetermined value by the first predetermined value, and the first predetermined value is less than the 3rd predetermined value, and the first predetermined value and the 3rd predetermined value are the integer that is more than or equal to 1.Realized by setting the value of n for changing, the susceptibility while making terminal can regulate adaptively judgement shake, reaches better determine effect and eliminates shake effect.

It should be noted that: the terminal that above-described embodiment five to embodiment 12 provides is when carrying out Video processing, only the division with above-mentioned each functional unit is illustrated, in practical application, can above-mentioned functions be distributed and by different functional units, completed as required, the inner structure that is about to terminal is divided into different functional units, to complete all or part of function described above.In addition, the terminal that above-described embodiment provides and method for processing video frequency belong to same design, and its specific implementation process refers to embodiment of the method, repeats no more here.

The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.

One of ordinary skill in the art will appreciate that all or part of step that realizes above-described embodiment can complete by hardware, also can come the hardware that instruction is relevant to complete by program, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium of mentioning can be ROM (read-only memory), disk or CD etc.

The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.

Claims

1. a method for processing video frequency, is characterized in that, described method comprises:

Gather respectively the i two field picture of video source and next associated frame image of i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and described n is more than or equal to 1 integer;

Obtain respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame;

When the difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, next associated frame image of described i frame is replaced with predetermined image.

2. method for processing video frequency according to claim 1, is characterized in that, described predetermined image is described i two field picture;

Or, the image that before next associated frame image that described predetermined image is described i frame, a nearest frame is not replaced.

3. method for processing video frequency according to claim 1 and 2, is characterized in that, described locus comprises at least one in position angle, the angle of pitch and the roll angle of described terminal;

When described difference between the corresponding locus of described current time and described next corresponding locus of the moment is greater than threshold value, next associated frame image of described i frame is replaced with predetermined image, being comprised:

When in position angle, the angle of pitch and roll angle in the corresponding locus of described current time and described next corresponding locus of the moment, the difference of unspecified angle is greater than threshold value, next associated frame image of described i frame is replaced with predetermined image.

4. according to the method for processing video frequency described in any one in claims 1 to 3, it is characterized in that, described method, also comprises:

Whether the continuous N two field picture that judgement is processed is recently the image being replaced, and M is more than or equal to 1 integer;

If so, the value that changes described n switches to the second predetermined value by the first predetermined value, and described the first predetermined value is greater than described the second predetermined value, and described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1.

5. according to the method for processing video frequency described in any one in claim 1 to 4, it is characterized in that, described method, also comprises:

Whether the N continuous two field picture that judgement is processed is recently the image not being replaced, and N is more than or equal to 1 integer;

If so, the value that changes described n switches to the 3rd predetermined value by the first predetermined value, and described the first predetermined value is less than described the 3rd predetermined value, and described the first predetermined value and described the 3rd predetermined value are the integer that is more than or equal to 1.

6. according to the method for processing video frequency described in any one in claim 1 to 5, it is characterized in that, the described terminal of obtaining respectively, in current time and next locus constantly, specifically comprises:

Obtain respectively the acceleration transducer of terminal and magnetic induction sensor in described current time and described next data that constantly gather;

Utilize sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtain respectively described terminal in described current time and the locus in described next moment.

7. according to the method for processing video frequency described in any one in claim 1 to 5, it is characterized in that, the described terminal of obtaining respectively, in current time and next locus constantly, specifically comprises:

Utilize sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtain respectively described terminal in described current time and the initial space position in described next moment;

The data that utilization is arranged on the gyro sensor collection in described terminal are revised and are obtained described current time and the locus in described next moment described current time and described next initial space position constantly.

8. a terminal, is characterized in that, described terminal comprises:

Video acquisition unit, for gathering respectively the i two field picture of video source and next associated frame image of described i frame; Wherein, next associated frame image of described i frame is the n two field picture after described i frame, and described n is more than or equal to 1 integer;

Locus acquiring unit, for obtaining respectively terminal in current time and next locus constantly; Wherein, described current time is for gathering the moment of described i two field picture, described next constantly for gathering the moment of next associated frame image of described i frame;

Video processing unit, while being greater than threshold value for the difference when between the corresponding locus of described current time and described next corresponding locus of the moment, replaces next associated frame image of described i two field picture with predetermined image.

9. terminal according to claim 8, is characterized in that, described predetermined image is described i two field picture;

10. terminal according to claim 8 or claim 9, is characterized in that, the locus obtaining in the acquiring unit of described locus comprises at least one in position angle, the angle of pitch and the roll angle of described terminal;

Described video processing unit specifically for:

Terminal in 11. according to Claim 8 to 10 described in any one, is characterized in that, described terminal also comprises: first processes judgment sub-unit and the first interval switching subelement;

Described first processes judgment sub-unit, for judging whether the continuous N two field picture of nearest processing is the image being replaced, and M is more than or equal to 1 integer;

Subelement is switched at described the first interval, if process judgment result is that of judgment sub-unit for described first, be, the value that changes described n switches to the second predetermined value by the first predetermined value, described the first predetermined value is greater than described the second predetermined value, and described the first predetermined value and described the second predetermined value are the integer that is more than or equal to 1.

Terminal in 12. according to Claim 8-11 described in any one, is characterized in that, described terminal also comprises: second processes judgment sub-unit and the second interval switching subelement;

Described second processes judgment sub-unit, for judging whether the N continuous two field picture of nearest processing is the image not being replaced, and N is more than or equal to 1 integer;

Subelement is switched at described the second interval, if process judgment result is that of judgment sub-unit for described second, be, the value that changes described n switches to the 3rd predetermined value by the first predetermined value, described the first predetermined value is less than described the 3rd predetermined value, and described the first predetermined value and described the 3rd predetermined value are the integer that is more than or equal to 1.

Terminal in 13. according to Claim 8 to 12 described in any one, is characterized in that, described locus acquiring unit specifically comprises:

Sensor gathers subelement and fusion calculation subelement;

Described sensor gathers subelement, for obtaining respectively the acceleration transducer of terminal and magnetic induction sensor in described current time and described next data that constantly gather;

Described fusion calculation subelement, for utilizing sensor fusion algorithm to calculate respectively described current time and described next data that constantly gather, obtains respectively described terminal in described current time and next locus constantly.

Terminal in 14. according to Claim 8 to 12 described in any one, is characterized in that, described locus acquiring unit specifically comprises:

Sensor gathers subelement, angle calculation subelement and compensation and revises subelement;

Described sensor gathers subelement, for obtaining respectively the acceleration transducer of terminal and magnetic induction sensor in current time and next data that constantly gather;

Described angle calculation subelement, for utilizing sensor fusion algorithm to calculate respectively described current time and next data that constantly gather, obtains respectively described terminal in described current time and next initial space position constantly;

Described compensation correction subelement, for utilizing the data of the gyro sensor collection that is arranged on described terminal to revise and obtain described current time and next locus constantly described current time and next initial space position constantly.

15. 1 kinds of terminals, is characterized in that, described terminal comprises camera, sensor, storer and processor;

Described camera, for gathering the i two field picture of video source and next the associated frame image of i frame as described in as arbitrary in claim 1 to 7, and is sent to described storer by the image collecting;

Described processor, for obtaining respectively terminal as described in as arbitrary in claim 1 to 7 according to the data of described sensor collection in current time and next locus constantly, and is sent to described storer by the locus obtaining;

Described processor, be used for calling the i two field picture of described storer, next associated frame image of i frame and current time and next locus constantly, and when carrying out the described difference when between the corresponding locus of current time and next corresponding locus of the moment as arbitrary in claim 1 to 7 and being greater than threshold value, next associated frame image of i frame is replaced with predetermined image.