CN105049706A - Image processing method and terminal - Google Patents
Image processing method and terminal Download PDFInfo
- Publication number
- CN105049706A CN105049706A CN201510365946.2A CN201510365946A CN105049706A CN 105049706 A CN105049706 A CN 105049706A CN 201510365946 A CN201510365946 A CN 201510365946A CN 105049706 A CN105049706 A CN 105049706A
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- play amount
- current block
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The embodiment of the present invention discloses an image processing method and a terminal, wherein the method comprises the steps of using a first camera to acquire a first image comprising a target object, at the same time, using a second camera to acquire a second image comprising the target object, wherein the first image is a positive rolling photoreceptive image of the target object, the second image is an inverted rolling photoreceptive image of the target object, and the first and second images are center symmetric images; rotating the second image 180 degrees to obtain a third image; comparing the first and third images to obtain the offset amount between the first and third images; carrying out the geometric correction on the first image according to the offset amount to obtain a final image of the target object. Therefore, by implementing the embodiment of the present invention, the distortion amount in the images can be removed.
Description
Technical field
The present invention relates to shooting technology field, be specifically related to a kind of image processing method and terminal.
Background technology
At present, camera shooting personage, landscape usually can be set in the terminal equipment such as smart mobile phone, panel computer.In actual applications, the camera many employings belt-type shutter arranged in these terminals, adopts the mode exposed line by line to take.And find in practice, when needs shooting moving object, exposure causes the picture taking moving object to there is the amount of distortion such as dislocation, inclination line by line.
Summary of the invention
Embodiments provide a kind of image processing method and terminal, the amount of distortion in image can be removed.
A kind of image processing method that the embodiment of the present invention provides, comprising:
The first image of object is comprised by the first camera collection, comprised the second image of described object by second camera collection simultaneously, described first image is the upright roller shutter type bearing member, image of described object, described second image is the roller shutter type bearing member, image that described object stands upside down, and symmetric graph picture centered by described first image and described second image;
By described second image rotation, 180 degree of acquisitions the 3rd image;
More described first image and described 3rd image, obtain the side-play amount between described first image and described 3rd image;
According to described side-play amount, geometric correction is carried out to described first image, obtain the final image of described object;
Described first camera and described second camera are the camera be arranged in parallel.
The embodiment of the present invention additionally provides a kind of terminal, comprising:
Collecting unit, for being comprised the first image of object by the first camera collection, comprised the second image of described object by second camera collection simultaneously, described first image is the upright roller shutter type bearing member, image of described object, described second image is the roller shutter type bearing member, image that described object stands upside down, and symmetric graph picture centered by described first image and described second image;
Rotary unit, for described second image rotation, 180 degree of acquisitions the 3rd image gathered by described collecting unit;
Comparing unit, the 3rd image that described first image gathered for more described collecting unit and described rotary unit obtain, obtains the side-play amount between described first image and described 3rd image;
Correcting unit, carries out geometric correction for the side-play amount obtained according to described comparing unit to described first image, obtains the final image of described object;
Described first camera and described second camera are the camera be arranged in parallel.
The embodiment of the present invention can gather the first image and the second image by the first camera and second camera simultaneously respectively, wherein, first image is the upright roller shutter type bearing member, image of object, second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image, can by the second image rotation 180 degree of acquisitions the 3rd image, relatively the first image and the 3rd image, obtain the side-play amount between the first image and the 3rd image, according to this side-play amount, geometric correction is carried out to the first image, obtain the final image of described object.Visible, the final image that the embodiment of the present invention obtains is the image of the first image after geometric correction, thus can remove the amount of distortion in the first image.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, be briefly described to the accompanying drawing used required in embodiment below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of a kind of image processing method that the embodiment of the present invention provides;
Fig. 2 is the schematic flow sheet of the another kind of image processing method that the embodiment of the present invention provides;
Fig. 3 a-Fig. 3 d is the schematic diagram of the first image disclosed in the embodiment of the present invention, the second image, the 3rd image and the final image through image procossing respectively;
Fig. 4 is the structural representation of a kind of terminal that the embodiment of the present invention provides;
Fig. 5 is the structural representation of the another kind of terminal that the embodiment of the present invention provides;
Fig. 6 is the structural representation of another terminal that the embodiment of the present invention provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The embodiment of the invention discloses a kind of image processing method and terminal, the amount of distortion in image can be removed.Below be described in detail respectively.
Refer to Fig. 1, Fig. 1 is the schematic flow sheet of a kind of image processing method disclosed in the embodiment of the present invention.As shown in Figure 1, this image processing method can comprise the following steps.
S101, terminal comprise the first image of object by the first camera collection, are comprised the second image of object by second camera collection simultaneously;
In the embodiment of the present invention, terminal can be mobile phone, panel computer, notebook computer, palmtop PC, mobile internet device, wearable device or other-end etc.
In the embodiment of the present invention, the first image is the upright roller shutter type bearing member, image of object, and the second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image; First camera and second camera are the picture centre symmetry and the camera be arranged in parallel that gather, and such as, the first camera and second camera can be set in parallel on mobile phone respectively.
Common electronic shutter mode has global shutter and belt-type shutter two kinds, global shutter exposes realization at one time by picture in its entirety, namely all pixels of transducer collect light simultaneously, expose simultaneously, when the default time for exposure then, transducer stops collecting light, and exposure image is changed into electronic image.And belt-type shutter exposes realization line by line by control chip, because transducer different piece is different to the susceptibility of light under different time, exposure is until all pixels are all exposed just change into electronic image line by line, visible by belt-type shutter shooting moving object time, because the position at different time moving object place is different, thus cause the electronic image changed into occur amount of distortion, due to mobile phone, panel computer equal-volume requires that terminal is not suitable for adopting the global shutter of circuit complexity easily, basic for adopting the photosensitive shutter of roller shutter type, and the embodiment of the present invention can remove the amount of distortion in the electronic image of the photosensitive shutter shooting of roller shutter type by step S101 to S104.
S102, terminal are by the second image rotation 180 degree of acquisitions the 3rd image;
S103, terminal compare the first image and the 3rd image, obtain the side-play amount between the first image and the 3rd image;
S104, terminal carry out geometric correction according to side-play amount to the first image, obtain the final image of object.
In the embodiment of the present invention, terminal carries out geometric correction according to side-play amount to the first image, obtains the final image of object, can be specially and carry out coordinate transform according to the half of side-play amount to the first image, obtains the final image of object.
As the optional execution mode of one, terminal compares the first image and the 3rd image, obtains the side-play amount between the first image and the 3rd image, can specifically comprise the following steps:
11) the first image is divided at least one current block of non-overlapping copies by terminal;
12) terminal pins is to each current block, obtains image block the most similar to current block in the 3rd image as its match block;
13) terminal pins is to each current block, obtains the relative displacement between current block and match block;
14) terminal by current block, match block and the relative displacement corresponding stored between current block and match block in presetting database, as the side-play amount between the first image and the 3rd image.
Correspondingly, terminal carries out geometric correction according to side-play amount to the first image, and obtain the final image of object, can be specially for each current block, the half according to relative displacement carries out coordinate transform to current block, obtains the final image of object.
As the optional execution mode of another kind, terminal compares the first image and the 3rd image, obtains the side-play amount between the first image and the 3rd image, can specifically comprise the following steps:
21) terminal registration first image and the 3rd image, obtains the feature point pairs of coupling;
22) terminal obtains the relative displacement of the space coordinates of feature point pairs;
23) terminal by the relative displacement corresponding stored of the space coordinates of feature point pairs and feature point pairs in presetting database, as the side-play amount between the first image and the 3rd image;
Correspondingly, terminal is according to step 23) side-play amount that obtains carries out geometric correction to the first image, obtain the final image of object, can be specially, according to the half of relative displacement, coordinate transform be carried out to the characteristic point of the first image in feature point pairs, obtain the final image of object.
In the embodiment of the present invention, step 21) algorithm of terminal registration first image and the 3rd image can have multiple, such as consistency point shift algorithm and optical flow method etc., wherein, consistency point shift algorithm is a kind of Point set matching algorithm based on gauss hybrid models of robust, this algorithm is applicable to the Multidimensional Point Set registration problems under cylinder body and non-rigid conversion, for noise, the impact going out lattice point and missing point has stronger robustness, the locus distribution of point set adopts gauss hybrid models to express, the coupling of two point sets is considered as a maximum a posteriori probability problem.
Wherein, consistency point shift algorithm is specially use characteristic point and detects feature point pairs collection in the first image, the 3rd image, the geometric maps relation concentrated according to feature point pairs can calculate the side-play amount between feature point pairs, by the relative displacement corresponding stored of the space coordinates of feature point pairs and feature point pairs in presetting database, as the side-play amount between the first image and the 3rd image, thus geometric correction is carried out to the first image, obtain final image.Optical flow method is the important method of current movement image analysis, when object is when moving, the luminance patterns of its corresponding points on image is also in motion, the apparent motion of this image brightness pattern is exactly light stream, light stream have expressed the change of image, owing to containing the information of object of which movement, the motion conditions of object therefore can be determined thus.
In the method described by Fig. 1, terminal comprises the first image of object by the first camera collection, comprised the second image of object by second camera collection simultaneously, first image is the upright roller shutter type bearing member, image of object, second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image; By the second image rotation 180 degree of acquisitions the 3rd image; Relatively the first image and the 3rd image, obtain the side-play amount between the first image and three images; According to side-play amount, geometric correction is carried out to the first image, obtain the final image of object; First camera and second camera are the camera be arranged in parallel.Visible, the amount of distortion can removed in the first image by geometric correction in the method described by Fig. 1 obtains final image.
Refer to Fig. 2, Fig. 2 is the schematic flow sheet of another kind of image processing method disclosed in the embodiment of the present invention.As shown in Figure 2, this image processing method can comprise the following steps.
Whether the object that S201, terminal detect current shooting by the first camera is kept in motion, if detect, object is kept in motion, then perform step S203 to S206, if detect, object remains static, then perform step S202, and process ends.
In the embodiment of the present invention, terminal can be mobile phone, panel computer, notebook computer, palmtop PC, mobile internet device, wearable device or other-end etc.
S202, terminal are carried out shooting by the first camera to object and are obtained final image.
Wherein, this shooting process is general image processing process, and the embodiment of the present invention does not describe in detail
S203, terminal enable second camera;
In the embodiment of the present invention, the camera whether object for detecting current shooting is in running status can be the first camera or second camera, specifically can be set or User Defined by system default; When detecting that the object of current shooting is kept in motion, second camera or the first camera can be enabled, specifically can be set or User Defined by system default.
S204, terminal comprise the first image of object by the first camera collection, are comprised the second image of object by second camera collection simultaneously;
In the embodiment of the present invention, hypothetical target thing is the alphabetical A of motion, then refer to shown in Fig. 3 a, 3b, the schematic diagram of the first image that Fig. 3 a provides for the embodiment of the present invention, the schematic diagram of the second image that Fig. 3 b provides for the embodiment of the present invention.
S205, terminal are by the second image rotation 180 degree of acquisitions the 3rd image;
Refer to Fig. 3 c, the schematic diagram of the 3rd image that Fig. 3 c provides for the embodiment of the present invention.As seen from the figure, be top to bottm exposing line by line from alphabetical A owing to taking the first image, taking the second image is that by the 3rd image of the second image rotation 180 degree of acquisitions, the order that alphabetical A exposes line by line is from top to bottom from alphabetical A lower to upper exposure.
S206, terminal compare the first image and the 3rd image, obtain the side-play amount between the first image and the 3rd image;
Refer to Fig. 3 a and Fig. 3 c, by step 11 in foregoing invention embodiment) to step 14) or step 21) to 23) side-play amount between the first image and the 3rd image can be obtained.For example, because the time for exposure is different line by line, the degree that each pixel of alphabetical A in the first image is tilted to the right is different from the degree that alphabetical A in the 3rd image is tilted to the right, and by obtaining side-play amount between the two, can carry out geometric correction to the first image.
S207, terminal carry out geometric correction according to side-play amount to the first image, obtain the final image of object.
Terminal carries out geometric correction according to side-play amount to the first image, for example, in Fig. 3 a, the summit of alphabetical A is relative to the apex offset 3mm of A alphabetical in Fig. 3 c, because during shooting, letter A is kept in motion, therefore, by the summit of A alphabetical in the first image to the right offset setting be compromise value 1.5mm, by the position closest to the summit of letter A during transducer first time exposure, same reason, calculate the side-play amount of each pixel in the first image, and compromise correction is carried out to the first image can obtain final image Fig. 3 d, thus the amount of distortion eliminated owing to producing in time for exposure different first image.In actual scene, amount of calculation is more complicated than above-mentioned, therefore can by step 11 in foregoing invention embodiment) to step 14) or step 21) to 23) side-play amount between the first image and the 3rd image can be obtained, adopt the geometric correction in step S205, can final image be obtained.
In the method described by Fig. 2, whether terminal can be kept in motion by the object of the first camera detection current shooting, if, then enable second camera, comprised the first image of object by the first camera collection, comprised the second image of object simultaneously by second camera collection, the first image is the upright roller shutter type bearing member, image of object, second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image; By the second image rotation 180 degree of acquisitions the 3rd image; Relatively the first image and the 3rd image, obtain the side-play amount between the first image and three images; According to side-play amount, geometric correction is carried out to the first image, obtain the final image of object.Visible, the method described by Fig. 2 when shooting moving object being detected, can be opened dual camera to remove the amount of distortion in image, thus can improve the convenience of operation automatically.
Refer to Fig. 4, the structural representation of a kind of terminal that Fig. 4 provides for the embodiment of the present invention.Wherein, the terminal shown in Fig. 4 can comprise: collecting unit 310, rotary unit 320, comparing unit 330 and correcting unit 340.
At present, common electronic shutter mode has global shutter and belt-type shutter two kinds, global shutter exposes realization at one time by picture in its entirety, namely all pixels of transducer collect light simultaneously, expose simultaneously, when the default time for exposure then, transducer stop collect light, exposure image is changed into electronic image.And belt-type shutter exposes realization line by line by control chip, because transducer different piece is different to the susceptibility of light under different time, exposure is until all pixels are all exposed just change into electronic image line by line, visible by belt-type shutter shooting moving object time, because the position at different time moving object place is different, thus cause the electronic image changed into occur amount of distortion, and the embodiment of the present invention can remove the amount of distortion in electronic image by collecting unit 310, rotary unit 320, comparing unit 330 and correcting unit 340.
Collecting unit 310, for being comprised the first image of object by the first camera collection, comprised the second image of object by second camera collection simultaneously, first image is the upright roller shutter type bearing member, image of object, second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image;
Rotary unit 320, for the second image rotation 180 degree of acquisitions the 3rd image gathered by collecting unit 310;
Comparing unit 330, the 3rd image that the first image and rotary unit 320 for comparing collecting unit collection obtain, obtains the side-play amount between the first image and the 3rd image;
Correcting unit 340, carries out geometric correction for the side-play amount obtained according to comparing unit to the first image, obtains the final image of object.
In the embodiment of the present invention, the first camera and second camera are the camera be arranged in parallel.
In the embodiment of the present invention, correcting unit 340 carries out coordinate transform specifically for the half according to side-play amount to the first image, obtains the final image of object.
Please also refer to Fig. 5, the structural representation of the another kind of terminal that Fig. 5 provides for the embodiment of the present invention, wherein, terminal shown in Fig. 5 is that the enterprising one-step optimization in basis of terminal shown in Fig. 4 obtains, compared with the terminal shown in Fig. 4, the terminal shown in Fig. 5 can also comprise detecting unit 350 and enable unit 360.
Detecting unit 350, for comprising the first image of object at collecting unit 310 by the first camera collection, comprised the second image of object by second camera collection before, whether the object being detected current shooting by the first camera is kept in motion simultaneously;
Enable unit 360, for when detecting unit 350 detects that the object of current shooting is kept in motion, enable second camera.
In the embodiment of the present invention, the camera whether object that detecting unit 350 detects current shooting is in running status can be the first camera or second camera, specifically can be set or User Defined by system default; When detecting unit 350 detects that the object of current shooting is kept in motion, can trigger and enable unit 360 and enable second camera or the first camera, specifically can be set or User Defined by system default.
As the optional execution mode of one, in the terminal shown in Fig. 5, comparing unit 330 can specifically comprise with lower unit:
Division unit 331, for being divided at least one current block of non-overlapping copies by the first image;
First acquiring unit 332, for each current block divided for division unit 331, obtains image block the most similar to this current block in the 3rd image as its match block;
Second acquisition unit 333, for for each current block, obtains the relative displacement between current block and match block;
First memory cell 334, for by current block, match block and the relative displacement corresponding stored between current block and match block in presetting database, as the side-play amount between the first image and the 3rd image;
Correspondingly, correcting unit 340 is specifically for for each current block, and the half according to relative displacement carries out coordinate transform to this current block, obtains the final image of object.
As the optional execution mode of another kind, in the terminal shown in Fig. 5, comparing unit 330 can specifically comprise with lower unit:
Registration unit 335, for registration first image and the 3rd image, obtains the feature point pairs of coupling;
3rd acquiring unit 336, for obtaining the relative displacement of the space coordinates of feature point pairs;
Second memory cell 337, for the relative displacement corresponding stored of the space coordinates by feature point pairs and feature point pairs in presetting database, as the side-play amount between the first image and the 3rd image;
Correspondingly, correcting unit 340 carries out coordinate transform specifically for the half according to relative displacement to the characteristic point of the first image in feature point pairs, obtains the final image of object.
It should be noted that, comparing unit 330 can adopt a kind of side-play amount obtained between the first image and the 3rd image in above-mentioned two kinds of execution modes, optionally, comparing unit 330 also can comprise the unit in above-mentioned two kinds of execution modes simultaneously, and the embodiment of the present invention does not limit.
In the embodiment of the present invention, the algorithm of registration unit 335 registration first image and the 3rd image can have multiple, such as consistency point shift algorithm and optical flow method etc., wherein, consistency point shift algorithm is a kind of Point set matching algorithm based on gauss hybrid models of robust, this algorithm is applicable to the Multidimensional Point Set registration problems under cylinder body and non-rigid conversion, for noise, the impact that goes out lattice point and missing point, there is stronger robustness, the locus distribution of point set adopts gauss hybrid models to express, and the coupling of two point sets is considered as a maximum a posteriori probability problem.Consistency point shift algorithm is specially use characteristic point and detects feature point pairs collection in the first image, the 3rd image, 3rd acquiring unit 336 can calculate the side-play amount between feature point pairs according to the geometric maps relation that feature point pairs is concentrated, second memory cell 337 by the relative displacement corresponding stored of the space coordinates of feature point pairs and feature point pairs in presetting database, as the side-play amount between the first image and the 3rd image, by correcting unit 340, geometric correction is carried out to the first image, obtain final image.Optical flow method is the important method of current movement image analysis, when object is when moving, the luminance patterns of its corresponding points on image is also in motion, the apparent motion of this image brightness pattern is exactly light stream, and light stream have expressed the change of image, owing to containing the information of object of which movement, therefore the motion conditions of object can be determined thus, namely determine the relative displacement between pixel, concrete the present invention does not set forth, can with reference to optical flow method pertinent literature.
For example, for Fig. 3 a to Fig. 3 d, detecting unit 350 detects that the object of current shooting is the alphabetical A of motion, can trigger and enable unit 360 and enable the first camera and second camera, shoot the first image shown in Fig. 3 a, 3b, the second image respectively, the image rotation 180 shown in Fig. 3 b is obtained the 3rd image shown in Fig. 3 c by rotary unit 320.As seen from the figure, be top to bottm exposing line by line from alphabetical A owing to taking the first image, taking the second image is exposing from top to bottom from smiling face, and by the 3rd image of the second image rotation 180 degree of acquisitions, the order that alphabetical A exposes line by line is from top to bottom.Comparing unit 330 compares the first image and the 3rd image, obtains the side-play amount between the first image and the 3rd image.Because the time for exposure is different line by line, the degree that each pixel of alphabetical A in the first image is tilted to the right is different from the degree that alphabetical A in the 3rd image is tilted to the right, and by obtaining side-play amount between the two, carries out geometric correction by correcting unit 340 to the first image.For example, in Fig. 3 a, the summit of alphabetical A is relative to the apex offset 3mm of A alphabetical in Fig. 3 c, because during shooting, letter A is kept in motion, therefore, by the summit of A alphabetical in the first image to the right offset setting be compromise value 1.5mm, by the position closest to the summit of letter A during transducer first time exposure, same reason, calculate the side-play amount of each pixel in the first image, and compromise correction is carried out to the first image can obtain final image Fig. 3 d, thus eliminate the amount of distortion owing to producing in time for exposure different first image.
In the terminal described by Fig. 4, Fig. 5, collecting unit can comprise the first image of object by the first camera collection, comprised the second image of object by second camera collection simultaneously, first image is the upright roller shutter type bearing member, image of object, second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image; Rotary unit can by the second image rotation 180 degree of acquisitions the 3rd image; Comparing unit can compare the first image and the 3rd image, obtains the side-play amount between the first image and three images; The side-play amount that correcting unit can obtain according to comparing unit carries out geometric correction to the first image, obtains the final image of object.Visible, the amount of distortion that the terminal described by Fig. 4, Fig. 5 can be removed in the first image by geometric correction obtains final image.Further, in terminal described by Fig. 5, whether detecting unit can be kept in motion by the object of the first camera detection current shooting, if so, then triggering is enabled unit and is enabled second camera, and then the amount of distortion that triggering collection unit, rotary unit, comparing unit and correcting unit are removed in image obtains final image, visible, terminal described by Fig. 5 when shooting moving object being detected, can be opened dual camera, thus improve the convenience of operation automatically.
Refer to Fig. 6, the structural representation of another terminal that Fig. 6 provides for the embodiment of the present invention, as shown in Figure 6, this terminal can comprise at least one processor 401, such as CPU, input unit 402, memory 403, at least one communication bus 404, output device 405.Wherein, communication bus 404 is for realizing the communication connection between these assemblies.Memory 403 can be high-speed RAM memory, also can be non-labile memory (non-volatilememory), such as at least one magnetic disc store.Memory 403 can also be optionally that at least one is positioned at the storage device away from aforementioned processor 401.Wherein, processor 401 can composition graphs 4 and the terminal described by Fig. 5, stores batch processing code in memory 403, and processor 401 calls the program code stored in memory 403, for performing following operation:
The first image of object is comprised by the first camera collection, comprised the second image of object by second camera collection simultaneously, first image is the upright roller shutter type bearing member, image of object, second image is the roller shutter type bearing member, image that object stands upside down, and symmetric graph picture centered by the first image and the second image;
By the second image rotation 180 degree of acquisitions the 3rd image;
Relatively the first image and the 3rd image, obtain the side-play amount between the first image and the 3rd image;
According to side-play amount, geometric correction is carried out to the first image, obtain the final image of object;
Wherein, the first camera and second camera are the camera be arranged in parallel.
In the embodiment of the present invention, processor 401 calls the program code in memory 403, carries out geometric correction according to side-play amount to the first image, obtains the final image of object, can perform following steps:
Half according to described side-play amount carries out coordinate transform to described first image, obtains the final image of described object.
In the embodiment of the present invention, processor 401 calls the program code in memory 403, compares the first image and the 3rd image, obtains the side-play amount between the first image and the 3rd image, can perform following steps:
First image is divided at least one current block of non-overlapping copies;
For each current block, obtain image block the most similar to current block in the 3rd image as its match block;
For each current block, obtain the relative displacement between current block and match block;
By current block, match block and the relative displacement corresponding stored between current block and match block in presetting database, as the side-play amount between the first image and the 3rd image;
Correspondingly, processor 401 calls the program code in memory 403, carries out geometric correction according to side-play amount to the first image, obtains the final image of object, specifically can perform following steps:
For each current block, the half according to relative displacement carries out coordinate transform to current block, obtains the final image of object.
In the embodiment of the present invention, processor 401 calls the program code in memory 403, compares the first image and the 3rd image, obtains the side-play amount between the first image and the 3rd image, comprise and can perform following steps:
Registration first image and the 3rd image, obtain the feature point pairs of coupling;
Obtain the relative displacement of the space coordinates of feature point pairs;
By the relative displacement corresponding stored of the space coordinates of feature point pairs and feature point pairs in presetting database, as the side-play amount between the first image and the 3rd image;
Correspondingly, processor 401 calls the program code in memory 403, carries out geometric correction, obtains the final image of described object, specifically can perform following steps according to described side-play amount to described first image:
Half according to relative displacement carries out coordinate transform to the characteristic point of the first image in feature point pairs, obtains the final image of object.
In the embodiment of the present invention, the algorithm of terminal registration first image and the 3rd image can have multiple, such as consistency point shift algorithm and optical flow method etc., wherein, consistency point shift algorithm is a kind of Point set matching algorithm based on gauss hybrid models of robust, this algorithm is applicable to the Multidimensional Point Set registration problems under cylinder body and non-rigid conversion, for noise, the impact that goes out lattice point and missing point, there is stronger robustness, the locus distribution of point set adopts gauss hybrid models to express, and the coupling of two point sets is considered as a maximum a posteriori probability problem.
Wherein, consistency point shift algorithm is specially use characteristic point and detects feature point pairs collection in the first image, the 3rd image, the geometric maps relation concentrated according to feature point pairs can calculate the side-play amount between feature point pairs, by the relative displacement corresponding stored of the space coordinates of feature point pairs and feature point pairs in presetting database, as the side-play amount between the first image and the 3rd image, thus geometric correction is carried out to the first image, obtain final image.Optical flow method is the important method of current movement image analysis, when object is when moving, the luminance patterns of its corresponding points on image is also in motion, the apparent motion of this image brightness pattern is exactly light stream, light stream have expressed the change of image, owing to containing the information of object of which movement, the motion conditions of object therefore can be determined thus.
In the embodiment of the present invention, processor 401 calls the program code in memory 403, is comprised the first image of object by the first camera collection, before being comprised the second image of object, can also perform following steps by second camera collection simultaneously:
Whether the object being detected current shooting by the first camera is kept in motion;
If so, then second camera is enabled.
In the embodiment of the present invention, the camera whether object for detecting current shooting is in running status can be the first camera or second camera, specifically can be set or User Defined by system default; When detecting that the object of current shooting is kept in motion, second camera or the first camera can be enabled, specifically can be set or User Defined by system default.Concrete, the terminal introduced in the present embodiment can implement the part or all of flow process in the operating method of touch panel embodiment of composition graphs 1 of the present invention or Fig. 2 introduction.
Step in embodiment of the present invention method can be carried out order according to actual needs and be adjusted, merges and delete.
Unit in embodiment of the present invention terminal or equipment or subelement can carry out merging, divide and deleting according to actual needs.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment can carry out the device-dependent hardware of command terminal by program to have come, this program can be stored in a computer-readable recording medium, storage medium can comprise: flash disk, read-only memory (Read-OnlyMemory, ROM), random access device (RandomAccessMemory, RAM), disk or CD etc.
Above to the embodiment of the invention discloses a kind of image processing method and terminal is described in detail, apply specific case herein to set forth principle of the present invention and execution mode, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (10)
1. an image processing method, is characterized in that, comprising:
The first image of object is comprised by the first camera collection, comprised the second image of described object by second camera collection simultaneously, described first image is the upright roller shutter type bearing member, image of described object, described second image is the roller shutter type bearing member, image that described object stands upside down, and symmetric graph picture centered by described first image and described second image;
By described second image rotation, 180 degree of acquisitions the 3rd image;
More described first image and described 3rd image, obtain the side-play amount between described first image and described 3rd image;
According to described side-play amount, geometric correction is carried out to described first image, obtain the final image of described object;
Described first camera and described second camera are the camera be arranged in parallel.
2. the method for claim 1, is characterized in that, describedly carries out geometric correction according to described side-play amount to described first image, obtains the final image of described object, comprising:
Half according to described side-play amount carries out coordinate transform to described first image, obtains the final image of described object.
3. the method for claim 1, is characterized in that, described first image and described 3rd image, obtain the side-play amount between described first image and described 3rd image, comprising:
Described first image is divided at least one current block of non-overlapping copies;
For each described current block, obtain image block the most similar to described current block in described 3rd image as its match block;
For each described current block, obtain the relative displacement between described current block and described match block;
By described current block, described match block and the described relative displacement corresponding stored between described current block and described match block in presetting database, as the side-play amount between described first image and described 3rd image;
Describedly according to described side-play amount, geometric correction is carried out to described first image, obtains the final image of described object, comprising:
For each described current block, the half according to described relative displacement carries out coordinate transform to described current block, obtains the final image of described object.
4. the method for claim 1, is characterized in that, described first image and described 3rd image, obtain the side-play amount between described first image and described 3rd image, comprising:
First image described in registration and described 3rd image, obtain the feature point pairs of coupling;
Obtain the relative displacement of the space coordinates of described feature point pairs;
By the described relative displacement corresponding stored of the space coordinates of described feature point pairs and described feature point pairs in presetting database, as the side-play amount between described first image and described 3rd image;
Describedly according to described side-play amount, geometric correction is carried out to described first image, obtains the final image of described object, comprising:
The characteristic point of half to the first image described in described feature point pairs according to described relative displacement carries out coordinate transform, obtains the final image of described object.
5. the method as described in any one of Claims 1-4, is characterized in that, described the first image being comprised object by the first camera collection, and comprised the second image of described object by second camera collection before, described method also comprises simultaneously:
Whether the object being detected current shooting by the first camera is kept in motion;
If so, then second camera is enabled.
6. a terminal, is characterized in that, comprising:
Collecting unit, for being comprised the first image of object by the first camera collection, comprised the second image of described object by second camera collection simultaneously, described first image is the upright roller shutter type bearing member, image of described object, described second image is the roller shutter type bearing member, image that described object stands upside down, and symmetric graph picture centered by described first image and described second image;
Rotary unit, for described second image rotation, 180 degree of acquisitions the 3rd image gathered by described collecting unit;
Comparing unit, the 3rd image that described first image gathered for more described collecting unit and described rotary unit obtain, obtains the side-play amount between described first image and described 3rd image;
Correcting unit, carries out geometric correction for the side-play amount obtained according to described comparing unit to described first image, obtains the final image of described object;
Described first camera and described second camera are the camera be arranged in parallel.
7. terminal as claimed in claim 6, it is characterized in that, described correcting unit carries out coordinate transform specifically for the half according to described side-play amount to described first image, obtains the final image of described object.
8. terminal as claimed in claim 6, it is characterized in that, described comparing unit, comprising:
Division unit, for being divided at least one current block of non-overlapping copies by described first image;
First acquiring unit, for each described current block divided for described division unit, obtains image block the most similar to described current block in described 3rd image as its match block;
Second acquisition unit, for for each described current block, obtains the relative displacement between described current block and described match block;
First memory cell, for by described current block, described match block and the described relative displacement corresponding stored between described current block and described match block in presetting database, as the side-play amount between described first image and described 3rd image;
Described correcting unit is specifically for for each described current block, and the half according to described relative displacement carries out coordinate transform to described current block, obtains the final image of described object.
9. terminal as claimed in claim 6, it is characterized in that, described comparing unit comprises:
Registration unit, for the first image described in registration and described 3rd image, obtains the feature point pairs of coupling;
3rd acquiring unit, for obtaining the relative displacement of the space coordinates of described feature point pairs;
Second memory cell, for the described relative displacement corresponding stored of the space coordinates by described feature point pairs and described feature point pairs in presetting database, as the side-play amount between described first image and described 3rd image;
Described correcting unit carries out coordinate transform specifically for the characteristic point of half to the first image described in described feature point pairs according to described relative displacement, obtains the final image of described object.
10. the terminal as described in any one of claim 6 to 9, is characterized in that, described terminal also comprises:
Detecting unit, for comprising the first image of object at described collecting unit by the first camera collection, comprised the second image of described object by second camera collection before, whether the object being detected current shooting by the first camera is kept in motion simultaneously;
Enable unit, for when described detecting unit detects that the object of current shooting is kept in motion, enable second camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510365946.2A CN105049706A (en) | 2015-06-26 | 2015-06-26 | Image processing method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510365946.2A CN105049706A (en) | 2015-06-26 | 2015-06-26 | Image processing method and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105049706A true CN105049706A (en) | 2015-11-11 |
Family
ID=54455872
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510365946.2A Pending CN105049706A (en) | 2015-06-26 | 2015-06-26 | Image processing method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105049706A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017197651A1 (en) * | 2016-05-20 | 2017-11-23 | SZ DJI Technology Co., Ltd. | Systems and methods for rolling shutter correction |
| CN107592453A (en) * | 2017-09-08 | 2018-01-16 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| CN109410130A (en) * | 2018-09-28 | 2019-03-01 | 华为技术有限公司 | Image processing method and image processing apparatus |
| CN112220448A (en) * | 2020-10-14 | 2021-01-15 | 上海鹰瞳医疗科技有限公司 | Fundus camera and fundus image synthesis method |
-
2015
- 2015-06-26 CN CN201510365946.2A patent/CN105049706A/en active Pending
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017197651A1 (en) * | 2016-05-20 | 2017-11-23 | SZ DJI Technology Co., Ltd. | Systems and methods for rolling shutter correction |
| CN108605098A (en) * | 2016-05-20 | 2018-09-28 | 深圳市大疆创新科技有限公司 | system and method for rolling shutter correction |
| US10771699B2 (en) | 2016-05-20 | 2020-09-08 | SZ DJI Technology Co., Ltd. | Systems and methods for rolling shutter correction |
| CN108605098B (en) * | 2016-05-20 | 2020-12-11 | 深圳市大疆创新科技有限公司 | System and method for rolling shutter correction |
| CN107592453A (en) * | 2017-09-08 | 2018-01-16 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| CN107592453B (en) * | 2017-09-08 | 2019-11-05 | 维沃移动通信有限公司 | A kind of image pickup method and mobile terminal |
| CN109410130A (en) * | 2018-09-28 | 2019-03-01 | 华为技术有限公司 | Image processing method and image processing apparatus |
| CN109410130B (en) * | 2018-09-28 | 2020-12-04 | 华为技术有限公司 | Image processing method and image processing apparatus |
| CN112220448A (en) * | 2020-10-14 | 2021-01-15 | 上海鹰瞳医疗科技有限公司 | Fundus camera and fundus image synthesis method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110189285B (en) | Multi-frame image fusion method and device | |
| US10915998B2 (en) | Image processing method and device | |
| CN108833785B (en) | Fusion method and device of multi-view images, computer equipment and storage medium | |
| WO2020043155A1 (en) | Multiple scale image fusion method and device, storage medium, and terminal | |
| CN108986152B (en) | Foreign matter detection method and device based on difference image | |
| CN104994283A (en) | Correction method for local distortion and mobile terminal | |
| CN104486552A (en) | Method and electronic device for obtaining images | |
| WO2013145589A1 (en) | Image-processing device, image-capturing device, and image-processing method | |
| WO2021136386A1 (en) | Data processing method, terminal, and server | |
| CN105049706A (en) | Image processing method and terminal | |
| CN111028276A (en) | Image alignment method and device, storage medium and electronic equipment | |
| CN114298902A (en) | Image alignment method and device, electronic equipment and storage medium | |
| CN112802081A (en) | Depth detection method and device, electronic equipment and storage medium | |
| CN104917963A (en) | Image processing method and terminal | |
| CN107357422A (en) | Video camera projection interaction touch control method, device and computer-readable recording medium | |
| CN110874814B (en) | Image processing method, image processing device and terminal equipment | |
| CN111080683A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN110610178A (en) | Image recognition method, device, terminal and computer readable storage medium | |
| CN111931786B (en) | Image processing method and device and computer readable storage medium | |
| CN112637587B (en) | Dead pixel detection method and device | |
| CN116993654A (en) | Camera module defect detection method, device, equipment, storage medium and product | |
| CN114445370A (en) | Module film layer foreign matter detection method, device and system and computer medium | |
| CN116152167B (en) | Sliding detection method, device, medium and equipment | |
| CN110599504B (en) | Image processing method and device | |
| CN110232321B (en) | Method and device for detecting fingertip clicking position, terminal and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20151111 |