CN110177216A - Image processing method, device, mobile terminal and storage medium - Google Patents
Image processing method, device, mobile terminal and storage medium Download PDFInfo
- Publication number
- CN110177216A CN110177216A CN201910579216.0A CN201910579216A CN110177216A CN 110177216 A CN110177216 A CN 110177216A CN 201910579216 A CN201910579216 A CN 201910579216A CN 110177216 A CN110177216 A CN 110177216A
- Authority
- CN
- China
- Prior art keywords
- image
- images
- visual angle
- target
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
This application discloses a kind of image processing method, device, mobile terminal and storage mediums.Mobile terminal simultaneously shoots target scene with different perspectives by multiple cameras, obtains multiple first images；The image quality for obtaining multiple first images respectively is controlled after multiple cameras change visual angle and is shot again to target scene when the image quality of any first image in multiple first images is unsatisfactory for default image quality condition；When the image quality of the first image of each of multiple first images is all satisfied default image quality condition, multiple first images are handled, obtain multiple second images, the corresponding visual angle of multiple second images includes the visual angle other than the corresponding visual angle of multiple first images and the corresponding visual angle of multiple first images；Target image and displaying target image are generated based on multiple second images.This programme simultaneously shoots target scene with different perspectives by multiple cameras, and the image of other more multi-angle of view is obtained with this, promotes the display effect of image.
Description
Technical field
This application involves technical field of mobile terminals, eventually more particularly, to a kind of image processing method, device, movement
End and storage medium.
Background technique
With the development of science and technology, mobile terminal have become in people's daily life most common electronic product it
One.Also, user often passes through mobile terminal and takes pictures, and still, current shooting is only capable of obtaining the image of fixed angle, uses
The image that all angles are wanted to obtain in family then needs all to shoot all angles, cumbersome.
Summary of the invention
In view of the above problems, present applicant proposes a kind of image processing method, device, mobile terminal and storage medium,
To solve the above problems.
In a first aspect, the embodiment of the present application provides a kind of image processing method, it is applied to mobile terminal, the method packet
Include: the mobile terminal with different perspectives shoots target scene simultaneously by the multiple camera, obtains multiple the
One image；The image quality of the multiple first image is obtained respectively, and it is pre- to judge whether the image quality of the multiple first image meets
If image quality condition；When the image quality of any first image in the multiple first image is unsatisfactory for the default image quality condition,
It controls after the multiple camera changes visual angle and the target scene is shot again；When in the multiple first image
When the image quality of each first image is all satisfied the default image quality condition, the multiple first image is handled, is obtained more
A second image, wherein the corresponding visual angle of the multiple second image include the corresponding visual angle of the multiple first image and
Visual angle other than the corresponding visual angle of the multiple first image；Target image is generated based on the multiple second image, shows institute
State target image.
Second aspect, the embodiment of the present application provide a kind of image processing apparatus, are applied to mobile terminal, described device packet
Include: shooting module simultaneously claps target scene with different perspectives by the multiple camera for the mobile terminal
It takes the photograph, obtains multiple first images；Judgment module for obtaining the image quality of the multiple first image respectively, and judges described more
Whether the image quality of a first image meets default image quality condition；Control module, for when any in the multiple first image
When the image quality of first image is unsatisfactory for the default image quality condition, controls the multiple camera and change behind visual angle again to described
Target scene is shot；Processing module, for being all satisfied when the image quality of the first image of each of the multiple first image
When the default image quality condition, the multiple first image is handled, obtains multiple second images, wherein the multiple
The corresponding visual angle of second image includes the corresponding visual angle of the multiple first image and the corresponding view of the multiple first image
Visual angle other than angle；Generation module shows the target image for generating target image based on the multiple second image.
The third aspect, the embodiment of the present application provide a kind of mobile terminal, including memory and processor, the memory
It is couple to the processor, the memory store instruction, the processor is held when executed by the processor
The row above method.
Fourth aspect, the embodiment of the present application provides a kind of computer-readable storage medium, described computer-readable
Program code is stored in storage medium, said program code can be called by processor and execute the above method.
The embodiment of the present application provides image processing method, device, mobile terminal and storage medium, and this method is applied to move
Dynamic terminal obtains this method comprises: mobile terminal simultaneously shoots target scene with different perspectives by multiple cameras
Multiple first images；The image quality for obtaining multiple first images respectively, when the image quality of any first image in multiple first images
When being unsatisfactory for default image quality condition, controls after multiple cameras change visual angle and target scene is shot again；When multiple
When the image quality of the first image of each of one image is all satisfied default image quality condition, multiple first images are handled, are obtained
Multiple second images, the corresponding visual angle of multiple second images includes the corresponding visual angle of multiple first images and multiple first images
Visual angle other than corresponding visual angle；Target image and displaying target image are generated based on multiple second images.This programme passes through more
A camera simultaneously shoots target scene with different perspectives, and the image of other more multi-angle of view is obtained with this, promotes image
Display effect.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 shows a kind of structural schematic diagram of mobile terminal provided by the embodiments of the present application；
Fig. 2 shows the flow diagrams of an image processing method provided by the embodiments of the present application；
Fig. 3 shows a kind of schematic diagram of operation of mobile terminal provided by the embodiments of the present application；
Fig. 4 shows the schematic diagram of another operation of mobile terminal provided by the embodiments of the present application；
Fig. 5 shows the flow diagram of another image processing method provided by the embodiments of the present application；
Fig. 6 shows the flow diagram of another image processing method provided by the embodiments of the present application；
Fig. 7 shows the module frame chart of image processing apparatus provided by the embodiments of the present application；
Fig. 8 shows the embodiment of the present application for executing the mobile terminal of the image processing method according to the embodiment of the present application
Block diagram；
Fig. 9 shows realizing for saving or carrying according to the image procossing of the embodiment of the present application for the embodiment of the present application
The storage unit of the program code of method.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described.
Currently, camera function has become the standard configuration of most mobile terminals, mobile terminal user can be carried around movement
Terminal simultaneously passes through the fine moment of the mobile terminal records at one's side, in addition, with the intelligentized fast development of mobile terminal, very much
User new, characteristic picture is required daily to show outward, mobile terminal user to the quality requirement of photo, take pictures
The requirement of mode capabilities is also higher and higher.But current user goes for the picture of target object all angles, needs to object
All angles all shot, when shooting, also needs to keep certain track, cumbersome for users and exist certain
Operation difficulty.
In view of the above-mentioned problems, inventor has found by long-term research, and propose image provided by the embodiments of the present application
Processing method, device, mobile terminal and storage medium simultaneously carry out target scene with different perspectives by multiple cameras
Shooting, the image of other more multi-angle of view is obtained with this, promotes the display effect of image.Wherein, specific image processing method exists
It is described in detail in subsequent embodiment.
Mobile terminal involved in this programme as shown in Figure 1, mobile terminal 100 may include multiple cameras 140, and this
The visual angles of multiple cameras 140 is different, this multiple camera 140 can all be the front camera of mobile terminal, that is, be located at
The ipsilateral camera of mobile terminal operation interface；It can also all be the rear camera of mobile terminal, that is, be located at and mobile terminal
The camera (as shown in Figure 1) at the operation interface back side；It can be the rear camera of mobile terminal with a part, a part is position
In the camera of other positions, it is not limited here.Above-mentioned Fig. 1 is only schematic diagram, the mobile terminal not being related to this programme
Generate restriction.
Referring to Fig. 2, the flow diagram of the image processing method provided Fig. 2 shows the application one embodiment.Institute
Image processing method is stated for shooting simultaneously with different perspectives to target scene by multiple cameras, other are obtained with this
The image of more multi-angle of view promotes the display effect of image.In the particular embodiment, described image processing method is applied to as schemed
Image processing apparatus 200 shown in 7 and the mobile terminal 100 (Fig. 8) configured with described image processing unit 200.Below will
By taking mobile terminal as an example, illustrate the detailed process of the present embodiment, it will of course be understood that, it is mobile whole applied by the present embodiment
End can include the electronic equipment of camera for smart phone, tablet computer, wearable mobile terminal etc., not do herein specific
It limits.It will be explained in detail below for process shown in Fig. 2, described image processing method can specifically include following step
It is rapid:
Step S110: the mobile terminal simultaneously claps target scene with different perspectives by the multiple camera
It takes the photograph, obtains multiple first images.
Mobile terminal simultaneously can shoot target scene with different perspectives by multiple cameras, as a kind of side
Formula, mobile terminal can user click take pictures software icon enter take pictures interface when and meanwhile open multiple camera simultaneously
Target scene is shot, multiple camera and right can also be opened simultaneously again after user selects preset photographing mode
Target scene is shot simultaneously, and so as to be shot simultaneously to target scene by multiple cameras, obtaining includes not
With multiple first images of the target scene under visual angle, the visual angle of the different corresponding target scenes of the first image is different.
Step S120: obtaining the image quality of the multiple first image respectively, and judges the image quality of the multiple first image
Whether satisfaction presets image quality condition.
In the present embodiment, mobile terminal is simultaneously clapping target scene with different perspectives by multiple cameras
It takes the photograph, when obtaining multiple first images, the image quality of multiple first image can be obtained respectively.Wherein, image quality can be understood as figure
The quality of picture specifically may include clarity, acutance, lens distortion, dispersity, resolution, gamut range, color purity
The index of several aspects such as (the gorgeous degree of color), color balance.
In some embodiments, judge whether the image quality of multiple first image meets default image quality condition, can be
Judge whether the parameter of the corresponding index of image quality meets the preset parameter of the index, for example, can obtain respectively multiple
The clarity of first image, and judge whether the clarity of multiple first image meets preset clarity.Further, sentence
Whether the image quality of multiple first image of breaking meets default image quality condition, can be the parameter for judging the corresponding multiple indexs of image quality
Whether multiple index corresponding preset parameter is all met, for example, the clear of multiple first image can be obtained respectively
Clear degree, acutance and dispersity, and the whether preset clarity of the clarity of multiple first image is judged respectively, whether acutance
Meet preset acutance and whether dispersity meets preset dispersity.
Step S130: when the image quality of any first image in the multiple first image is unsatisfactory for the default image quality item
When part, controls after the multiple camera changes visual angle and the target scene is shot again.
In the present embodiment, after being shot to obtain multiple first images to target scene, it can further judge this
Whether the image quality of multiple first images meets default image quality, with the picture quality of this multiple first image for determining acquisition.When this
When the image quality of any first image in multiple first images is unsatisfactory for default image quality condition, it can show first image
Picture quality is poor, can not carry out other processing to first image, can control multiple cameras at this time and changes weight behind visual angle
Newly target scene is shot.Wherein it is possible to by the position of mobile multiple camera to obtain different visual angles, it can also
Target scene is shot again with obtaining different visual angles with the angle information by adjusting multiple camera.
Step S140: when the image quality of the first image of each of the multiple first image is all satisfied the default image quality item
When part, the multiple first image is handled, obtains multiple second images, wherein the multiple second image is corresponding
Visual angle includes the visual angle other than the corresponding visual angle of the multiple first image and the corresponding visual angle of the multiple first image.
In the present embodiment, when the image quality of the first image of each of multiple first images is all satisfied default image quality condition,
The parameter that can be the corresponding index of image quality of each first image in multiple first image meets the index and presets
Parameter, for example, it may be the clarity of the first image of each of multiple first image meets preset clarity, i.e.,
The image quality of the first image of each of multiple first image is all satisfied default image quality condition.It is further possible to be that this is more
The parameter of the corresponding multiple indexs of the image quality of each first image meets the preset parameter of multiple index in a first image,
For example, it may be the clarity of the first image of each of multiple first image meets preset clarity, each first
The resolution of image all meets preset resolution, it can illustrates the image quality of the first image of each of multiple first image
It is all satisfied default image quality condition.
In the present embodiment, when the image quality of the first image of each of multiple first images is all satisfied default image quality condition
When, multiple first image can be handled, with obtain corresponding visual angle include the corresponding visual angle of multiple first images with
And multiple second images at the visual angle other than the corresponding visual angle of multiple first images.Wherein it is possible to according to multiple first images
Parallax obtains corresponding disparity map, and corresponding depth map is calculated according to disparity map, extracts the target field in the first image
The characteristic point of scape, and disparity map and depth map is combined to establish the threedimensional model of target scene, which is converted to two
Image is tieed up, so that obtaining includes other than the corresponding visual angle of multiple first images and the corresponding visual angle of the multiple first image
Multiple second images at visual angle.In some embodiments, preset algorithm is also based on to handle multiple first images
Multiple second image is obtained, concrete mode is it is not limited here.
Step S150: target image is generated based on the multiple second image, shows the target image.
In the present embodiment, multiple second images handled multiple first images can be synthesized from
And target image is generated, specifically, it can be and the position of each second image in the target image is determined based on Viewing-angle information, and
Multiple second image is placed sequentially in behind corresponding position and carries out image co-registration so as to generate target image.
As an implementation, mobile terminal be based on multiple second images generate target image after, can receive by with
The rotation command that family issues, and the rotation command is responded, displaying target image is rotated with different perspectives.Wherein, rotation command can
Be it is as shown in Figure 3 mobile phone is rotated so that showing corresponding visual angle by the way that the rotation angle of detection mobile phone is corresponding
Target image, rotation command is also possible to carry out operation triggering in the operation interface of mobile terminal by user, such as
Shown in Fig. 4, user slides in the operation interface of mobile terminal, thus the corresponding rotation display pair in the direction based on sliding
Answer the target image under visual angle.
The image processing method that the application one embodiment provides, mobile terminal is by multiple cameras simultaneously with different views
Angle shoots target scene, obtains multiple first images；The image quality for obtaining multiple first images respectively, when multiple first figures
When the image quality of any first image as in is unsatisfactory for default image quality condition, controls multiple cameras and change behind visual angle again to mesh
Mark scene is shot；When the image quality of the first image of each of multiple first images is all satisfied default image quality condition, to more
A first image is handled, and obtains multiple second images, and the corresponding visual angle of multiple second images includes multiple first images pair
Visual angle other than the visual angle and the corresponding visual angle of multiple first images answered；Target image is generated based on multiple second images and is shown
Show target image.This programme simultaneously shoots target scene with different perspectives by multiple cameras, obtains other with this
The image of more multi-angle of view promotes the display effect of image.
Referring to Fig. 5, Fig. 5 shows the flow diagram of the image processing method of another embodiment of the application offer.
Described image processing method is applied to above-mentioned mobile terminal, will be explained in detail below for process shown in fig. 5, described
Method can specifically include following steps:
Step S210: the mobile terminal simultaneously claps target scene with different perspectives by the multiple camera
It takes the photograph, obtains multiple first images.
Step S220: obtaining the image quality of the multiple first image respectively, and judges the image quality of the multiple first image
Whether satisfaction presets image quality condition.
Step S230: when the image quality of any first image in the multiple first image is unsatisfactory for the default image quality item
When part, controls after the multiple camera changes visual angle and the target scene is shot again.
Wherein, the specific descriptions of step S210- step S230 please refer to step S110- step S130, and details are not described herein.
Step S240: picture material benefit is carried out to the target scene based on preset algorithm and the multiple first image
It repays, obtains the multiple second image.
In the present embodiment, mobile terminal simultaneously can shoot with acquisition target scene by multiple cameras
Multiple first images, wherein first image only includes the image under a part of visual angle of target scene, i.e., on mobile terminal
Image under the corresponding visual angle of multiple cameras can not include the image under all visual angles of the target scene, for example, by more
A camera shoots the front of target scene, can obtain the image of target scene front and a part of side, and
The image of target scene behind is unknown.Thus it is possible to by preset algorithm simulated target scene in multiple first images pair
The image under visual angle other than the visual angle answered, it can by preset algorithm by target scene in the corresponding view of multiple first images
Image under visual angle other than angle carries out picture material compensation, it is hereby achieved that including under the corresponding visual angle of multiple first images
And the second image under the visual angle other than the corresponding visual angle of multiple first images.
Further, in the present embodiment, step S240 may comprise steps of:
Step S241A: one or more objects in the target scene are identified from the multiple first image, and are divided
Indescribably take the Partial Feature parameter of one or more of objects.
In the present embodiment, mobile terminal can be based on image recognition technology, to obtained multiple first images of shooting into
Row identification, and therefrom identify one or more objects of the target scene.Wherein it is possible to based on default object condition, from more
One or more objects in the target scene are obtained in a first image, default object condition can be the item of system setting
Part, is also possible to pre-set by user, and default object condition can be the type of object, such as default object condition can be with
It is personage, then mobile terminal can identify from multiple first images and obtain all persons in target scene；Default object
Condition is also possible to the color of object, such as default object condition can be green, and mobile terminal then can be from multiple first figures
It is identified as in and obtains the viridescent object of institute in target scene.
After identifying one or more objects in multiple first images, can be extracted respectively from the first image this one
A or multiple objects Partial Feature parameters, wherein characteristic parameter may include brightness, edge, texture and color etc..From multiple
The Partial Feature parameter of one or more objects is extracted in first image, it can be by positioning one or more objects places respectively
The image gray processing of one or more object regions is divided the image into small connected region by region, then acquisition connection
In region the gradient of each pixel or edge direction histogram, these set of histograms finally can be obtained by spy altogether
Levy vector.As a kind of mode, it is also based on neural network, by by one or more object institutes in multiple first images
In the corresponding image input neural network in region, so as to export the one or more extracted from multiple first images
The Partial Feature parameter of object.The part that target object can also be extracted by other means based on multiple first images is special
Parameter is levied, it is not limited here.
Step S242A: one or more of objects are identified according to the characteristic parameter of one or more of objects respectively
Object type, and inquire based on the object type global feature parameter of one or more of objects.
In the present embodiment, the Partial Feature parameter of one or more objects can be extracted based on multiple first images,
To carry out picture material compensation to the one or more object, need to obtain the global feature ginseng of the one or more object
Number.Mobile terminal can be compared according to Partial Feature parameter by characteristic parameter based on image recognition technology, to identify this
The object type of one or more objects, further, the object type based on the one or more object can be inquired accordingly
The server or network inquiry one or more object global feature parameter.For example, when in the one or more object
One object is automobile, and the Partial Feature parameter such as color of automobile, profile can be extracted from multiple first images, and is based on mentioning
The type for the Partial Feature parameter identification automobile got, if identifying, automobile is " XX " board automobile, can be according to the inquiry product
The official website of board is to get the global feature parameter of the automobile.
Step S243A: picture material compensation is carried out to the target scene based on the global feature parameter, is obtained described
Multiple second images.
In the present embodiment, based on one or more in the target scene in multiple first images and multiple first images
The Partial Feature parameter of a object determines the corresponding pass between the Partial Feature parameter of the one or more object and the first image
System, after getting the global feature parameter of the one or more object, it can based on true with the corresponding relationship of the first image
Fixed second image.
Further, in the present embodiment, step S240 can with the following steps are included:
Step S241B: the parallax of the multiple first image is obtained.
It in the present embodiment, can be by obtaining two the first images in multiple first images respectively, to this two
One image carries out identification to obtain the corresponding relationship between two the first images, and is based on principle of triangulation, to calculate
The parallax of first image is obtained, is based on the above method, then the parallax of available multiple first view.Further, also
It can be based on Stereo Matching Algorithm, the calculating of matching cost is carried out to the first image, and carry out cost polymerization, complete matching cost
Polymerization after choose the optimal point of cascade matching cost in a certain range as Corresponding matching point, the corresponding parallax of the match point
The as parallax of first image, specific disparity computation mode is it is not limited here.
Step S242B: the different parallaxes based on the multiple first image obtain pending figure in the target scene
As the angle information of the part of content augmentation.
In the present embodiment, mobile terminal can determine target scene multiple based on the different parallaxes of multiple first images
The parallax of image corresponding to visual angle other than the corresponding visual angle of first image, and based on the parallax determine in target scene into
The angle information of the part of row picture material compensation.Specifically, any two first in multiple first images can be obtained respectively
The coordinate information of the characteristic point of object in image in target scene, and corresponding angle information is obtained based on the coordinate information,
Then the corresponding relationship of the parallax between the available angle information and two first images, and it is possible thereby to pass through multiple
The coordinate information of the characteristic point of object in the parallax of first image and multiple first images in target scene obtains angle information
Multiple corresponding relationships between parallax obtain the mapping between angle information and parallax via obtained multiple corresponding relationships
Table.The parallax that pending picture material compensates part is simulated by the different parallaxes using multiple first image, based on above-mentioned
Obtained mapping table obtains the angle information of pending picture material compensation part.
Step S243B: corresponding picture material is matched and based on described image content to described based on the angle information
Target scene compensates, and obtains the multiple second image.
In the present embodiment, the part of pending picture material compensation in the parallax and target scene based on the first image
Angle information, match point can be searched on the corresponding virtual view of the angle information, obtain the corresponding pixel of the match point
Point content, is moved to the match point for the pixel content, so as to obtain the virtual view, i.e. the second image.As another
A kind of mode, the coordinate information of the characteristic point of the object in target scene in available multiple second images, based on to obtain
The coordinate letter of the characteristic point of the object in the target scene of pending picture material compensation can be calculated in the angle information obtained
Breath, thus according to the coordinate information of characteristic point by the image completion of the target scene of pending picture material compensatory zone, thus
Obtain multiple second images.
Step S250: target image is generated based on the multiple second image, shows the target image.
Wherein, the specific descriptions of step S250 can be refering to step S150, and details are not described herein.
The image processing method that another embodiment of the application provides, mobile terminal is by multiple cameras simultaneously with difference
Visual angle shoots target scene, obtains multiple first images, obtains the image quality of multiple first images respectively, and judge multiple
Whether the image quality of the first image meets default image quality condition, when the image quality of any first image in multiple first images is unsatisfactory for
It when default image quality condition, controls after multiple cameras change visual angle and the target scene is shot again, based on pre- imputation
Method and multiple first images carry out picture material compensation to target scene, obtain multiple second images, are based on multiple second figures
As generating target image, displaying target image.Compared to image processing method shown in Fig. 2, the present embodiment is also based on pre-
Imputation method and multiple first images carry out picture material compensation to target scene, obtain multiple second images, thus based on pre-
Imputation method handles image, to improve the accuracy of image procossing and promote the effect of image procossing.
Referring to Fig. 6, Fig. 6 is to show the process signal of the image processing method of the application further embodiment offer
Figure.Described image processing method is applied to above-mentioned mobile terminal, will be explained in detail below for process shown in fig. 6,
The method can specifically include following steps:
Step S310: the mobile terminal simultaneously claps target scene with different perspectives by the multiple camera
It takes the photograph, obtains multiple first images.
Step S320: obtaining the image quality of the multiple first image respectively, and judges the image quality of the multiple first image
Whether satisfaction presets image quality condition.
Step S330: when the image quality of any first image in the multiple first image is unsatisfactory for the default image quality item
When part, controls after the multiple camera changes visual angle and the target scene is shot again.
Step S340: when the image quality of the first image of each of the multiple first image is all satisfied the default image quality item
When part, the multiple first image is handled, obtains multiple second images, wherein the multiple second image is corresponding
Visual angle includes the visual angle other than the corresponding visual angle of the multiple first image and the corresponding visual angle of the multiple first image.
Wherein, the specific descriptions of step S310- step S340 please refer to step S110- step S140, and details are not described herein.
Step S350: the multiple second image is subjected to image mosaic and generates the target image.
In the present embodiment, according to multiple second images generate target image, can by by multiple second image into
Row splicing is to generate target image.When multiple second images are spliced, can be to multiple second image at
Reason, to reach more natural splicing effect.Specifically, it is spelled to the second image of any two in multiple second image
When connecing, the color of fringe region, edge, Texture eigenvalue in two the second images can be obtained respectively, calculated between feature
Similarity, and judge whether similarity is greater than similarity threshold.When similarity is greater than similarity threshold, show this two second
The features such as color of fringe region are same or similar in image, then can synthesize the two the second images.Further, work as phase
When being less than threshold value like degree, the spies such as form and aspect, saturation degree, contrast, brightness of fringe region in the two adjustable second images
Parameter is levied, to increase the similarity in the two second images between fringe region, so that raw after the two second image mosaics
At image show that more natural, style is consistent.
In some embodiments, carrying out image mosaic to multiple second images specifically can extract each second figure
The characteristic point of picture, matches characteristic point, and carries out image registration, by one second image copy to another the second image
Specific position, and fusion treatment is carried out to the boundary of overlapping.
The image processing method that the application further embodiment provides, mobile terminal is by multiple cameras simultaneously with difference
Visual angle shoots target scene, obtains multiple first images, obtains the image quality of multiple first images respectively, and judge multiple
Whether the image quality of the first image meets default image quality condition, when the image quality of any first image in multiple first images is unsatisfactory for
When default image quality condition, controls after multiple cameras change visual angle and target scene is shot again, when multiple first images
Each of the image quality of the first image when being all satisfied default image quality condition, multiple first images are handled, obtain multiple
Two images, wherein the corresponding visual angle of multiple second images includes the corresponding visual angle of multiple first images and multiple first images
Multiple second images are carried out image mosaic and generate target image by the visual angle other than corresponding visual angle.Compared to figure shown in Fig. 2
As processing method, multiple second images can also be carried out image mosaic and generate target image by the present embodiment, to promote image
Display effect.
Referring to Fig. 7, Fig. 7 shows the module frame chart of image processing apparatus 200 provided by the embodiments of the present application.The figure
As processing unit 200 is applied to above-mentioned mobile terminal.It will be illustrated below for block diagram described in Fig. 7, described image processing
Device 200 includes: shooting module 210, judgment module 220, control module 230, processing module 240 and generation module 250,
In:
Shooting module 210, for the mobile terminal by the multiple camera simultaneously with different perspectives to target field
Scape is shot, and multiple first images are obtained.
Judgment module 220 for obtaining the image quality of the multiple first image respectively, and judges the multiple first image
Image quality whether meet default image quality condition.
Control module 230, the image quality for working as any first image in the multiple first image are unsatisfactory for described pre-
If when image quality condition, controlling after the multiple camera changes visual angle and being shot again to the target scene.
Processing module 240, the image quality for working as the first image of each of the multiple first image are all satisfied described pre-
If when image quality condition, handling the multiple first image, multiple second images are obtained, wherein the multiple second figure
As corresponding visual angle includes other than the corresponding visual angle of the multiple first image and the corresponding visual angle of the multiple first image
Visual angle.
Further, the processing module 240 includes: content augmentation submodule, in which:
Content augmentation submodule, for being carried out based on preset algorithm and the multiple first image to the target scene
Picture material compensation, obtains the multiple second image.
Further, the content augmentation submodule includes: extraction unit, recognition unit and the first compensating unit,
In:
Extraction unit, for identifying one or more objects in the target scene from the multiple first image,
And the Partial Feature parameter of one or more of objects is extracted respectively.
Recognition unit, for identifying one or more of objects respectively according to the characteristic parameter of one or more of objects
The object type of body, and inquire based on the object type global feature parameter of one or more of objects.
First compensating unit, for carrying out picture material compensation to the target scene based on the global feature parameter,
Obtain the multiple second image.
Further, content augmentation submodule further include: parallax acquiring unit, angle information acquiring unit and second are mended
Repay unit, in which:
Parallax acquiring unit, for obtaining the parallax of the multiple first image.
Angle information acquiring unit obtains the target scene for the different parallaxes based on the multiple first image
In the compensation of pending picture material part angle information.
Second compensating unit, for matching corresponding picture material based on the angle information and being based on described image content
The target scene is compensated, the multiple second image is obtained.
Generation module 240 shows the target image for generating target image based on the multiple second image.
Further, the generation module 240 includes: receiving submodule and rotation display sub-module, in which:
Receiving submodule, for receiving rotation command.
Display sub-module is rotated, for responding the rotation command, the target image is shown with different perspectives rotation.
Further, the generation module 240 further include: splicing submodule, in which:
Splice submodule, generates the target image for the multiple second image to be carried out image mosaic.
Further, the splicing submodule includes: extraction unit, computing unit and concatenation unit, in which:
Extraction unit, the feature of the fringe region for extracting the second image of any two in the multiple second image
Parameter.
Computing unit, the similarity for the fringe region based on described two second images of the calculation of characteristic parameters.
Concatenation unit is used for when the similarity is greater than similarity threshold, by described two second image mosaics.
It is apparent to those skilled in the art that for convenience and simplicity of description, foregoing description device and
The specific work process of module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, the mutual coupling of module can be electrical property, mechanical or other
The coupling of form.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application
It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.
Referring to Fig. 8, it illustrates a kind of structural block diagrams of mobile terminal 100 provided by the embodiments of the present application.The movement
Terminal 100, which can be smart phone, tablet computer, e-book etc., can run the mobile terminal of application program.In the application
Mobile terminal 100 may include one or more such as lower component: processor 110, memory 120, screen 130, camera 140 with
And one or more application program, wherein one or more application programs can be stored in memory 120 and be configured as
It is executed by one or more processors 110, one or more programs are configured to carry out as described in preceding method embodiment
Method.
Wherein, processor 110 may include one or more processing core.Processor 110 utilizes various interfaces and route
The various pieces in entire mobile terminal 100 are connected, by running or executing the instruction being stored in memory 120, program, generation
Code collection or instruction set, and the data being stored in memory 120 are called, execute the various functions and processing of mobile terminal 100
Data.Optionally, processor 110 can be using Digital Signal Processing (Digital Signal Processing, DSP), scene
Programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable
Logic Array, PLA) at least one of example, in hardware realize.Processor 110 can integrating central processor (Central
Processing Unit, CPU), in graphics processor (Graphics Processing Unit, GPU) and modem etc.
One or more of combinations.Wherein, the main processing operation system of CPU, user interface and application program etc.；GPU is for being responsible for
Show the rendering and drafting of content；Modem is for handling wireless communication.It is understood that above-mentioned modem
It can not be integrated into processor 110, be realized separately through one piece of communication chip.
Memory 120 may include random access memory (Random Access Memory, RAM), also may include read-only
Memory (Read-Only Memory).Memory 120 can be used for store instruction, program, code, code set or instruction set.It deposits
Reservoir 120 may include storing program area and storage data area, wherein the finger that storing program area can store for realizing operating system
Enable, for realizing at least one function instruction (such as touch function, sound-playing function, image player function etc.), be used for
Realize the instruction etc. of following each embodiments of the method.Storage data area can also store the number that terminal 100 is created in use
According to (such as phone directory, audio, video data, chat record data) etc..
Further, the screen 130 can be liquid crystal display (Liquid Crystal Display, LCD), can be with
For Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) etc..The screen 130 for show by with
The information of family input is supplied to the information of user and the various graphical user interface of the mobile terminal, these graphical users
Interface can be made of figure, text, icon, number, video and any combination thereof.
Camera 140 can be fixedly installed on mobile terminal 100, can be slideably positioned in mobile terminal 100, can also turn
It is dynamic to be set to mobile terminal 100, it is not limited here.
Referring to Fig. 9, it illustrates a kind of structural frames of computer-readable storage medium provided by the embodiments of the present application
Figure.Program code is stored in the computer-readable storage medium 300, said program code can be called by processor and be executed
State method described in embodiment of the method.
Computer-readable storage medium 300 can be (the read-only storage of electrically erasable of such as flash memory, EEPROM
Device), the electronic memory of EPROM, hard disk or ROM etc.Optionally, computer-readable storage medium 300 includes non-easy
The property lost computer-readable medium (non-transitory computer-readable storage medium).Computer can
Read the memory space that storage medium 300 has the program code 310 for executing any method and step in the above method.These journeys
Sequence code can read or be written to this one or more computer journey from one or more computer program product
In sequence product.Program code 310 can for example be compressed in a suitable form.
In conclusion image processing method provided by the embodiments of the present application, device, mobile terminal and storage medium, are moved
Dynamic terminal simultaneously shoots target scene with different perspectives by multiple cameras, obtains multiple first images；It obtains respectively
The image quality for taking multiple first images, when the image quality of any first image in multiple first images is unsatisfactory for default image quality condition
When, it controls after multiple cameras change visual angle and target scene is shot again；When each of multiple first images first
When the image quality of image is all satisfied default image quality condition, multiple first images are handled, obtain multiple second images, Duo Ge
The corresponding visual angle of two images includes the view other than the corresponding visual angle of multiple first images and the corresponding visual angle of multiple first images
Angle；Target image and displaying target image are generated based on multiple second images.This programme is by multiple cameras simultaneously with difference
Visual angle shoots target scene, and the image of other more multi-angle of view is obtained with this, promotes the display effect of image.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations；Although
The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding: it still can be with
It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；And
These are modified or replaceed, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and
Range.
Claims (10)
1. a kind of image processing method, which is characterized in that it is applied to mobile terminal, the mobile terminal includes multiple cameras,
The visual angle of the multiple camera is different, which comprises
The mobile terminal with different perspectives shoots target scene simultaneously by the multiple camera, obtains multiple the
One image；
The image quality of the multiple first image is obtained respectively, and judges whether the image quality of the multiple first image meets default picture
Matter condition；
When the image quality of any first image in the multiple first image is unsatisfactory for the default image quality condition, described in control
Multiple cameras again shoot the target scene after changing visual angle；
When the image quality of the first image of each of the multiple first image is all satisfied the default image quality condition, to described more
A first image is handled, and multiple second images are obtained, wherein the corresponding visual angle of the multiple second image includes described more
Visual angle other than a corresponding visual angle of first image and the corresponding visual angle of the multiple first image；
Target image is generated based on the multiple second image, shows the target image.
2. the method according to claim 1, wherein the display target image, comprising:
Receive rotation command；
The rotation command is responded, the target image is shown with different perspectives rotation.
3. being obtained the method according to claim 1, wherein described handle the multiple first image
Multiple second images, comprising:
Picture material compensation is carried out to the target scene based on preset algorithm and the multiple first image, is obtained described more
A second image.
4. according to the method described in claim 3, it is characterized in that, described be based on preset algorithm and the multiple first image
Picture material compensation is carried out to the target scene, comprising:
One or more objects in the target scene are identified from the multiple first image, and are extracted respectively one
Or the Partial Feature parameter of multiple objects；
Identify the object type of one or more of objects, and base respectively according to the characteristic parameter of one or more of objects
The global feature parameter of one or more of objects is inquired in the object type；
Picture material compensation is carried out to the target scene based on the global feature parameter, obtains the multiple second image.
5. according to the method described in claim 3, it is characterized in that, described be based on preset algorithm and the multiple first image
Picture material compensation is carried out to the target scene, comprising:
Obtain the parallax of the multiple first image；
Different parallaxes based on the multiple first image obtain the portion of pending picture material compensation in the target scene
The angle information divided；
Corresponding picture material is matched based on the angle information and the target scene is mended based on described image content
It repays, obtains the multiple second image.
6. method according to claim 1-5, which is characterized in that described to be generated based on the multiple second image
Target image, comprising:
The multiple second image is subjected to image mosaic and generates the target image.
7. according to the method described in claim 6, it is characterized in that, described carry out image mosaic life for the multiple second image
At the target image, comprising:
Extract the characteristic parameter of the fringe region of the second image of any two in the multiple second image；
The similarity of fringe region based on described two second images of the calculation of characteristic parameters；
When the similarity is greater than similarity threshold, by described two second image mosaics.
8. a kind of image processing apparatus, which is characterized in that it is applied to mobile terminal, the mobile terminal includes multiple cameras,
The visual angle of the multiple camera is different, and described device includes:
Shooting module simultaneously claps target scene with different perspectives by the multiple camera for the mobile terminal
It takes the photograph, obtains multiple first images；
Judgment module for obtaining the image quality of the multiple first image respectively, and judges the image quality of the multiple first image
Whether satisfaction presets image quality condition；
Control module, for being unsatisfactory for the default image quality item when the image quality of any first image in the multiple first image
When part, controls after the multiple camera changes visual angle and the target scene is shot again；
Processing module, for being all satisfied the default image quality item when the image quality of the first image of each of the multiple first image
When part, the multiple first image is handled, obtains multiple second images, wherein the multiple second image is corresponding
Visual angle includes the visual angle other than the corresponding visual angle of the multiple first image and the corresponding visual angle of the multiple first image；
Generation module shows the target image for generating target image based on the multiple second image.
9. a kind of mobile terminal, which is characterized in that including memory and processor, the memory is couple to the processor,
The memory store instruction, the processor executes claim 1-7 such as and appoints when executed by the processor
Method described in one.
10. a kind of computer-readable storage medium, which is characterized in that be stored with journey in the computer-readable storage medium
Sequence code, said program code can be called by processor and execute the method according to claim 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910579216.0A CN110177216B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing device, mobile terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910579216.0A CN110177216B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing device, mobile terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110177216A true CN110177216A (en) | 2019-08-27 |
| CN110177216B CN110177216B (en) | 2021-06-15 |
Family
ID=67699468
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910579216.0A Active CN110177216B (en) | 2019-06-28 | 2019-06-28 | Image processing method, image processing device, mobile terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110177216B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083364A (en) * | 2019-12-18 | 2020-04-28 | 华为技术有限公司 | Control method, electronic equipment, computer readable storage medium and chip |
| CN111445559A (en) * | 2020-04-07 | 2020-07-24 | 珠海格力电器股份有限公司 | Image processing and displaying method, device, equipment and computer readable medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651841A (en) * | 2008-08-13 | 2010-02-17 | 华为技术有限公司 | Method, system and equipment for realizing stereo video communication |
| CN102075779A (en) * | 2011-02-21 | 2011-05-25 | 北京航空航天大学 | Intermediate view synthesizing method based on block matching disparity estimation |
| CN104883495A (en) * | 2015-04-30 | 2015-09-02 | 广东欧珀移动通信有限公司 | Shooting method and device |
| CN105635566A (en) * | 2015-12-22 | 2016-06-01 | 东莞酷派软件技术有限公司 | Terminal shooting method and terminal shooting device |
| CN106507087A (en) * | 2016-12-05 | 2017-03-15 | 宇龙计算机通信科技(深圳)有限公司 | A kind of terminal imaging method and system |
| CN106603903A (en) * | 2015-10-15 | 2017-04-26 | 中兴通讯股份有限公司 | Photo processing method and apparatus |
| CN107071384A (en) * | 2017-04-01 | 2017-08-18 | 上海讯陌通讯技术有限公司 | The binocular rendering intent and system of virtual active disparity computation compensation |
| CN107483804A (en) * | 2017-09-30 | 2017-12-15 | 努比亚技术有限公司 | A kind of image pickup method, mobile terminal and computer-readable recording medium |
| CN108388637A (en) * | 2018-02-26 | 2018-08-10 | 腾讯科技（深圳）有限公司 | A kind of method, apparatus and relevant device for providing augmented reality service |
| US20190082110A1 (en) * | 2017-09-11 | 2019-03-14 | Samsung Electronics Co., Ltd. | Apparatus and method for processing image received through a plurality of cameras |
-
2019
- 2019-06-28 CN CN201910579216.0A patent/CN110177216B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651841A (en) * | 2008-08-13 | 2010-02-17 | 华为技术有限公司 | Method, system and equipment for realizing stereo video communication |
| CN102075779A (en) * | 2011-02-21 | 2011-05-25 | 北京航空航天大学 | Intermediate view synthesizing method based on block matching disparity estimation |
| CN104883495A (en) * | 2015-04-30 | 2015-09-02 | 广东欧珀移动通信有限公司 | Shooting method and device |
| CN106603903A (en) * | 2015-10-15 | 2017-04-26 | 中兴通讯股份有限公司 | Photo processing method and apparatus |
| CN105635566A (en) * | 2015-12-22 | 2016-06-01 | 东莞酷派软件技术有限公司 | Terminal shooting method and terminal shooting device |
| CN106507087A (en) * | 2016-12-05 | 2017-03-15 | 宇龙计算机通信科技(深圳)有限公司 | A kind of terminal imaging method and system |
| CN107071384A (en) * | 2017-04-01 | 2017-08-18 | 上海讯陌通讯技术有限公司 | The binocular rendering intent and system of virtual active disparity computation compensation |
| US20190082110A1 (en) * | 2017-09-11 | 2019-03-14 | Samsung Electronics Co., Ltd. | Apparatus and method for processing image received through a plurality of cameras |
| CN107483804A (en) * | 2017-09-30 | 2017-12-15 | 努比亚技术有限公司 | A kind of image pickup method, mobile terminal and computer-readable recording medium |
| CN108388637A (en) * | 2018-02-26 | 2018-08-10 | 腾讯科技（深圳）有限公司 | A kind of method, apparatus and relevant device for providing augmented reality service |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083364A (en) * | 2019-12-18 | 2020-04-28 | 华为技术有限公司 | Control method, electronic equipment, computer readable storage medium and chip |
| CN111083364B (en) * | 2019-12-18 | 2023-05-02 | 荣耀终端有限公司 | Control method, electronic equipment, computer readable storage medium and chip |
| US11991441B2 (en) | 2019-12-18 | 2024-05-21 | Honor Device Co., Ltd. | Control method, electronic device, computer-readable storage medium, and chip |
| CN111445559A (en) * | 2020-04-07 | 2020-07-24 | 珠海格力电器股份有限公司 | Image processing and displaying method, device, equipment and computer readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110177216B (en) | 2021-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11756223B2 (en) | Depth-aware photo editing | |
| CN108764091B (en) | Living body detection method and apparatus, electronic device, and storage medium | |
| CN107993216B (en) | Image fusion method and equipment, storage medium and terminal thereof | |
| WO2020010979A1 (en) | Method and apparatus for training model for recognizing key points of hand, and method and apparatus for recognizing key points of hand | |
| CN110300264B (en) | Image processing method, image processing device, mobile terminal and storage medium | |
| WO2022000992A1 (en) | Photographing method and apparatus, electronic device, and storage medium | |
| WO2015180659A1 (en) | Image processing method and image processing device | |
| CN111541907B (en) | Article display method, apparatus, device and storage medium | |
| JP2019510297A (en) | Virtual try-on to the user's true human body model | |
| US10523916B2 (en) | Modifying images with simulated light sources | |
| US20180357819A1 (en) | Method for generating a set of annotated images | |
| TW201222288A (en) | Image retrieving system and method and computer program product thereof | |
| CN110599593B (en) | Data synthesis method, device, equipment and storage medium | |
| CN110636276B (en) | Video shooting method and device, storage medium and electronic equipment | |
| CN106203286A (en) | The content acquisition method of a kind of augmented reality, device and mobile terminal | |
| US20200065559A1 (en) | Generating a video using a video and user image or video | |
| US11900552B2 (en) | System and method for generating virtual pseudo 3D outputs from images | |
| WO2023066120A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN108961375A (en) | A kind of method and device generating 3-D image according to two dimensional image | |
| CN110266926A (en) | Image processing method, device, mobile terminal and storage medium | |
| CN110177216A (en) | Image processing method, device, mobile terminal and storage medium | |
| WO2021109764A1 (en) | Image or video generation method and apparatus, computing device and computer-readable medium | |
| WO2017141223A1 (en) | Generating a video using a video and user image or video | |
| CN116452745A (en) | Hand modeling, hand model processing method, device and medium | |
| CN115623313A (en) | Image processing method, image processing apparatus, electronic device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |