CN104243814B - Analysis method, image taking reminding method and the device of objects in images layout - Google Patents
Analysis method, image taking reminding method and the device of objects in images layout Download PDFInfo
- Publication number
- CN104243814B CN104243814B CN201410364752.6A CN201410364752A CN104243814B CN 104243814 B CN104243814 B CN 104243814B CN 201410364752 A CN201410364752 A CN 201410364752A CN 104243814 B CN104243814 B CN 104243814B
- Authority
- CN
- China
- Prior art keywords
- image
- layout
- captured
- metric
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the present disclosure discloses analysis method, image taking reminding method and the device of a kind of objects in images layout, and the analysis method of object layout carries out object classification to image first in described image, obtains object classification result；Image is split according to object classification result, obtains image segmentation result；Using standard layout's information corresponding to image segmentation result and image, the object layout reasonability metric of image is obtained.Described image shoots reminding method, and the analysis method being laid out using objects in images obtains the object layout reasonability metric of image to be captured, then, to the object layout reasonability metric of image to be captured described in user feedback.When the object layout of image to be captured is unreasonable, user adjusts the acquisition parameters such as the shooting direction of terminal, angle according to the information of prompting, change the layout of image to be captured, so that the objects in images layout that user takes is more reasonable, the shooting effect of image is more preferable.
Description
Technical field
This disclosure relates to image taking technology field, analysis method, figure more particularly to a kind of objects in images layout
As shooting reminding method and device.
Background technology
With the popularization of intelligent terminal, and the raising of intelligent terminal shooting effect, increasing user passes through intelligence
Terminal carrys out shooting image.
, will if the selection of the parameter such as shooting angle or position is improper when user carries out image taking using intelligent terminal
Cause the layout for shooting obtained objects in images unreasonable, for example, when carrying out personage's shooting, the ratio of personage in the picture
Smaller, it is unreasonable to may result in the distributed layout of primary objects (personage) and secondary object (background) in the image taken, and then
Reduce the shooting effect of image.And in related image taking technology, the analysis method also without objects in images distributed layout
And reminding method, therefore, need the distributed layout situation that a kind of image taking reminding method prompts objects in images to be captured badly.
The content of the invention
To overcome problem present in correlation technique, the disclosure provides a kind of analysis method of objects in images layout, figure
As shooting reminding method and device.
In order to solve the above-mentioned technical problem, the embodiment of the present disclosure discloses following technical scheme：
According to the first aspect of the embodiment of the present disclosure, there is provided a kind of image taking reminding method, including：
Treat shooting image and carry out object classification, obtain object classification result；
Image segmentation is carried out to the image to be captured according to the object classification result, obtains image object segmentation knot
Fruit；
According to standard layout's information corresponding to described image object segmentation result and the image to be captured, obtain described
The object layout reasonability metric of image to be captured；
To object layout reasonability metric corresponding to image to be captured described in user feedback.
With reference in a first aspect, in the first possible implementation of first aspect, according to described image object segmentation
As a result and standard layout's information corresponding to the image to be captured, the object layout reasonability in the image to be captured is obtained
Metric, in the following way：
According to described image object segmentation result, the area ratio/occupancy ratio of each type objects in the image to be captured is calculated；
According to the area ratio/occupancy ratio and standard layout's information of each type objects in the image to be captured, it is calculated described
The object layout reasonability metric of image to be captured.
With reference to the first possible implementation of first aspect, in second of possible implementation of first aspect
In, according to the area ratio/occupancy ratio and standard layout's information of each type objects in the image to be captured, it is calculated and described waits to clap
The object layout reasonability metric of image is taken the photograph, in the following way：
It is corresponding with standard layout's information according to the area ratio/occupancy ratio of each type objects in the image to be captured
Difference between standard item area ratio/occupancy ratio, obtain the object layout different information of the image to be captured；
The object layout reasonability metric of the image to be captured is obtained according to the object layout different information.
With reference to the first possible implementation of first aspect, in the third possible implementation of first aspect
In, according to the area ratio/occupancy ratio and standard layout's information of each type objects in the image to be captured, it is calculated and described waits to clap
The object layout reasonability metric of image is taken the photograph, in the following way：
According to the area ratio/occupancy ratio of each type objects in the image to be captured, the shooting mould of the image to be captured is determined
Formula；
The difference weight of object is corresponded to according to area ratio/occupancy ratio, the screening-mode corresponding to each type objects, with
And standard layout's information, obtain the object layout different information of the image to be captured；
According to the object layout different information, the object layout reasonability metric is obtained.
With reference to any of the first of first aspect and first aspect to the third possible implementation, first
It is described to object layout reasonability corresponding to image to be captured described in user feedback in 4th kind of possible implementation of aspect
Metric, in the following way：
Pass through object layout reasonability described in text prompt information, auditory tone cues information and/or graphical cues feedback of the information
Information.
With reference to any of the first of first aspect and first aspect to the third possible implementation, first
In 5th kind of possible implementation of aspect, measured to object layout reasonability corresponding to image to be captured described in user feedback
Information, in the following way：
According to the number range of the object layout reasonability metric of described image, corresponding prompting letter is prompted the user with
Breath.
According to the second aspect of the embodiment of the present disclosure, there is provided a kind of analysis method of objects in images layout, including：
Object classification is carried out to target image, obtains object classification result；
Image segmentation is carried out to the target image according to the object classification result, obtains image object segmentation result；
According to standard layout's information corresponding to described image object segmentation result and the target image, the mesh is obtained
The object layout reasonability metric of logo image.
With reference to second aspect, in the first possible implementation of second aspect, according to described image object segmentation
As a result and standard layout's information corresponding to the target image, the object layout reasonability obtained in the target image are measured
Information, in the following way：
According to described image object segmentation result, the area ratio/occupancy ratio of each type objects in the target image is calculated；
According to the area ratio/occupancy ratio of each type objects in the target image and standard layout's information, the mesh is calculated
The object layout reasonability metric of logo image.
According to the third aspect of the embodiment of the present disclosure, there is provided a kind of image taking suggestion device, including：
Object classification unit, object classification is carried out for treating shooting image, obtains object classification result；
Image segmentation unit, for carrying out image segmentation to the image to be captured according to the object classification result, obtain
To image object segmentation result；
Metric element is laid out, for the standard according to corresponding to described image object segmentation result and the image to be captured
Layout information, obtain the object layout reasonability metric of the image to be captured；
Feedback unit, for object layout reasonability metric corresponding to image to be captured described in user feedback.
With reference to the third aspect, in the first possible implementation of the third aspect, the layout metric element includes：
First computation subunit, for according to described image object segmentation result, calculating each in the image to be captured
The area ratio/occupancy ratio of type objects；
Second computation subunit, for the area ratio/occupancy ratio according to each type objects and standard layout's information, it is calculated
The object layout reasonability metric of the image to be captured.
With reference to the first possible implementation of the third aspect, in second of possible implementation of the third aspect
In, second computation subunit, including：
Screening-mode determination subelement, for the area ratio/occupancy ratio according to each type objects in the image to be captured, really
The screening-mode of the fixed image to be captured；
First placement differences obtain subelement, for area ratio/occupancy ratio, the bat according to corresponding to each type objects
The pattern of taking the photograph corresponds to the difference weight of object, and standard layout's information, and the object layout for obtaining the image to be captured is poor
Different information；
3rd computation subunit, for according to the object layout different information, obtaining the object layout reasonability degree
Measure information.
According to the fourth aspect of the embodiment of the present disclosure, there is provided a kind of analytical equipment of objects in images layout, including：
Object classification unit, for carrying out object classification to target image, obtain object classification result；
Image segmentation unit, for carrying out image segmentation to the target image according to the object classification result, obtain
Image object segmentation result；
Metric element is laid out, for the standard cloth according to corresponding to described image object segmentation result and the target image
Office's information, obtains the object layout reasonability metric of the target image.
According to the 5th of the embodiment of the present disclosure the aspect, there is provided a kind of terminal device, including：Processor；Handled for storage
The memory of device executable instruction；Wherein, the processor is configured as：
Treat shooting image and carry out object classification, obtain object classification result；
Image segmentation is carried out to the image to be captured according to the object classification result, obtains image object segmentation knot
Fruit；
According to standard layout's information corresponding to described image object segmentation result and the image to be captured, obtain described
The object layout reasonability metric of image to be captured.
With reference to the 5th aspect, in the first possible implementation of the 5th aspect, the processor is additionally configured to：
To object layout reasonability metric corresponding to image to be captured described in user feedback.
The technical scheme provided by this disclosed embodiment can include the following benefits：The image taking that the disclosure provides
Reminding method, the object treated first in shooting image are classified, and obtain object classification result；According to object classification result pair
Image to be captured is split, and obtains image segmentation result；Utilize standard cloth corresponding to image segmentation result and image to be captured
Office's information, obtains the object layout reasonability metric of image to be captured；And to the thing of image to be captured described in user feedback
The rationally distributed property metric of body.Remind the user that whether the object layout of image to be captured is reasonable.Especially when figure to be captured
When the object layout of picture is unreasonable, user adjusts the acquisition parameters such as the shooting direction of terminal, angle according to the information of prompting, changes
Become the layout of image to be captured, so that the objects in images layout that user takes is more reasonable, the shooting effect of image is more preferable.
The disclosure additionally provides the analysis method of objects in images layout, carries out rude classification to the object in image, obtains
To object classification result.According to the object classification result of image, image is split, obtains image object segmentation result.Root
According to image object segmentation result and standard layout's information, the object layout reasonability metric in image is obtained, so as to figure
The layout of picture is analyzed, evaluated.
It should be appreciated that the general description and following detailed description of the above are only exemplary, this can not be limited
It is open.
Brief description of the drawings
Accompanying drawing herein is merged in specification and forms the part of this specification, shows the implementation for meeting the present invention
Example, and for explaining principle of the invention together with specification.
Fig. 1 is a kind of flow chart of image taking reminding method according to an exemplary embodiment；
Fig. 2 is a kind of interface display schematic diagram of terminal device according to an exemplary embodiment；
Fig. 3 is a kind of method flow of acquisition object layout reasonability metric according to an exemplary embodiment
Figure；
Fig. 4 is the method flow diagram of S220 shown in a kind of Fig. 3 according to an exemplary embodiment；
Fig. 5 is the method flow diagram of S220 shown in another Fig. 3 according to an exemplary embodiment；
Fig. 6 is a kind of flow chart of objects in images topological analysis method according to an exemplary embodiment；
Fig. 7 is a kind of image taking suggestion device block diagram according to an exemplary embodiment；
Fig. 8 is a kind of analytical equipment block diagram of objects in images layout according to an exemplary embodiment；
Fig. 9 is a kind of block diagram of device according to an exemplary embodiment；
Figure 10 is a kind of block diagram of device for image taking reminding method according to an exemplary embodiment.
Pass through above-mentioned accompanying drawing, it has been shown that the clear and definite embodiment of the disclosure, will hereinafter be described in more detail.These accompanying drawings
The scope for limiting the disclosure by any mode and conceiving is not intended to, but is art technology by reference to specific embodiment
Personnel illustrate the concept of the disclosure.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following description is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the disclosure.On the contrary, they be only with it is such as appended
The example of the consistent apparatus and method of some aspects be described in detail in claims, the disclosure.
Fig. 1 is a kind of flow chart of image taking reminding method according to an exemplary embodiment, as shown in figure 1,
Methods described can apply in terminal device or server, comprise the following steps：
In step s 110, treat shooting image and carry out object classification, obtain object classification result.
When user is taken pictures to obtain using terminal device (for example, smart mobile phone, tablet personal computer, intelligent photographing device etc.)
After image to be captured, terminal device can extract specific characteristic from image to be captured, for example, the feature such as personage, scenery, then,
Rude classification is carried out to the object in image using Bag of Features algorithms and deep learning algorithms, obtains image
The rough low layer of middle object is semantic, for example, it is main comprising tree, high building and blue sky in an image, then it is rough corresponding to the image
Low layer semanteme is：Sky, building and tree.
In the step s 120, image segmentation is carried out to the image to be captured according to the object classification result, obtains figure
As object segmentation result.
Rough image segmentation is carried out according to objects in images classification results to be captured, obtains rough image object segmentation knot
Fruit, the object in image is split according to the rough low layer semanteme of the objects in images obtained in step S110, adopted
The example stated, a main image for including tree, high building and blue sky, corresponding image object are divided into sky, building and tree
Three parts.
Accurate Segmentation figure is not needed due to only needing to obtain image segmentation result rough corresponding to image to be captured herein
Each details object as in.Therefore, using rough image dividing method, for example, the active segmentation side based on viewpoint
Method, Grab-Cut dividing methods etc..
In step s 130, the standard layout according to corresponding to described image object segmentation result and the image to be captured
Information, obtain the object layout reasonability metric of the image to be captured.
Standard layout's information corresponding to image can be preset, for example, can set primary objects occupies whole image
Area ratio/occupancy ratio number range, such as 0.4~0.6, moreover, other objects are evenly distributed among in image in image.
The area ratio/occupancy ratio for obtaining object in the area ratio/occupancy ratio of each object in image to be captured, and standard layout's information enters
Row relatively obtains the difference between the practical layout of image to be captured and corresponding standard layout's information, and difference is bigger, shows to wait to clap
The layout effect for taking the photograph image is poorer.And then rationally distributed property metric is obtained according to the placement differences of the image to be captured,
Judge whether the layout of image to be captured is reasonable according to the rationally distributed property metric.
In step S140, to object layout reasonability metric corresponding to image to be captured described in user feedback.
In the embodiment of the disclosure one, only when detecting that the layout effect of image to be captured of user's shooting is unreasonable,
Just to the object layout reasonability metric of image to be captured described in user feedback.
In another embodiment of the present disclosure, no matter detect whether the layout effect of image to be captured reasonable, all to
Feed back the object layout reasonability metric of the image to be captured in family.
Can be in the following ways to the mode of user feedback object layout reasonability metric：
(1) text prompt information, is shown to user on the display interface of terminal device, as shown in Fig. 2 in terminal device
Corresponding prompt message is shown on image to be captured on 100 display interface 200：" photo is laid out poor effect, does not recommend to clap
According to ".
(2), auditory tone cues information is played to user；
(3) text prompt information, is shown on the display interface of terminal device, while plays auditory tone cues information；
(4), on the display interface of terminal device, graphical cues information is shown.
, can be according to the number range of object layout reasonability metric, Xiang Yong in the another embodiment of the disclosure
Feed back different prompt messages in family.The rationally distributed degree of the image to be captured characterized when object layout reasonability metric
When differing, different text prompt information is shown, different auditory tone cues information is played, shows different graphical cues information
It can be the shape difference of figure or the color difference of figure to show different graphical cues information.It is for example, green
Prompting frame represents rationally distributed, and yellow prompting frame represents that layout is general, and red prompting frame represents that layout is very poor.And for example, utilize
" √ " represents rationally distributed, represents to be laid out with "×" very poor.
The image taking reminding method that the present embodiment provides, the object treated first in shooting image are classified, obtained
Object classification result；Shooting image is treated according to object classification result to be split, and obtains image segmentation result；Utilize image point
Standard layout's information corresponding to cutting result and image to be captured, obtain the object layout reasonability metric of image to be captured.
And to the object layout reasonability metric of image to be captured described in user feedback.Remind the user that the thing of image to be captured
Whether body layout is reasonable.Especially when the object layout of image to be captured is unreasonable, user adjusts terminal according to the information of prompting
Shooting direction, the acquisition parameters such as angle, change the layout of image to be captured, so that the objects in images layout that user takes
More rationally, the shooting effect of image is more preferable.
Fig. 3 is a kind of object layout reasonability metric method of acquisition image according to an exemplary embodiment
Flow chart, as shown in figure 3, methods described can apply in terminal device or server, comprise the following steps：
In step S210, according to described image object segmentation result, each type objects in the image to be captured are calculated
Area ratio/occupancy ratio.
In step S220, according to the area ratio/occupancy ratio and standard layout's information of each type objects, institute is calculated
State the object layout reasonability metric of image to be captured.
Wherein, standard layout's information in the exemplary embodiment of the disclosure one, can set figure to be captured with default settings
The area ratio/occupancy ratio of primary objects as in must be interior in preset range (for example, 0.4~0.6), and other in image to be captured
The area ratio/occupancy ratio of object is more or less the same, i.e., other object equiblibrium mass distributions in image to be captured are in image.It is assumed that in image
Comprising N number of object, the area ratio/occupancy ratio of primary objects is 0.5 in standard layout's information setting image, in addition to primary objects
Other object equiblibrium mass distributions, i.e., the area ratio/occupancy ratio of other objects are
In the exemplary embodiment of the disclosure one, step S220 can use method flow as shown in Figure 4 to realize, such as scheme
Shown in 4, methods described may comprise steps of：
In step S221, according to the area ratio/occupancy ratio of each type objects in the image to be captured and the standard layout
Difference in information between corresponding standard item area ratio/occupancy ratio, obtain the object layout difference letter of the image to be captured
Breath.
Assuming that detecting N number of object in image, the area ratio/occupancy ratio that any one object is calculated is Ratei, wherein, i
For positive integer, and 1≤i≤N.Wherein, m-th of object is the primary objects in image.Tentative standard layout information sets image
The area ratio/occupancy ratio of middle primary objects is 0.5, then, the area ratio/occupancy ratio of other each objects is
Then the object layout different information Delta of the image to be captured is：
(formula 1)
In formula 1, RatemFor the area ratio/occupancy ratio of primary objects, RatejFor any one object in addition to primary objects
Area ratio/occupancy ratio.
The layout that Delta characterizes image to be captured shows more greatly with the difference between corresponding standard layout's information, numerical value
The layout effect of image to be captured is poorer；Otherwise, numerical value it is smaller show image to be captured layout effect it is better.
In step S222, according to the object layout different information, the object layout reasonability metric is obtained.
Score=100-100*Delta (formula 2)
The score being calculated according to formula 2, it is roughly divided into 3 grades：70~100, show the layout of image to be captured
Rationally, it is strongly recommended that taking pictures, the prompting frame prompting user of green can be shown on image to be captured；40~70, show to wait to clap
It is general to take the photograph the layout of image, does not recommend to take pictures, the prompting frame of yellow can be shown on image to be captured, user can be by flat
Moving terminal device makes image to be captured reach preferably layout effect；0~40, show that the layout of image to be captured is very poor, do not push away
Recommend and take pictures, the prompting frame of red is shown on image to be captured, user must improve figure to be captured by translating terminal device
The layout effect of picture.
The method of the object layout reasonability metric for the acquisition image to be captured that the present embodiment provides, according to be captured
The area ratio/occupancy ratio of each object in image, and standard layout's information corresponding to image to be captured, are calculated to be captured
Object layout different information between the layout and standard layout's information of image, is treated according to the object layout different information
The object layout reasonability metric of shooting image, the cloth of image to be captured is judged according to object layout reasonability metric
Whether office is reasonable.
In another embodiment of the present disclosure, step S220 can use method flow as shown in Figure 5 to realize, such as Fig. 5
Shown, methods described may comprise steps of：
In step S223, according to the area ratio/occupancy ratio of each type objects in the image to be captured, it is determined that described wait to clap
Take the photograph the screening-mode of image.
According to image object segmentation result to be captured, the classification of each object in image object segmentation result is judged, and,
The area ratio/occupancy ratio for the object that segmentation obtains is calculated, determines the screening-mode of image to be captured.The screening-mode includes personage
Close shot pattern, personage's landscape mode, natural scene close shot pattern and natural scene landscape mode.
If personage is included in image object segmentation result, and the area ratio/occupancy ratio of each object is more or less the same, it is determined that treat
The screening-mode of shooting image is personage's landscape mode；If only include natural scene, and each thing in image object segmentation result
The area ratio/occupancy ratio of body is more or less the same, it is determined that the screening-mode of image to be captured is natural scene landscape mode；If image thing
Personage is included in body segmentation result, and the area ratio/occupancy ratio of personage is all higher than the area ratio/occupancy ratio of other objects, it is determined that wait to clap
The screening-mode for taking the photograph image is personage's close shot pattern；If personage is included in image object segmentation result, and personage's area ratio/occupancy ratio
The area ratio/occupancy ratio of significantly larger than other objects, it is determined that the screening-mode of image to be captured is personage's close shot pattern.
In step S224, according to the area ratio/occupancy ratio of each type objects, the screening-mode in the image to be captured
The difference weight of corresponding object, and standard layout's information, obtain the object layout different information of the image to be captured.
No matter for which kind of screening-mode, standard layout's information all thinks that the area ratio/occupancy ratio of the primary objects in image must
Must within a preset range, and in image other objects must equiblibrium mass distribution in image.But different screening-mode things
The difference weighted of body.The difference weight of object includes two classes, and one kind is the difference weight of primary objects；Another kind of is except master
Want the difference weight of other objects outside object, moreover, the difference weight of the difference weight of primary objects and other objects it
With the difference weight that primary objects equal to 1, can be set, the difference weights of other objects is tried to achieve；Or other things can be set
The difference weight of body, try to achieve the difference weight of main other objects.Difference weight can obtain according to many experiments, for example, people
It is 0.8 that thing close shot pattern, which corresponds to difference weight corresponding to primary objects, and difference weight corresponding to other objects is 0.2.
For close shot pattern, more focus on the difference of primary objects, therefore, the difference weight of primary objects is larger, other things
The difference weight of body is smaller；And for landscape mode, more value the equilibrium situation of object, therefore, the difference weight of primary objects
Smaller, the difference weight of other objects is larger.
Assuming that detecting N number of object in image, the area ratio/occupancy ratio that any one object is calculated is Ratei, wherein, i
For positive integer, and 1≤i≤N.Wherein, m-th of object is the primary objects in image.Tentative standard layout information sets image
The area ratio/occupancy ratio of middle primary objects is 0.5, and the area ratio/occupancy ratio of other each objects is
Then the object layout different information Delta of the image to be captured is：
(formula 3)
In formula 3, wpatternIt is poor corresponding to other objects in the image under different screening-modes in addition to primary objects
Different weight, wpatternIt is smaller, show that the layout of primary objects under such a screening-mode is more important.
In step S225, according to the object layout different information, the object layout reasonability metric is obtained.
The numerical value for the Delta being calculated using formula 3 is substituted into formula 2, the current cloth of image to be captured is calculated
The score of office, i.e., the object layout reasonability metric of image to be captured.Judged according to object layout reasonability metric
Whether rational the object layout of image to be captured process be identical with above-mentioned process, and here is omitted.
The method for the acquisition object layout reasonability metric that the present embodiment provides, according to each in image segmentation result
The area ratio/occupancy ratio of type objects, determine the screening-mode of image to be captured.According to different for different screening-mode settings
Difference weight, the object in difference weight corresponding to the area ratio/occupancy ratio of binding object, the object and standard layout's information
The area ratio/occupancy ratio of standard item, obtain the object layout different information of image.Finally obtained according to object layout different information
Object layout reasonability metric.Due to by graphic collection to be captured into different screening-modes, to not in different patterns
Value degree difference with object, therefore different difference weights, so, the object layout different information energy being calculated are set
Enough to be more biased in the object more valued, the object layout reasonability metric being calculated is more accurate.
Fig. 6 is a kind of flow chart of objects in images topological analysis method according to an exemplary embodiment, such as Fig. 6
Shown, methods described can be used in terminal device or server, comprise the following steps：
In step S310, object classification is carried out to target image, obtains object classification result.
In step s 320, image segmentation is carried out to the target image according to the object classification result, obtains image
Object segmentation result.
In step S330, believed according to standard layout corresponding to described image object segmentation result and the target image
Breath, obtains the object layout reasonability metric of the target image.
Wherein, step S330 implementation is identical with the implementation of the step S130 in above-described embodiment, herein not
Repeat again.
The analysis method for the objects in images layout that the present embodiment provides, carries out rude classification to the object in image, obtains
To object classification result.According to the object classification result of image, image is split, obtains image object segmentation result.Root
According to image object segmentation result and standard layout's information, the object layout reasonability metric in image is obtained, so as to figure
The layout of picture is analyzed, evaluated.
Fig. 7 is a kind of image taking suggestion device block diagram according to an exemplary embodiment.As shown in fig. 7, the dress
Put including：Object classification unit 110, image segmentation unit 120, layout metric element 130 and feedback unit 140.
Object classification unit 110 is configured as treating shooting image progress object classification, obtains object classification result.
Image segmentation unit 120 is configured as carrying out image point to the image to be captured according to the object classification result
Cut, obtain image object segmentation result.
Layout metric element 130 is configured as corresponding according to described image object segmentation result and the image to be captured
Standard layout's information, obtain the object layout reasonability metric of the image to be captured.
In the embodiment of the disclosure one, the layout metric element can include：First computation subunit and second calculates
Subelement.
First computation subunit is configured as, according to described image object segmentation result, calculating the image to be captured
In each type objects area ratio/occupancy ratio.
Second computation subunit is configured as area ratio/occupancy ratio and standard layout's information according to each type objects, meter
Calculation obtains the object layout reasonability metric of the image to be captured.
Wherein, in the exemplary embodiment of the disclosure one, second computation subunit can include：Screening-mode determines
Subelement, the first placement differences obtain subelement and the 3rd computation subunit.
The screening-mode determination subelement is configured as being accounted for according to the area of each type objects in the image to be captured
There is rate, determine the screening-mode of the image to be captured；
First placement differences obtain subelement be configured as according to corresponding to each type objects area ratio/occupancy ratio,
The screening-mode corresponds to the difference weight of object, and standard layout's information, obtains the object of the image to be captured
Placement differences information；
3rd computation subunit is configured as according to the object layout different information, is obtained the object layout and is closed
Rationality metric.
In another embodiment of the disclosure, second computation subunit can include：It is single that second placement differences obtain son
Member and the 4th computation subunit.
The second placement differences acquisition subelement is configured as the face according to each type objects in the image to be captured
Difference between product occupation rate standard item area ratio/occupancy ratio corresponding with standard layout's information, is obtained described to be captured
The object layout different information of image.
4th computation subunit is configured as obtaining the image to be captured according to the object layout different information
Object layout reasonability metric.
Feedback unit 140 is configured as to object layout reasonability measurement letter corresponding to image to be captured described in user feedback
Breath.
The image taking suggestion device that the present embodiment provides, treats the thing in shooting image by object classification unit first
Body is classified, and obtains object classification result；Shooting image is treated by image segmentation unit according to object classification result to be divided
Cut, obtain image segmentation result.Metric element is laid out using standard layout's letter corresponding to image segmentation result and image to be captured
Breath, obtains the object layout reasonability metric of image to be captured.And by be captured described in feedback unit to user feedback
The object layout reasonability metric of image.Remind the user that whether the object layout of image to be captured is reasonable.Especially when
When the object layout of image to be captured is unreasonable, user adjusts the shooting such as the shooting direction of terminal, angle according to the information of prompting
Parameter, change the layout of image to be captured, so that the objects in images that user takes is laid out more reasonable, the shooting effect of image
More preferably.
The analysis method embodiment being laid out corresponding to above-mentioned objects in images, it is real that the disclosure additionally provides corresponding device
Apply example.
Fig. 8 is a kind of analytical equipment block diagram of objects in images layout according to an exemplary embodiment, such as Fig. 8 institutes
Show, described device includes：Object classification unit 210, image segmentation unit 220 and layout metric element 230.
Object classification unit 210 is configured as carrying out object classification to target image, obtains object classification result.
Image segmentation unit 220 is configured as carrying out image point to the target image according to the object classification result
Cut, obtain image object segmentation result.
Layout metric element 230 is configured as according to corresponding to described image object segmentation result and the target image
Standard layout's information, obtain the object layout reasonability metric of the target image.
Wherein, the implementation process of metric element 230 and the layout metric element 130 in above-mentioned device embodiment are laid out
Implementation process is identical, and here is omitted.
The analytical equipment for the objects in images layout that the present embodiment provides, carries out rude classification to the object in image, obtains
To object classification result.According to the object classification result of image, image is split, obtains image object segmentation result.Root
According to image object segmentation result and standard layout's information, the object layout reasonability metric in image is obtained, so as to figure
The layout of picture is analyzed, evaluated.
On the device in above-described embodiment, wherein modules perform the concrete mode of operation in relevant this method
Embodiment in be described in detail, explanation will be not set forth in detail herein.
Fig. 9 is a kind of terminal device 800 for image taking reminding method according to an exemplary embodiment
Block diagram.For example, terminal device 800 can be mobile phone, and computer, digital broadcast terminal, messaging devices, game control
Platform, tablet device, Medical Devices, body-building equipment, personal digital assistant, photographing device etc..
Reference picture 9, terminal device 800 can include following one or more assemblies：Processing component 802, memory 804,
Power supply module 806, multimedia groupware 808, audio-frequency assembly 810, the interface 812 of input/output (I/O), sensor cluster 814,
And communication component 816.
Processing component 802 generally controls the integrated operation of terminal device 800, such as leads to display, call, data
The operation that letter, camera operation and record operation are associated.Processing component 802 can include one or more processors 820 to hold
Row instruction, to complete all or part of step of above-mentioned method.In addition, processing component 802 can include one or more moulds
Block, the interaction being easy between processing component 802 and other assemblies.For example, processing component 802 can include multi-media module, with
Facilitate the interaction between multimedia groupware 808 and processing component 802.
Memory 804 is configured as storing various types of data to support the operation in terminal device 800.These data
Example include being used for the instruction of any application program or method operated on terminal device 800, contact data, telephone directory
Data, message, picture, video etc..Memory 804 can by any kind of volatibility or non-volatile memory device or it
Combination realize, as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM) are erasable
Except programmable read only memory (EPROM), programmable read only memory (PROM), read-only storage (ROM), magnetic memory, soon
Flash memory, disk or CD.
Power supply module 806 provides electric power for the various assemblies of terminal device 800.Power supply module 806 can include power supply pipe
Reason system, one or more power supplys, and other components associated with generating, managing and distributing electric power for terminal device 800.
Multimedia groupware 808 is included in the screen of one output interface of offer between the terminal device 800 and user.
In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes touch surface
Plate, screen may be implemented as touch-screen, to receive the input signal from user.Touch panel includes one or more touch
Sensor is with the gesture on sensing touch, slip and touch panel.The touch sensor can not only sensing touch or slip
The border of action, but also detect the duration and pressure related to the touch or slide.In certain embodiments,
Multimedia groupware 808 includes a front camera and/or rear camera.When terminal device 800 is in operator scheme, such as clap
When taking the photograph pattern or video mode, front camera and/or rear camera can receive outside multi-medium data.It is each preposition
Camera and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio-frequency assembly 810 is configured as output and/or input audio signal.For example, audio-frequency assembly 810 includes a Mike
Wind (MIC), when terminal device 800 is in operator scheme, during such as call model, logging mode and speech recognition mode, microphone
It is configured as receiving external audio signal.The audio signal received can be further stored in memory 804 or via logical
Letter component 816 is sent.In certain embodiments, audio-frequency assembly 810 also includes a loudspeaker, for exports audio signal.
I/O interfaces 812 provide interface between processing component 802 and peripheral interface module, and above-mentioned peripheral interface module can
To be keyboard, click wheel, button etc..These buttons may include but be not limited to：Home button, volume button, start button and lock
Determine button.
Sensor cluster 814 includes one or more sensors, for providing the state of various aspects for terminal device 800
Assess.For example, sensor cluster 814 can detect opening/closed mode of terminal device 800, the relative positioning of component, example
Such as the display and keypad that the component is terminal device 800, sensor cluster 814 can with detection terminal equipment 800 or
The position of 800 1 components of terminal device changes, the existence or non-existence that user contacts with terminal device 800, terminal device 800
The temperature change of orientation or acceleration/deceleration and terminal device 800.Sensor cluster 814 can include proximity transducer, be configured
For detecting the presence of object nearby in no any physical contact.Sensor cluster 814 can also include light sensing
Device, such as CMOS or ccd image sensor, for being used in imaging applications.In certain embodiments, the sensor cluster 814
Acceleration transducer, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor can also be included.
Communication component 816 is configured to facilitate the communication of wired or wireless way between terminal device 800 and other equipment.
Terminal device 800 can access the wireless network based on communication standard, such as WiFi, 2G or 3G, or combinations thereof.Show at one
In example property embodiment, communication component 816 receives broadcast singal or broadcast from external broadcasting management system via broadcast channel
Relevant information.In one exemplary embodiment, the communication component 816 also includes near-field communication (NFC) module, short to promote
Cheng Tongxin.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module
(UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, terminal device 800 can be by one or more application specific integrated circuits (ASIC), number
Word signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for performing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instructing, example are additionally provided
Such as include the memory 804 of instruction, above-mentioned instruction can be performed to complete the above method by the processor 820 of terminal device 800.Example
Such as, the non-transitorycomputer readable storage medium can be ROM, it is random access memory (RAM), CD-ROM, tape, soft
Disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by the processing of terminal device
When device performs so that terminal device is able to carry out a kind of image taking reminding method, and methods described includes：
Treat shooting image and carry out object classification, obtain object classification result；
Image segmentation is carried out to the image to be captured according to the object classification result, obtains image object segmentation knot
Fruit；
According to standard layout's information corresponding to described image object segmentation result and the image to be captured, obtain described
The object layout reasonability metric of image to be captured；
To object layout reasonability metric corresponding to image to be captured described in user feedback.
Alternatively, the terminal device 800 also includes another non-transitorycomputer readable storage medium, is deposited when described
Instruction in storage media by terminal device computing device when so that terminal device is able to carry out a kind of objects in images layout
Analysis method, methods described includes：
Treat shooting image and carry out object classification, obtain object classification result；
Image segmentation is carried out to the image to be captured according to the object classification result, obtains image object segmentation knot
Fruit；
According to standard layout's information corresponding to described image object segmentation result and the image to be captured, obtain described
The object layout reasonability metric of image to be captured.
Figure 10 is a kind of frame of device 1900 for image taking reminding method according to an exemplary embodiment
Figure.For example, device 1900 may be provided in a server.Reference picture 10, device 1900 include processing component 1922, and it enters one
Step includes one or more processors, and as the memory resource representated by memory 1932, can be by treatment group for storing
The instruction of the execution of part 1922, such as application program.The application program stored in memory 1932 can include one or one
Above each corresponds to the module of one group of instruction.In addition, processing component 1922 is configured as execute instruction, it is above-mentioned to perform
Fig. 1~Fig. 6 shown in embodiment of the method.
Device 1900 can also include a power supply module 1926 and be configured as the power management of performs device 1900, one
Wired or wireless network interface 1950 is configured as device 1900 being connected to network, and input and output (I/O) interface
1958.Device 1900 can be operated based on the operating system for being stored in memory 1932, such as Windows ServerTM, Mac
OS XTM, UnixTM, LinuxTM, FreeBSDTM or similar.
Those skilled in the art will readily occur to the present invention its after considering specification and putting into practice invention disclosed herein
Its embodiment.The application be intended to the present invention any modification, purposes or adaptations, these modifications, purposes or
Person's adaptations follow the general principle of the present invention and including the undocumented common knowledges in the art of the disclosure
Or conventional techniques.Description and embodiments are considered only as exemplary, and true scope and spirit of the invention are by following
Claim is pointed out.
It should be appreciated that the invention is not limited in the precision architecture for being described above and being shown in the drawings, and
And various modifications and changes can be being carried out without departing from the scope.The scope of the present invention is only limited by appended claim.
Claims (11)
- A kind of 1. image taking reminding method, it is characterised in that including：Treat shooting image and carry out object classification, obtain each object classification result；Image segmentation is carried out to the image to be captured according to the object classification result, obtains each type objects segmentation in image As a result；According to the object segmentation result, the area ratio/occupancy ratio of each type objects in the image to be captured is calculated；According to the area ratio/occupancy ratio and standard layout's information of each type objects in the image to be captured, it is calculated and described waits to clap Take the photograph the object layout reasonability metric of image；To object layout reasonability metric corresponding to image to be captured described in user feedback.
- 2. according to the method for claim 1, it is characterised in that according to the area of each type objects in the image to be captured Occupation rate and standard layout's information, the object layout reasonability metric of the image to be captured is calculated, using as follows Mode：According to the area ratio/occupancy ratio of each type objects in the image to be captured and corresponding standard in standard layout's information Difference between object area ratio/occupancy ratio, obtain the object layout different information of the image to be captured；The object layout reasonability metric of the image to be captured is obtained according to the object layout different information.
- 3. according to the method for claim 1, it is characterised in that according to the area of each type objects in the image to be captured Occupation rate and standard layout's information, the object layout reasonability metric of the image to be captured is calculated, using as follows Mode：According to the area ratio/occupancy ratio of each type objects in the image to be captured, the screening-mode of the image to be captured is determined；The difference weight of object, Yi Jisuo are corresponded to according to area ratio/occupancy ratio, the screening-mode corresponding to each type objects Standard layout's information is stated, obtains the object layout different information of the image to be captured；According to the object layout different information, the object layout reasonability metric is obtained.
- 4. according to the method described in claim any one of 1-3, it is characterised in that described to image to be captured described in user feedback Corresponding object layout reasonability metric, in the following way：Pass through object layout reasonability information described in text prompt information, auditory tone cues information and/or graphical cues feedback of the information.
- 5. according to the method described in claim any one of 1-3, it is characterised in that corresponding to image to be captured described in user feedback Object layout reasonability metric, in the following way：According to the number range of the object layout reasonability metric of described image, corresponding prompt message is prompted the user with.
- A kind of 6. analysis method of objects in images layout, it is characterised in that including：Object classification is carried out to target image, obtains each object classification result；Image segmentation is carried out to the target image according to the object classification result, obtains each type objects segmentation knot in image Fruit；According to the object segmentation result, the area ratio/occupancy ratio of each type objects in the target image is calculated；According to the area ratio/occupancy ratio of each type objects in the target image and standard layout's information, the target figure is calculated The object layout reasonability metric of picture.
- A kind of 7. image taking suggestion device, it is characterised in that including：Object classification unit, object classification is carried out for treating shooting image, obtains each object classification result；Image segmentation unit, for carrying out image segmentation to the image to be captured according to the object classification result, obtain figure Each type objects segmentation result as in；Metric element is laid out, for according to the object segmentation result, calculating the face of each type objects in the image to be captured Product occupation rate；It is additionally operable to,According to the area ratio/occupancy ratio of each type objects in the target image and standard layout's information, it is calculated described to be captured The object layout reasonability metric of image；Feedback unit, for object layout reasonability metric corresponding to image to be captured described in user feedback.
- 8. device according to claim 7, it is characterised in that the layout metric element, including：Screening-mode determination subelement, for the area ratio/occupancy ratio according to each type objects in the image to be captured, determine institute State the screening-mode of image to be captured；First placement differences obtain subelement, for area ratio/occupancy ratio, the shooting mould according to corresponding to each type objects Formula corresponds to the difference weight of object, and standard layout's information, obtains the object layout difference letter of the image to be captured Breath；3rd computation subunit, for according to the object layout different information, obtaining the object layout reasonability measurement letter Breath.
- A kind of 9. analytical equipment of objects in images layout, it is characterised in that including：Object classification unit, for carrying out object classification to target image, obtain each object classification result；Image segmentation unit, for carrying out image segmentation to the target image according to the object classification result, obtain image In each type objects segmentation result；Metric element is laid out, for according to the object segmentation result, calculating the area of each type objects in the target image Occupation rate；It is additionally operable to,According to the area ratio/occupancy ratio of each type objects in the target image and standard layout's information, the target figure is calculated The object layout reasonability metric of picture.
- A kind of 10. terminal device, it is characterised in that including：Processor；For storing the memory of processor-executable instruction；Wherein, the processor is configured as：Treat shooting image and carry out object classification, obtain each object classification result；Image segmentation is carried out to the image to be captured according to the object classification result, obtains each type objects segmentation in image As a result；According to the object segmentation result, the area ratio/occupancy ratio of each type objects in the image to be captured is calculated；According to the area ratio/occupancy ratio of each type objects in the target image and standard layout's information, it is calculated described to be captured The object layout reasonability metric of image.
- 11. terminal device according to claim 10, it is characterised in that the processor is additionally configured to：It is anti-to user Present object layout reasonability metric corresponding to the image to be captured.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410364752.6A CN104243814B (en) | 2014-07-28 | 2014-07-28 | Analysis method, image taking reminding method and the device of objects in images layout |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410364752.6A CN104243814B (en) | 2014-07-28 | 2014-07-28 | Analysis method, image taking reminding method and the device of objects in images layout |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104243814A CN104243814A (en) | 2014-12-24 |
| CN104243814B true CN104243814B (en) | 2018-02-02 |
Family
ID=52231068
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410364752.6A Active CN104243814B (en) | 2014-07-28 | 2014-07-28 | Analysis method, image taking reminding method and the device of objects in images layout |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104243814B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9800778B2 (en) * | 2015-07-21 | 2017-10-24 | Qualcomm Incorporated | Camera orientation notification system |
| CN105323491B (en) * | 2015-11-27 | 2019-04-23 | 小米科技有限责任公司 | Image capturing method and device |
| CN105812665B (en) * | 2016-03-29 | 2019-01-15 | 联想(北京)有限公司 | A kind of shooting processing method, device and electronic equipment |
| CN106293070B (en) * | 2016-07-27 | 2019-11-15 | 网易（杭州）网络有限公司 | Virtual role view directions control method and device |
| EP3496386A4 (en) * | 2016-11-24 | 2019-07-03 | Huawei Technologies Co., Ltd. | Guiding method and device for photography composition |
| CN106791204A (en) * | 2017-02-27 | 2017-05-31 | 努比亚技术有限公司 | Mobile terminal and its image pickup method |
| CN107895041B (en) * | 2017-11-30 | 2020-12-29 | 北京小米移动软件有限公司 | Shooting mode setting method and device and storage medium |
| CN112385207B (en) * | 2018-07-03 | 2022-04-12 | 富士胶片株式会社 | Shooting plan prompting device and method |
| CN109218609B (en) * | 2018-07-23 | 2020-10-23 | 麒麟合盛网络技术股份有限公司 | Image composition method and device |
| CN113055593B (en) * | 2021-03-11 | 2022-08-16 | 百度在线网络技术（北京）有限公司 | Image processing method and device |
| CN115242923A (en) * | 2022-07-28 | 2022-10-25 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0698245A (en) * | 1992-09-07 | 1994-04-08 | Nippon Telegr & Teleph Corp <Ntt> | Spatial image input device |
| CN103188423A (en) * | 2011-12-27 | 2013-07-03 | 富泰华工业（深圳）有限公司 | Camera shooting device and camera shooting method |
| CN103402058A (en) * | 2013-08-22 | 2013-11-20 | 深圳市金立通信设备有限公司 | Shot image processing method and device |
-
2014
- 2014-07-28 CN CN201410364752.6A patent/CN104243814B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0698245A (en) * | 1992-09-07 | 1994-04-08 | Nippon Telegr & Teleph Corp <Ntt> | Spatial image input device |
| CN103188423A (en) * | 2011-12-27 | 2013-07-03 | 富泰华工业（深圳）有限公司 | Camera shooting device and camera shooting method |
| CN103402058A (en) * | 2013-08-22 | 2013-11-20 | 深圳市金立通信设备有限公司 | Shot image processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104243814A (en) | 2014-12-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104243814B (en) | Analysis method, image taking reminding method and the device of objects in images layout | |
| CN104156947B (en) | Image partition method, device and equipment | |
| KR101906827B1 (en) | Apparatus and method for taking a picture continously | |
| CN104408402B (en) | Face identification method and device | |
| CN104850828B (en) | Character recognition method and device | |
| CN110188236A (en) | A kind of recommended method of music, apparatus and system | |
| CN109670397A (en) | Detection method, device, electronic equipment and the storage medium of skeleton key point | |
| CN104063865B (en) | Disaggregated model creation method, image partition method and relevant apparatus | |
| CN109859096A (en) | Image Style Transfer method, apparatus, electronic equipment and storage medium | |
| CN107123081A (en) | image processing method, device and terminal | |
| CN107492115A (en) | The detection method and device of destination object | |
| CN104484664B (en) | Face picture treating method and apparatus | |
| CN104219445B (en) | Screening-mode method of adjustment and device | |
| CN105184313B (en) | Disaggregated model construction method and device | |
| CN109446994A (en) | Gesture critical point detection method, apparatus, electronic equipment and storage medium | |
| CN107766820A (en) | Image classification method and device | |
| CN106548468A (en) | The method of discrimination and device of image definition | |
| CN106971164A (en) | Shape of face matching process and device | |
| CN108010060A (en) | Object detection method and device | |
| CN104182967B (en) | image processing method, device and terminal | |
| CN106250921A (en) | Image processing method and device | |
| CN105957037B (en) | Image enchancing method and device | |
| CN105912944B (en) | The method and device of application program access authority is set | |
| CN109672830A (en) | Image processing method, device, electronic equipment and storage medium | |
| CN108062547A (en) | Character detecting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |