KR101898888B1 - Method and apparatus for providing automatic composition recognition and optimal composition guide of a digital image capture device - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and an apparatus for providing an automatic composition recognition and optimal composition of a digital image photographing apparatus, and more particularly to a method and apparatus for automatically recognizing a composition of a photographed image through a digital image photographing apparatus, Thereby enabling a user to shoot an image with an optimal composition, thereby maximizing the aesthetic sense of the image.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital image capturing apparatus,

The present invention relates to a method and apparatus for providing an automatic composition recognition and optimal composition of a digital image photographing apparatus, and more particularly to a method and apparatus for automatically recognizing a composition of an image photographed through a digital image photographing apparatus, The present invention relates to a method and apparatus for maximizing a sense of aesthetics of a digital image when a digital image is captured.

[0002] Recently, with the spread of digital image processing technology and digital image photographing apparatus, a digital image photographing apparatus (e.g., a digital camera, a smart phone) is substituted for photographing using a conventional film, As the number of pixels to be determined exceeds 400 megapixels, it is possible to take a picture that is much sharper and more aesthetically pleasing than that of a camera using a conventional film, easily and conveniently at any time and place.

In the process of holding the subject viewed by the human eye through the digital image pickup device in the shooting area of the camera, it is necessary to set the position of the subject in a stable composition so that the image can be aesthetically improved. In general, It is not easy for non-experts to take a picture of each other and take a picture.

Conventional digital imaging devices offer many convenience features for users, such as auto focus, auto exposure, and auto white balance. There is also a function to automatically set the shutter speed, focus, and white balance according to the location and environment. These technologies help users who use digital image taking apparatus to easily and comfortably take digital images.

However, most of the images taken using a conventional digital camera or a digital image photographing device including a camera mounted on a mobile device are not stable. The conventional digital image photographing apparatus automatically corrects the composition and provides the corrected image to the user. However, in the conventional digital image photographing apparatus, it is necessary to correct the composition so that the position of the subject is stable during the process of holding the subject, It does not have. That is, in a conventional digital image photographing apparatus, when a user photographs a digital image, it is difficult for a general user to photograph a photograph with a high sense of beauty because the photographing composition is automatically recognized and an optimal composition can not be provided to the user There is a difficult problem.

Accordingly, the present invention provides a method and apparatus for directly recognizing a line of a subject, a shape of a subject, a shape of a subject, and a composition of an object and determining an optimal composition therefor and providing the digital image to a user, And to provide a method and an apparatus for performing the method.

Hereinafter, the prior art related to the present invention will be briefly described, and then, the technical matter that the present invention intends to differentiate from the prior art will be described.

Korean Patent Registration No. 1642402 (Jul. 25, 2016) discloses a digital image photographing apparatus and method for guiding a photographing composition. When a digital image photographing apparatus inputs an image of a human face, And extracting the inclination information and the line of sight of the person, and photographing a face of the person according to the photographed composition stored in advance according to the inclination information and the extracted line of sight.

Korean Patent Laid-Open Publication No. 2009-0104429 (October 10, 2009) is directed to an apparatus and method for providing a photographing composition using face recognition in a digital image processor. The apparatus searches for a plurality of feature points through face recognition of a live view image, To a technique of generating a photographing composition guide using the searched feature points and inducing the photographing composition change so that the generated guide line coincides with the reference guide line.

 Although the prior arts have technical features that are somewhat similar to the present invention in that they provide a suitable imaging scheme to a user in digital image shooting, the prior art detects a face of a person through complicated steps, It is necessary to extract the inclination information, the direction of gaze or the feature point by analyzing the face of the person, so that it takes a long time to detect the face of the person, Face), so there are limitations in providing an optimal composition for various subjects.

On the other hand, the present invention judges whether a main line, a repetitive form, and a main object exist of an object that influences a composition in an image input to a digital image photographing apparatus, recognizes a current composition in a currently input image, It is possible to provide an optimum composition for a variety of subjects without limiting to a specific subject by providing the user with an optimal composition for the image.

The present invention has been made to solve the above problems, and it is an object of the present invention to recognize a main object of a line, a repeated form, and an image from an input image when capturing a digital image, So that a digital image of a higher esthetic feeling can be photographed.

The apparatus for providing a best composition for recognizing a composition of a digital image according to an embodiment of the present invention and providing a best composition for the recognized image includes an image processing module for providing a preview image for photographing the image, And automatically provides guidance to the user about the optimal composition of the corresponding image. When the user can not automatically recognize the composition of the image through the automatic guide unit, And a semi-automatic guide unit for recognizing the composition of the image and providing the user with a guide to the optimal composition of the image.

In addition, the automatic guide unit may automatically detect a line, a repeated shape, a main object, or a combination thereof, which influences an image composition through the image to recognize a composition of the image, And provides a guide to the optimal composition of the image.

In addition, the semi-automatic guide unit sequentially displays a specific line and all the objects appearing in the image, recognizes the composition of the corresponding image according to a line or an object selected by the user, and stores information on the recognized composition and the pre- And provides a guide to the optimal composition of the image.

Further, the guide is characterized in that it is performed by displaying an object including an arrow, a figure, a text or a combination thereof for guiding to an optimal composition, displaying a mini window for an optimal composition, or displaying an overlapping object .

Further, the optimal composition may include a golden division composition, a half composition, a ternary composition, a radial composition, a horizontal composition, a vertical composition, or a combination thereof.

According to another aspect of the present invention, there is provided a method of providing a best composition, comprising: providing a preview image for capturing an image; automatically recognizing a composition of the provided image; When the user does not automatically recognize the composition of the image through the automatic guide unit and the automatic guide unit, the user can recognize the composition of the image semi-automatically according to the user's selection and provide the user with a guide to the optimal composition of the image And a semi-automatic guiding step of guiding the guided vehicle.

In addition, the automatic guiding step may automatically detect a line, a repeating form, a main object, or a combination thereof that influences an image composition through the image, recognize a composition of the image, And provides a guide to the optimal composition of the image by comparing and calculating information on the composition.

In addition, the semi-automatic guide step sequentially displays a specific line and all the objects displayed on the image, recognizes a composition of the image according to a line or an object selected by the user, and displays information on the recognized composition And provides a guide to the optimal composition of the image.

The present invention relates to an apparatus and method for recognizing an automatic composition of a digital image photographing apparatus and a method for recognizing a line image, a repetitive shape, and a main object appearing on a preview image of a digital photographing apparatus, It is possible to photograph a digital image giving a high aesthetic feeling by providing the user with information on an optimal composition, an example image, and the like.

FIG. 1 is a view schematically showing a configuration of a device for providing a best composition guide for automatically recognizing an image composition according to an embodiment of the present invention and guiding the optimal composition.
FIG. 2 is a flowchart illustrating a procedure for determining an optimum composition through an automatic guide unit according to an embodiment of the present invention.
FIG. 3 is a flowchart illustrating a procedure for determining an optimal composition through a semi-automatic guide unit according to an embodiment of the present invention.
FIG. 4 is a diagram for explaining a method of providing a user with an optimal composition using a specific object in a method of providing a best composition according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating a method for providing a user with an optimum composition by creating a window in a method of providing a best composition according to another embodiment of the present invention. Referring to FIG.
FIG. 6 is a view for explaining a method of providing an optimal composition to a user by overlapping a subject in a method of providing a best composition according to another embodiment of the present invention. FIG.
FIG. 7 is a view showing information on a best composition for determining a best composition stored in a database according to an embodiment of the present invention, an example photograph, and data for user guidance.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements. Furthermore, specific structural and functional descriptions for embodiments of the present invention are presented for the purpose of describing an embodiment of the present invention only, and, unless otherwise defined, all terms used herein, including technical or scientific terms Have the same meaning as commonly understood by those of ordinary skill in the art to which the present invention belongs.

FIG. 1 is a view schematically showing a configuration of a device for providing a best composition guide for automatically recognizing an image composition according to an embodiment of the present invention and guiding the optimal composition.

As shown in FIG. 1, the optimal composition guide providing apparatus 100 includes an image processing module (not shown) for processing an image input from the digital image photographing apparatus, An automatic guide unit 110 that automatically provides a guide to the optimal composition, and a semi-automatic guide unit 120 that semi-automatically guides the guide to the optimal composition according to a user's selection.

Further, the automatic guide unit 110 automatically determines the optimal composition of the digital image photographed by the digital image photographing apparatus, and provides the optimal structure to the user.

That is, the automatic guide unit 110 automatically recognizes a main line, a repeated shape, or a main object that influences the image composition from the input image, recognizes the image composition for the image, And compares the optimal composition stored according to the line, the shape, and the shape and position of the main object, thereby providing an optimal composition for the image to the user.

In addition, when the optimal composition guide providing apparatus 100 can not automatically recognize the image composition of the image input from the automatic guide unit 110, the automatic image forming apparatus 100 converts the image composition into the semi-automatic mode, Thereby providing an optimal composition.

If the semi-automatic guide unit 120 can not automatically recognize the composition of the image input from the automatic guide unit 110, the semi-automatic guide unit 120 may display all the objects that may affect the composition of the image from the corresponding image, Make selection by the user.

In addition, when the user selects the displayed line or object, the semi-automatic guide unit 120 recognizes the composition of the corresponding image according to the shape and position of the corresponding line or object, And compares it with the composition, thereby providing an optimal composition to the user.

The process for determining the optimal composition in the automatic guide unit 110 and the process for determining the optimal composition in the semi-automatic guide unit 120 will be described with reference to FIGS. 2 and 3. FIG.

FIG. 2 is a flowchart illustrating a procedure for determining an optimum composition through an automatic guide unit according to an embodiment of the present invention.

As described with reference to FIG. 1, the optimal composition guide providing apparatus 100 of the present invention recognizes an input composition through an automatic mode and a semi-automatic mode, and recognizes the input image based on the recognized image composition Guide the optimal composition.

The optimal composition guide providing apparatus 100 may be provided in a digital image photographing apparatus such as a mobile communication terminal (e.g., smart phone) capable of photographing a digital image, a webcam, a digital camera, and the like, So that the optimal composition of the digital image photographed by the photographing apparatus can be determined and provided to the user.

In addition, the optimal composition guide providing apparatus 100 processes an image input from the digital image photographing apparatus in an automatic mode state, and provides the user with an optimal composition for the image.

As shown in FIG. 2, the automatic guide unit 110 determines whether there is a main line that affects an image composition in an original image input through a photographing module of a digital image photographing apparatus, through an image processing module.

If there is a main line that influences the image composition as a result of the determination through the automatic guide unit 110, a plurality of optimal compositions are loaded from a database storing a plurality of optimal compositions corresponding to the positions of the lines, And selects an optimal composition and provides the selected optimal composition to the user so that the user can take an image according to the provided optimum composition.

On the other hand, if it is determined that there is no main line that influences the image composition, the automatic guide unit 110 determines whether there is a repeated shape in the input original image.

Next, as a result of determining whether there is a repeated shape affecting the composition of the image in the automatic guide unit 110, if there is a repeated shape, a plurality of optimal compositions according to the shape are repeated from a database The user can load a plurality of optimal scenes according to the shape of the input image and compare the calculated optimal scenes with the input image to select an optimal scene and provide the selected optimal scene to the user, .

On the other hand, if it is determined that there is no repeating form, the image processing module determines whether or not there is a main object that affects the image composition in the first input image.

Next, as a result of judging the existence of the main object, if there are main objects influencing the image composition, a plurality of optimal compositions are loaded from a database storing a plurality of optimal compositions for the main object as described above Calculates an optimum composition for the principal object, and provides the selected optimal composition to the user so that the user can take an image according to the provided optimal composition.

If there is no line, shape, or object as a result of judging existence of a main line, existence of a repetitive pattern, presence of a main object, or the like from the image input to the automatic guide unit 110 first, Converts the automatic mode being executed to semi-automatic mode.

That is, when the optimal composition guide providing apparatus 100 can not automatically recognize the existence of the main line that influences the composition of the image, the existence of the repeated shape, the main object, and the image of the first input image, .

FIG. 3 is a flowchart illustrating a procedure for determining an optimal composition through a semi-automatic guide unit according to an embodiment of the present invention.

3, when the composition of the image is not automatically recognized from the image input from the digital image photographing apparatus through the automatic guide unit 110, the semi- And displays the most prominent lines that may affect the composition in the image input through the image processing, and allows the user to select a desired line from among the displayed lines.

Next, when the user selects a desired line, the semi-automatic guide unit 120 loads a plurality of optimal compositions from a database storing a plurality of optimal images according to the position of the corresponding line, compares the optimal images with the first input image, And selects and provides the optimum composition to the user.

On the other hand, if the user does not select a line, all objects detectable in the first input image are processed and displayed, and at least one object desired by the user is selected from among the displayed objects.

Next, when the user selects the desired object, the semi-automatic guide unit 120 loads a plurality of optimal compositions from a database storing a plurality of optimal compositions corresponding to the positions of the objects, compares the optimal compositions with the first input image, And selects and provides the optimum composition to the user.

   FIG. 4 is a diagram for explaining a method of providing a user with an optimal composition using a specific object in a method of providing a best composition according to an embodiment of the present invention.

   FIG. 4 is a flowchart illustrating a method of providing an optimal composition according to an exemplary embodiment of the present invention. Referring to FIG. 4, a method of guiding an optimal composition to a user using a specific object is performed by selecting an optimal composition , The user can guide the first input image to photograph the optimal composition using a specific object such as an arrow, a dotted line, a square, or the like so as to match the selected optimal composition.

At this time, it is possible to easily display the position information on the moving object (that is, the position information of the subject in the image) and the scores of the aesthetics on the image in a text format so as to easily lead to the optimal composition.

FIG. 5 is a diagram illustrating a method for providing a user with an optimum composition by creating a window in a method of providing a best composition according to another embodiment of the present invention. Referring to FIG.

As shown in FIG. 5, a method of creating a window and guiding a user to a best composition is a method of selecting a best composition of a first image input by the digital image photographing apparatus and providing the optimal composition to a user, mini) window to display the optimal composition for the subject.

The window displays the corresponding image set to the optimal composition, and overlapped with the image input to the digital photographing apparatus.

The position of the window can be displayed on the upper, lower, left, and right sides of the image so that the user can easily recognize the position without being confused with the image.

FIG. 6 is a view for explaining a method of providing an optimal composition to a user by overlapping a subject in a method of providing a best composition according to another embodiment of the present invention. FIG.

As shown in FIG. 6, a method of overlapping a subject and guiding a user to an optimal composition is performed by selecting an optimal composition through a video processing module provided in the optimal composition guide providing apparatus 100, The user can select a subject of the input image and overlap the selected subject with the image, thereby guiding the optimal composition.

That is, the user can easily change the composition of the input image by overlapping the input image with a subject set to the optimal composition.

 FIG. 7 is a diagram illustrating data on a best composition, an example photograph, and a guide for determining a best composition stored in a database according to an exemplary embodiment of the present invention.

As shown in Fig. 7, the optimal composition is preset and stored.

In addition, the optimal composition guide providing apparatus 100 may be configured to provide the optimal composition guide 100 with one or more of an optimal composition 1 to an optimal composition 6 according to a line, an iterative shape, a main object, So that the user can guide the user to photograph the image with the best composition.

Although FIG. 5 shows six optimal compositions as an example, various types of optimal compositions may be stored in advance according to a user's selection.

On the other hand, the optimal composition 1 refers to a half-composition (two-part composition). When the user wants to shoot an image at a certain ratio at a specific portion, such as photographing a sky and a rapeseed field at the same time Can be selected.

Also, the optimal composition 2 is a composition that is often found in natural materials such as sora, at a rate that is perceived to be the most beautiful to a person regarding the golden division composition. The golden division composition guides the user to shoot images with a composition ratio of 1 to 1.618, which is a compositional aspect ratio that allows the user to feel the most sense of stability.

Also, the optimal composition 3 relates to the composition of the third division, and the screen is divided into three parts, that is, the width and the length, so that the subject can be photographed near the intersection so that a photograph having a sense of stability can be obtained. The optimal composition guide providing apparatus 100 may select a triangle composition and provide it to a user when there is a main object influencing the composition of the image.

Also, the optimal composition 4 is about a radial composition and is a good composition for expressing perspective. If there is a line or an object exists in the image composition, the radial composition may be selected and provided to the user according to the shape of the line and the shape of the object.

In addition, when the optimum composition guide providing apparatus 100 finds a repeated pattern, it can select the optimal composition 5 or the optimal composition 6 and provide the composition to the user.

The optimal composition 5 relates to a horizontal composition, and is a composition which can be used to give a losing feeling and repeated rhythm when a repeated pattern is found. The optimal composition 6 has a stability feeling compared to the optimal composition 5 (horizontal composition) It is a composition that can be used for expressing dynamic elements which can be reduced.

As described above, the present invention relates to a method and an apparatus for providing an automatic composition recognition and a optimal composition guide of a digital image photographing apparatus, and it is an object of the present invention to recognize a composition of a current image through a preview image, An optimal composition for the image is determined, and the image is provided to the user, so that an image with high esthetics can be photographed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

100: Optimum composition guide device 110: Automatic guide part
120: Semi-automatic guide section

Claims (10)

An image processing module for providing a preview image for capturing an image;
A line, a repeating form, and an object that affect the composition of an image are automatically detected through the image to recognize an image composition for the image, and a plurality of optimal compositions for the detected line, An automatic guide unit for loading a selected image from the database and comparing the plurality of optimal images loaded with the recognized image composition to select a best image for the corresponding image among the plurality of optimal images and providing the guide to the user; And
Displaying a plurality of lines appearing on the image when no line, repeated shape or object is detected from the image; and when the user selects a specific line among the plurality of lines, The plurality of optimal compositions according to the position of the selected specific line are loaded from the database, and the plurality of optimal compositions and the image composition are compared with each other by loading the plurality And a semi-automatic guide unit for selecting a best frame for the corresponding image among the best frames and providing a guide to the user,
The semi-
Wherein when the user does not select the specific line, a plurality of objects detected from the image are displayed to allow the user to select at least one specific object, and when the user selects a specific object, A plurality of optimal compositions according to positions of the selected specific objects are loaded from a database, and the plurality of optimized compositions and the image composition are compared with each other by loading the plurality of optimal compositions, Selecting an optimal composition for the corresponding image from the best composition and providing the guide to the user,
Providing the guide to a user may include,
An object including an arrow and a dotted line for guiding to the selected optimal composition is displayed on an image input to the digital photographing device to allow the user to select a photograph in the optimum composition,
And a mini window for the selected optimal composition is generated and displayed on an image input to the digital photographing apparatus,
Selecting an object set in the optimal composition and displaying the overlapping object on the input image so that the user can change the composition of the input image,
The score of the aesthetic sense and the positional information of the subject being moved to the optimal composition are displayed in a text format on the input image, and in the process of holding the subject, which is viewed by the human eye through the digital image photographing apparatus, To a stable composition, and to photograph an aesthetically improved image,
Recognizing the image composition may include:
The optimal composition of the image is recognized as one of a golden division structure, a half structure, a ternary structure, a radial composition, a horizontal composition, and a vertical composition,
Wherein when the ratio of the length to the width of the image to be photographed is 1 to 1.618, the optimal composition of the image is recognized as the golden division composition,
If the specific portion of the image to be photographed is the same ratio, recognizes the optimal composition of the image as the half composition,
When the image of the image to be photographed is divided into three equal parts in the horizontal and vertical directions and the subject is photographed in the vicinity of the intersection, the optimum composition of the image is recognized as the third degree composition,
Recognizing the optimal composition of the image as the radial composition so that a perspective can be selected according to the shape of the line and the shape of the object when a line exists or an object exists in the image to be photographed,
Recognizing the optimal composition of the image as the horizontal composition so as to give a lapse sense and a repetitive rhythm when the repeated pattern is found in the image to be photographed,
Wherein when the image to be photographed is less stable than the horizontal composition, if the dynamic element is to be expressed, the optimal composition of the image is recognized as the vertical composition. delete delete delete delete Providing a preview image for capturing an image;
A line, a repeating form, and an object that affect the composition of an image are automatically detected through the image to recognize an image composition for the image, and a plurality of optimal compositions for the detected line, An automatic guiding step of selecting a best frame for the corresponding image among the plurality of optimal frames by loading the plurality of optimal frames and the recognized image frame by loading from the database and providing the guide to the user; And
Displaying a plurality of lines appearing on the image when no line, repeated shape or object is detected from the image; and when the user selects a specific line among the plurality of lines, The plurality of optimal compositions according to the position of the selected specific line are loaded from the database, and the plurality of optimal compositions and the image composition are compared with each other by loading the plurality A semi-automatic guide step of selecting a best frame for the corresponding image among the best frames and providing a guide to the user,
The semi-
Wherein when the user does not select the specific line, a plurality of objects detected from the image are displayed to allow the user to select at least one specific object, and when the user selects a specific object, A plurality of optimal compositions according to positions of the selected specific objects are loaded from a database, and the plurality of optimized compositions and the image composition are compared with each other by loading the plurality of optimal compositions, Selecting an optimal composition for the corresponding image from the best composition and providing the guide to the user,
Providing the guide to a user may include,
An object including an arrow and a dotted line for guiding to the selected optimal composition is displayed on an image input to the digital photographing device to allow the user to select a photograph in the optimum composition,
And a mini window for the selected optimal composition is generated and displayed on an image input to the digital photographing apparatus,
Selecting an object set in the optimal composition and displaying the overlapping object on the input image so that the user can change the composition of the input image,
The score of the aesthetic sense and the positional information of the subject being moved to the optimal composition are displayed in a text format on the input image, and in the process of holding the subject, which is viewed by the human eye through the digital image photographing apparatus, To a stable composition, and to photograph an aesthetically improved image,
Recognizing the image composition may include:
The optimal composition of the image is recognized as one of a golden division structure, a half structure, a ternary structure, a radial composition, a horizontal composition, and a vertical composition,
Wherein when the ratio of the length to the width of the image to be photographed is 1 to 1.618, the optimal composition of the image is recognized as the golden division composition,
If the specific portion of the image to be photographed is the same ratio, recognizes the optimal composition of the image as the half composition,
When the image of the image to be photographed is divided into three equal parts in the horizontal and vertical directions and the subject is photographed in the vicinity of the intersection, the optimum composition of the image is recognized as the third degree composition,
Recognizing the optimal composition of the image as the radial composition so that a perspective can be selected according to the shape of the line and the shape of the object when a line exists or an object exists in the image to be photographed,
Recognizing the optimal composition of the image as the horizontal composition so as to give a lapse sense and a repetitive rhythm when the repeated pattern is found in the image to be photographed,
Wherein the image to be photographed is less stable than the horizontal composition, but when it is desired to express a dynamic element, the optimal composition of the image is recognized as the vertical composition. delete delete delete delete

Images