KR20220154556A - Photography system for surpporting to picture for mobile terminal and method thereof - Google Patents

Abstract

The present invention discloses a camera system. More specifically, the present invention relates to a camera system for supporting photographing for a mobile terminal, which runs in the mobile terminal such as a smart phone and supports photographing with the same background as a background image in an existing picture and the same pose as a person in the picture, and a method thereof. According to an embodiment of the present invention, the camera system and the method thereof analyze an original photo to identify a background and a target object, to specify a scene, and to identify a pose of a person appearing in the scene, and provide matching information on angles and the pose for a place and the person currently displayed on the screen, thereby performing photographing with the same composition and pose in the same place as a celebrity.

Description

Photo taking support camera system and method for mobile terminal {PHOTOGRAPHY SYSTEM FOR SURPPORTING TO PICTURE FOR MOBILE TERMINAL AND METHOD THEREOF}

The present invention relates to a camera system, and in particular, to take pictures for a mobile terminal that is driven by a mobile terminal such as a smart phone and supports taking pictures with the same background as a background image in an existing picture and the same pose as a person appearing in the picture. It relates to a supported camera system and method.

With the technological development of mobile terminals such as smart phones and tablet PCs, mobile terminals have recently been equipped with various functions such as a video playback function, a file transfer function, and a photo taking function as well as a general phone function.

In particular, as the performance of cameras mounted on smartphones improves day by day, it is now possible to take pictures with a clear quality comparable to that of dedicated digital cameras, such as over 100 million pixels. In addition, as various technologies such as Auto Focus (AF), self-shooting, and anti-shake are applied to enable users to easily use the recording device, users can conveniently take high-quality photos and videos anywhere. It became.

Furthermore, various smartphone-specific applications that implement functions such as photo editing and transmission are also being spread.

These smartphone-specific applications include an application for photo correction, an application for changing the frame of a photo, and an application for requesting a photo printing service. I am keeping a record of my daily life.

On the other hand, as the general public's interest in celebrities, including entertainers, increases, information about these celebrities is also explosively increasing. In particular, with the development of information and communication technology represented by the Internet, celebrity portal sites that provide various information such as profiles of specific celebrities, related news, works in progress, fan club information, etc. have appeared, allowing the general public to share various information. making it possible This phenomenon coincides with the spread of smartphones, and when you find a celebrity on the street or in a specific place, you take a picture of the celebrity from a close distance and share information about the celebrity with your acquaintances through SNS.

In particular, when a famous celebrity shares a photo taken in a specific pose in a specific place on social media, etc., fans who see it often go to the location and pose in the same pose as the celebrity and take pictures. In this case, it can be said that it is important to find the appropriate location, find the correct background for the photoshoot, and accurately check the pose of the celebrity.

However, applications currently provided for smart phones have a limitation in that they cannot provide a function for taking a picture in the same place as the background image in the picture and in the same pose as the person in the picture.

Publication No. 10-2006-0058323 (published date: 2006.05.30.)

The present invention has been devised to overcome the above-mentioned limitations, the present invention implements a process of finding the same background as the background image in the picture and finding the same pose as the person in the picture through an augmented reality service, and the user with the same background and pose. There is a challenge in providing an environment for people to take pictures.

In order to solve the above problems, a camera system for supporting taking a picture for a mobile terminal according to an embodiment of the present invention provides a plurality of background line information constituting a background and outline information constituting a character, from an original image stored in a storage. an image information extractor for extracting meta information of an original image; a background/person separator for separating and identifying a background and a character located in the background based on the background line information and outline information; A photographing unit generating a photographed image including 3D depth information by photographing a surrounding background of the subject person, first spatial information corresponding to a background of the photographed image and the subject person of the photographed image by using the 3D depth information A space setting unit for setting a point cloud including second space information corresponding to, calculating an angle difference between the background of the original image and the background of the captured image by comparing the background line information and the first space information; A comparison and analysis unit that compares the contour information and the second space information to calculate a pose difference between the character and the subject person, and overlaps matching information including the angle difference and the pose difference with a captured image on the screen of the mobile terminal. It may include a matching information generation unit for displaying the matching information.

The background of the original image includes one or more target objects, and the comparison and analysis unit compares a plurality of points of the first spatial information with the target object so that a capturing location of the captured image is the same as a capturing location of the original image. can be judged to be the same.

In addition, the system of the present invention receives coordinate information including the latitude and longitude at which the photographed image was created from a GPS module installed in the mobile terminal, and transmits the coordinates to the comparison and analysis unit for reference when determining whether the photographed location is the same. An information providing unit may be further included.

The angle difference is expressed by the following equation for the X, Y, and Z coordinates of the first spatial information;

can be calculated as

The image information extraction unit may further perform a preprocessing process including removing noise and segmenting a plurality of images with respect to the original image.

In addition, in order to solve the above problems, a method for supporting taking pictures by a camera system installed and executed in a mobile terminal according to an embodiment of another aspect of the present invention includes (a) one or more subject persons and surroundings of the subject persons generating a photographed image including 3D depth information by photographing a background; (b) using the 3D depth information, first spatial information corresponding to a background of the photographed image and a subject person of the photographed image; Setting a point cloud including second spatial information; (c) a plurality of background line information constituting a background, contour information constituting a character, and meta information of an original image, from an original image stored in a storage; (d) identifying and separating a background and a character located in the background based on the background line information and the contour line information; (e) comparing the background line information and the first spatial information to Calculating an angle difference between the background of the original image and the background of the photographed image, and calculating a pose difference between the character and the subject by comparing the outline information and the second space information; (f) the angle difference and overlapping and displaying matching information including the pose difference with the photographed image on the screen of the mobile terminal.

Prior to the step (e), a target object included in the background of the original image is compared with a plurality of points of the first spatial information, and the target object is compared to determine the capturing location of the captured image as the capturing location of the original image. It may include the step of determining whether it is the same as.

The step (e) may include receiving coordinate information including the latitude and longitude at which the captured image was created from a GPS module installed in the mobile terminal; A step of determining whether they are identical may be further included.

The angle difference is expressed by the following equation for the X, Y, and Z coordinates of the first spatial information;

can be calculated as

The step (d) may further include performing a preprocessing process including removing noise and segmenting a plurality of images with respect to the original image.

According to an embodiment of the present invention, a background and a target object are identified by analyzing an original photo, a scene is identified and a pose of a person appearing in the scene is identified, and angles and poses for a place and a person currently displayed on a screen are identified. By providing matching information, there is an effect of taking a picture with the same composition and pose in the same place as the celebrity.

The present invention makes it possible to easily reflect the above-mentioned user's needs. In addition, the technical idea of the present invention can be applied to any scene in a movie or drama or a photograph of a famous work.

1 is a diagram illustrating a photo taking site using a mobile terminal.
2 is a diagram illustrating a camera system for supporting taking a picture for a mobile terminal according to an embodiment of the present invention.
3 is a diagram illustrating a method for supporting taking a picture for a mobile terminal according to an embodiment of the present invention.
4 and 5 are diagrams schematically illustrating an image processing method of a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention.
6 is a diagram illustrating a photographing screen provided by a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention.

The present invention as described above will be described in detail through the accompanying drawings and embodiments.

It should be noted that technical terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention. In addition, technical terms used in the present invention should be interpreted in terms commonly understood by those of ordinary skill in the art to which the present invention belongs, unless specifically defined otherwise in the present invention, and are excessively inclusive. It should not be interpreted in a positive sense or in an excessively reduced sense. In addition, when the technical terms used in the present invention are incorrect technical terms that do not accurately express the spirit of the present invention, they should be replaced with technical terms that those skilled in the art can correctly understand. In addition, general terms used in the present invention should be interpreted as defined in advance or according to context, and should not be interpreted in an excessively reduced sense.

Also, singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as "consisting of" or "comprising" should not be construed as necessarily including all of the various elements or steps described in the invention, and some of the elements or steps are included. It should be construed that it may not be, or may further include additional components or steps.

Also, terms including ordinal numbers such as first and second used in the present invention may be used to describe components, but components should not be limited by the terms. Terms are used only to distinguish one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention.

In the following description, the term "camera system for supporting picture taking for a mobile terminal" of the present invention may be abbreviated as "camera system" or "system" for convenience of description.

Hereinafter, a camera system and method for supporting taking a picture for a mobile terminal according to an embodiment of the present invention will be described with reference to the drawings.

1 is a diagram illustrating a photo taking site using a mobile terminal.

Referring to FIG. 1 , a camera system for supporting taking a picture for a mobile terminal according to an embodiment of the present invention may be implemented in the form of an application program installed and executed in a mobile terminal 10 such as a smartphone, and Depending on execution, it may be driven in conjunction with a camera mounted on the mobile terminal 10 .

In addition, the user may use the mobile terminal 10 to take a photograph of a subject person to leave a picture of in the same position and pose as the celebrity, against the background of a photographing location visited by a previous celebrity.

To this end, the mobile terminal 10 may download or store an original image taken and shared by a celebrity at a corresponding place, and the corresponding original image may be stored in a storage of the camera system. Accordingly, the camera system of the present invention determines whether the composition of the currently captured image and the pose of the subject are the same by referring to the original image when capturing the subject person, calculates accuracy, and generates numerically expressed matching information and displays the image. can be provided on the

In particular, the camera system according to an embodiment of the present invention identifies and separates a background and a character based on a background line constituting the image and an outline of a character in an original image, and is mounted on the mobile terminal 10 A photographed image including 3D depth information is generated by photographing the subject person and the surrounding background of the subject person through the camera, deriving spatial information using the 3D depth information, and Through comparison of , it is possible to determine whether the currently photographed place matches the place appearing in the original image, and whether the angle of the photographed image and the pose of the person subject are the same. A detailed description of this image analysis method will be described later.

Then, the camera system digitizes the accuracy between the original image and the captured image according to the determination result, and displays it on the screen of the mobile terminal 10 by overlapping with the captured image as matching information.

The above-mentioned matching information is displayed on the screen in real time according to the current shooting state, and accordingly, the user looks at the screen of the mobile terminal 10 and moves the subject person and background to match the original image so that the accuracy is close to 100%. Shooting can be performed by changing the location and angle.

In addition, one or more target objects 3 appearing in the original image may exist in the shooting site 1, and the camera system may refer to the target object 3 when comparing the original image and the captured image.

The target object 3 may be various objects, signboards, and facilities existing in the corresponding place, and the target object 3 may be used as an indicator for determining not only the location of the currently captured image but also the shooting angle.

As the mobile terminal 10 to which the system 100 of the present invention is applied, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, smartphone, smart phone Various known portable computing devices such as all types of handheld-based terminals such as a smartpad and a tablet PC may be used.

According to the above-described structure, the camera system for supporting taking pictures for mobile terminals according to an embodiment of the present invention provides an augmented reality service for finding a background identical to that in a picture taken by a celebrity and finding a pose identical to that of a person in the picture. It can be implemented in a form and provide an environment to take a picture of a subject person with the same background and pose.

Hereinafter, a camera system for supporting taking a picture for a mobile terminal according to an embodiment of the present invention will be described in detail with reference to the drawings.

2 is a diagram illustrating a camera system for supporting taking a picture for a mobile terminal according to an embodiment of the present invention. In the following description, each component constituting the camera system 100 may be implemented as an application program executable by a known microprocessor, recorded on a readable and writable recording medium, and loaded into a mobile terminal.

Referring to FIG. 2 , the camera system 100 for supporting taking a picture for a mobile terminal according to an embodiment of the present invention extracts a plurality of background line information constituting a background and a character from an original image stored in a storage 110. An image information extractor 120 that extracts the constitutive contour information and meta information of the original image, and a background/person separator that separates and identifies a background and a character located in the background based on the background line information and the contour information. 130, a photographing unit 140 for generating a photographed image including 3D depth information by photographing one or more subject persons and a surrounding background of the subject person, and a first image corresponding to the background of the photographed image by using the 3D depth information. A space setting unit 150 for setting a point cloud including spatial information and second spatial information corresponding to a subject person of a photographed image, and comparing the background line information and the first spatial information to a background of the original image and a background of the photographed image. A comparison and analysis unit 160 that calculates an angle difference between the spaces and compares the contour information and the second space information to calculate a pose difference between the character and the subject, and matching information including the angle difference and the pose difference to the mobile terminal. When receiving coordinate information including the latitude and longitude at which the captured image was generated from the matching information generation unit 170 overlapping with the captured image and displayed on the screen and the GPS module installed in the mobile terminal, determining whether the captured location is the same It may include a coordinate information providing unit 180 that is transmitted to the comparison and analysis unit for reference.

The storage 110 is a file storage space allocated to a memory mounted in the camera system 100 and may store original images of celebrities and places to be photographed. These original images may be pre-downloaded from the web and stored in the storage 110, and may be referred to when analyzing the images.

The image information extractor 120 may extract various information related to the image from the original image stored in the storage 110 according to the execution of the camera system 100 . In particular, the original image may include a plurality of background line information constituting the background, contour information constituting the character, and meta information about the original image, and the image information extractor 120 extracts such information to be described later. It can be transmitted to the comparison and analysis unit 160.

Here, background line information may be used to identify a region corresponding to a background in the original image, and contour information may be used to identify a region corresponding to a character. In addition, meta information can be used to identify the latitude and longitude of a photographing location, data collection time, illumination, color, etc. Here, information such as data collection time, illumination, color, etc. can be excluded during analysis.

In addition, the image information extractor 120 may further perform a pre-processing process including noise removal and segmentation of a plurality of images on the original image, and this pre-processing process removes noise from the image in the picture to improve recognition accuracy. In order to improve the recognition speed, points and intervals between points that connect multiple background lines and outlines in the range where augmented reality-based recognition is possible centered on the background and the pose of the person in the picture to improve the recognition speed With this non-dense structure, a lightweight, low-density contour frame can be constructed.

The background/person separator 130 may identify and separate a background and a person using image information extracted from an original image. The background/person separation unit 130 can identify the shape of the background appearing in the original image and the perspective ratio of the background through the extracted background line information, and can identify one or more characters located on the background through the contour information. can

Background line information may include a plurality of background lines constituting a background in an original image. The background and perspective of the background can be simulated by the arrangement and connection form of the background lines, and can be used to calculate the perspective ratio between the background and the characters.

Also, the background line information may include the shape of one or more target objects existing on the background. The target object may be a building, facility, signboard, object, etc. on the background excluding characters, and one or more target objects capable of specifying the corresponding place may exist in each place. The target object may be identified as an object separate from the background and the character, and may be used to increase accuracy when determining whether the location of the captured image and the location of the original image are the same location.

Also, a character on the original image corresponds to one or more celebrities and may be generally located at the center of the image. In addition, the outline information may represent a pose of a character forming a closed curve, and may then be used to calculate pose accuracy through comparison of outlines of the subject person in a photographed image.

The photographing unit 140 may generate a photographed image captured in real time from a camera installed in the mobile terminal. A user may take a picture corresponding to a celebrity at a place corresponding to an original image using a mobile terminal, and the photographing unit 140 may generate a photographed image being photographed by a camera of the mobile terminal in real time. Here, the camera of the mobile terminal may be a depth vision camera capable of obtaining 3D depth information on a subject, and then acquire 3D depth information for setting space-related information.

The space setting unit 150 may set space-related information for analysis of captured images. The space setting unit 150 sets a point cloud for the background and subject person appearing in the captured image. A point cloud may be set by generating first spatial information and second spatial information corresponding to a subject person of a captured image. Through this point cloud, it is possible to identify the shape of the background and subject person on the photographed image, calculate the perspective ratio, and calculate the photographing angle.

The comparison and analysis unit 160 compares and analyzes the information derived from the original image and the information derived from the captured image to determine whether the captured image was captured at the same location and location as the original image and at the same angle, as well as the character and the subject person. It can be determined whether the poses of are the same.

In detail, the comparison and analysis unit 160 compares and analyzes each position of the point cloud corresponding to the background line information of the original image and the first space information, and then each point of the background constituting the original image and the point of the point cloud of the captured image. is mapped, and the angle difference between the two backgrounds, that is, the angle difference at the time of shooting, can be calculated in comparison with the background of the original image.

Here, the angle difference described above can be calculated by Equation 1 below with respect to the X, Y, and Z coordinates of the first spatial information.

In addition, the comparison and analysis unit 160 compares and analyzes the contour information of the original image and each position of the point cloud corresponding to the second spatial information, and captures the head position, arm, leg position, and gesture of the character appearing in the original image. Each point of the point cloud of the image may be mapped to calculate the degree of difference between the current pose of the person in comparison with the person in the original image.

In addition, in the case of the background image, the comparative analysis unit 160 compares the 3D space simulation value and compares the size of the target image through the application of the perspective value so that the background image can be compared with photos taken at various locations based on background-related information. Matching accuracy between an original image and a photographed image may be increased by reflecting position and distance correction. In addition, the pose matching accuracy of the character and the subject may be improved through 3D space simulation and perspective ratio application based on the outline information of the pose.

The matching information generation unit 170 may display the angle difference and the pose difference between the original image and the photographed image calculated through the comparison and analysis unit 160 as numerical values, overlapping with the currently photographed image on the screen of the mobile terminal. .

According to the comparative analysis between the original image and the captured image, the difference between the captured image and the original image is calculated, and the matching information generating unit 170 may display the angle difference and pose difference calculated in real time on the screen of the mobile terminal, respectively. have. Therefore, the user can frequently change the shooting distance and composition of the background and the subject person using his or her current location, find a location with a high level of accuracy with the original image or more, and proceed with the photographing. By requesting the same pose as the celebrity, a photographing result similar to the original can be obtained.

As described above, the process of correcting by matching the background of the captured image and the pose of the subject with the original image may be performed through digitization according to accuracy calculation. Here, the camera system 100 allows taking a picture only when the accuracy is higher than a certain level, and when the accuracy is lower than a certain level, the picture can be taken after increasing the accuracy through correction.

On the other hand, the camera system 100 according to an embodiment of the present invention includes a coordinate information providing unit 180, which is a means for increasing accuracy in determining whether a place where a mobile terminal is currently photographing matches a place appearing in an original image. may further include.

The coordinate information providing unit 180 receives the GPS coordinates of the current location from the GPS module installed in the mobile terminal, compares them with the latitude and longitude included in the meta information extracted from the original image, and records the current location in the meta information. It is possible to check whether the coordinates coincide with the coordinates, and the currently determined coordinate information can be corrected.

Hereinafter, a method for supporting picture taking for a mobile terminal according to an embodiment of the present invention will be described in detail with reference to the drawings.

3 is a diagram illustrating a method for supporting taking a picture for a mobile terminal according to an embodiment of the present invention. In the following description, the subject of execution for each step is the camera system and its components of the present invention described above, even if there is no separate description.

Referring to FIG. 3 , according to the method for supporting taking a picture for a mobile terminal according to an embodiment of the present invention, in step S100 of generating a photographed image of a subject person, a picture identical to the original image in which a celebrity appears is taken, A desired user can execute the camera system of the present invention on a mobile terminal possessed by the user and take a picture of a subject posing in a specific place. In this case, the mobile terminal is equipped with a depth vision capable of generating 3D depth information, and thus the 3D depth information may be included in the captured image.

Next, the step of setting a point cloud using the 3D depth information (S110) is a step of determining space information in the image using the 3D depth information included in the captured image, and the system determines the captured image and the 3D included in it A point cloud including first spatial information on a background and second spatial information on a subject may be set using depth information. Such a point cloud defines spatial information of a photographed image, and can be used to determine the shape of a background and an object in an image, a perspective ratio, and the like.

Next, the step of extracting background line information, outline information, and meta information from the original image (S120) is a step of extracting various information for analysis from the original image, which is a standard source that the user wants to photograph.

In detail, the original image is an image containing the appearance of a celebrity to be photographed through the current mobile terminal, and may be stored in the mobile terminal in advance, such as downloaded, and the system uses a plurality of background line information constituting the background from the stored original image. And, it is possible to extract outline information constituting the character and meta information of the original image.

Next, in the step of identifying and separating the background and the character based on the background line information and the outline information (S130), the background and the character located in the background are identified and separated based on the background line information and the outline information. can The background line is a line representation of buildings, facilities, signboards, etc. located behind or around the character. can be identified.

Next, in step S140 of calculating the angle difference between the original image and the background of the captured image, and calculating the pose difference between the character and the subject person, a comparative analysis is performed on the two images using the extracted information.

Specifically, the system compares the background line information of the original image with the first spatial information of the corresponding captured image to determine how close the current capturing location and image composition, especially the capturing angle, are compared to the original, and It is determined how similar the pose of the subject is to the pose of the character by comparing the contour information with the second spatial information of the photographed image. Then, the accuracy of these angles and poses is calculated as numerical values. Here, the accuracy of the angle can be calculated by Equation 1 above.

And, as a procedure for increasing the accuracy of the comparison judgment result, the step of performing a preprocessing process including removing noise and segmenting a plurality of images with respect to the original image may be further included.

On the other hand, according to an embodiment of the present invention, according to the analysis of the photographed image, a procedure for confirming whether the place currently being photographed matches the place appearing in the original image may be further included.

In detail, before step S140, a plurality of points of the first spatial information are compared with a target object included in the background of the original image, and the target object is compared so that the capturing location of the captured image is the capturing location of the original image. It may include the step of determining whether it is the same as.

In step S140, coordinate information including the latitude and longitude at which the captured image was created is received from a GPS module mounted in the mobile terminal, and whether the original image and the captured image are the same by referring to the coordinate information. The step of determining may be further included.

Next, in the step of overlapping and displaying the matching information with the photographed image on the screen of the mobile terminal (S150), the angle difference with respect to the background calculated in step S140 and the pose difference with respect to the subject person are converted into numerical values on the screen of the mobile terminal. This is the step to display in

These angle differences and pose differences may be displayed on the screen in real time by overlapping with the currently photographed image, and the user may refer to the corresponding values to adjust the photographing position and composition or request the subject to change the pose. In addition, the system may block photo generation until the angle difference and the pose difference reach a certain level, and after a certain level or higher accuracy is confirmed, a photo file may be created and stored through a captured image of the current screen.

Hereinafter, a method for comparing and analyzing images by a camera system for supporting taking pictures for a mobile terminal according to an embodiment of the present invention will be described with reference to the drawings.

4 and 5 are diagrams schematically illustrating an image processing method of a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention.

4 illustrates an original image screen (a) and an image processing image screen (b) used in a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention, and a background 201 is included in the original image 200. There may be a facility, target objects 202 to 204 and a character 205.

Here, the facility serving as the background 201 corresponds to the place visited by the celebrity, and the character 205 may be the celebrity himself.

According to the execution of the program, the outline of the background and the outline of the character are extracted from the original image 200, and the background and the character can be identified and separated through this.

In general, in the original image 200, a background 201 of the place where the image was taken and a celebrity character 205 exist, and the system performs image processing on the original image 200 to create a background 201. A background line 211 can be extracted. In addition to these background lines 211 , other lines 212 to 214 corresponding to the target objects 202 to 204 existing in the entire original image 200 may also be extracted.

In addition, the system can identify the character 205 by extracting the outline corresponding to the character 205 from the original image 200, but separates it from the background line 211 and determines the similarity with the subject person separately. will do

In particular, according to an embodiment of the present invention, in addition to the background line 211 for overall identification of the original image 200, target objects 202 to 204 capable of specifying a photographing location are further identified and compared with subsequent photographed images. It can be used as an auxiliary indicator to determine the same location, and the system can specify the location where the currently captured image is being captured through one or more other lines 212 to 214 for the target object.

Referring to FIG. 5 , two image screens (a and b) taken at different angles according to first spatial information on a captured image taken by a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention are shown. As an example, the background lines 301 and 314 in the captured images 300 and 310 are photographed inclined at a certain angle θ from the horizontal according to the angle when the user shoots the subject person and the background in the corresponding place. indicates

Therefore, when calculating the angle difference (θ) between the background line (201 in FIG. 4) of the original image and the background line 301 according to the connection of the points included in the first spatial information of the captured image, the angle difference between the captured image can be derived, and the matching accuracy for the background can be calculated by reflecting the perspective ratio.

As an example, according to the above-described Equation 1, the X, Y, and Z coordinate values of the background formed by the background line 301 of the captured image 300 are 45°, 35°, and 0°, respectively, and the perspective ratio is 1:1. Assuming that , the matching accuracy can be calculated as 79%. In addition, assuming that the coordinate values of X, Y, and Z are 0°, 0°, and 0°, respectively, and the perspective ratio is 1:0.75, matching accuracy can be calculated as 75%.

In addition, the shape of the target objects 302 to 304 on the background of the captured image 300 may also be distorted according to the screen composition, but according to the three-dimensional coordinates considering the angle difference θ, the target objects 301 to 304 ) can be determined to be the same as the object existing in the original image and used to specify the place.

Hereinafter, the technical concept of the present invention will be described in detail with reference to the drawings through an example of a screen provided by a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention.

6 is a diagram illustrating a photographing screen provided by a camera system for supporting picture taking for a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 6 , a camera system for supporting taking pictures for a mobile terminal according to an embodiment of the present invention is an application program installed and executed in a mobile terminal 10 equipped with a camera, such as a smartphone, and allows a user to enter a specific place. When the subject person is photographed, the system may display the photographed image currently being photographed on the screen (a) through comparative analysis with the registered original image.

On the screen of the mobile terminal 10, a subject person 405 is displayed along with a background 400 and a target object 403, and the user can attempt to take a picture with the same composition as the original image while viewing the screen.

Here, the target object 403, such as a signboard existing on the background 400, can be used to specify a place, and if the system determines that it is the same place, the angle difference through real-time comparative analysis between the original image and the captured image. and the pose difference is calculated.

Further, the system may display an angle difference 406 for the background between the original image and the photographed image and a pose difference 407 between the character and the subject person 405 on one side of the screen as numerical values.

In addition, during real-time shooting, according to changes in the composition, distance, and posture of the subject, the system may reflect the updated value 408 of the angle difference and the pose difference on the screen in real time (b), and the user By checking the number, you can take the intended picture while changing the angle and pose.

Although many details are specifically described in the above description, this should be interpreted as an example of a preferred embodiment rather than limiting the scope of the invention. Therefore, the invention should not be defined by the described examples, but should be defined by what is equivalent to the claims and claims.

1: shooting scene 3: target object
10: mobile terminal 100: camera system
110: storage 120: image information extraction unit
130: background / character separation unit 140: shooting unit
150: space setting unit 160: comparison analysis unit
170: matching information generating unit 180: coordinate information generating unit

Claims (10)

an image information extractor configured to extract a plurality of background line information constituting a background, outline information constituting a character, and meta information of an original image from an original image stored in a storage;
a background/character separator separating and identifying a background and a character located in the background based on the background line information and the outline information;
a photographing unit generating a photographed image including 3D depth information by photographing at least one subject person and a surrounding background of the subject person;
a space setting unit configured to set a point cloud including first spatial information corresponding to a background of the captured image and second spatial information corresponding to a subject of the captured image, using the 3D depth information;
An angle difference between the background of the original image and the background of the photographed image is calculated by comparing the background line information with the first space information, and comparing the contour line information with the second space information to determine the relationship between the character and the subject person. a comparison analysis unit that calculates a pose difference; and
Matching information generation unit for displaying the matching information including the angle difference and the pose difference in an overlapping manner with the captured image on the screen of the mobile terminal
A camera system for taking pictures for a mobile terminal including a camera system. According to claim 1,
The background of the original image includes one or more target objects,
The comparative analysis unit,
and comparing a plurality of points of the first spatial information with the target object to determine whether a capturing location of the captured image is the same as a capturing location of the original image. According to claim 2,
Coordinate information providing unit for receiving coordinate information including the latitude and longitude at which the captured image was created from a GPS module installed in the mobile terminal, and passing it to the comparison and analysis unit for reference when determining whether the photographed location is the same
A camera system for taking a picture for a mobile terminal further comprising a camera system. According to claim 1,
The angle difference,
For the X, Y, and Z coordinates of the first spatial information, the following equation,

A camera system that supports taking pictures for mobile terminals, which is calculated as According to claim 1,
The image information extraction unit,
The camera system for supporting picture taking for a mobile terminal, further performing a pre-processing process including noise removal and segmentation of a plurality of images with respect to the original image. As a method of supporting taking a picture by a camera system installed and executed in a mobile terminal,
(a) generating a photographed image including 3D depth information by photographing at least one subject person and a surrounding background of the subject person;
(b) setting a point cloud including first spatial information corresponding to a background of the captured image and second spatial information corresponding to a subject of the captured image, using the 3D depth information;
(c) extracting a plurality of background line information constituting a background, contour information constituting a character, and meta information of an original image from an original image stored in a storage;
(d) identifying and separating a background and a character located in the background based on the background line information and outline information;
(e) an angle difference between the background of the original image and the background of the photographed image is calculated by comparing the background line information with the first spatial information; calculating a pose difference between subjects; and
(f) displaying the matching information including the angle difference and the pose difference overlapping with the captured image on the screen of the mobile terminal
Photo taking support method for a mobile terminal comprising a. According to claim 6,
Before step (e),
Comparing a plurality of points of the first spatial information with a target object included in the background of the original image and comparing the target object to determine whether a capturing location of the captured image is the same as a capturing location of the original image
Photo taking support method for a mobile terminal comprising a. According to claim 6,
In step (e),
receiving coordinate information including the latitude and longitude of the captured image from a GPS module installed in the mobile terminal;
Determining whether the original image and the captured image are identical to each other by referring to the coordinate information
A method for supporting taking a picture for a mobile terminal further comprising a. According to claim 6,
The angle difference,
For the X, Y, and Z coordinates of the first spatial information, the following equation,

A method for supporting photo taking for a mobile terminal, which is calculated as According to claim 6,
In step (d),
Performing a preprocessing process including noise removal and segmentation of a plurality of images with respect to the original image;
A method for supporting taking a picture for a mobile terminal further comprising a.

Images