KR102275172B1 - Method for providing barrel distortion calibration and background change based photo printing service abling to take self id photo - Google Patents

Abstract

A method for providing a photo taking service capable of taking a self-identification photo based on barrel distortion correction and background replacement function is provided, and performing photo shooting control to include a subject corresponding to a person by turning on the front camera or the rear camera of the user terminal , receiving the photo data taken from the user terminal, and inverting the left and right when the photo data is taken from the front camera, correcting barrel distortion occurring in the wide-angle lens of the front camera or rear camera of the user terminal and replacing the background excluding the subject with a pre-stored background and transmitting the replaced background to the user terminal.

Description

How to provide a photo shoot service that allows you to take a self ID photo based on barrel distortion correction and background replacement function

The present invention relates to a method of providing a photo taking service capable of taking a self-identification photo based on barrel distortion correction and background replacement function, and provides a platform that can take a photo that meets a standard according to a photo purpose and request a print. .

With the spread of digital cameras, photography, which was considered the domain of professionals, is expanding to the realm of the general public, and it has become possible to easily acquire and reproduce images without time and cost constraints. In addition, sites that print digital images on behalf of users in line with the convenience of users are popular, while services that print out general photos as ID photos in the desired format are also increasing. However, unlike other types of photos, ID photos have to satisfy certain standards such as size, proportion, and background color depending on their purpose, so the ID photo service still relies on professional photography and graphic work. In order to guarantee the quality of the printout, there are various restrictions on the original photo provided in advance.

At this time, a configuration for taking an ID photo by providing a shooting option was disclosed. In this regard, Korean Patent Application Laid-Open No. 2006-0083492 (published on July 21, 2006), which is a prior art, takes an ID photo in response to a user request. Configuration for setting option information, configuration for extracting a person’s image from the input image frame when an image frame is input in preset ID photo shooting mode, and an image created by combining the extracted person’s image with the set ID photo shooting option information A configuration for displaying a frame is disclosed.

However, even if the above-mentioned configuration is used, the rules to be followed depending on the purpose of the ID photo are still complicated, and the rules change every time, so it is almost impossible for the general public, not experts, to take one by one and take pictures. to be. In addition, even if all of the above regulations are observed, it is difficult for non-professionals to print according to the proportions and positions of faces in the ID photo, so users will waste time and effort if the ID photo is rejected by the submitting agency. In most cases, taking and printing ID photos is still entrusted to professionals in consideration of the opportunity cost.

An embodiment of the present invention provides guidelines so that even non-professionals can take pictures according to the purpose of photography, and at the same time converts the image to meet the photo standards and regulations according to the purpose of the photo, barrel distortion generated in the camera By correcting and removing the background and replacing it with the background of the ID photo, even if the photo was taken by a non-professional person, the photo standard can be satisfied, and even post-photography work can be automatically processed, and by automating the manual part, the operator It is possible to provide a method of providing a photo-taking service capable of taking self-identification photos based on barrel-type distortion correction and background replacement functions, which can reduce manpower wastage and load, and increase the emotional quality of users. However, the technical task to be achieved by the present embodiment is not limited to the technical task as described above, and other technical tasks may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention includes the steps of turning on a front camera or a rear camera of a user terminal to perform photo taking control to include a subject corresponding to a person, from the user terminal Receiving the photographed photo data and inverting the left and right when the photo data is taken from the front camera, correcting barrel distortion occurring in the wide-angle lens of the front camera or the rear camera of the user terminal, and the subject and replacing the background other than the background with a previously stored background and transmitting the replaced background to the user terminal.

Another embodiment of the present invention includes the steps of turning on the front camera or the rear camera to perform photo shooting control to include a subject corresponding to a person, loading the captured photo data, and left and right when the photo data is taken from the front camera Inverting, correcting barrel distortion occurring in the wide-angle lens of the front camera or rear camera, and replacing a background excluding the subject with a pre-stored background and displaying the displayed on the screen.

According to any one of the above-described problem solving means of the present invention, a guideline is provided so that even non-professionals can take pictures according to the purpose of the photo, and the image is converted to meet the photo standards and regulations according to the purpose of the photo. By correcting the barrel distortion that occurs in the camera, removing the background and replacing it with the background of the ID photo, even if the photo was taken by a non-professional person, the standard of the photo can be satisfied, and even post-shooting work can be processed automatically, and it can be done manually. By automating the necessary parts, it is possible to reduce manpower wastage and load for operators, and improve the emotional quality of users.

1 is a view for explaining a system for providing a photo taking service capable of taking a self-identification photo based on a barrel-shaped distortion correction and background replacement function according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a photo taking service providing server included in the system of FIG. 1 .
3 and 4 are diagrams for explaining an embodiment in which a photo taking service capable of taking a self-identification photo based on barrel distortion correction and background replacement function according to an embodiment of the present invention is implemented.
5 is an operation flowchart illustrating a method of providing a photo taking service capable of taking a self-identification photo based on a barrel-shaped distortion correction and background replacement function according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement them. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . Also, when a part "includes" a component, it means that other components may be further included, rather than excluding other components, unless otherwise stated, and one or more other features However, it is to be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

The terms "about", "substantially", etc. to the extent used throughout the specification are used in a sense at or close to the numerical value when the manufacturing and material tolerances inherent in the stated meaning are presented, and serve to enhance the understanding of the present invention. To help, precise or absolute figures are used to prevent unfair use by unscrupulous infringers of the stated disclosure. As used throughout the specification of the present invention, the term “step for (to)” or “step for” does not mean “step for”.

In this specification, a "part" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be implemented using two or more hardware, and two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal, apparatus, or device may be performed instead of in a server connected to the terminal, apparatus, or device. Similarly, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the terminal's unique number or personal identification information, which is the identification data of the terminal. can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a system for providing a photo taking service capable of taking a self-identification photo based on a barrel-shaped distortion correction and background replacement function according to an embodiment of the present invention. Referring to FIG. 1 , a photo taking service providing system 1 capable of taking a self ID photo based on barrel distortion correction and background replacement function includes at least one user terminal 100 , a photo taking service providing server 300 , and It may include at least one photo printing kiosk 400 . However, since the photo taking service providing system 1 capable of taking a self-identification photo based on the barrel distortion correction and background replacement function of FIG. 1 is only an embodiment of the present invention, the present invention is limitedly interpreted through FIG. it's not going to be

In this case, each component of FIG. 1 is generally connected through a network 200 . For example, as shown in FIG. 1 , at least one user terminal 100 may be connected to the photo taking service providing server 300 through the network 200 . In addition, the photo taking service providing server 300 may be connected to at least one user terminal 100 and at least one photo printing kiosk 400 through the network 200 . In addition, the at least one photo printing kiosk 400 may be connected to the photo taking service providing server 300 through the network 200 .

Here, the network refers to a connection structure in which information exchange is possible between each node, such as a plurality of terminals and servers, and an example of such a network includes RF, 3rd Generation Partnership Project (3GPP) network, Long Term (LTE). Evolution) network, 5th Generation Partnership Project (5GPP) network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network) , PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, and the like are included, but are not limited thereto.

In the following, the term at least one is defined as a term including the singular and the plural, and even if at least one term does not exist, each element may exist in the singular or plural, and may mean the singular or plural. it will be self-evident In addition, that each component is provided in singular or plural may be changed according to embodiments.

At least one user terminal 100 takes an ID picture using a web page, an app page, a program or an application related to a picture taking service capable of self ID picture taking based on barrel distortion correction and background replacement function, and requests picture printing It may be a terminal that does At this time, the at least one user terminal 100 sets the ID photo purpose and standard, turns on the front camera or the rear camera to photograph the subject, and provides the photographing service providing server 300 to the photographed photo data. It may be a terminal that outputs a calibration interface and generates a calibration event to reflect the calibration. In addition, the at least one user terminal 100 may be a terminal that performs payment for photo printing, sets a delivery time or deadline, and transmits it to the photo taking service providing server 300 , and a photo taking service providing server ( 300) may be a terminal that receives the real-time delivery status shared.

Here, the at least one user terminal 100 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100, for example, as a wireless communication device that guarantees portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

The photo taking service providing server 300 may be a server that provides a photo taking service web page, an app page, a program or an application capable of taking a self-identification photo based on a barrel-type distortion correction and background replacement function. In addition, the photo taking service providing server 300 may be a server that converts a photo standard corresponding to a photo purpose into a database, and stores guidelines corresponding to each photo standard together to take a photo in the user terminal 100 . It could be a server that allows guidelines to be overlaid. In addition, the photo taking service providing server 300 automatically corrects distortion that occurs differently depending on the type of each camera by making a database of at least one type of camera and a process of correcting the barrel-shaped distortion occurring in each camera. It can be a server that lets you do that. And, the photo taking service providing server 300 is a server that classifies the shooting of the front camera or the rear camera, inverts the photo image of the front camera left and right, removes the background except for the subject, and replaces it with a background suitable for the purpose can In addition, the photo-taking service providing server 300 may be a server that outputs an order form so that delivery is completed by a preset deadline when payment is made after the setting is completed by the user terminal 100 . In addition, the photo taking service providing server 300 designates at least one photo printing kiosk 400 as an O2O (Online to Offline) service in the user terminal 100, or the user terminal 100 has applied for an O2O service. In this case, it may be a server that issues an identification code to print at the photo printing kiosk 400 .

Here, the photo taking service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop.

At least one photo printing kiosk 400 scans or reads an identification code using a photo taking service related web page, app page, program or application capable of self-identification photo taking based on barrel distortion correction and background replacement function, The device may receive photo data corresponding to the identification code from the photo taking service providing server 300 and print the photo data into an ID photo.

Here, the at least one photo printing kiosk 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop. In this case, the at least one photo printing kiosk 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. The at least one photo printing kiosk 400 is, for example, a wireless communication device that ensures portability and mobility, such as navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), and Personal Digital Cellular (PDC). , PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband) Internet) terminals, smart phones, smart pads, tablet PCs, and the like may include all kinds of handheld-based wireless communication devices.

2 is a block diagram for explaining a photo taking service providing server included in the system of FIG. 1, and FIGS. 3 and 4 are self-identification photos based on barrel distortion correction and background replacement functions according to an embodiment of the present invention. It is a diagram for explaining an embodiment in which a photographing service capable of photographing is implemented.

Referring to FIG. 2 , the photo taking service providing server 300 includes an execution unit 310 , an inversion unit 320 , a correction unit 330 , a transmission unit 340 , a guide application unit 350 , and a selection unit ( 360 ), an ordering unit 370 , a change unit 380 , and an O 2 O unit 390 .

The photo taking service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with at least one user terminal 100 and at least one photo printing kiosk 400 is a barrel type. When transmitting a photo taking service application, program, app page, web page, etc. capable of self-identification photo taking based on distortion correction and background replacement function, at least one user terminal 100, and at least one photo printing kiosk 400 can install or open a photo taking service application, program, app page, web page, etc. capable of taking self-identification photos based on barrel distortion correction and background replacement functions. In addition, the service program may be driven in at least one user terminal 100 and at least one photo printing kiosk 400 by using a script executed in a web browser. Here, the web browser is a program that enables the use of a web (WWW: world wide web) service, and refers to a program that receives and displays hypertext written in HTML (hyper text mark-up language), for example, Netscape , Explorer, Chrome, and the like. In addition, the application means an application on the terminal, for example, includes an app (app) executed in a mobile terminal (smartphone).

Referring to FIG. 2 , the performing unit 310 may turn on the front camera or the rear camera of the user terminal 100 to perform photo taking control so that the subject corresponding to the person is included. The performer 310 may display an outline where the face part of the subject is to be located so as to be overlaid on the screen of the user terminal 100 . At this time, the outline is formed by the outer periphery corresponding to the face, the head and chin texts are respectively overlaid on the upper center position and the lower center position of the outline, and the outline is a center line vertically crossing the outer periphery inside. may include. The performing unit 310 turns on the front camera or the rear camera of the user terminal 100 to perform photo taking control so that the subject corresponding to the person is included, and when the timer is set in the user terminal 100, the set A number corresponding to the timer may be controlled to count down on the photographing screen of the user terminal 100 .

The reversing unit 320 may receive the photographed photo data from the user terminal 100 and invert the photo data left and right when the photo data is taken from the front camera. To this end, the inverting unit 320 must distinguish whether the photo data taken from the user terminal 100 is taken from the front camera or the rear camera. When receiving the photo data, the camera position is These may be distinguished by being included in the header so that they are received, but the method of confirming the position of the camera is not limited to the above-described method.

The correction unit 330 may correct barrel distortion occurring in the wide-angle lens of the front camera or the rear camera of the user terminal 100 . Here, the barrel distortion is called barrel distortion, and is a phenomenon observed due to the structure and physical non-ideality of the wide-angle lens included in the camera. The barrel-shaped distortion is a phenomenon in which the magnification of the lens changes non-linearly due to the difference in thickness between the center and the edge of the lens, resulting in a distorted image. Barrel distortion causes difficulties in accurately identifying objects on images, which can cause fatal defects in the entire system, so it is necessary to effectively correct the distortion. At this time, the barrel-shaped distortion correction should be made for all pixels in the image. For example, it is based on the inverse mapping process that reduces the hardware complexity by approximating the inverse mapping polynomial and eliminating the coordinate transformation process involved in the inverse mapping process. Alternatively, a method of implementing a low-complexity process by superimposing vignetting distortion correction and barrel-shaped distortion correction may be used. In order to obtain the shading factor and the scaling factor, the fitting function is not directly calculated, but the fitting function is calculated by performing a section linear approximation, so that the computational complexity can be greatly reduced while maintaining the correction quality, and the vignetting distortion correction and By designing the barrel-shaped distortion correction to be superimposed on a single pipeline structure, it is possible to achieve a high correction rate while lowering the complexity of the overall system.

The barrel distortion correction reconstructs an image based on pixel values of the distorted image corresponding to each pixel of the corrected image. The process of finding the pixel position of the distorted image corresponding to the pixel position of the corrected image is called inverse mapping and is used as a notation to indicate the pixel value after distortion correction. Since it can be assumed that , a scaling factor, which is the similarity ratio of two symmetric figures, can be defined and reverse mapping becomes possible. The inverse mapping coefficient may be calculated by least-squares estimation by measuring the degree of distortion with respect to a preset grid pattern. Since the pixel coordinates obtained through the inverse mapping process may not be integers, an interpolation process using neighboring pixel values may be further added to obtain a pixel value at the corresponding position.

The correction unit 330 maps and stores the type of the camera mounted differently according to the model of the user terminal 100 of the user and the type of distortion generated in the corresponding camera, and provides different methods for correcting the distortion. By making a database so that the specifications are applied differently, the correction can be applied differently. For example, assuming that X-type distortion occurs in A company B model and Y-type distortion occurs in C company D model, there is a possibility that the distortion may not be accurately corrected when the same distortion correction is applied. Accordingly, each distortion phenomenon and a numerical value or method capable of correcting the distortion phenomenon may be differently applied to completely remove the distortion phenomenon.

The transmitter 340 may replace the background excluding the subject with a pre-stored background and transmit it to the user terminal 100 . Here, the face part of the subject is a part located within the outline area described above, and since the outline is set as a default, it may be difficult to accurately detect an edge due to different faces of people. In this case, a face recognition method may be used, and the face recognition may be composed of three steps: face region detection, feature extraction from the detected region, and recognition using the extracted features. Face region detection can use an approach based on luminance, chrominance, geometric shape of the face, and symmetry, principal component analysis (PCA), a neural network, etc., and features In the case of extraction, a method using edge information, a principal component analysis method, and a method using template matching can be used, and a method using a curvature using 3D face data or a 3D PCA method is applied. It is possible. In the recognition stage, similarity can be calculated and recognized using DTM using geometric distance, Mahalanobis Distance, etc. using data of feature points.

Sample-based image separation is a method of separating images by analyzing a color space based on samples of the foreground and background predefined by the user. You can use Baysian Matting with Bayesian applied. Belief Propagation Matting to which a neural network is applied may be used, but is not limited thereto. Diffusion-based image separation is a method that separates the image only by roughly designating the foreground and rear view. Poisson calculates the brightness change in the image under the assumption that the color of the foreground and rear view has a narrow range of change within each area. Poisson Matting separated by applying an equation or Random Walks using a similar logic may be used. In addition, Closed-Form Matting in which regions are separated by calculating the lowest cost in the global space by applying a linear model to the foreground and background color spaces can be used, and the interface can be simplified if based on diffusion.

Alternatively, according to an embodiment of the present invention, a background is separated by a diffusion-based image separation method using a detected face feature point as an initial point, and then a sample with high reliability is collected from the separated area after generating a Trimap. Image separation may also be performed. Here, face component data (FCD)-CNN, which is a method of extracting eye, nose, and mouth components from a face image and recognizing a face through a convolution neural network (CNN) algorithm, may be used. In this case, the FCD-CNN may extract components such as eyes, nose, and mouth from a face image to recognize a face, respectively, and convert it into data. This reduces the complexity of the convolution operation and at the same time improves accuracy through the effect of removing noise such as background from the image. In order to minimize the computational complexity of the component detection process, methods such as skin detection and use of coordinates of the preceding components may be applied, and in order to utilize the coordinates, detection may be performed in the order of skin, eyes, mouth, and nose.

For skin region extraction, skin detection may use an HSI/HSV color space. You can quickly detect skin using hue, saturation, and contrast information. The skin area is extracted by setting the range of hue, saturation, and contrast. For example, regardless of race, the skin has a red color to some extent, ie, red due to the color of blood, so that the channel value of the color tone may be set within this value range. At this time, when the color tone is 0, it is excluded because it is completely red. In addition, if the color saturation is too low, the image itself appears white. In the reverse case, since it means only a specific color, it is out of the red color range, which is the skin color range, so other areas can be set as the area within the range. Excessive light intensity can also be excluded.

Second, the eye region can be detected. Generally, people's eyes are located at the top of their face. The upper part of the skin region extracted in the first step is used as the search region, and the eye region can be detected by edge detection after blurring by changing it to a black and white image. Third, the mouth area is extracted. As for the mouth area, the lower end of the skin area extracted in the first step can be designated as the search area. A person's mouth is usually located on the lower part of the face and between the eyes. Therefore, the mouth region can be extracted by connecting the center x-coordinates of both eyes detected in the second step. Fourth, the nose region can be detected. It uses the human nose as the center of the face. Search is possible by connecting the coordinates of the central point in the detected mouth image with the center coordinates of both eyes obtained in the second step.

The guide application unit 350, the performing unit 310 turns on the front camera or the rear camera of the user terminal 100, before performing the photography control so that the subject corresponding to the person is included, the user terminal 100 It is possible to select any one type from among at least one ID photo type. In addition, the guide application unit 350 may extract the photo rule guideline data that has been previously mapped to the selected type and set the photo taking control so as to correspond to the photo rule guideline data.

For example, the photo on the resident registration card must be taken within 6 months as of 2019, and photos that cover hair such as a hat or scarf and around the neck of the upper body are against the rules. Whether the teeth are visible or invisible is free, but the background color can only be changed in a single color, the face must not be tilted or crooked, and the face direction must face the front. Both ears and eyebrows do not have to be exposed, but from February 2019, the size of the photo must be changed from 3cmX4cm to 3.5cmX4.5cm, which is the same as the passport photo. A driver's license photo is similar to a resident registration card photo, but it can be changed to a variety of solid colors without gradation as well as a white background.

On the other hand, passport standards are more stringent. As of 2019, a natural color upper body frontal hair loss photo taken within 6 months of 3.5 cm in width and 4.5 cm in height as of 2019. The length of the face must be 2.5 to 3.5 cm, and the background color must be white. do. The length of the head and the length from the top of the head to the chin should be 3.2~3.6cm (vertical), the direction of the face should face the front, such as a resident registration card or driver's license, the upper body should only extend to the shoulders, and the pupils should have red eyes or Color lenses are not allowed, teeth must not be seen with the mouth closed, sunglasses are not allowed, and horn-rimmed glasses are allowed as long as they do not cover the eyebrows or pupils, the face contour must be clearly exposed with both ears exposed, and no hats or mufflers are allowed, Accessories should be avoided as much as possible, and ears should not be covered with bangs. The background must be a uniform white background, and military uniforms, uniforms, and white clothing are not allowed.

Accordingly, in one embodiment of the present invention, when an image that violates the above-described rules is extracted, the guide application unit 350 may overlay a guide message on the screen so that the user who is the photographer can correct it. For example, when the glasses reflect light in the user's shooting screen or cover the eyebrows or pupils, the guide application unit 350 provides a guide for this so that the photographer feels like giving advice when taking a picture. can do. In addition, if the user is smiling while revealing the teeth when taking a picture, the guide application unit 350 may provide a guide so that the teeth are invisible, and if the hair is on the face contour, it is guided to remove it, and if the muffler is on It may be a method of giving a guide to solve this problem. Since the user cannot be familiar with the rules that are changed by the administration every time, the user's convenience can be increased by providing a comment like a photographer giving advice according to the regulations at a photo studio. To this end, it is possible to build a database by mapping a situation that violates each rule and advice (guiding message) therefor, and output a guidance message to correspond to the detected situation and image. In this case, the above-described feature extraction method may be used in order to find features that violate each rule from the image, but the present invention is not limited thereto, and it will be obvious that various methods are available.

The selection unit 360, after correcting the barrel distortion occurring in the wide-angle lens of the front camera or the rear camera of the user terminal 100 in the correction unit 330, the bottom of the screen of the user terminal 100 The type of ID photo is displayed on the left and right sliding interface. Then, the selection unit 360, when any one type of ID picture is selected in the user terminal 100, the screen of the user terminal 100, the corrected picture data to correspond to the photo standard data of the selected type of ID picture. can be output to For example, after the user takes a photo, the position or percentage of the background and face size within the photo image will vary depending on whether the photo is for a national ID photo or for a passport, so let the user choose to enlarge the photo. or may be included to reduce it. In this case, enlargement or reduction of the photo may be applied, and the position or XY coordinates occupied by the face in the photo may be changed.

The ordering unit 370 replaces the background excluding the subject in the transmitting unit 340 with a previously stored background and transmits it to the user terminal 100 , and then, when a photo printing event is output from the user terminal 100 , the user terminal An order event can be created with the photo data selected in ( 100 ). In addition, the ordering unit 370 may share with the user terminal 100 by performing delivery tracking corresponding to the ordering event, and when a receipt confirmation event is generated in the user terminal 100, delivery corresponding to the ordering event A process can be terminated. When most customers take photos, it's more likely that they don't, according to plans, than if they take photos before the deadline. That is, in most cases, a photo is urgently needed, and the ordering unit 370 can set each delivery deadline, so that even offline customers with urgent circumstances can be incorporated online.

The change unit 380, the performing unit 310 turns on the front camera or the rear camera of the user terminal 100 to perform photo shooting control so that the subject corresponding to the person is included, and then brightness, contrast, temperature and saturation to output an adjustable calibration interface from the user terminal 100 . In addition, when a correction event of the correction interface occurs in the user terminal 100 , the change unit 380 may correct the photo data to correspond to the correction event. In case the user does not understand or fails while adjusting each, the changer 380 may further provide automatic image correction. Of course, even when shooting, beauty shooting options such as removing blemishes or brightening the face color may be basically provided, but changing in the change unit 380 is to change brightness, contrast, temperature and saturation, etc., so the two functions can be distinguished. Of course, it does not exclude that it is provided at one time.

The O2O (Online to Offline) unit 390 replaces the background excluding the subject in the transmitting unit 340 with a pre-stored background and transmits it to the user terminal 100 , and then, in the user terminal 100 , O2O (Online to Offline) ) When a printing service is selected, information of at least one photo printing kiosk 400 located within a preset radius based on the current location or a designated location of the user terminal 100 is displayed on the map to the user terminal 100. can be transmitted And, when the identification code of the user terminal 100 is scanned or read from the at least one photo printing kiosk 400, the O2O unit 390 transmits the photo data to the at least one photo printing kiosk 400 for printing. can be controlled as much as possible.

To this end, the O2O unit 390 may generate an identification code for identifying the photo data taken by the user terminal 100 and the user terminal 100, and the generated identification code is the user terminal 100 and the photo. It can be mapped with data and stored. In addition, when the O2O unit 390 searches for the photo printing kiosk 400 centered on the current location in the user terminal 100, it is possible to increase convenience by providing a display and a route on the map, and the user terminal 100 ), if you want to print at the photo print kiosk 400 directly by Walk-in without making a reservation for photo print, the O2O unit 390 reads or scans the identification code from the photo print kiosk 400. By transmitting the photo data stored in response to the received identification code and the output setting data together to the photo printing kiosk 400, the user only reads the identification code to the kiosk so that it can be output without any additional manipulation. can At this time, it is important that the output setting data is transmitted to the photo printing kiosk 400 together, because the photo printing kiosk 400 does not know what size and how many photos should be output because the photo printing kiosk 400 only receives the photo data. Therefore, if the user is in a hurry and wants to use the nearby photo printing kiosk 400, the O2O unit 390 transmits the photo data and the output setting data to the photo printing kiosk 400 that scans the identification code together, and , when all payments are completed in the user terminal 100 , the cost of using the photo printing kiosk 400 may be later settled with the photo printing kiosk 400 .

In this case, the at least one photo printing kiosk 400 may be a device to output a corrected and edited image through a digital photo printer through an image layout interface according to a printing paper standard, and determine the size of the image to be output. Technique of performing an interpolation process using the ratio of width and height to meet the printing paper specification of the output device, obtaining the coordinates of the printing paper so that it is output at a predetermined location, and scattering the image at that location can be used, but is not limited thereto.

Meanwhile, the above-described configurations may be made through communication between the photo taking service providing server 300 and the user terminal 100 , or may be stored and driven as a native application in the user terminal 100 . Of course, it is not excluded that distortion correction is performed by the photo taking service providing server 300 according to the computing resource or networking resource of the user terminal 100 . First, when the service according to an embodiment of the present invention is run in the user terminal 100, the user terminal 100 turns on the front camera or the rear camera to perform photo taking control so that the subject corresponding to the person is included. can do. And, the user terminal 100 may load the photographed photo data, and reverse the left and right when the photo data is taken from the front camera. In addition, the user terminal 100 may correct the barrel-shaped distortion occurring in the wide-angle lens of the front camera or the rear camera, and may replace the background excluding the subject with a pre-stored background and display it on the screen.

Hereinafter, an operation process according to the configuration of the photo taking service providing server of FIG. 2 will be described in detail with reference to FIGS. 3 and 4 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

Referring to FIGS. 3A to 3H , when the user terminal 100 uses the photo taking service of the present invention, a tutorial or guide screen explaining the process of shooting, correction, and ordering is output. In addition, when the user terminal 100 intends to take a picture, as shown in FIGS. 4A and 4B , by providing a shooting tip, it is possible to prevent as much as possible a case in which correction is impossible or distortion occurs due to light reflection or shadow occurring. When taking a picture using the front camera in the user terminal 100 as shown in FIG. 4c , the line of the tip of the head and the tip of the chin are provided as horizontal axes to the upper and lower parts of the outline so that the tip of the head and the tip of the chin are aligned, and a timer is set. In this case, the timer is set to count down seconds to give the user time to prepare. When shooting is completed as shown in FIG. 4D, a desired photo can be selected as shown in FIG. 4E. And, as shown in Fig. 4f, the value can be adjusted to correct the barrel-shaped distortion, and the photo can be enlarged or reduced to fit the tip of the head and the chin as shown in Fig. 4g. Of course, in the process of FIG. 4G , it is possible to automatically enlarge and reduce the size according to the standard even if the user does not manually select it.

As shown in Fig. 4h, brightness, contrast, temperature, and saturation can be adjusted, preset default settings can be automatically applied, and the purpose of the photo can be set as shown in Fig. 4i, and when the purpose is selected as shown in Fig. 4j , When the user sets the number of cuts, sets, etc. as shown in FIGS. 4K to 4O and uploads them to the server as shown in FIG. 4P, the payment is performed by setting the delivery deadline, etc. as shown in FIGS. 4G to 4T, and all processes are When completed, the delivery status can be shared as shown in FIG. 4u.

As for the method of providing a photo taking service capable of taking a self ID photo based on the barrel distortion correction and background replacement function of FIGS. 2 to 4 as described above, through FIG. 1 above, the barrel distortion correction and background replacement function based self Since the description of the method of providing a photo taking service capable of taking an ID photo is the same as or can be easily inferred from the described content, the following description will be omitted.

5 is an operation flowchart for explaining a method of providing a photo taking service capable of taking a self-identification photo based on a barrel-shaped distortion correction and background replacement function according to an embodiment of the present invention. Referring to FIG. 5 , the photo taking service providing server turns on the front camera or the rear camera of the user terminal to perform photo taking control so that the subject corresponding to the person is included ( S5100 ).

And, the photo taking service providing server receives the photo data taken from the user terminal, reverses the left and right when the photo data is taken from the front camera (S5200), the barrel generated from the wide-angle lens of the front camera or the rear camera of the user terminal Barrel distortion may be corrected (S5300).

Finally, the photo taking service providing server replaces the background excluding the subject with a pre-stored background and transmits it to the user terminal (S5400).

The order between the above-described steps (S5100 to S5400) is only an example and is not limited thereto. That is, the order between the above-described steps S5100 to S5400 may be mutually changed, and some of these steps may be simultaneously executed or deleted.

As described above, the method of providing a photo taking service capable of taking a self-identification photo based on the barrel distortion correction and background replacement function of FIG. 5 is described above with reference to FIGS. 1 to 4 based on the barrel distortion correction and background replacement function. Since the description of the method of providing a photo taking service capable of taking an ID photo is the same as or can be easily inferred from the described content, the following description will be omitted.

The method for providing a photo taking service capable of taking a self-identification photo based on a barrel distortion correction and background replacement function according to an embodiment described through FIG. 5 is a command executable by a computer, such as an application or program module executed by a computer. It may also be implemented in the form of a recording medium comprising a. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The method for providing a photo taking service capable of taking self-identification photos based on the barrel distortion correction and background replacement function according to an embodiment of the present invention described above is an application basically installed in the terminal (which is a platform or operating system basically installed in the terminal, etc.) by an application (that is, a program) installed directly on the master terminal through an application providing server such as an application store server, an application or a web server related to the service by the user. may be executed. In this sense, the method for providing a photo taking service capable of taking a self-identification photo based on the barrel-shaped distortion correction and background replacement function according to the embodiment of the present invention described above is an application (that is, basically installed in the terminal or directly installed by the user) program) and may be recorded in a computer-readable recording medium such as a terminal.

The above description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Claims (10)

In the method of providing a photo taking service executed in a photo taking service providing server,
Turning on the front camera or the rear camera of the user terminal to perform a picture taking control to include a subject corresponding to the person;
receiving the picture data taken from the user terminal, and inverting the picture data left and right when the picture data is taken from the front camera;
compensating for barrel distortion occurring in the wide-angle lens of the front camera or the rear camera of the user terminal;
replacing a background other than the subject with a pre-stored background and transmitting it to the user terminal;
When the O2O (Online to Offline) printing service is selected in the user terminal, information of at least one photo printing kiosk located within a preset radius based on the current or designated location of the user terminal is displayed on the map. transmitting to the terminal; and
when the identification code of the user terminal is scanned or read from the at least one photo printing kiosk, transmitting the photo data and output setting data to the at least one photo printing kiosk to control the printing process;
including,
The output setting data is
It contains information about the size of the photo to be printed and the number of prints,
Before the step of turning on the front camera or the rear camera of the user terminal to perform photo taking control to include a subject corresponding to a person, the step of selecting any one type of at least one ID photo type from the user terminal and extracting pre-mapped and stored photo rule guideline data to the selected type and controlling and setting the photo taking to correspond to the photo rule guideline data,
The step of controlling and setting the photography to correspond to the photo regulation guideline data includes:
When the image confirmed in the shooting screen of the user terminal is in violation of the photo regulation guideline data corresponding to the type of identification photo prescribed by the administration, a guide message is overlaid on the screen so that the user who is the photographer can be corrected,
The step of turning on the front camera or the rear camera of the user terminal to perform photo taking control so that the subject corresponding to the person is included, overlaying the outline where the face part of the subject should be located on the screen of the user terminal ) comprising the step of displaying to be,
The outline is formed with an outer periphery corresponding to the face, and text on the tip of the head and the tip of the chin are respectively overlaid at the position of the upper center and the lower center of the outline, and the outline crosses the inside of the outer periphery vertically includes a centerline,
After turning on the front camera or the rear camera of the user terminal to perform photo taking control so that the subject corresponding to the person is included,
mapping and storing the types of cameras mounted differently according to the types of user terminals and the types of distortions generated in the cameras, and databaseizing a method for correcting distortions to be applied differently in different specifications;
outputting, from the user terminal, a correction interface capable of adjusting brightness, contrast, temperature and saturation; and
When a correction event of the correction interface occurs in the user terminal, correcting the photo data using the databased information to correspond to the correction event. A method of providing a photo taking service that enables feature-based self ID photo taking.
delete delete delete delete delete delete In the method of providing a photo taking service executed in a user terminal,
Turning on the front camera or the rear camera to perform photography control so that the subject corresponding to the person is included;
loading the photographed picture data and inverting the picture data left and right when the picture data is taken from the front camera;
compensating for barrel distortion occurring in the wide-angle lens of the front camera or the rear camera;
replacing a background other than the subject with a pre-stored background and displaying it on a screen;
displaying, on a map, information on at least one photo printing kiosk located within a preset radius based on a current location or a designated location of the user terminal when an O2O (Online to Offline) printing service is selected; and
when the identification code of the user terminal is scanned or read from the at least one photo printing kiosk, transmitting the photo data and output setting data to the at least one photo printing kiosk to control the printing process;
including,
The output setting data is
It contains information about the size of the photo to be printed and the number of prints,
Before the step of turning on the front camera or the rear camera of the user terminal to perform photo taking control to include a subject corresponding to a person, the step of selecting any one type of at least one ID photo type from the user terminal and extracting pre-mapped and stored photo rule guideline data to the selected type and controlling and setting the photo taking to correspond to the photo rule guideline data,
The step of controlling and setting the photography to correspond to the photo regulation guideline data includes:
When the image confirmed in the shooting screen of the user terminal is in violation of the photo regulation guideline data corresponding to the type of identification photo prescribed by the administration, a guide message is overlaid on the screen so that the user who is the photographer can be corrected,
The step of turning on the front camera or the rear camera of the user terminal to perform photo taking control so that the subject corresponding to the person is included, overlaying the outline where the face part of the subject should be located on the screen of the user terminal ) comprising the step of displaying to be,
The outline is formed with an outer periphery corresponding to the face, and text on the tip of the head and the tip of the chin are respectively overlaid at the position of the upper center and the lower center of the outline, and the outline crosses the inside of the outer periphery vertically includes a centerline,
After turning on the front camera or the rear camera of the user terminal to perform photo taking control so that the subject corresponding to the person is included,
mapping and storing the types of cameras mounted differently according to the types of user terminals and the types of distortions generated in the cameras, and databaseizing a method for correcting distortions to be applied differently in different specifications;
outputting a calibration interface capable of adjusting brightness, contrast, temperature and saturation; and
When a correction event of the correction interface occurs, correcting the photo data using the databased information to correspond to the correction event How to provide a photo shoot service where you can take photos. delete delete

Images